Jul 03 15:13:01.278651 ip-10-0-142-176 systemd[1]: Starting Kubernetes Kubelet... Jul 03 15:13:01.763389 ip-10-0-142-176 kubenswrapper[2532]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 15:13:01.763389 ip-10-0-142-176 kubenswrapper[2532]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 03 15:13:01.764002 ip-10-0-142-176 kubenswrapper[2532]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 15:13:01.764002 ip-10-0-142-176 kubenswrapper[2532]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 03 15:13:01.764002 ip-10-0-142-176 kubenswrapper[2532]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 15:13:01.765342 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.765253 2532 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 03 15:13:01.773049 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773016 2532 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 15:13:01.773049 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773038 2532 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 15:13:01.773049 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773042 2532 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 15:13:01.773049 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773045 2532 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 15:13:01.773049 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773049 2532 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 15:13:01.773049 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773052 2532 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 15:13:01.773049 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773056 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 15:13:01.773049 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773059 2532 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 15:13:01.773331 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773063 2532 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 15:13:01.773331 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773069 2532 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 15:13:01.773331 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773072 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 15:13:01.773331 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773075 2532 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 15:13:01.773331 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773078 2532 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 15:13:01.773331 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773080 2532 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 15:13:01.773331 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773083 2532 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 15:13:01.773331 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773086 2532 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 15:13:01.773331 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773088 2532 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 15:13:01.773331 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773108 2532 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 15:13:01.773331 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773212 2532 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 15:13:01.773331 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773216 2532 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 15:13:01.773331 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773219 2532 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 15:13:01.773331 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773222 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 15:13:01.773331 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773225 2532 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 15:13:01.773331 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773227 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 15:13:01.773331 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773230 2532 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 15:13:01.773331 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773233 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 15:13:01.773331 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773235 2532 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 15:13:01.773804 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773240 2532 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 15:13:01.773804 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773244 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 15:13:01.773804 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773246 2532 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 15:13:01.773804 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773249 2532 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 15:13:01.773804 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773251 2532 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 15:13:01.773804 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773254 2532 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 15:13:01.773804 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773256 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 15:13:01.773804 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773259 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 15:13:01.773804 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773261 2532 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 15:13:01.773804 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773264 2532 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 15:13:01.773804 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773267 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 15:13:01.773804 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773270 2532 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 15:13:01.773804 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773273 2532 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 15:13:01.773804 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773276 2532 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 15:13:01.773804 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773281 2532 feature_gate.go:328] unrecognized feature gate: Example Jul 03 15:13:01.773804 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773284 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 15:13:01.773804 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773286 2532 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 15:13:01.773804 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773289 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 15:13:01.773804 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773292 2532 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 15:13:01.773804 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773294 2532 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 15:13:01.774286 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773297 2532 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 15:13:01.774286 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773299 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 15:13:01.774286 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773302 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 15:13:01.774286 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773306 2532 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 15:13:01.774286 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773308 2532 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 15:13:01.774286 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773311 2532 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 15:13:01.774286 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773313 2532 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 15:13:01.774286 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773315 2532 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 15:13:01.774286 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773318 2532 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 15:13:01.774286 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773321 2532 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 15:13:01.774286 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773323 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 15:13:01.774286 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773326 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 15:13:01.774286 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773328 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 15:13:01.774286 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773331 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 15:13:01.774286 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773335 2532 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 15:13:01.774286 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773340 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 15:13:01.774286 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773343 2532 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 15:13:01.774286 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773346 2532 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 15:13:01.774286 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773349 2532 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 15:13:01.774749 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773352 2532 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 15:13:01.774749 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773355 2532 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 15:13:01.774749 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773357 2532 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 15:13:01.774749 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773360 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 15:13:01.774749 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773362 2532 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 15:13:01.774749 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773382 2532 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 15:13:01.774749 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773386 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 15:13:01.774749 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773393 2532 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 15:13:01.774749 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773396 2532 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 15:13:01.774749 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773399 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 15:13:01.774749 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773402 2532 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 15:13:01.774749 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773404 2532 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 15:13:01.774749 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773407 2532 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 15:13:01.774749 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773409 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 15:13:01.774749 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773412 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 15:13:01.774749 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773414 2532 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 15:13:01.774749 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773417 2532 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 15:13:01.774749 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773421 2532 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 15:13:01.774749 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773424 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 15:13:01.774749 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773426 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 15:13:01.775230 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773429 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 15:13:01.775230 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773431 2532 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 15:13:01.775230 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773434 2532 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 15:13:01.775230 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773436 2532 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 15:13:01.775230 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773439 2532 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 15:13:01.775230 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773443 2532 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 15:13:01.775230 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773446 2532 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 15:13:01.775230 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773449 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 15:13:01.775230 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773452 2532 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 15:13:01.775230 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773455 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 15:13:01.775230 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773457 2532 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 15:13:01.775230 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773461 2532 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 15:13:01.775230 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.773464 2532 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 15:13:01.775230 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774230 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 15:13:01.775230 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774237 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 15:13:01.775230 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774241 2532 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 15:13:01.775230 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774245 2532 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 15:13:01.775230 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774248 2532 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 15:13:01.775230 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774251 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 15:13:01.775806 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774254 2532 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 15:13:01.775806 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774257 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 15:13:01.775806 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774259 2532 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 15:13:01.775806 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774262 2532 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 15:13:01.775806 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774264 2532 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 15:13:01.775806 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774267 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 15:13:01.775806 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774270 2532 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 15:13:01.775806 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774272 2532 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 15:13:01.775806 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774275 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 15:13:01.775806 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774277 2532 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 15:13:01.775806 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774280 2532 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 15:13:01.775806 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774284 2532 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 15:13:01.775806 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774286 2532 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 15:13:01.775806 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774289 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 15:13:01.775806 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774291 2532 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 15:13:01.775806 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774294 2532 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 15:13:01.775806 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774297 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 15:13:01.775806 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774299 2532 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 15:13:01.775806 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774302 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 15:13:01.776276 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774305 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 15:13:01.776276 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774308 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 15:13:01.776276 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774311 2532 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 15:13:01.776276 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774314 2532 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 15:13:01.776276 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774316 2532 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 15:13:01.776276 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774319 2532 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 15:13:01.776276 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774322 2532 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 15:13:01.776276 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774324 2532 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 15:13:01.776276 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774327 2532 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 15:13:01.776276 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774329 2532 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 15:13:01.776276 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774331 2532 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 15:13:01.776276 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774334 2532 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 15:13:01.776276 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774336 2532 feature_gate.go:328] unrecognized feature gate: Example Jul 03 15:13:01.776276 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774340 2532 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 15:13:01.776276 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774342 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 15:13:01.776276 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774345 2532 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 15:13:01.776276 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774347 2532 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 15:13:01.776276 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774350 2532 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 15:13:01.776276 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774352 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 15:13:01.776276 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774355 2532 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 15:13:01.776795 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774357 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 15:13:01.776795 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774360 2532 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 15:13:01.776795 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774362 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 15:13:01.776795 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774382 2532 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 15:13:01.776795 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774384 2532 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 15:13:01.776795 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774388 2532 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 15:13:01.776795 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774390 2532 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 15:13:01.776795 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774393 2532 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 15:13:01.776795 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774396 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 15:13:01.776795 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774398 2532 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 15:13:01.776795 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774401 2532 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 15:13:01.776795 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774404 2532 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 15:13:01.776795 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774409 2532 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 15:13:01.776795 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774412 2532 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 15:13:01.776795 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774415 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 15:13:01.776795 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774417 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 15:13:01.776795 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774420 2532 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 15:13:01.776795 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774423 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 15:13:01.776795 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774425 2532 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 15:13:01.777263 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774428 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 15:13:01.777263 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774430 2532 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 15:13:01.777263 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774433 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 15:13:01.777263 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774435 2532 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 15:13:01.777263 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774438 2532 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 15:13:01.777263 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774441 2532 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 15:13:01.777263 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774443 2532 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 15:13:01.777263 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774446 2532 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 15:13:01.777263 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774448 2532 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 15:13:01.777263 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774450 2532 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 15:13:01.777263 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774453 2532 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 15:13:01.777263 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774456 2532 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 15:13:01.777263 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774458 2532 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 15:13:01.777263 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774461 2532 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 15:13:01.777263 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774463 2532 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 15:13:01.777263 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774467 2532 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 15:13:01.777263 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774471 2532 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 15:13:01.777263 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774474 2532 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 15:13:01.777263 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774478 2532 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 15:13:01.777748 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774481 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 15:13:01.777748 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774484 2532 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 15:13:01.777748 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774487 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 15:13:01.777748 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774489 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 15:13:01.777748 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774492 2532 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 15:13:01.777748 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774494 2532 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 15:13:01.777748 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774497 2532 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 15:13:01.777748 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774499 2532 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 15:13:01.777748 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774502 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 15:13:01.777748 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774504 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 15:13:01.777748 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774507 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 15:13:01.777748 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774510 2532 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 15:13:01.777748 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774512 2532 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 15:13:01.777748 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774515 2532 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 15:13:01.777748 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774517 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 15:13:01.777748 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774519 2532 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 15:13:01.777748 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774905 2532 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 15:13:01.777748 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774909 2532 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 15:13:01.777748 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774912 2532 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 15:13:01.777748 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774915 2532 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 15:13:01.778231 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774917 2532 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 15:13:01.778231 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774920 2532 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 15:13:01.778231 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774922 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 15:13:01.778231 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774925 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 15:13:01.778231 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774928 2532 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 15:13:01.778231 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774930 2532 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 15:13:01.778231 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774933 2532 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 15:13:01.778231 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774935 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 15:13:01.778231 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774938 2532 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 15:13:01.778231 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774940 2532 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 15:13:01.778231 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774942 2532 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 15:13:01.778231 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774945 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 15:13:01.778231 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774953 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 15:13:01.778231 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774955 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 15:13:01.778231 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774958 2532 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 15:13:01.778231 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774960 2532 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 15:13:01.778231 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774963 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 15:13:01.778231 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774965 2532 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 15:13:01.778231 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774967 2532 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 15:13:01.778231 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774970 2532 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 15:13:01.778741 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774973 2532 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 15:13:01.778741 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774977 2532 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 15:13:01.778741 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774980 2532 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 15:13:01.778741 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774984 2532 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 15:13:01.778741 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774988 2532 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 15:13:01.778741 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774991 2532 feature_gate.go:328] unrecognized feature gate: Example Jul 03 15:13:01.778741 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774994 2532 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 15:13:01.778741 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774997 2532 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 15:13:01.778741 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.774999 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 15:13:01.778741 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775001 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 15:13:01.778741 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775004 2532 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 15:13:01.778741 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775006 2532 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 15:13:01.778741 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775008 2532 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 15:13:01.778741 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775011 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 15:13:01.778741 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775013 2532 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 15:13:01.778741 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775016 2532 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 15:13:01.778741 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775018 2532 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 15:13:01.778741 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775020 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 15:13:01.778741 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775023 2532 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 15:13:01.779203 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775025 2532 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 15:13:01.779203 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775028 2532 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 15:13:01.779203 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775030 2532 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 15:13:01.779203 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775033 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 15:13:01.779203 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775035 2532 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 15:13:01.779203 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775037 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 15:13:01.779203 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775044 2532 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 15:13:01.779203 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775047 2532 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 15:13:01.779203 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775049 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 15:13:01.779203 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775052 2532 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 15:13:01.779203 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775054 2532 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 15:13:01.779203 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775056 2532 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 15:13:01.779203 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775059 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 15:13:01.779203 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775061 2532 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 15:13:01.779203 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775064 2532 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 15:13:01.779203 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775067 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 15:13:01.779203 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775069 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 15:13:01.779203 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775072 2532 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 15:13:01.779203 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775074 2532 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 15:13:01.779722 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775076 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 15:13:01.779722 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775079 2532 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 15:13:01.779722 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775082 2532 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 15:13:01.779722 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775084 2532 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 15:13:01.779722 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775086 2532 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 15:13:01.779722 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775089 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 15:13:01.779722 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775091 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 15:13:01.779722 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775093 2532 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 15:13:01.779722 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775096 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 15:13:01.779722 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775098 2532 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 15:13:01.779722 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775101 2532 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 15:13:01.779722 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775103 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 15:13:01.779722 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775105 2532 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 15:13:01.779722 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775108 2532 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 15:13:01.779722 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775110 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 15:13:01.779722 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775113 2532 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 15:13:01.779722 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775115 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 15:13:01.779722 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775118 2532 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 15:13:01.779722 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775121 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 15:13:01.779722 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775126 2532 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 15:13:01.780221 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775133 2532 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 15:13:01.780221 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775137 2532 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 15:13:01.780221 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775140 2532 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 15:13:01.780221 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775143 2532 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 15:13:01.780221 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775145 2532 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 15:13:01.780221 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775148 2532 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 15:13:01.780221 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775151 2532 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 15:13:01.780221 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775153 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 15:13:01.780221 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775156 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 15:13:01.780221 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775158 2532 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 15:13:01.780221 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775161 2532 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 15:13:01.780221 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775163 2532 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 15:13:01.780221 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775166 2532 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 15:13:01.780221 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775168 2532 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 15:13:01.780221 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775170 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 15:13:01.780221 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775173 2532 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 15:13:01.780221 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775175 2532 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 15:13:01.780221 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775247 2532 flags.go:64] FLAG: --address="0.0.0.0" Jul 03 15:13:01.780221 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775255 2532 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 03 15:13:01.780221 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775265 2532 flags.go:64] FLAG: --anonymous-auth="true" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775269 2532 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775273 2532 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775276 2532 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775281 2532 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775289 2532 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775302 2532 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775305 2532 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775309 2532 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775312 2532 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775315 2532 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775318 2532 flags.go:64] FLAG: --cgroup-root="" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775322 2532 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775325 2532 flags.go:64] FLAG: --client-ca-file="" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775338 2532 flags.go:64] FLAG: --cloud-provider="external" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775341 2532 flags.go:64] FLAG: --cluster-dns="[]" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775348 2532 flags.go:64] FLAG: --cluster-domain="" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775350 2532 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775353 2532 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775356 2532 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775360 2532 flags.go:64] FLAG: --container-log-max-files="5" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775378 2532 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775381 2532 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 03 15:13:01.780757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775384 2532 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775387 2532 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775390 2532 flags.go:64] FLAG: --contention-profiling="false" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775392 2532 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775395 2532 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775398 2532 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775401 2532 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775405 2532 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775407 2532 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775410 2532 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775413 2532 flags.go:64] FLAG: --enable-load-reader="false" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775416 2532 flags.go:64] FLAG: --enable-server="true" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775419 2532 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775425 2532 flags.go:64] FLAG: --event-burst="100" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775428 2532 flags.go:64] FLAG: --event-qps="50" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775431 2532 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775434 2532 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775437 2532 flags.go:64] FLAG: --eviction-hard="" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775440 2532 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775443 2532 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775445 2532 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775448 2532 flags.go:64] FLAG: --eviction-soft="" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775451 2532 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775454 2532 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775457 2532 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 03 15:13:01.781304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775460 2532 flags.go:64] FLAG: --experimental-mounter-path="" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775463 2532 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775466 2532 flags.go:64] FLAG: --fail-swap-on="true" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775469 2532 flags.go:64] FLAG: --feature-gates="" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775474 2532 flags.go:64] FLAG: --file-check-frequency="20s" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775476 2532 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775479 2532 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775482 2532 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775485 2532 flags.go:64] FLAG: --healthz-port="10248" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775488 2532 flags.go:64] FLAG: --help="false" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775490 2532 flags.go:64] FLAG: --hostname-override="ip-10-0-142-176.ec2.internal" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775494 2532 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775496 2532 flags.go:64] FLAG: --http-check-frequency="20s" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775499 2532 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775502 2532 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775505 2532 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775508 2532 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775511 2532 flags.go:64] FLAG: --image-service-endpoint="" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775513 2532 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775516 2532 flags.go:64] FLAG: --kube-api-burst="100" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775519 2532 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775522 2532 flags.go:64] FLAG: --kube-api-qps="50" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775524 2532 flags.go:64] FLAG: --kube-reserved="" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775527 2532 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 03 15:13:01.781962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775529 2532 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775532 2532 flags.go:64] FLAG: --kubelet-cgroups="" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775535 2532 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775538 2532 flags.go:64] FLAG: --lock-file="" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775540 2532 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775543 2532 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775546 2532 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775560 2532 flags.go:64] FLAG: --log-json-split-stream="false" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775564 2532 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775567 2532 flags.go:64] FLAG: --log-text-split-stream="false" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775570 2532 flags.go:64] FLAG: --logging-format="text" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775572 2532 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775577 2532 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775580 2532 flags.go:64] FLAG: --manifest-url="" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775582 2532 flags.go:64] FLAG: --manifest-url-header="" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775587 2532 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775590 2532 flags.go:64] FLAG: --max-open-files="1000000" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775594 2532 flags.go:64] FLAG: --max-pods="110" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775597 2532 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775600 2532 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775603 2532 flags.go:64] FLAG: --memory-manager-policy="None" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775605 2532 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775608 2532 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775611 2532 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775614 2532 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 03 15:13:01.782685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775621 2532 flags.go:64] FLAG: --node-status-max-images="50" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775624 2532 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775627 2532 flags.go:64] FLAG: --oom-score-adj="-999" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775630 2532 flags.go:64] FLAG: --pod-cidr="" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775633 2532 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775638 2532 flags.go:64] FLAG: --pod-manifest-path="" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775640 2532 flags.go:64] FLAG: --pod-max-pids="-1" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775643 2532 flags.go:64] FLAG: --pods-per-core="0" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775646 2532 flags.go:64] FLAG: --port="10250" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775649 2532 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775652 2532 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-042fd23544253fc86" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775655 2532 flags.go:64] FLAG: --qos-reserved="" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775658 2532 flags.go:64] FLAG: --read-only-port="10255" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775661 2532 flags.go:64] FLAG: --register-node="true" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775664 2532 flags.go:64] FLAG: --register-with-taints="" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775667 2532 flags.go:64] FLAG: --registry-burst="10" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775671 2532 flags.go:64] FLAG: --registry-qps="5" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775674 2532 flags.go:64] FLAG: --reserved-cpus="" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775677 2532 flags.go:64] FLAG: --reserved-memory="" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775680 2532 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775685 2532 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775688 2532 flags.go:64] FLAG: --rotate-certificates="false" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775690 2532 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775693 2532 flags.go:64] FLAG: --runonce="false" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775696 2532 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 03 15:13:01.783331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775699 2532 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775701 2532 flags.go:64] FLAG: --seccomp-default="false" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775704 2532 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775707 2532 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775710 2532 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775713 2532 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775716 2532 flags.go:64] FLAG: --storage-driver-password="root" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775718 2532 flags.go:64] FLAG: --storage-driver-secure="false" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775721 2532 flags.go:64] FLAG: --storage-driver-table="stats" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775724 2532 flags.go:64] FLAG: --storage-driver-user="root" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775727 2532 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775730 2532 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775732 2532 flags.go:64] FLAG: --system-cgroups="" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775735 2532 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775740 2532 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775743 2532 flags.go:64] FLAG: --tls-cert-file="" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775745 2532 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775752 2532 flags.go:64] FLAG: --tls-min-version="" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775756 2532 flags.go:64] FLAG: --tls-private-key-file="" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775758 2532 flags.go:64] FLAG: --topology-manager-policy="none" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775761 2532 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775764 2532 flags.go:64] FLAG: --topology-manager-scope="container" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775767 2532 flags.go:64] FLAG: --v="2" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775771 2532 flags.go:64] FLAG: --version="false" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775775 2532 flags.go:64] FLAG: --vmodule="" Jul 03 15:13:01.783971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775779 2532 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 03 15:13:01.784575 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.775782 2532 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 03 15:13:01.784575 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775903 2532 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 15:13:01.784575 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775908 2532 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 15:13:01.784575 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775911 2532 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 15:13:01.784575 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775914 2532 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 15:13:01.784575 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775917 2532 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 15:13:01.784575 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775919 2532 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 15:13:01.784575 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775922 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 15:13:01.784575 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775924 2532 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 15:13:01.784575 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775926 2532 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 15:13:01.784575 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775929 2532 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 15:13:01.784575 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775932 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 15:13:01.784575 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775934 2532 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 15:13:01.784575 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775936 2532 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 15:13:01.784575 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775939 2532 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 15:13:01.784575 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775943 2532 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 15:13:01.784575 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775946 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 15:13:01.784575 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775949 2532 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 15:13:01.784575 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775951 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 15:13:01.784575 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775954 2532 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 15:13:01.785055 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775956 2532 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 15:13:01.785055 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775959 2532 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 15:13:01.785055 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775961 2532 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 15:13:01.785055 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775963 2532 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 15:13:01.785055 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775968 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 15:13:01.785055 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775970 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 15:13:01.785055 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775972 2532 feature_gate.go:328] unrecognized feature gate: Example Jul 03 15:13:01.785055 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775975 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 15:13:01.785055 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775977 2532 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 15:13:01.785055 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775980 2532 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 15:13:01.785055 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775982 2532 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 15:13:01.785055 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775985 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 15:13:01.785055 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775988 2532 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 15:13:01.785055 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775992 2532 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 15:13:01.785055 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775994 2532 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 15:13:01.785055 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775997 2532 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 15:13:01.785055 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.775999 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 15:13:01.785055 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776002 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 15:13:01.785055 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776004 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 15:13:01.785055 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776007 2532 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 15:13:01.785568 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776009 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 15:13:01.785568 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776012 2532 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 15:13:01.785568 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776014 2532 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 15:13:01.785568 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776016 2532 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 15:13:01.785568 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776019 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 15:13:01.785568 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776021 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 15:13:01.785568 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776024 2532 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 15:13:01.785568 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776026 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 15:13:01.785568 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776029 2532 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 15:13:01.785568 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776031 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 15:13:01.785568 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776033 2532 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 15:13:01.785568 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776035 2532 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 15:13:01.785568 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776038 2532 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 15:13:01.785568 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776041 2532 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 15:13:01.785568 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776043 2532 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 15:13:01.785568 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776045 2532 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 15:13:01.785568 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776049 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 15:13:01.785568 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776051 2532 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 15:13:01.785568 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776054 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 15:13:01.786056 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776056 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 15:13:01.786056 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776059 2532 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 15:13:01.786056 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776061 2532 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 15:13:01.786056 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776063 2532 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 15:13:01.786056 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776066 2532 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 15:13:01.786056 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776069 2532 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 15:13:01.786056 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776072 2532 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 15:13:01.786056 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776075 2532 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 15:13:01.786056 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776077 2532 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 15:13:01.786056 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776080 2532 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 15:13:01.786056 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776082 2532 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 15:13:01.786056 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776085 2532 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 15:13:01.786056 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776087 2532 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 15:13:01.786056 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776089 2532 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 15:13:01.786056 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776092 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 15:13:01.786056 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776094 2532 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 15:13:01.786056 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776096 2532 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 15:13:01.786056 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776099 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 15:13:01.786056 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776101 2532 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 15:13:01.786056 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776104 2532 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 15:13:01.786558 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776106 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 15:13:01.786558 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776108 2532 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 15:13:01.786558 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776111 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 15:13:01.786558 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776114 2532 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 15:13:01.786558 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776116 2532 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 15:13:01.786558 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776119 2532 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 15:13:01.786558 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776121 2532 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 15:13:01.786558 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776125 2532 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 15:13:01.786558 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776128 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 15:13:01.786558 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776133 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 15:13:01.786558 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776135 2532 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 15:13:01.786558 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776138 2532 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 15:13:01.786558 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776141 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 15:13:01.786558 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776143 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 15:13:01.786558 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776146 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 15:13:01.786558 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776149 2532 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 15:13:01.786558 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776151 2532 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 15:13:01.786558 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776154 2532 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 15:13:01.786558 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776161 2532 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 15:13:01.787023 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776164 2532 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 15:13:01.787023 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.776167 2532 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 15:13:01.787023 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.776878 2532 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 15:13:01.787023 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.783730 2532 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 03 15:13:01.787023 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.783746 2532 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 03 15:13:01.787023 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.783766 2532 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 03 15:13:01.787023 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.783771 2532 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 03 15:13:01.787023 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783832 2532 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 15:13:01.787023 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783838 2532 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 15:13:01.787023 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783841 2532 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 15:13:01.787023 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783844 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 15:13:01.787023 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783846 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 15:13:01.787023 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783849 2532 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 15:13:01.787023 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783852 2532 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 15:13:01.787023 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783854 2532 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 15:13:01.787487 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783857 2532 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 15:13:01.787487 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783859 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 15:13:01.787487 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783862 2532 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 15:13:01.787487 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783865 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 15:13:01.787487 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783867 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 15:13:01.787487 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783869 2532 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 15:13:01.787487 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783872 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 15:13:01.787487 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783874 2532 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 15:13:01.787487 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783877 2532 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 15:13:01.787487 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783879 2532 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 15:13:01.787487 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783881 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 15:13:01.787487 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783884 2532 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 15:13:01.787487 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783887 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 15:13:01.787487 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783890 2532 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 15:13:01.787487 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783892 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 15:13:01.787487 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783895 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 15:13:01.787487 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783898 2532 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 15:13:01.787487 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783901 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 15:13:01.787487 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783903 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 15:13:01.787487 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783906 2532 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 15:13:01.787972 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783908 2532 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 15:13:01.787972 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783911 2532 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 15:13:01.787972 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783914 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 15:13:01.787972 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783917 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 15:13:01.787972 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783919 2532 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 15:13:01.787972 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783922 2532 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 15:13:01.787972 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783924 2532 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 15:13:01.787972 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783927 2532 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 15:13:01.787972 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783929 2532 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 15:13:01.787972 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783932 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 15:13:01.787972 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783935 2532 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 15:13:01.787972 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783937 2532 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 15:13:01.787972 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783941 2532 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 15:13:01.787972 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783945 2532 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 15:13:01.787972 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783947 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 15:13:01.787972 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783950 2532 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 15:13:01.787972 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783953 2532 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 15:13:01.787972 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783955 2532 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 15:13:01.787972 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783957 2532 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 15:13:01.787972 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783960 2532 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 15:13:01.788471 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783962 2532 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 15:13:01.788471 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783965 2532 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 15:13:01.788471 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783967 2532 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 15:13:01.788471 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783969 2532 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 15:13:01.788471 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783972 2532 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 15:13:01.788471 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783975 2532 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 15:13:01.788471 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783977 2532 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 15:13:01.788471 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783980 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 15:13:01.788471 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783982 2532 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 15:13:01.788471 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783986 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 15:13:01.788471 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783989 2532 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 15:13:01.788471 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783991 2532 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 15:13:01.788471 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783994 2532 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 15:13:01.788471 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.783997 2532 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 15:13:01.788471 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784001 2532 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 15:13:01.788471 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784004 2532 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 15:13:01.788471 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784006 2532 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 15:13:01.788471 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784008 2532 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 15:13:01.788471 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784011 2532 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 15:13:01.788471 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784013 2532 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 15:13:01.788948 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784016 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 15:13:01.788948 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784018 2532 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 15:13:01.788948 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784021 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 15:13:01.788948 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784023 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 15:13:01.788948 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784025 2532 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 15:13:01.788948 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784028 2532 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 15:13:01.788948 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784030 2532 feature_gate.go:328] unrecognized feature gate: Example Jul 03 15:13:01.788948 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784032 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 15:13:01.788948 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784035 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 15:13:01.788948 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784037 2532 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 15:13:01.788948 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784040 2532 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 15:13:01.788948 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784042 2532 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 15:13:01.788948 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784044 2532 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 15:13:01.788948 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784047 2532 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 15:13:01.788948 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784051 2532 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 15:13:01.788948 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784054 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 15:13:01.788948 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784058 2532 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 15:13:01.788948 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784061 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 15:13:01.789392 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784064 2532 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 15:13:01.789392 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784067 2532 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 15:13:01.789392 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784069 2532 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 15:13:01.789392 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784072 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 15:13:01.789392 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784075 2532 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 15:13:01.789392 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784078 2532 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 15:13:01.789392 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784080 2532 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 15:13:01.789392 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784083 2532 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 15:13:01.789392 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784086 2532 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 15:13:01.789392 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784089 2532 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 15:13:01.789392 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784091 2532 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 15:13:01.789392 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784094 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 15:13:01.789392 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784096 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 15:13:01.789392 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.784101 2532 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 15:13:01.789392 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784218 2532 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 15:13:01.789774 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784222 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 15:13:01.789774 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784225 2532 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 15:13:01.789774 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784228 2532 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 15:13:01.789774 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784230 2532 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 15:13:01.789774 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784233 2532 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 15:13:01.789774 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784236 2532 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 15:13:01.789774 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784238 2532 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 15:13:01.789774 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784241 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 15:13:01.789774 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784243 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 15:13:01.789774 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784246 2532 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 15:13:01.789774 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784248 2532 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 15:13:01.789774 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784251 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 15:13:01.789774 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784253 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 15:13:01.789774 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784256 2532 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 15:13:01.789774 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784258 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 15:13:01.789774 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784260 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 15:13:01.789774 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784263 2532 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 15:13:01.789774 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784265 2532 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 15:13:01.789774 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784268 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 15:13:01.789774 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784270 2532 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 15:13:01.790252 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784273 2532 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 15:13:01.790252 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784275 2532 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 15:13:01.790252 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784278 2532 feature_gate.go:328] unrecognized feature gate: Example Jul 03 15:13:01.790252 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784280 2532 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 15:13:01.790252 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784283 2532 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 15:13:01.790252 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784286 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 15:13:01.790252 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784288 2532 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 15:13:01.790252 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784291 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 15:13:01.790252 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784293 2532 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 15:13:01.790252 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784295 2532 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 15:13:01.790252 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784298 2532 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 15:13:01.790252 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784300 2532 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 15:13:01.790252 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784302 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 15:13:01.790252 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784305 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 15:13:01.790252 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784307 2532 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 15:13:01.790252 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784310 2532 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 15:13:01.790252 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784312 2532 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 15:13:01.790252 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784314 2532 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 15:13:01.790252 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784317 2532 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 15:13:01.790252 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784319 2532 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 15:13:01.790745 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784322 2532 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 15:13:01.790745 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784324 2532 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 15:13:01.790745 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784326 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 15:13:01.790745 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784329 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 15:13:01.790745 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784331 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 15:13:01.790745 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784333 2532 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 15:13:01.790745 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784336 2532 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 15:13:01.790745 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784338 2532 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 15:13:01.790745 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784340 2532 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 15:13:01.790745 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784343 2532 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 15:13:01.790745 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784345 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 15:13:01.790745 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784347 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 15:13:01.790745 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784350 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 15:13:01.790745 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784352 2532 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 15:13:01.790745 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784354 2532 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 15:13:01.790745 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784358 2532 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 15:13:01.790745 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784360 2532 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 15:13:01.790745 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784362 2532 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 15:13:01.790745 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784385 2532 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 15:13:01.791218 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784388 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 15:13:01.791218 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784391 2532 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 15:13:01.791218 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784395 2532 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 15:13:01.791218 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784397 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 15:13:01.791218 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784400 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 15:13:01.791218 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784402 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 15:13:01.791218 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784405 2532 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 15:13:01.791218 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784407 2532 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 15:13:01.791218 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784410 2532 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 15:13:01.791218 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784412 2532 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 15:13:01.791218 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784414 2532 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 15:13:01.791218 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784417 2532 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 15:13:01.791218 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784419 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 15:13:01.791218 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784422 2532 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 15:13:01.791218 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784424 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 15:13:01.791218 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784427 2532 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 15:13:01.791218 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784429 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 15:13:01.791218 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784432 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 15:13:01.791218 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784434 2532 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 15:13:01.791713 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784438 2532 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 15:13:01.791713 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784441 2532 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 15:13:01.791713 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784443 2532 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 15:13:01.791713 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784447 2532 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 15:13:01.791713 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784451 2532 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 15:13:01.791713 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784453 2532 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 15:13:01.791713 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784456 2532 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 15:13:01.791713 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784459 2532 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 15:13:01.791713 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784462 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 15:13:01.791713 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784464 2532 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 15:13:01.791713 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784468 2532 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 15:13:01.791713 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784470 2532 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 15:13:01.791713 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784472 2532 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 15:13:01.791713 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784475 2532 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 15:13:01.791713 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784477 2532 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 15:13:01.791713 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784480 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 15:13:01.791713 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784482 2532 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 15:13:01.791713 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784485 2532 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 15:13:01.791713 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784487 2532 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 15:13:01.792167 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:01.784489 2532 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 15:13:01.792167 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.784494 2532 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 15:13:01.792167 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.784589 2532 server.go:962] "Client rotation is on, will bootstrap in background" Jul 03 15:13:01.792167 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.786714 2532 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 03 15:13:01.792167 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.788159 2532 server.go:1019] "Starting client certificate rotation" Jul 03 15:13:01.792167 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.788256 2532 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 03 15:13:01.792167 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.789121 2532 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 03 15:13:01.792167 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.790861 2532 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 03 15:13:01.794012 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.793995 2532 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 03 15:13:01.803912 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.803891 2532 log.go:25] "Validated CRI v1 runtime API" Jul 03 15:13:01.806279 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.806261 2532 log.go:25] "Validated CRI v1 image API" Jul 03 15:13:01.808241 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.808225 2532 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 03 15:13:01.810747 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.810729 2532 fs.go:135] Filesystem UUIDs: map[1e3b26cb-6a12-4e29-a56e-31f1e5f5574f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d073179a-3acd-40a8-8491-5c066b657a79:/dev/nvme0n1p3] Jul 03 15:13:01.810811 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.810746 2532 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 03 15:13:01.816597 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.816579 2532 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 03 15:13:01.817322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.817211 2532 manager.go:216] Machine: {Timestamp:2026-07-03 15:13:01.814627132 +0000 UTC m=+0.397650952 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101799 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2785064f6043f20dfa6103c80c8d04 SystemUUID:ec278506-4f60-43f2-0dfa-6103c80c8d04 BootID:7b0c3bd4-ccbc-451d-936a-1145799b22b7 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d3:90:70:7e:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d3:90:70:7e:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:00:08:9d:26:3e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 03 15:13:01.817322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.817322 2532 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 03 15:13:01.817433 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.817426 2532 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 03 15:13:01.821429 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.821399 2532 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 03 15:13:01.821565 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.821431 2532 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-176.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 03 15:13:01.822882 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.822872 2532 topology_manager.go:138] "Creating topology manager with none policy" Jul 03 15:13:01.822915 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.822884 2532 container_manager_linux.go:309] "Creating device plugin manager" Jul 03 15:13:01.822915 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.822892 2532 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 03 15:13:01.823760 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.823749 2532 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 03 15:13:01.825314 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.825304 2532 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 03 15:13:01.828236 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.828224 2532 state_mem.go:36] "Initialized new in-memory state store" Jul 03 15:13:01.828392 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.828363 2532 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 03 15:13:01.828425 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.828410 2532 kubelet.go:486] "Attempting to sync node with API server" Jul 03 15:13:01.828425 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.828420 2532 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 03 15:13:01.828480 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.828431 2532 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 03 15:13:01.828480 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.828443 2532 kubelet.go:398] "Adding apiserver pod source" Jul 03 15:13:01.828480 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.828451 2532 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 03 15:13:01.828853 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.828841 2532 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 03 15:13:01.828915 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.828858 2532 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 03 15:13:01.830972 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.830946 2532 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 03 15:13:01.833272 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.833259 2532 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 03 15:13:01.833322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.833289 2532 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 03 15:13:01.834392 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.834377 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 03 15:13:01.834462 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.834397 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 03 15:13:01.834462 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.834406 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 03 15:13:01.834462 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.834411 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 03 15:13:01.834462 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.834420 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 03 15:13:01.834462 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.834425 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 03 15:13:01.834462 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.834433 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 03 15:13:01.834462 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.834438 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 03 15:13:01.834462 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.834445 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 03 15:13:01.834462 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.834450 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 03 15:13:01.834462 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.834463 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 03 15:13:01.834717 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.834469 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 03 15:13:01.836007 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.835995 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 03 15:13:01.836049 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.836008 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 03 15:13:01.839617 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.839574 2532 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-176.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 03 15:13:01.839617 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:01.839610 2532 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-176.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 03 15:13:01.839750 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.839654 2532 server.go:1268] "Started kubelet" Jul 03 15:13:01.839750 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:01.839661 2532 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 03 15:13:01.839835 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.839739 2532 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 03 15:13:01.839835 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.839811 2532 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 03 15:13:01.839923 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.839853 2532 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 03 15:13:01.840627 ip-10-0-142-176 systemd[1]: Started Kubernetes Kubelet. Jul 03 15:13:01.841529 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.841411 2532 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 03 15:13:01.846795 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.846777 2532 server.go:310] "Adding debug handlers to kubelet server" Jul 03 15:13:01.847516 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:01.847158 2532 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 03 15:13:01.849964 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:01.847777 2532 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-176.ec2.internal.18bed058b18a5f2a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-176.ec2.internal,UID:ip-10-0-142-176.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-176.ec2.internal,},FirstTimestamp:2026-07-03 15:13:01.839630122 +0000 UTC m=+0.422653947,LastTimestamp:2026-07-03 15:13:01.839630122 +0000 UTC m=+0.422653947,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-176.ec2.internal,}" Jul 03 15:13:01.853522 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.853501 2532 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 03 15:13:01.853620 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.853520 2532 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 03 15:13:01.853673 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:01.853624 2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-176.ec2.internal\" not found" Jul 03 15:13:01.854513 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.854336 2532 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 03 15:13:01.854513 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.854337 2532 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 03 15:13:01.854513 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.854363 2532 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 03 15:13:01.854513 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.854423 2532 factory.go:55] Registering systemd factory Jul 03 15:13:01.854513 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.854436 2532 factory.go:223] Registration of the systemd container factory successfully Jul 03 15:13:01.854513 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.854496 2532 reconstruct.go:97] "Volume reconstruction finished" Jul 03 15:13:01.854513 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.854507 2532 reconciler.go:29] "Reconciler: start to sync state" Jul 03 15:13:01.854933 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.854663 2532 factory.go:153] Registering CRI-O factory Jul 03 15:13:01.854933 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.854674 2532 factory.go:223] Registration of the crio container factory successfully Jul 03 15:13:01.854933 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.854724 2532 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 03 15:13:01.854933 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.854747 2532 factory.go:103] Registering Raw factory Jul 03 15:13:01.854933 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.854758 2532 manager.go:1196] Started watching for new ooms in manager Jul 03 15:13:01.855284 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.855245 2532 manager.go:349] Starting recovery of all containers Jul 03 15:13:01.860942 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:01.860874 2532 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-176.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 03 15:13:01.860942 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:01.860935 2532 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 03 15:13:01.865530 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.865297 2532 manager.go:354] Recovery completed Jul 03 15:13:01.869565 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.869554 2532 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 15:13:01.871438 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.871416 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-176.ec2.internal" event="NodeHasSufficientMemory" Jul 03 15:13:01.871511 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.871451 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-176.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 15:13:01.871511 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.871461 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-176.ec2.internal" event="NodeHasSufficientPID" Jul 03 15:13:01.871966 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.871954 2532 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 03 15:13:01.871966 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.871965 2532 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 03 15:13:01.871966 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.871956 2532 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 15:13:01.872078 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.871979 2532 state_mem.go:36] "Initialized new in-memory state store" Jul 03 15:13:01.872731 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.872714 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-176.ec2.internal" event="NodeHasSufficientMemory" Jul 03 15:13:01.872780 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.872743 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-176.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 15:13:01.872780 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.872754 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-176.ec2.internal" event="NodeHasSufficientPID" Jul 03 15:13:01.873093 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:01.873026 2532 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-176.ec2.internal.18bed058b36fb454 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-176.ec2.internal,UID:ip-10-0-142-176.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-176.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-176.ec2.internal,},FirstTimestamp:2026-07-03 15:13:01.871436884 +0000 UTC m=+0.454460704,LastTimestamp:2026-07-03 15:13:01.871436884 +0000 UTC m=+0.454460704,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-176.ec2.internal,}" Jul 03 15:13:01.873272 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.873261 2532 policy_none.go:49] "None policy: Start" Jul 03 15:13:01.873308 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.873277 2532 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 03 15:13:01.873308 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.873287 2532 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 03 15:13:01.874269 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.874258 2532 policy_none.go:47] "Start" Jul 03 15:13:01.883819 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:01.883753 2532 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-176.ec2.internal.18bed058b3700009 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-176.ec2.internal,UID:ip-10-0-142-176.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-176.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-176.ec2.internal,},FirstTimestamp:2026-07-03 15:13:01.871456265 +0000 UTC m=+0.454480084,LastTimestamp:2026-07-03 15:13:01.871456265 +0000 UTC m=+0.454480084,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-176.ec2.internal,}" Jul 03 15:13:01.892514 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.892498 2532 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g72nx" Jul 03 15:13:01.895441 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:01.895337 2532 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-176.ec2.internal.18bed058b3702441 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-176.ec2.internal,UID:ip-10-0-142-176.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-176.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-176.ec2.internal,},FirstTimestamp:2026-07-03 15:13:01.871465537 +0000 UTC m=+0.454489357,LastTimestamp:2026-07-03 15:13:01.871465537 +0000 UTC m=+0.454489357,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-176.ec2.internal,}" Jul 03 15:13:01.898583 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.898566 2532 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g72nx" Jul 03 15:13:01.907268 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.906397 2532 manager.go:337] "Starting Device Plugin manager" Jul 03 15:13:01.907268 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:01.906441 2532 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 03 15:13:01.907268 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.906479 2532 server.go:87] "Starting device plugin registration server" Jul 03 15:13:01.907268 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.906748 2532 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 03 15:13:01.907268 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.906773 2532 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 03 15:13:01.907268 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.907087 2532 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 03 15:13:01.907268 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.907163 2532 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 03 15:13:01.907268 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:01.907175 2532 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 03 15:13:01.908145 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:01.908127 2532 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 03 15:13:01.908223 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:01.908180 2532 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-176.ec2.internal\" not found" Jul 03 15:13:02.007049 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.006975 2532 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 15:13:02.008277 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.008178 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-176.ec2.internal" event="NodeHasSufficientMemory" Jul 03 15:13:02.008277 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.008217 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-176.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 15:13:02.008277 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.008234 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-176.ec2.internal" event="NodeHasSufficientPID" Jul 03 15:13:02.008277 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.008269 2532 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-176.ec2.internal" Jul 03 15:13:02.009006 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.008982 2532 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 03 15:13:02.010385 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.010350 2532 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 03 15:13:02.010492 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.010394 2532 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 03 15:13:02.010492 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.010415 2532 kubelet.go:2448] "Starting kubelet main sync loop" Jul 03 15:13:02.010492 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:02.010443 2532 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 03 15:13:02.012161 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.012141 2532 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 15:13:02.017669 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.017649 2532 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-176.ec2.internal" Jul 03 15:13:02.017761 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:02.017672 2532 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-176.ec2.internal\": node \"ip-10-0-142-176.ec2.internal\" not found" Jul 03 15:13:02.053653 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:02.053630 2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-176.ec2.internal\" not found" Jul 03 15:13:02.111198 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.111164 2532 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-176.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-176.ec2.internal"] Jul 03 15:13:02.111277 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.111236 2532 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 15:13:02.112939 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.112924 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-176.ec2.internal" event="NodeHasSufficientMemory" Jul 03 15:13:02.113014 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.112958 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-176.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 15:13:02.113014 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.112972 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-176.ec2.internal" event="NodeHasSufficientPID" Jul 03 15:13:02.114569 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.114558 2532 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 15:13:02.114679 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.114666 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-176.ec2.internal" Jul 03 15:13:02.114716 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.114695 2532 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 15:13:02.116258 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.116243 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-176.ec2.internal" event="NodeHasSufficientMemory" Jul 03 15:13:02.116322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.116274 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-176.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 15:13:02.116322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.116291 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-176.ec2.internal" event="NodeHasSufficientPID" Jul 03 15:13:02.116322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.116303 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-176.ec2.internal" event="NodeHasSufficientMemory" Jul 03 15:13:02.116322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.116321 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-176.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 15:13:02.116465 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.116332 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-176.ec2.internal" event="NodeHasSufficientPID" Jul 03 15:13:02.117564 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.117551 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-176.ec2.internal" Jul 03 15:13:02.117602 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.117596 2532 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 15:13:02.118405 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.118387 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-176.ec2.internal" event="NodeHasSufficientMemory" Jul 03 15:13:02.118514 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.118418 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-176.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 15:13:02.118514 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.118431 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-176.ec2.internal" event="NodeHasSufficientPID" Jul 03 15:13:02.143995 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:02.143974 2532 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-176.ec2.internal\" not found" node="ip-10-0-142-176.ec2.internal" Jul 03 15:13:02.148444 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:02.148429 2532 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-176.ec2.internal\" not found" node="ip-10-0-142-176.ec2.internal" Jul 03 15:13:02.153846 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:02.153832 2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-176.ec2.internal\" not found" Jul 03 15:13:02.156040 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.156026 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/73f560aa491ff61278bfb8d3807767ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-176.ec2.internal\" (UID: \"73f560aa491ff61278bfb8d3807767ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-176.ec2.internal" Jul 03 15:13:02.156096 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.156048 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73f560aa491ff61278bfb8d3807767ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-176.ec2.internal\" (UID: \"73f560aa491ff61278bfb8d3807767ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-176.ec2.internal" Jul 03 15:13:02.156096 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.156066 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3555bbdadd92d8671a620ff24c1e02e8-config\") pod \"kube-apiserver-proxy-ip-10-0-142-176.ec2.internal\" (UID: \"3555bbdadd92d8671a620ff24c1e02e8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-176.ec2.internal" Jul 03 15:13:02.254296 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:02.254262 2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-176.ec2.internal\" not found" Jul 03 15:13:02.256475 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.256460 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/73f560aa491ff61278bfb8d3807767ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-176.ec2.internal\" (UID: \"73f560aa491ff61278bfb8d3807767ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-176.ec2.internal" Jul 03 15:13:02.256535 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.256483 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73f560aa491ff61278bfb8d3807767ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-176.ec2.internal\" (UID: \"73f560aa491ff61278bfb8d3807767ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-176.ec2.internal" Jul 03 15:13:02.256535 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.256501 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3555bbdadd92d8671a620ff24c1e02e8-config\") pod \"kube-apiserver-proxy-ip-10-0-142-176.ec2.internal\" (UID: \"3555bbdadd92d8671a620ff24c1e02e8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-176.ec2.internal" Jul 03 15:13:02.256599 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.256555 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3555bbdadd92d8671a620ff24c1e02e8-config\") pod \"kube-apiserver-proxy-ip-10-0-142-176.ec2.internal\" (UID: \"3555bbdadd92d8671a620ff24c1e02e8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-176.ec2.internal" Jul 03 15:13:02.256599 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.256577 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73f560aa491ff61278bfb8d3807767ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-176.ec2.internal\" (UID: \"73f560aa491ff61278bfb8d3807767ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-176.ec2.internal" Jul 03 15:13:02.256659 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.256556 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/73f560aa491ff61278bfb8d3807767ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-176.ec2.internal\" (UID: \"73f560aa491ff61278bfb8d3807767ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-176.ec2.internal" Jul 03 15:13:02.354968 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:02.354943 2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-176.ec2.internal\" not found" Jul 03 15:13:02.447330 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.447302 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-176.ec2.internal" Jul 03 15:13:02.452516 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.452500 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-176.ec2.internal" Jul 03 15:13:02.455255 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:02.455242 2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-176.ec2.internal\" not found" Jul 03 15:13:02.555896 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:02.555868 2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-176.ec2.internal\" not found" Jul 03 15:13:02.656425 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:02.656348 2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-176.ec2.internal\" not found" Jul 03 15:13:02.713835 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.713812 2532 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 15:13:02.754353 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.754326 2532 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-176.ec2.internal" Jul 03 15:13:02.766643 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.766622 2532 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 03 15:13:02.769808 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.769789 2532 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-176.ec2.internal" Jul 03 15:13:02.778187 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.778167 2532 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 03 15:13:02.787309 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.787281 2532 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 03 15:13:02.787449 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.787429 2532 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 03 15:13:02.787449 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.787437 2532 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 03 15:13:02.829608 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.829584 2532 apiserver.go:52] "Watching apiserver" Jul 03 15:13:02.849605 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.849572 2532 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 03 15:13:02.849932 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.849913 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-9df89","kube-system/kube-apiserver-proxy-ip-10-0-142-176.ec2.internal","openshift-cluster-node-tuning-operator/tuned-4qw9k","openshift-dns/node-resolver-rpqwz","openshift-image-registry/node-ca-7pwdd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-176.ec2.internal","openshift-multus/multus-additional-cni-plugins-grc4q","openshift-multus/multus-lnx8q","kube-system/konnectivity-agent-nl55n","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg","openshift-multus/network-metrics-daemon-chpm2","openshift-network-diagnostics/network-check-target-gtq6v","openshift-network-operator/iptables-alerter-t2bpm","openshift-ovn-kubernetes/ovnkube-node-m5hcn"] Jul 03 15:13:02.851976 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.851959 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.853504 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.853474 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t2bpm" Jul 03 15:13:02.854103 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.853659 2532 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 03 15:13:02.854336 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.854319 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 03 15:13:02.854435 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.854356 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 03 15:13:02.854435 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.854425 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 03 15:13:02.854536 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.854476 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 03 15:13:02.854536 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.854514 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 03 15:13:02.854536 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.854527 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b2jfc\"" Jul 03 15:13:02.855413 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.855400 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.855865 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.855851 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 03 15:13:02.855919 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.855909 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 03 15:13:02.856549 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.856534 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 03 15:13:02.857104 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.857072 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6zjcr\"" Jul 03 15:13:02.858220 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.857801 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 03 15:13:02.858220 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.858030 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 03 15:13:02.858220 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.858058 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2wsmd\"" Jul 03 15:13:02.859012 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.858990 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rpqwz" Jul 03 15:13:02.859563 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.859542 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e41e9a11-9c6a-42d2-b73f-45707d71798b-cni-binary-copy\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.859667 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.859583 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ec11eac5-ac9d-4153-9d00-dc510d6988ac-iptables-alerter-script\") pod \"iptables-alerter-t2bpm\" (UID: \"ec11eac5-ac9d-4153-9d00-dc510d6988ac\") " pod="openshift-network-operator/iptables-alerter-t2bpm" Jul 03 15:13:02.859667 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.859619 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-etc-sysconfig\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.859667 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.859650 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-etc-kubernetes\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.859789 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.859673 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-etc-sysctl-d\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.859789 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.859703 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e41e9a11-9c6a-42d2-b73f-45707d71798b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.859870 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.859783 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e41e9a11-9c6a-42d2-b73f-45707d71798b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.859870 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.859828 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-etc-sysctl-conf\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.859959 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.859933 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-etc-systemd\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.859999 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.859986 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-sys\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.860042 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.860013 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-lib-modules\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.860078 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.860041 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-host\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.860127 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.860082 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-etc-tuned\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.860127 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.860111 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e41e9a11-9c6a-42d2-b73f-45707d71798b-cnibin\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.860190 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.860152 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k5t9\" (UniqueName: \"kubernetes.io/projected/e41e9a11-9c6a-42d2-b73f-45707d71798b-kube-api-access-2k5t9\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.860190 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.860186 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-etc-modprobe-d\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.860190 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.860215 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-run\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.860362 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.860242 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-tmp\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.860362 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.860300 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e41e9a11-9c6a-42d2-b73f-45707d71798b-system-cni-dir\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.860486 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.860341 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e41e9a11-9c6a-42d2-b73f-45707d71798b-os-release\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.860486 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.860416 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e41e9a11-9c6a-42d2-b73f-45707d71798b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.860486 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.860448 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec11eac5-ac9d-4153-9d00-dc510d6988ac-host-slash\") pod \"iptables-alerter-t2bpm\" (UID: \"ec11eac5-ac9d-4153-9d00-dc510d6988ac\") " pod="openshift-network-operator/iptables-alerter-t2bpm" Jul 03 15:13:02.860486 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.860478 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7pwdd" Jul 03 15:13:02.860486 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.860480 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gczm\" (UniqueName: \"kubernetes.io/projected/ec11eac5-ac9d-4153-9d00-dc510d6988ac-kube-api-access-2gczm\") pod \"iptables-alerter-t2bpm\" (UID: \"ec11eac5-ac9d-4153-9d00-dc510d6988ac\") " pod="openshift-network-operator/iptables-alerter-t2bpm" Jul 03 15:13:02.860713 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.860506 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-var-lib-kubelet\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.860713 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.860557 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh8ws\" (UniqueName: \"kubernetes.io/projected/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-kube-api-access-gh8ws\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.861698 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.861676 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 03 15:13:02.861796 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.861779 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5fw27\"" Jul 03 15:13:02.861865 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.861793 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 03 15:13:02.861921 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.861908 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lnx8q" Jul 03 15:13:02.862863 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.862845 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-64pm7\"" Jul 03 15:13:02.862978 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.862902 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 03 15:13:02.862978 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.862921 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 03 15:13:02.863418 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.863404 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 03 15:13:02.864329 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.864298 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 03 15:13:02.864329 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.864309 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vnznm\"" Jul 03 15:13:02.864492 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.864404 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nl55n" Jul 03 15:13:02.864492 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.864481 2532 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 03 15:13:02.865998 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.865635 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:02.865998 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:02.865701 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9df89" podUID="37843d47-7c15-44ce-b3af-54b536ace36f" Jul 03 15:13:02.867768 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.867747 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:02.867845 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:02.867828 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtq6v" podUID="1e8f757a-bb70-43d0-be0c-ba0863018f52" Jul 03 15:13:02.868334 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.868318 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 03 15:13:02.868414 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.868318 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dp8lw\"" Jul 03 15:13:02.868589 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.868577 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 03 15:13:02.869468 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.869447 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:02.872263 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.872246 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:02.872353 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:02.872292 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chpm2" podUID="a9e3ec89-82d9-45ae-a945-4318350c2074" Jul 03 15:13:02.872917 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.872901 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 03 15:13:02.872980 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.872968 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gcjpp\"" Jul 03 15:13:02.873257 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.873243 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 03 15:13:02.873346 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.873332 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 03 15:13:02.874833 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.874818 2532 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 15:13:02.875095 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.875081 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:02.877121 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.877105 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 03 15:13:02.878686 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.878615 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 03 15:13:02.878686 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.878639 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ghdbc\"" Jul 03 15:13:02.878686 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.878672 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 03 15:13:02.878853 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.878639 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 03 15:13:02.878853 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.878643 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 03 15:13:02.878853 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.878617 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 03 15:13:02.888320 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.888304 2532 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bfrsr" Jul 03 15:13:02.896312 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.896296 2532 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bfrsr" Jul 03 15:13:02.900742 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.900700 2532 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-02 15:08:02 +0000 UTC" deadline="2028-02-28 10:20:04.856820047 +0000 UTC" Jul 03 15:13:02.900742 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.900738 2532 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14515h7m1.956084665s" Jul 03 15:13:02.955766 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.955748 2532 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 03 15:13:02.961384 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.961079 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-host-cni-bin\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:02.961384 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.961133 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh8ws\" (UniqueName: \"kubernetes.io/projected/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-kube-api-access-gh8ws\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.961384 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.961164 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-etc-sysctl-d\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.961384 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.961224 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-etc-systemd\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.961384 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.961277 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a3096b4d-2e2e-4297-88a8-1b4db7fe67c5-socket-dir\") pod \"aws-ebs-csi-driver-node-hjptg\" (UID: \"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:02.961740 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.961706 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-etc-systemd\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.961856 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.961749 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-etc-sysctl-d\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.961856 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.961781 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a3096b4d-2e2e-4297-88a8-1b4db7fe67c5-device-dir\") pod \"aws-ebs-csi-driver-node-hjptg\" (UID: \"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:02.961856 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.961829 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e41e9a11-9c6a-42d2-b73f-45707d71798b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.964945 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.961865 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a3096b4d-2e2e-4297-88a8-1b4db7fe67c5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hjptg\" (UID: \"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:02.964945 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.962162 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-host-run-netns\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:02.964945 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.962196 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/df460999-eb58-4575-91fc-8130653c6f5b-ovn-node-metrics-cert\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:02.964945 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.962229 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmsrh\" (UniqueName: \"kubernetes.io/projected/f2d8e1ee-2726-48a1-a016-01e11e8f02bf-kube-api-access-qmsrh\") pod \"node-resolver-rpqwz\" (UID: \"f2d8e1ee-2726-48a1-a016-01e11e8f02bf\") " pod="openshift-dns/node-resolver-rpqwz" Jul 03 15:13:02.964945 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.962268 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e41e9a11-9c6a-42d2-b73f-45707d71798b-cnibin\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.964945 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.962553 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e41e9a11-9c6a-42d2-b73f-45707d71798b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.964945 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.962572 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e41e9a11-9c6a-42d2-b73f-45707d71798b-cnibin\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.964945 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.963623 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k5t9\" (UniqueName: \"kubernetes.io/projected/e41e9a11-9c6a-42d2-b73f-45707d71798b-kube-api-access-2k5t9\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.964945 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.963656 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-multus-socket-dir-parent\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:02.964945 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.963687 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-etc-kubernetes\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:02.964945 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.963722 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e41e9a11-9c6a-42d2-b73f-45707d71798b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.964945 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.963752 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a3096b4d-2e2e-4297-88a8-1b4db7fe67c5-etc-selinux\") pod \"aws-ebs-csi-driver-node-hjptg\" (UID: \"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:02.964945 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.963791 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-etc-openvswitch\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:02.964945 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.963816 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-host-run-netns\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:02.964945 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.963846 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/37843d47-7c15-44ce-b3af-54b536ace36f-dbus\") pod \"global-pull-secret-syncer-9df89\" (UID: \"37843d47-7c15-44ce-b3af-54b536ace36f\") " pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:02.964945 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.963878 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-etc-sysconfig\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.965681 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.963911 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/df460999-eb58-4575-91fc-8130653c6f5b-ovnkube-script-lib\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:02.965681 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.963941 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-host-run-k8s-cni-cncf-io\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:02.965681 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.963967 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e41e9a11-9c6a-42d2-b73f-45707d71798b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.965681 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.963997 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-lib-modules\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.965681 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964025 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-os-release\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:02.965681 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964054 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-etc-modprobe-d\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.965681 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964135 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-etc-sysconfig\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.965681 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964190 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-run\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.965681 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964227 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-tmp\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.965681 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964262 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-run-systemd\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:02.965681 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964288 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/df460999-eb58-4575-91fc-8130653c6f5b-ovnkube-config\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:02.965681 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964302 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e41e9a11-9c6a-42d2-b73f-45707d71798b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.965681 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964317 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c8200bbb-db4c-4118-b9b6-451401a16fd0-konnectivity-ca\") pod \"konnectivity-agent-nl55n\" (UID: \"c8200bbb-db4c-4118-b9b6-451401a16fd0\") " pod="kube-system/konnectivity-agent-nl55n" Jul 03 15:13:02.965681 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964348 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret\") pod \"global-pull-secret-syncer-9df89\" (UID: \"37843d47-7c15-44ce-b3af-54b536ace36f\") " pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:02.965681 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964577 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs\") pod \"network-metrics-daemon-chpm2\" (UID: \"a9e3ec89-82d9-45ae-a945-4318350c2074\") " pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:02.965681 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964601 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-run\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.965681 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964616 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-lib-modules\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.966309 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964635 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e41e9a11-9c6a-42d2-b73f-45707d71798b-system-cni-dir\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.966309 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964670 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec11eac5-ac9d-4153-9d00-dc510d6988ac-host-slash\") pod \"iptables-alerter-t2bpm\" (UID: \"ec11eac5-ac9d-4153-9d00-dc510d6988ac\") " pod="openshift-network-operator/iptables-alerter-t2bpm" Jul 03 15:13:02.966309 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964703 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gczm\" (UniqueName: \"kubernetes.io/projected/ec11eac5-ac9d-4153-9d00-dc510d6988ac-kube-api-access-2gczm\") pod \"iptables-alerter-t2bpm\" (UID: \"ec11eac5-ac9d-4153-9d00-dc510d6988ac\") " pod="openshift-network-operator/iptables-alerter-t2bpm" Jul 03 15:13:02.966309 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964730 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-log-socket\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:02.966309 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964744 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-etc-modprobe-d\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.966309 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964762 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f2d8e1ee-2726-48a1-a016-01e11e8f02bf-hosts-file\") pod \"node-resolver-rpqwz\" (UID: \"f2d8e1ee-2726-48a1-a016-01e11e8f02bf\") " pod="openshift-dns/node-resolver-rpqwz" Jul 03 15:13:02.966309 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964778 2532 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 03 15:13:02.966309 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964794 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fst4\" (UniqueName: \"kubernetes.io/projected/c481e3d5-ae74-4023-9633-aaeb93addb3a-kube-api-access-5fst4\") pod \"node-ca-7pwdd\" (UID: \"c481e3d5-ae74-4023-9633-aaeb93addb3a\") " pod="openshift-image-registry/node-ca-7pwdd" Jul 03 15:13:02.966309 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964839 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-host-run-multus-certs\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:02.966309 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964875 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/df460999-eb58-4575-91fc-8130653c6f5b-env-overrides\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:02.966309 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964905 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e41e9a11-9c6a-42d2-b73f-45707d71798b-system-cni-dir\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.966309 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.964971 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e41e9a11-9c6a-42d2-b73f-45707d71798b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.966309 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965012 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e41e9a11-9c6a-42d2-b73f-45707d71798b-cni-binary-copy\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.966309 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965060 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec11eac5-ac9d-4153-9d00-dc510d6988ac-host-slash\") pod \"iptables-alerter-t2bpm\" (UID: \"ec11eac5-ac9d-4153-9d00-dc510d6988ac\") " pod="openshift-network-operator/iptables-alerter-t2bpm" Jul 03 15:13:02.966309 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965114 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-etc-kubernetes\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.966309 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965163 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-sys\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.966309 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965199 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzqkc\" (UniqueName: \"kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc\") pod \"network-check-target-gtq6v\" (UID: \"1e8f757a-bb70-43d0-be0c-ba0863018f52\") " pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:02.966951 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965231 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-run-ovn\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:02.966951 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965266 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-etc-kubernetes\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.966951 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965316 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-sys\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.966951 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965346 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-host-var-lib-cni-multus\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:02.966951 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965406 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-host\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.966951 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965440 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a3096b4d-2e2e-4297-88a8-1b4db7fe67c5-registration-dir\") pod \"aws-ebs-csi-driver-node-hjptg\" (UID: \"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:02.966951 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965488 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-host-run-ovn-kubernetes\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:02.966951 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965512 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-host-cni-netd\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:02.966951 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965553 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e41e9a11-9c6a-42d2-b73f-45707d71798b-cni-binary-copy\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.966951 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965557 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:02.966951 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965611 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-host\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.966951 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965684 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2d8e1ee-2726-48a1-a016-01e11e8f02bf-tmp-dir\") pod \"node-resolver-rpqwz\" (UID: \"f2d8e1ee-2726-48a1-a016-01e11e8f02bf\") " pod="openshift-dns/node-resolver-rpqwz" Jul 03 15:13:02.966951 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965840 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c481e3d5-ae74-4023-9633-aaeb93addb3a-host\") pod \"node-ca-7pwdd\" (UID: \"c481e3d5-ae74-4023-9633-aaeb93addb3a\") " pod="openshift-image-registry/node-ca-7pwdd" Jul 03 15:13:02.966951 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965867 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c481e3d5-ae74-4023-9633-aaeb93addb3a-serviceca\") pod \"node-ca-7pwdd\" (UID: \"c481e3d5-ae74-4023-9633-aaeb93addb3a\") " pod="openshift-image-registry/node-ca-7pwdd" Jul 03 15:13:02.966951 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965894 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-node-log\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:02.966951 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965925 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx2z8\" (UniqueName: \"kubernetes.io/projected/df460999-eb58-4575-91fc-8130653c6f5b-kube-api-access-hx2z8\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:02.966951 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965963 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-hostroot\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:02.967714 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.965986 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-multus-conf-dir\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:02.967714 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.966013 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm4v6\" (UniqueName: \"kubernetes.io/projected/a8e7b01d-06ca-45f9-9516-e6e059981672-kube-api-access-fm4v6\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:02.967714 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.966039 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c8200bbb-db4c-4118-b9b6-451401a16fd0-agent-certs\") pod \"konnectivity-agent-nl55n\" (UID: \"c8200bbb-db4c-4118-b9b6-451401a16fd0\") " pod="kube-system/konnectivity-agent-nl55n" Jul 03 15:13:02.967714 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.966097 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e41e9a11-9c6a-42d2-b73f-45707d71798b-os-release\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.967714 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.966152 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-var-lib-kubelet\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.967714 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.966169 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e41e9a11-9c6a-42d2-b73f-45707d71798b-os-release\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:02.967714 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.966196 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-system-cni-dir\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:02.967714 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.966227 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a8e7b01d-06ca-45f9-9516-e6e059981672-multus-daemon-config\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:02.967714 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.966234 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-var-lib-kubelet\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.967714 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.966257 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/37843d47-7c15-44ce-b3af-54b536ace36f-kubelet-config\") pod \"global-pull-secret-syncer-9df89\" (UID: \"37843d47-7c15-44ce-b3af-54b536ace36f\") " pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:02.967714 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.966295 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k98c6\" (UniqueName: \"kubernetes.io/projected/a9e3ec89-82d9-45ae-a945-4318350c2074-kube-api-access-k98c6\") pod \"network-metrics-daemon-chpm2\" (UID: \"a9e3ec89-82d9-45ae-a945-4318350c2074\") " pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:02.967714 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.966712 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ec11eac5-ac9d-4153-9d00-dc510d6988ac-iptables-alerter-script\") pod \"iptables-alerter-t2bpm\" (UID: \"ec11eac5-ac9d-4153-9d00-dc510d6988ac\") " pod="openshift-network-operator/iptables-alerter-t2bpm" Jul 03 15:13:02.967714 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.966772 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-etc-sysctl-conf\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.967714 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.966805 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-var-lib-openvswitch\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:02.967714 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.966849 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-cnibin\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:02.967714 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.966870 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8e7b01d-06ca-45f9-9516-e6e059981672-cni-binary-copy\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:02.967714 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.966891 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-etc-tuned\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.968219 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.966911 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-host-kubelet\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:02.968219 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.966929 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-run-openvswitch\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:02.968219 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.966948 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-host-var-lib-cni-bin\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:02.968219 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.966969 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a3096b4d-2e2e-4297-88a8-1b4db7fe67c5-sys-fs\") pod \"aws-ebs-csi-driver-node-hjptg\" (UID: \"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:02.968219 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.967008 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzjps\" (UniqueName: \"kubernetes.io/projected/a3096b4d-2e2e-4297-88a8-1b4db7fe67c5-kube-api-access-dzjps\") pod \"aws-ebs-csi-driver-node-hjptg\" (UID: \"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:02.968219 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.967029 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-systemd-units\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:02.968219 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.967050 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-host-slash\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:02.968219 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.967082 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-multus-cni-dir\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:02.968219 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.967118 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-host-var-lib-kubelet\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:02.968219 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.967280 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ec11eac5-ac9d-4153-9d00-dc510d6988ac-iptables-alerter-script\") pod \"iptables-alerter-t2bpm\" (UID: \"ec11eac5-ac9d-4153-9d00-dc510d6988ac\") " pod="openshift-network-operator/iptables-alerter-t2bpm" Jul 03 15:13:02.968219 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.967403 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-etc-sysctl-conf\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.968632 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.968485 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-tmp\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.969346 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.969327 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh8ws\" (UniqueName: \"kubernetes.io/projected/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-kube-api-access-gh8ws\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.969610 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.969593 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6da9f69-ee8a-4fa5-ad51-82997ae029f9-etc-tuned\") pod \"tuned-4qw9k\" (UID: \"a6da9f69-ee8a-4fa5-ad51-82997ae029f9\") " pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:02.972597 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.972578 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gczm\" (UniqueName: \"kubernetes.io/projected/ec11eac5-ac9d-4153-9d00-dc510d6988ac-kube-api-access-2gczm\") pod \"iptables-alerter-t2bpm\" (UID: \"ec11eac5-ac9d-4153-9d00-dc510d6988ac\") " pod="openshift-network-operator/iptables-alerter-t2bpm" Jul 03 15:13:02.972685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:02.972627 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k5t9\" (UniqueName: \"kubernetes.io/projected/e41e9a11-9c6a-42d2-b73f-45707d71798b-kube-api-access-2k5t9\") pod \"multus-additional-cni-plugins-grc4q\" (UID: \"e41e9a11-9c6a-42d2-b73f-45707d71798b\") " pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:03.051020 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:03.050992 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3555bbdadd92d8671a620ff24c1e02e8.slice/crio-fe9f6267a2732274ffc06980c45fb55921647902d41ead03661a7408ba0b9e23 WatchSource:0}: Error finding container fe9f6267a2732274ffc06980c45fb55921647902d41ead03661a7408ba0b9e23: Status 404 returned error can't find the container with id fe9f6267a2732274ffc06980c45fb55921647902d41ead03661a7408ba0b9e23 Jul 03 15:13:03.051671 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:03.051655 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73f560aa491ff61278bfb8d3807767ac.slice/crio-7edb3c54f024b6dd3f757b0c538b8ec3635d6fea77b44df20ae470d288d1af8f WatchSource:0}: Error finding container 7edb3c54f024b6dd3f757b0c538b8ec3635d6fea77b44df20ae470d288d1af8f: Status 404 returned error can't find the container with id 7edb3c54f024b6dd3f757b0c538b8ec3635d6fea77b44df20ae470d288d1af8f Jul 03 15:13:03.056262 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.056244 2532 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 15:13:03.067507 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067484 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-var-lib-openvswitch\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.067582 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067513 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-cnibin\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.067582 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067529 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8e7b01d-06ca-45f9-9516-e6e059981672-cni-binary-copy\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.067647 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067589 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-var-lib-openvswitch\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.067647 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067602 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-host-kubelet\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.067647 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067592 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-cnibin\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.067647 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067642 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-host-kubelet\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.067776 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067661 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-run-openvswitch\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.067776 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067693 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-host-var-lib-cni-bin\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.067776 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067709 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a3096b4d-2e2e-4297-88a8-1b4db7fe67c5-sys-fs\") pod \"aws-ebs-csi-driver-node-hjptg\" (UID: \"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:03.067776 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067724 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-run-openvswitch\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.067776 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067753 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a3096b4d-2e2e-4297-88a8-1b4db7fe67c5-sys-fs\") pod \"aws-ebs-csi-driver-node-hjptg\" (UID: \"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:03.067776 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067751 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-host-var-lib-cni-bin\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.067969 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067771 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzjps\" (UniqueName: \"kubernetes.io/projected/a3096b4d-2e2e-4297-88a8-1b4db7fe67c5-kube-api-access-dzjps\") pod \"aws-ebs-csi-driver-node-hjptg\" (UID: \"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:03.067969 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067800 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-systemd-units\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.067969 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067824 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-host-slash\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.067969 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067852 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-systemd-units\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.067969 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067874 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-multus-cni-dir\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.067969 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067898 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-host-var-lib-kubelet\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.067969 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067924 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-host-cni-bin\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.067969 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067941 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-host-slash\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.067969 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067951 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a3096b4d-2e2e-4297-88a8-1b4db7fe67c5-socket-dir\") pod \"aws-ebs-csi-driver-node-hjptg\" (UID: \"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:03.068322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067995 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-host-var-lib-kubelet\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.068322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.067994 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-multus-cni-dir\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.068322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068018 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a3096b4d-2e2e-4297-88a8-1b4db7fe67c5-device-dir\") pod \"aws-ebs-csi-driver-node-hjptg\" (UID: \"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:03.068322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068053 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a3096b4d-2e2e-4297-88a8-1b4db7fe67c5-socket-dir\") pod \"aws-ebs-csi-driver-node-hjptg\" (UID: \"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:03.068322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068055 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a3096b4d-2e2e-4297-88a8-1b4db7fe67c5-device-dir\") pod \"aws-ebs-csi-driver-node-hjptg\" (UID: \"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:03.068322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068057 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-host-cni-bin\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.068322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068055 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a3096b4d-2e2e-4297-88a8-1b4db7fe67c5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hjptg\" (UID: \"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:03.068322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068100 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a3096b4d-2e2e-4297-88a8-1b4db7fe67c5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hjptg\" (UID: \"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:03.068322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068109 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8e7b01d-06ca-45f9-9516-e6e059981672-cni-binary-copy\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.068322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068110 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-host-run-netns\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.068322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068147 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-host-run-netns\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.068322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068154 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/df460999-eb58-4575-91fc-8130653c6f5b-ovn-node-metrics-cert\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.068322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068174 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmsrh\" (UniqueName: \"kubernetes.io/projected/f2d8e1ee-2726-48a1-a016-01e11e8f02bf-kube-api-access-qmsrh\") pod \"node-resolver-rpqwz\" (UID: \"f2d8e1ee-2726-48a1-a016-01e11e8f02bf\") " pod="openshift-dns/node-resolver-rpqwz" Jul 03 15:13:03.068322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068192 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-multus-socket-dir-parent\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.068322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068207 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-etc-kubernetes\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.068322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068222 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a3096b4d-2e2e-4297-88a8-1b4db7fe67c5-etc-selinux\") pod \"aws-ebs-csi-driver-node-hjptg\" (UID: \"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:03.068322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068254 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-etc-openvswitch\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.069030 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068270 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-multus-socket-dir-parent\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.069030 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068277 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-host-run-netns\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.069030 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068278 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-etc-kubernetes\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.069030 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068307 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/37843d47-7c15-44ce-b3af-54b536ace36f-dbus\") pod \"global-pull-secret-syncer-9df89\" (UID: \"37843d47-7c15-44ce-b3af-54b536ace36f\") " pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:03.069030 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068317 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-host-run-netns\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.069030 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068326 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-etc-openvswitch\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.069030 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068337 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a3096b4d-2e2e-4297-88a8-1b4db7fe67c5-etc-selinux\") pod \"aws-ebs-csi-driver-node-hjptg\" (UID: \"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:03.069030 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068336 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/df460999-eb58-4575-91fc-8130653c6f5b-ovnkube-script-lib\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.069030 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068404 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-host-run-k8s-cni-cncf-io\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.069030 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068430 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/37843d47-7c15-44ce-b3af-54b536ace36f-dbus\") pod \"global-pull-secret-syncer-9df89\" (UID: \"37843d47-7c15-44ce-b3af-54b536ace36f\") " pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:03.069030 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068430 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-os-release\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.069030 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068459 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-run-systemd\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.069030 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068482 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-os-release\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.069030 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068484 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/df460999-eb58-4575-91fc-8130653c6f5b-ovnkube-config\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.069030 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068504 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-host-run-k8s-cni-cncf-io\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.069030 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068520 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c8200bbb-db4c-4118-b9b6-451401a16fd0-konnectivity-ca\") pod \"konnectivity-agent-nl55n\" (UID: \"c8200bbb-db4c-4118-b9b6-451401a16fd0\") " pod="kube-system/konnectivity-agent-nl55n" Jul 03 15:13:03.069030 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068536 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-run-systemd\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.069030 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068547 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret\") pod \"global-pull-secret-syncer-9df89\" (UID: \"37843d47-7c15-44ce-b3af-54b536ace36f\") " pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:03.069893 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068574 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs\") pod \"network-metrics-daemon-chpm2\" (UID: \"a9e3ec89-82d9-45ae-a945-4318350c2074\") " pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:03.069893 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068600 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-log-socket\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.069893 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:03.068615 2532 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 15:13:03.069893 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068623 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f2d8e1ee-2726-48a1-a016-01e11e8f02bf-hosts-file\") pod \"node-resolver-rpqwz\" (UID: \"f2d8e1ee-2726-48a1-a016-01e11e8f02bf\") " pod="openshift-dns/node-resolver-rpqwz" Jul 03 15:13:03.069893 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068649 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fst4\" (UniqueName: \"kubernetes.io/projected/c481e3d5-ae74-4023-9633-aaeb93addb3a-kube-api-access-5fst4\") pod \"node-ca-7pwdd\" (UID: \"c481e3d5-ae74-4023-9633-aaeb93addb3a\") " pod="openshift-image-registry/node-ca-7pwdd" Jul 03 15:13:03.069893 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:03.068707 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret podName:37843d47-7c15-44ce-b3af-54b536ace36f nodeName:}" failed. No retries permitted until 2026-07-03 15:13:03.568661657 +0000 UTC m=+2.151685468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret") pod "global-pull-secret-syncer-9df89" (UID: "37843d47-7c15-44ce-b3af-54b536ace36f") : object "kube-system"/"original-pull-secret" not registered Jul 03 15:13:03.069893 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:03.068722 2532 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 15:13:03.069893 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068727 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-host-run-multus-certs\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.069893 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068755 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/df460999-eb58-4575-91fc-8130653c6f5b-env-overrides\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.069893 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:03.068760 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs podName:a9e3ec89-82d9-45ae-a945-4318350c2074 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:03.568749644 +0000 UTC m=+2.151773453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs") pod "network-metrics-daemon-chpm2" (UID: "a9e3ec89-82d9-45ae-a945-4318350c2074") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 15:13:03.069893 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068794 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzqkc\" (UniqueName: \"kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc\") pod \"network-check-target-gtq6v\" (UID: \"1e8f757a-bb70-43d0-be0c-ba0863018f52\") " pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:03.069893 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068820 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-run-ovn\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.069893 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068844 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-host-var-lib-cni-multus\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.069893 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068868 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a3096b4d-2e2e-4297-88a8-1b4db7fe67c5-registration-dir\") pod \"aws-ebs-csi-driver-node-hjptg\" (UID: \"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:03.069893 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068889 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-host-run-multus-certs\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.069893 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068893 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-host-run-ovn-kubernetes\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.069893 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068938 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-host-cni-netd\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.070454 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068944 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-log-socket\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.070454 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068965 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/df460999-eb58-4575-91fc-8130653c6f5b-ovnkube-script-lib\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.070454 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068964 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.070454 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068986 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-host-run-ovn-kubernetes\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.070454 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.068998 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.070454 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069009 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2d8e1ee-2726-48a1-a016-01e11e8f02bf-tmp-dir\") pod \"node-resolver-rpqwz\" (UID: \"f2d8e1ee-2726-48a1-a016-01e11e8f02bf\") " pod="openshift-dns/node-resolver-rpqwz" Jul 03 15:13:03.070454 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069034 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f2d8e1ee-2726-48a1-a016-01e11e8f02bf-hosts-file\") pod \"node-resolver-rpqwz\" (UID: \"f2d8e1ee-2726-48a1-a016-01e11e8f02bf\") " pod="openshift-dns/node-resolver-rpqwz" Jul 03 15:13:03.070454 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069040 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-host-cni-netd\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.070454 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069035 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c481e3d5-ae74-4023-9633-aaeb93addb3a-host\") pod \"node-ca-7pwdd\" (UID: \"c481e3d5-ae74-4023-9633-aaeb93addb3a\") " pod="openshift-image-registry/node-ca-7pwdd" Jul 03 15:13:03.070454 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069064 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c481e3d5-ae74-4023-9633-aaeb93addb3a-host\") pod \"node-ca-7pwdd\" (UID: \"c481e3d5-ae74-4023-9633-aaeb93addb3a\") " pod="openshift-image-registry/node-ca-7pwdd" Jul 03 15:13:03.070454 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069066 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/df460999-eb58-4575-91fc-8130653c6f5b-ovnkube-config\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.070454 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069078 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-host-var-lib-cni-multus\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.070454 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069080 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c481e3d5-ae74-4023-9633-aaeb93addb3a-serviceca\") pod \"node-ca-7pwdd\" (UID: \"c481e3d5-ae74-4023-9633-aaeb93addb3a\") " pod="openshift-image-registry/node-ca-7pwdd" Jul 03 15:13:03.070454 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069108 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-node-log\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.070454 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069136 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-run-ovn\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.070454 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069137 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c8200bbb-db4c-4118-b9b6-451401a16fd0-konnectivity-ca\") pod \"konnectivity-agent-nl55n\" (UID: \"c8200bbb-db4c-4118-b9b6-451401a16fd0\") " pod="kube-system/konnectivity-agent-nl55n" Jul 03 15:13:03.070454 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069148 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/df460999-eb58-4575-91fc-8130653c6f5b-node-log\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.070454 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069186 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx2z8\" (UniqueName: \"kubernetes.io/projected/df460999-eb58-4575-91fc-8130653c6f5b-kube-api-access-hx2z8\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.070936 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069162 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a3096b4d-2e2e-4297-88a8-1b4db7fe67c5-registration-dir\") pod \"aws-ebs-csi-driver-node-hjptg\" (UID: \"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:03.070936 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069217 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-hostroot\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.070936 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069240 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-multus-conf-dir\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.070936 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069265 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm4v6\" (UniqueName: \"kubernetes.io/projected/a8e7b01d-06ca-45f9-9516-e6e059981672-kube-api-access-fm4v6\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.070936 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069276 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-hostroot\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.070936 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069288 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c8200bbb-db4c-4118-b9b6-451401a16fd0-agent-certs\") pod \"konnectivity-agent-nl55n\" (UID: \"c8200bbb-db4c-4118-b9b6-451401a16fd0\") " pod="kube-system/konnectivity-agent-nl55n" Jul 03 15:13:03.070936 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069331 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-multus-conf-dir\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.070936 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069344 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2d8e1ee-2726-48a1-a016-01e11e8f02bf-tmp-dir\") pod \"node-resolver-rpqwz\" (UID: \"f2d8e1ee-2726-48a1-a016-01e11e8f02bf\") " pod="openshift-dns/node-resolver-rpqwz" Jul 03 15:13:03.070936 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069400 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-system-cni-dir\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.070936 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069454 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/df460999-eb58-4575-91fc-8130653c6f5b-env-overrides\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.070936 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069490 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8e7b01d-06ca-45f9-9516-e6e059981672-system-cni-dir\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.070936 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069497 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a8e7b01d-06ca-45f9-9516-e6e059981672-multus-daemon-config\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.070936 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069523 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/37843d47-7c15-44ce-b3af-54b536ace36f-kubelet-config\") pod \"global-pull-secret-syncer-9df89\" (UID: \"37843d47-7c15-44ce-b3af-54b536ace36f\") " pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:03.070936 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069560 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k98c6\" (UniqueName: \"kubernetes.io/projected/a9e3ec89-82d9-45ae-a945-4318350c2074-kube-api-access-k98c6\") pod \"network-metrics-daemon-chpm2\" (UID: \"a9e3ec89-82d9-45ae-a945-4318350c2074\") " pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:03.070936 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069599 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/37843d47-7c15-44ce-b3af-54b536ace36f-kubelet-config\") pod \"global-pull-secret-syncer-9df89\" (UID: \"37843d47-7c15-44ce-b3af-54b536ace36f\") " pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:03.070936 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.069976 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a8e7b01d-06ca-45f9-9516-e6e059981672-multus-daemon-config\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.070936 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.070158 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c481e3d5-ae74-4023-9633-aaeb93addb3a-serviceca\") pod \"node-ca-7pwdd\" (UID: \"c481e3d5-ae74-4023-9633-aaeb93addb3a\") " pod="openshift-image-registry/node-ca-7pwdd" Jul 03 15:13:03.071472 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.071413 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/df460999-eb58-4575-91fc-8130653c6f5b-ovn-node-metrics-cert\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.071701 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.071685 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c8200bbb-db4c-4118-b9b6-451401a16fd0-agent-certs\") pod \"konnectivity-agent-nl55n\" (UID: \"c8200bbb-db4c-4118-b9b6-451401a16fd0\") " pod="kube-system/konnectivity-agent-nl55n" Jul 03 15:13:03.074771 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:03.074751 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 15:13:03.074771 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:03.074769 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 15:13:03.074919 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:03.074779 2532 projected.go:196] Error preparing data for projected volume kube-api-access-fzqkc for pod openshift-network-diagnostics/network-check-target-gtq6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 15:13:03.074919 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:03.074836 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc podName:1e8f757a-bb70-43d0-be0c-ba0863018f52 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:03.574820135 +0000 UTC m=+2.157843959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fzqkc" (UniqueName: "kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc") pod "network-check-target-gtq6v" (UID: "1e8f757a-bb70-43d0-be0c-ba0863018f52") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 15:13:03.075587 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.075522 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzjps\" (UniqueName: \"kubernetes.io/projected/a3096b4d-2e2e-4297-88a8-1b4db7fe67c5-kube-api-access-dzjps\") pod \"aws-ebs-csi-driver-node-hjptg\" (UID: \"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:03.076994 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.076970 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmsrh\" (UniqueName: \"kubernetes.io/projected/f2d8e1ee-2726-48a1-a016-01e11e8f02bf-kube-api-access-qmsrh\") pod \"node-resolver-rpqwz\" (UID: \"f2d8e1ee-2726-48a1-a016-01e11e8f02bf\") " pod="openshift-dns/node-resolver-rpqwz" Jul 03 15:13:03.077356 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.077335 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fst4\" (UniqueName: \"kubernetes.io/projected/c481e3d5-ae74-4023-9633-aaeb93addb3a-kube-api-access-5fst4\") pod \"node-ca-7pwdd\" (UID: \"c481e3d5-ae74-4023-9633-aaeb93addb3a\") " pod="openshift-image-registry/node-ca-7pwdd" Jul 03 15:13:03.078096 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.078078 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k98c6\" (UniqueName: \"kubernetes.io/projected/a9e3ec89-82d9-45ae-a945-4318350c2074-kube-api-access-k98c6\") pod \"network-metrics-daemon-chpm2\" (UID: \"a9e3ec89-82d9-45ae-a945-4318350c2074\") " pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:03.078761 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.078746 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx2z8\" (UniqueName: \"kubernetes.io/projected/df460999-eb58-4575-91fc-8130653c6f5b-kube-api-access-hx2z8\") pod \"ovnkube-node-m5hcn\" (UID: \"df460999-eb58-4575-91fc-8130653c6f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.078801 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.078759 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm4v6\" (UniqueName: \"kubernetes.io/projected/a8e7b01d-06ca-45f9-9516-e6e059981672-kube-api-access-fm4v6\") pod \"multus-lnx8q\" (UID: \"a8e7b01d-06ca-45f9-9516-e6e059981672\") " pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.171758 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.171682 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-grc4q" Jul 03 15:13:03.180908 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:03.180880 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode41e9a11_9c6a_42d2_b73f_45707d71798b.slice/crio-ddc52f566c55ecc78180aa8db86dcd26d64a0d7045df7eeab41b2cd463ec6e57 WatchSource:0}: Error finding container ddc52f566c55ecc78180aa8db86dcd26d64a0d7045df7eeab41b2cd463ec6e57: Status 404 returned error can't find the container with id ddc52f566c55ecc78180aa8db86dcd26d64a0d7045df7eeab41b2cd463ec6e57 Jul 03 15:13:03.188051 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.188031 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t2bpm" Jul 03 15:13:03.194722 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.194706 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" Jul 03 15:13:03.194976 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:03.194956 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec11eac5_ac9d_4153_9d00_dc510d6988ac.slice/crio-23639bc3d812cfd9a624cd45eaed04965555ad0ea3b32fb92b5cd6f7769add4d WatchSource:0}: Error finding container 23639bc3d812cfd9a624cd45eaed04965555ad0ea3b32fb92b5cd6f7769add4d: Status 404 returned error can't find the container with id 23639bc3d812cfd9a624cd45eaed04965555ad0ea3b32fb92b5cd6f7769add4d Jul 03 15:13:03.197712 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.197698 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rpqwz" Jul 03 15:13:03.204067 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:03.204040 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6da9f69_ee8a_4fa5_ad51_82997ae029f9.slice/crio-ab10b96caf302e4824cd6569f34853a816bee07ba7954835ba77dc311c5a60db WatchSource:0}: Error finding container ab10b96caf302e4824cd6569f34853a816bee07ba7954835ba77dc311c5a60db: Status 404 returned error can't find the container with id ab10b96caf302e4824cd6569f34853a816bee07ba7954835ba77dc311c5a60db Jul 03 15:13:03.207077 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:03.207056 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d8e1ee_2726_48a1_a016_01e11e8f02bf.slice/crio-0be046d99e69ffd2a8d827a9181929e046b4b6249060f4ca4b615f94107b3611 WatchSource:0}: Error finding container 0be046d99e69ffd2a8d827a9181929e046b4b6249060f4ca4b615f94107b3611: Status 404 returned error can't find the container with id 0be046d99e69ffd2a8d827a9181929e046b4b6249060f4ca4b615f94107b3611 Jul 03 15:13:03.234086 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.234053 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7pwdd" Jul 03 15:13:03.241162 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:03.241140 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc481e3d5_ae74_4023_9633_aaeb93addb3a.slice/crio-295fd0104f93a1d9ec25603987723c338732e5f2bc1a50de81ed8cb4ce869327 WatchSource:0}: Error finding container 295fd0104f93a1d9ec25603987723c338732e5f2bc1a50de81ed8cb4ce869327: Status 404 returned error can't find the container with id 295fd0104f93a1d9ec25603987723c338732e5f2bc1a50de81ed8cb4ce869327 Jul 03 15:13:03.247198 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.247180 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lnx8q" Jul 03 15:13:03.254159 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:03.254139 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e7b01d_06ca_45f9_9516_e6e059981672.slice/crio-566fb676122d3c023f0051c706a29a61b5220f922401b7a589ddd9a0963d6980 WatchSource:0}: Error finding container 566fb676122d3c023f0051c706a29a61b5220f922401b7a589ddd9a0963d6980: Status 404 returned error can't find the container with id 566fb676122d3c023f0051c706a29a61b5220f922401b7a589ddd9a0963d6980 Jul 03 15:13:03.266023 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.266005 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nl55n" Jul 03 15:13:03.272604 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.272585 2532 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 15:13:03.274757 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:03.274728 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8200bbb_db4c_4118_b9b6_451401a16fd0.slice/crio-f383a20cd12e69e303a972314bfe1a6747630a3daeae571e27bfbf87179d0458 WatchSource:0}: Error finding container f383a20cd12e69e303a972314bfe1a6747630a3daeae571e27bfbf87179d0458: Status 404 returned error can't find the container with id f383a20cd12e69e303a972314bfe1a6747630a3daeae571e27bfbf87179d0458 Jul 03 15:13:03.290505 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.290482 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" Jul 03 15:13:03.295553 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.295535 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:03.299434 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:03.299415 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3096b4d_2e2e_4297_88a8_1b4db7fe67c5.slice/crio-9a86e2a569db5516d7b75dac022b5ca83521c09a89e1b4b63eb01aa7accd5e3f WatchSource:0}: Error finding container 9a86e2a569db5516d7b75dac022b5ca83521c09a89e1b4b63eb01aa7accd5e3f: Status 404 returned error can't find the container with id 9a86e2a569db5516d7b75dac022b5ca83521c09a89e1b4b63eb01aa7accd5e3f Jul 03 15:13:03.304709 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:03.304687 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf460999_eb58_4575_91fc_8130653c6f5b.slice/crio-e48496eee74d6ea325a564ecd8472abaf4d149c5926e60c654d7aeb745d26558 WatchSource:0}: Error finding container e48496eee74d6ea325a564ecd8472abaf4d149c5926e60c654d7aeb745d26558: Status 404 returned error can't find the container with id e48496eee74d6ea325a564ecd8472abaf4d149c5926e60c654d7aeb745d26558 Jul 03 15:13:03.574844 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.574815 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret\") pod \"global-pull-secret-syncer-9df89\" (UID: \"37843d47-7c15-44ce-b3af-54b536ace36f\") " pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:03.575035 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.574855 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs\") pod \"network-metrics-daemon-chpm2\" (UID: \"a9e3ec89-82d9-45ae-a945-4318350c2074\") " pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:03.575035 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.574892 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzqkc\" (UniqueName: \"kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc\") pod \"network-check-target-gtq6v\" (UID: \"1e8f757a-bb70-43d0-be0c-ba0863018f52\") " pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:03.575035 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:03.575014 2532 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 15:13:03.575035 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:03.575021 2532 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 15:13:03.575243 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:03.575040 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 15:13:03.575243 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:03.575060 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 15:13:03.575243 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:03.575074 2532 projected.go:196] Error preparing data for projected volume kube-api-access-fzqkc for pod openshift-network-diagnostics/network-check-target-gtq6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 15:13:03.575243 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:03.575094 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs podName:a9e3ec89-82d9-45ae-a945-4318350c2074 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:04.57507127 +0000 UTC m=+3.158095098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs") pod "network-metrics-daemon-chpm2" (UID: "a9e3ec89-82d9-45ae-a945-4318350c2074") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 15:13:03.575243 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:03.575118 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc podName:1e8f757a-bb70-43d0-be0c-ba0863018f52 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:04.575101408 +0000 UTC m=+3.158125216 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzqkc" (UniqueName: "kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc") pod "network-check-target-gtq6v" (UID: "1e8f757a-bb70-43d0-be0c-ba0863018f52") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 15:13:03.575243 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:03.575138 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret podName:37843d47-7c15-44ce-b3af-54b536ace36f nodeName:}" failed. No retries permitted until 2026-07-03 15:13:04.575128496 +0000 UTC m=+3.158152306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret") pod "global-pull-secret-syncer-9df89" (UID: "37843d47-7c15-44ce-b3af-54b536ace36f") : object "kube-system"/"original-pull-secret" not registered Jul 03 15:13:03.902197 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.902019 2532 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 15:08:03 +0000 UTC" deadline="2028-03-03 10:22:16.496590899 +0000 UTC" Jul 03 15:13:03.902197 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:03.902082 2532 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14611h9m12.59451419s" Jul 03 15:13:04.013601 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:04.013570 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:04.013799 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:04.013705 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9df89" podUID="37843d47-7c15-44ce-b3af-54b536ace36f" Jul 03 15:13:04.039400 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:04.039285 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lnx8q" event={"ID":"a8e7b01d-06ca-45f9-9516-e6e059981672","Type":"ContainerStarted","Data":"566fb676122d3c023f0051c706a29a61b5220f922401b7a589ddd9a0963d6980"} Jul 03 15:13:04.052240 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:04.052188 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rpqwz" event={"ID":"f2d8e1ee-2726-48a1-a016-01e11e8f02bf","Type":"ContainerStarted","Data":"0be046d99e69ffd2a8d827a9181929e046b4b6249060f4ca4b615f94107b3611"} Jul 03 15:13:04.068747 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:04.068641 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t2bpm" event={"ID":"ec11eac5-ac9d-4153-9d00-dc510d6988ac","Type":"ContainerStarted","Data":"23639bc3d812cfd9a624cd45eaed04965555ad0ea3b32fb92b5cd6f7769add4d"} Jul 03 15:13:04.078294 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:04.078130 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" event={"ID":"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5","Type":"ContainerStarted","Data":"9a86e2a569db5516d7b75dac022b5ca83521c09a89e1b4b63eb01aa7accd5e3f"} Jul 03 15:13:04.084878 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:04.084269 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nl55n" event={"ID":"c8200bbb-db4c-4118-b9b6-451401a16fd0","Type":"ContainerStarted","Data":"f383a20cd12e69e303a972314bfe1a6747630a3daeae571e27bfbf87179d0458"} Jul 03 15:13:04.094971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:04.094942 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7pwdd" event={"ID":"c481e3d5-ae74-4023-9633-aaeb93addb3a","Type":"ContainerStarted","Data":"295fd0104f93a1d9ec25603987723c338732e5f2bc1a50de81ed8cb4ce869327"} Jul 03 15:13:04.098142 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:04.098110 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" event={"ID":"a6da9f69-ee8a-4fa5-ad51-82997ae029f9","Type":"ContainerStarted","Data":"ab10b96caf302e4824cd6569f34853a816bee07ba7954835ba77dc311c5a60db"} Jul 03 15:13:04.104462 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:04.100798 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grc4q" event={"ID":"e41e9a11-9c6a-42d2-b73f-45707d71798b","Type":"ContainerStarted","Data":"ddc52f566c55ecc78180aa8db86dcd26d64a0d7045df7eeab41b2cd463ec6e57"} Jul 03 15:13:04.114325 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:04.114283 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-176.ec2.internal" event={"ID":"3555bbdadd92d8671a620ff24c1e02e8","Type":"ContainerStarted","Data":"fe9f6267a2732274ffc06980c45fb55921647902d41ead03661a7408ba0b9e23"} Jul 03 15:13:04.118220 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:04.117843 2532 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 15:13:04.122603 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:04.122575 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-176.ec2.internal" event={"ID":"73f560aa491ff61278bfb8d3807767ac","Type":"ContainerStarted","Data":"7edb3c54f024b6dd3f757b0c538b8ec3635d6fea77b44df20ae470d288d1af8f"} Jul 03 15:13:04.139480 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:04.139366 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" event={"ID":"df460999-eb58-4575-91fc-8130653c6f5b","Type":"ContainerStarted","Data":"e48496eee74d6ea325a564ecd8472abaf4d149c5926e60c654d7aeb745d26558"} Jul 03 15:13:04.585012 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:04.584968 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzqkc\" (UniqueName: \"kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc\") pod \"network-check-target-gtq6v\" (UID: \"1e8f757a-bb70-43d0-be0c-ba0863018f52\") " pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:04.585219 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:04.585055 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret\") pod \"global-pull-secret-syncer-9df89\" (UID: \"37843d47-7c15-44ce-b3af-54b536ace36f\") " pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:04.585219 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:04.585085 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs\") pod \"network-metrics-daemon-chpm2\" (UID: \"a9e3ec89-82d9-45ae-a945-4318350c2074\") " pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:04.585345 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:04.585222 2532 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 15:13:04.585345 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:04.585295 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs podName:a9e3ec89-82d9-45ae-a945-4318350c2074 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:06.585272488 +0000 UTC m=+5.168296300 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs") pod "network-metrics-daemon-chpm2" (UID: "a9e3ec89-82d9-45ae-a945-4318350c2074") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 15:13:04.585548 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:04.585531 2532 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 15:13:04.585623 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:04.585588 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret podName:37843d47-7c15-44ce-b3af-54b536ace36f nodeName:}" failed. No retries permitted until 2026-07-03 15:13:06.585571449 +0000 UTC m=+5.168595261 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret") pod "global-pull-secret-syncer-9df89" (UID: "37843d47-7c15-44ce-b3af-54b536ace36f") : object "kube-system"/"original-pull-secret" not registered Jul 03 15:13:04.585702 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:04.585677 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 15:13:04.585702 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:04.585696 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 15:13:04.585801 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:04.585710 2532 projected.go:196] Error preparing data for projected volume kube-api-access-fzqkc for pod openshift-network-diagnostics/network-check-target-gtq6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 15:13:04.585801 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:04.585746 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc podName:1e8f757a-bb70-43d0-be0c-ba0863018f52 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:06.585734743 +0000 UTC m=+5.168758553 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzqkc" (UniqueName: "kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc") pod "network-check-target-gtq6v" (UID: "1e8f757a-bb70-43d0-be0c-ba0863018f52") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 15:13:04.902716 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:04.902611 2532 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 15:08:03 +0000 UTC" deadline="2027-12-10 14:40:01.806219697 +0000 UTC" Jul 03 15:13:04.902716 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:04.902664 2532 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12599h26m56.903561019s" Jul 03 15:13:05.011411 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:05.011344 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:05.011608 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:05.011507 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chpm2" podUID="a9e3ec89-82d9-45ae-a945-4318350c2074" Jul 03 15:13:05.012065 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:05.011911 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:05.012065 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:05.012008 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtq6v" podUID="1e8f757a-bb70-43d0-be0c-ba0863018f52" Jul 03 15:13:05.490727 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:05.490463 2532 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 15:13:06.012030 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:06.011514 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:06.012030 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:06.011659 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9df89" podUID="37843d47-7c15-44ce-b3af-54b536ace36f" Jul 03 15:13:06.603173 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:06.603127 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret\") pod \"global-pull-secret-syncer-9df89\" (UID: \"37843d47-7c15-44ce-b3af-54b536ace36f\") " pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:06.603379 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:06.603189 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs\") pod \"network-metrics-daemon-chpm2\" (UID: \"a9e3ec89-82d9-45ae-a945-4318350c2074\") " pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:06.603379 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:06.603228 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzqkc\" (UniqueName: \"kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc\") pod \"network-check-target-gtq6v\" (UID: \"1e8f757a-bb70-43d0-be0c-ba0863018f52\") " pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:06.603379 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:06.603253 2532 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 15:13:06.603379 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:06.603316 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret podName:37843d47-7c15-44ce-b3af-54b536ace36f nodeName:}" failed. No retries permitted until 2026-07-03 15:13:10.60329906 +0000 UTC m=+9.186322871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret") pod "global-pull-secret-syncer-9df89" (UID: "37843d47-7c15-44ce-b3af-54b536ace36f") : object "kube-system"/"original-pull-secret" not registered Jul 03 15:13:06.603640 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:06.603474 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 15:13:06.603640 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:06.603503 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 15:13:06.603640 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:06.603518 2532 projected.go:196] Error preparing data for projected volume kube-api-access-fzqkc for pod openshift-network-diagnostics/network-check-target-gtq6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 15:13:06.603640 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:06.603572 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc podName:1e8f757a-bb70-43d0-be0c-ba0863018f52 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:10.603554022 +0000 UTC m=+9.186577856 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzqkc" (UniqueName: "kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc") pod "network-check-target-gtq6v" (UID: "1e8f757a-bb70-43d0-be0c-ba0863018f52") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 15:13:06.603854 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:06.603663 2532 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 15:13:06.603854 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:06.603701 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs podName:a9e3ec89-82d9-45ae-a945-4318350c2074 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:10.603688633 +0000 UTC m=+9.186712443 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs") pod "network-metrics-daemon-chpm2" (UID: "a9e3ec89-82d9-45ae-a945-4318350c2074") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 15:13:07.011043 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:07.010961 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:07.011212 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:07.011093 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtq6v" podUID="1e8f757a-bb70-43d0-be0c-ba0863018f52" Jul 03 15:13:07.011573 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:07.011550 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:07.011684 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:07.011666 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chpm2" podUID="a9e3ec89-82d9-45ae-a945-4318350c2074" Jul 03 15:13:08.012634 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:08.012596 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:08.013112 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:08.012732 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9df89" podUID="37843d47-7c15-44ce-b3af-54b536ace36f" Jul 03 15:13:09.011020 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:09.010972 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:09.011020 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:09.011018 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:09.011252 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:09.011106 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtq6v" podUID="1e8f757a-bb70-43d0-be0c-ba0863018f52" Jul 03 15:13:09.011617 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:09.011556 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chpm2" podUID="a9e3ec89-82d9-45ae-a945-4318350c2074" Jul 03 15:13:10.012785 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:10.012747 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:10.013264 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:10.012878 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9df89" podUID="37843d47-7c15-44ce-b3af-54b536ace36f" Jul 03 15:13:10.640555 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:10.640516 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret\") pod \"global-pull-secret-syncer-9df89\" (UID: \"37843d47-7c15-44ce-b3af-54b536ace36f\") " pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:10.640555 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:10.640562 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs\") pod \"network-metrics-daemon-chpm2\" (UID: \"a9e3ec89-82d9-45ae-a945-4318350c2074\") " pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:10.640820 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:10.640595 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzqkc\" (UniqueName: \"kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc\") pod \"network-check-target-gtq6v\" (UID: \"1e8f757a-bb70-43d0-be0c-ba0863018f52\") " pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:10.640820 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:10.640751 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 15:13:10.640820 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:10.640769 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 15:13:10.640820 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:10.640783 2532 projected.go:196] Error preparing data for projected volume kube-api-access-fzqkc for pod openshift-network-diagnostics/network-check-target-gtq6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 15:13:10.641011 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:10.640846 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc podName:1e8f757a-bb70-43d0-be0c-ba0863018f52 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:18.640825962 +0000 UTC m=+17.223849791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzqkc" (UniqueName: "kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc") pod "network-check-target-gtq6v" (UID: "1e8f757a-bb70-43d0-be0c-ba0863018f52") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 15:13:10.641253 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:10.641233 2532 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 15:13:10.641351 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:10.641292 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret podName:37843d47-7c15-44ce-b3af-54b536ace36f nodeName:}" failed. No retries permitted until 2026-07-03 15:13:18.641275532 +0000 UTC m=+17.224299359 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret") pod "global-pull-secret-syncer-9df89" (UID: "37843d47-7c15-44ce-b3af-54b536ace36f") : object "kube-system"/"original-pull-secret" not registered Jul 03 15:13:10.641430 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:10.641355 2532 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 15:13:10.641430 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:10.641391 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs podName:a9e3ec89-82d9-45ae-a945-4318350c2074 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:18.64137831 +0000 UTC m=+17.224402136 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs") pod "network-metrics-daemon-chpm2" (UID: "a9e3ec89-82d9-45ae-a945-4318350c2074") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 15:13:11.011627 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:11.011509 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:11.011627 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:11.011569 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:11.011858 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:11.011644 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chpm2" podUID="a9e3ec89-82d9-45ae-a945-4318350c2074" Jul 03 15:13:11.011858 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:11.011780 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtq6v" podUID="1e8f757a-bb70-43d0-be0c-ba0863018f52" Jul 03 15:13:12.012607 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:12.012569 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:12.013062 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:12.012679 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9df89" podUID="37843d47-7c15-44ce-b3af-54b536ace36f" Jul 03 15:13:13.010767 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:13.010691 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:13.010913 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:13.010795 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtq6v" podUID="1e8f757a-bb70-43d0-be0c-ba0863018f52" Jul 03 15:13:13.011169 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:13.011148 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:13.011251 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:13.011237 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chpm2" podUID="a9e3ec89-82d9-45ae-a945-4318350c2074" Jul 03 15:13:14.011607 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:14.011572 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:14.012039 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:14.011700 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9df89" podUID="37843d47-7c15-44ce-b3af-54b536ace36f" Jul 03 15:13:15.010859 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:15.010822 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:15.011041 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:15.010831 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:15.011041 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:15.010932 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtq6v" podUID="1e8f757a-bb70-43d0-be0c-ba0863018f52" Jul 03 15:13:15.011131 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:15.011047 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chpm2" podUID="a9e3ec89-82d9-45ae-a945-4318350c2074" Jul 03 15:13:16.011100 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:16.011067 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:16.011531 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:16.011187 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9df89" podUID="37843d47-7c15-44ce-b3af-54b536ace36f" Jul 03 15:13:17.011671 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:17.011639 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:17.011671 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:17.011678 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:17.012136 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:17.011781 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtq6v" podUID="1e8f757a-bb70-43d0-be0c-ba0863018f52" Jul 03 15:13:17.012136 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:17.011886 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chpm2" podUID="a9e3ec89-82d9-45ae-a945-4318350c2074" Jul 03 15:13:18.014272 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:18.014238 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:18.014750 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:18.014362 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9df89" podUID="37843d47-7c15-44ce-b3af-54b536ace36f" Jul 03 15:13:18.705428 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:18.705395 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret\") pod \"global-pull-secret-syncer-9df89\" (UID: \"37843d47-7c15-44ce-b3af-54b536ace36f\") " pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:18.705428 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:18.705428 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs\") pod \"network-metrics-daemon-chpm2\" (UID: \"a9e3ec89-82d9-45ae-a945-4318350c2074\") " pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:18.705710 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:18.705453 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzqkc\" (UniqueName: \"kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc\") pod \"network-check-target-gtq6v\" (UID: \"1e8f757a-bb70-43d0-be0c-ba0863018f52\") " pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:18.705710 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:18.705543 2532 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 15:13:18.705710 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:18.705550 2532 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 15:13:18.705710 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:18.705565 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 15:13:18.705710 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:18.705580 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 15:13:18.705710 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:18.705591 2532 projected.go:196] Error preparing data for projected volume kube-api-access-fzqkc for pod openshift-network-diagnostics/network-check-target-gtq6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 15:13:18.705710 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:18.705600 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret podName:37843d47-7c15-44ce-b3af-54b536ace36f nodeName:}" failed. No retries permitted until 2026-07-03 15:13:34.705584796 +0000 UTC m=+33.288608603 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret") pod "global-pull-secret-syncer-9df89" (UID: "37843d47-7c15-44ce-b3af-54b536ace36f") : object "kube-system"/"original-pull-secret" not registered Jul 03 15:13:18.705710 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:18.705621 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs podName:a9e3ec89-82d9-45ae-a945-4318350c2074 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:34.705611404 +0000 UTC m=+33.288635216 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs") pod "network-metrics-daemon-chpm2" (UID: "a9e3ec89-82d9-45ae-a945-4318350c2074") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 15:13:18.705710 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:18.705632 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc podName:1e8f757a-bb70-43d0-be0c-ba0863018f52 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:34.705626693 +0000 UTC m=+33.288650499 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzqkc" (UniqueName: "kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc") pod "network-check-target-gtq6v" (UID: "1e8f757a-bb70-43d0-be0c-ba0863018f52") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 15:13:19.011180 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:19.011102 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:19.011180 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:19.011143 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:19.011432 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:19.011235 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtq6v" podUID="1e8f757a-bb70-43d0-be0c-ba0863018f52" Jul 03 15:13:19.011432 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:19.011358 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chpm2" podUID="a9e3ec89-82d9-45ae-a945-4318350c2074" Jul 03 15:13:20.011018 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:20.010993 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:20.011577 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:20.011097 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9df89" podUID="37843d47-7c15-44ce-b3af-54b536ace36f" Jul 03 15:13:21.011125 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:21.011095 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:21.011575 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:21.011095 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:21.011575 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:21.011213 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chpm2" podUID="a9e3ec89-82d9-45ae-a945-4318350c2074" Jul 03 15:13:21.011575 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:21.011300 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtq6v" podUID="1e8f757a-bb70-43d0-be0c-ba0863018f52" Jul 03 15:13:22.012245 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:22.012205 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:22.012674 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:22.012322 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9df89" podUID="37843d47-7c15-44ce-b3af-54b536ace36f" Jul 03 15:13:23.011388 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:23.011343 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:23.011557 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:23.011496 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chpm2" podUID="a9e3ec89-82d9-45ae-a945-4318350c2074" Jul 03 15:13:23.011611 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:23.011559 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:23.011671 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:23.011645 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtq6v" podUID="1e8f757a-bb70-43d0-be0c-ba0863018f52" Jul 03 15:13:24.010823 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:24.010799 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:24.011114 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:24.010887 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9df89" podUID="37843d47-7c15-44ce-b3af-54b536ace36f" Jul 03 15:13:24.215760 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:24.215728 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" event={"ID":"a6da9f69-ee8a-4fa5-ad51-82997ae029f9","Type":"ContainerStarted","Data":"9a37bb17cbeade9851e48dba9d0e4c08a2ef277634623f1112fcb46169d9646e"} Jul 03 15:13:24.217629 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:24.217605 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-176.ec2.internal" event={"ID":"3555bbdadd92d8671a620ff24c1e02e8","Type":"ContainerStarted","Data":"6fdf90d5dd659a1be77d198beb18efe760d3b5c56177cb5e6eb518df8bd2a2c5"} Jul 03 15:13:25.010964 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:25.010749 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:25.011817 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:25.010788 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:25.011817 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:25.010999 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chpm2" podUID="a9e3ec89-82d9-45ae-a945-4318350c2074" Jul 03 15:13:25.011817 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:25.011084 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtq6v" podUID="1e8f757a-bb70-43d0-be0c-ba0863018f52" Jul 03 15:13:25.221918 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:25.221893 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5hcn_df460999-eb58-4575-91fc-8130653c6f5b/ovn-acl-logging/0.log" Jul 03 15:13:25.222257 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:25.222236 2532 generic.go:356] "Generic (PLEG): container finished" podID="df460999-eb58-4575-91fc-8130653c6f5b" containerID="da24c270a256b68bf9625f11c8240aa3a7be8eb3a682afb1a171d06397127fa0" exitCode=1 Jul 03 15:13:25.222322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:25.222305 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" event={"ID":"df460999-eb58-4575-91fc-8130653c6f5b","Type":"ContainerStarted","Data":"995b646933950ff03d5b941fcf2f8619e6ac45f83e948ed3f2d19dedbae0a2a6"} Jul 03 15:13:25.222387 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:25.222360 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" event={"ID":"df460999-eb58-4575-91fc-8130653c6f5b","Type":"ContainerStarted","Data":"d2c1ad1e163b4a470bd4ddb21dc2eb705a28f03403149f9470de5e9da177b6b0"} Jul 03 15:13:25.222447 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:25.222412 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" event={"ID":"df460999-eb58-4575-91fc-8130653c6f5b","Type":"ContainerStarted","Data":"2a17bb83c74afe7d79e8ae43907294a0a720a4af94372843b0509fc0dcad45c2"} Jul 03 15:13:25.222566 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:25.222451 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" event={"ID":"df460999-eb58-4575-91fc-8130653c6f5b","Type":"ContainerStarted","Data":"ab6ad536277f2a3bfa76b86626d050509dc1bc68c2be7af1dbfc85a38735f9bb"} Jul 03 15:13:25.222566 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:25.222486 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" event={"ID":"df460999-eb58-4575-91fc-8130653c6f5b","Type":"ContainerDied","Data":"da24c270a256b68bf9625f11c8240aa3a7be8eb3a682afb1a171d06397127fa0"} Jul 03 15:13:25.222566 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:25.222522 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" event={"ID":"df460999-eb58-4575-91fc-8130653c6f5b","Type":"ContainerStarted","Data":"54ab3568c0d6ff432f4a8a2ef7e5c3e095f9072616793d9b6f1f4229c1a28048"} Jul 03 15:13:25.223845 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:25.223820 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lnx8q" event={"ID":"a8e7b01d-06ca-45f9-9516-e6e059981672","Type":"ContainerStarted","Data":"0fb94c31d1059e35904dad95c203a580eaf6a0ca742b2a8b049db3810ad4f668"} Jul 03 15:13:25.246265 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:25.246221 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lnx8q" podStartSLOduration=2.419641867 podStartE2EDuration="23.246208198s" totalImagesPullingTime="20.826566331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:25.246044276 +0000 UTC m=+23.829068104" watchObservedRunningTime="2026-07-03 15:13:25.246208198 +0000 UTC m=+23.829232053" Jul 03 15:13:25.264786 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:25.264715 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4qw9k" podStartSLOduration=2.452076206 podStartE2EDuration="23.264703687s" totalImagesPullingTime="20.812627481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:25.264298581 +0000 UTC m=+23.847322409" watchObservedRunningTime="2026-07-03 15:13:25.264703687 +0000 UTC m=+23.847727537" Jul 03 15:13:25.276978 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:25.276943 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-176.ec2.internal" podStartSLOduration=22.276932137 podStartE2EDuration="22.276932137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:25.276743107 +0000 UTC m=+23.859766936" watchObservedRunningTime="2026-07-03 15:13:25.276932137 +0000 UTC m=+23.859955965" Jul 03 15:13:26.010910 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:26.010724 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:26.011135 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:26.011017 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9df89" podUID="37843d47-7c15-44ce-b3af-54b536ace36f" Jul 03 15:13:26.227644 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:26.227608 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t2bpm" event={"ID":"ec11eac5-ac9d-4153-9d00-dc510d6988ac","Type":"ContainerStarted","Data":"8899370b00eca393d85bad72df7337a6fb2f4aa2c69a3080fdb12b4cced6de96"} Jul 03 15:13:26.229178 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:26.229152 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" event={"ID":"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5","Type":"ContainerStarted","Data":"7466c0d0e592a510b14ceb57e133a5d868a01a6ac96900e691bdcdfc218b4256"} Jul 03 15:13:26.230508 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:26.230486 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nl55n" event={"ID":"c8200bbb-db4c-4118-b9b6-451401a16fd0","Type":"ContainerStarted","Data":"cf0744902f3ee6a300ff6a18353e581033936c70edc42ce86858038b5e53b787"} Jul 03 15:13:26.231833 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:26.231793 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7pwdd" event={"ID":"c481e3d5-ae74-4023-9633-aaeb93addb3a","Type":"ContainerStarted","Data":"c42195081afd69c0b039cce6a290bec7fc2e8264de58d97751af9d54dffc4dff"} Jul 03 15:13:26.233541 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:26.233518 2532 generic.go:356] "Generic (PLEG): container finished" podID="e41e9a11-9c6a-42d2-b73f-45707d71798b" containerID="2f13d3872a625a989f344c0ff662595862fe33056b00ad9e1be94a1ad376bdf5" exitCode=0 Jul 03 15:13:26.233641 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:26.233599 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grc4q" event={"ID":"e41e9a11-9c6a-42d2-b73f-45707d71798b","Type":"ContainerDied","Data":"2f13d3872a625a989f344c0ff662595862fe33056b00ad9e1be94a1ad376bdf5"} Jul 03 15:13:26.235241 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:26.235218 2532 generic.go:356] "Generic (PLEG): container finished" podID="73f560aa491ff61278bfb8d3807767ac" containerID="7317297d1069cfbd13bab9d5928aed19ee36e2434ea2884dfc3bb6e280d1c19c" exitCode=0 Jul 03 15:13:26.235334 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:26.235293 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-176.ec2.internal" event={"ID":"73f560aa491ff61278bfb8d3807767ac","Type":"ContainerDied","Data":"7317297d1069cfbd13bab9d5928aed19ee36e2434ea2884dfc3bb6e280d1c19c"} Jul 03 15:13:26.236886 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:26.236861 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rpqwz" event={"ID":"f2d8e1ee-2726-48a1-a016-01e11e8f02bf","Type":"ContainerStarted","Data":"6c2cb2742b2eca72d07c4e5defc5cbb3fb5f757af86922c203948a2a02c73314"} Jul 03 15:13:26.245472 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:26.245435 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-t2bpm" podStartSLOduration=3.390993183 podStartE2EDuration="24.245422234s" totalImagesPullingTime="20.854429051s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:26.244949738 +0000 UTC m=+24.827973568" watchObservedRunningTime="2026-07-03 15:13:26.245422234 +0000 UTC m=+24.828446062" Jul 03 15:13:26.278660 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:26.278569 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rpqwz" podStartSLOduration=7.480619012 podStartE2EDuration="24.278553253s" totalImagesPullingTime="16.797934241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:26.278513839 +0000 UTC m=+24.861537667" watchObservedRunningTime="2026-07-03 15:13:26.278553253 +0000 UTC m=+24.861577081" Jul 03 15:13:26.292063 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:26.292024 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7pwdd" podStartSLOduration=3.498338383 podStartE2EDuration="24.292011502s" totalImagesPullingTime="20.793673119s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:26.291755425 +0000 UTC m=+24.874779255" watchObservedRunningTime="2026-07-03 15:13:26.292011502 +0000 UTC m=+24.875035336" Jul 03 15:13:26.320075 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:26.320027 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nl55n" podStartSLOduration=7.589778763 podStartE2EDuration="24.320009657s" totalImagesPullingTime="16.730230894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:26.306525754 +0000 UTC m=+24.889549584" watchObservedRunningTime="2026-07-03 15:13:26.320009657 +0000 UTC m=+24.903033487" Jul 03 15:13:26.609525 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:26.609501 2532 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 03 15:13:26.921553 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:26.921468 2532 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-03T15:13:26.60952121Z","UUID":"abeb427d-972e-4c31-9dca-80e88ddd3069","Handler":null,"Name":"","Endpoint":""} Jul 03 15:13:26.923161 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:26.923137 2532 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 03 15:13:26.923270 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:26.923188 2532 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 03 15:13:27.011663 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:27.011629 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:27.011663 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:27.011656 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:27.012053 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:27.011759 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtq6v" podUID="1e8f757a-bb70-43d0-be0c-ba0863018f52" Jul 03 15:13:27.012053 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:27.011861 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chpm2" podUID="a9e3ec89-82d9-45ae-a945-4318350c2074" Jul 03 15:13:27.241708 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:27.241636 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" event={"ID":"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5","Type":"ContainerStarted","Data":"c40096e9d2ed6453b77c4ae2f19c2071be9499bafa52d7a01b7640a177089040"} Jul 03 15:13:27.243594 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:27.243568 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-176.ec2.internal" event={"ID":"73f560aa491ff61278bfb8d3807767ac","Type":"ContainerStarted","Data":"09dc09d5c326cd147f96fe6db959eed3feff4c1e0ddb207152ddd64bd8e8fed8"} Jul 03 15:13:27.246984 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:27.246959 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5hcn_df460999-eb58-4575-91fc-8130653c6f5b/ovn-acl-logging/0.log" Jul 03 15:13:27.247861 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:27.247525 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" event={"ID":"df460999-eb58-4575-91fc-8130653c6f5b","Type":"ContainerStarted","Data":"61de2e7173c361c85de1de0fede392d32384e8206279a80f918c55f6abec8a87"} Jul 03 15:13:28.011773 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:28.011555 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:28.012203 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:28.011862 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9df89" podUID="37843d47-7c15-44ce-b3af-54b536ace36f" Jul 03 15:13:28.252238 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:28.252157 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" event={"ID":"a3096b4d-2e2e-4297-88a8-1b4db7fe67c5","Type":"ContainerStarted","Data":"658562fb1e71785befff06c74f4cf7e1f77a1d1c8263ece75ef18979873f74b8"} Jul 03 15:13:28.270183 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:28.270145 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjptg" podStartSLOduration=3.240711385 podStartE2EDuration="26.270131379s" totalImagesPullingTime="23.029419994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:28.270099605 +0000 UTC m=+26.853123434" watchObservedRunningTime="2026-07-03 15:13:28.270131379 +0000 UTC m=+26.853155186" Jul 03 15:13:28.270690 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:28.270662 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-176.ec2.internal" podStartSLOduration=25.270656337 podStartE2EDuration="25.270656337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:27.257245092 +0000 UTC m=+25.840268920" watchObservedRunningTime="2026-07-03 15:13:28.270656337 +0000 UTC m=+26.853680163" Jul 03 15:13:28.595636 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:28.595609 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nl55n" Jul 03 15:13:28.596241 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:28.596226 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nl55n" Jul 03 15:13:29.011334 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:29.011316 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:29.011449 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:29.011316 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:29.011449 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:29.011431 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chpm2" podUID="a9e3ec89-82d9-45ae-a945-4318350c2074" Jul 03 15:13:29.011533 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:29.011482 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtq6v" podUID="1e8f757a-bb70-43d0-be0c-ba0863018f52" Jul 03 15:13:29.258324 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:29.258257 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5hcn_df460999-eb58-4575-91fc-8130653c6f5b/ovn-acl-logging/0.log" Jul 03 15:13:29.259044 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:29.258661 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" event={"ID":"df460999-eb58-4575-91fc-8130653c6f5b","Type":"ContainerStarted","Data":"ea0a102dbfc2bc3df3851ec73e95ec2c193a8f2c274e642b7d8d0072c9305aaa"} Jul 03 15:13:29.259166 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:29.259146 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nl55n" Jul 03 15:13:29.259204 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:29.259171 2532 scope.go:117] "RemoveContainer" containerID="da24c270a256b68bf9625f11c8240aa3a7be8eb3a682afb1a171d06397127fa0" Jul 03 15:13:29.259204 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:29.259201 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:29.259606 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:29.259592 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nl55n" Jul 03 15:13:30.011694 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:30.011456 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:30.011867 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:30.011797 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9df89" podUID="37843d47-7c15-44ce-b3af-54b536ace36f" Jul 03 15:13:30.265958 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:30.265810 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5hcn_df460999-eb58-4575-91fc-8130653c6f5b/ovn-acl-logging/0.log" Jul 03 15:13:30.267233 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:30.267200 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" event={"ID":"df460999-eb58-4575-91fc-8130653c6f5b","Type":"ContainerStarted","Data":"633b29819de70821754e697f9130c46b9601039befc1c22af37289aae27c1e0d"} Jul 03 15:13:30.267401 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:30.267357 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:30.267588 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:30.267569 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:30.293389 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:30.293285 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:30.294473 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:30.294436 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:13:30.300825 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:30.300777 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" podStartSLOduration=6.429269143 podStartE2EDuration="27.30075701s" totalImagesPullingTime="20.871487867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:30.298814012 +0000 UTC m=+28.881837842" watchObservedRunningTime="2026-07-03 15:13:30.30075701 +0000 UTC m=+28.883780841" Jul 03 15:13:31.011141 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:31.011110 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:31.011316 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:31.011229 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtq6v" podUID="1e8f757a-bb70-43d0-be0c-ba0863018f52" Jul 03 15:13:31.011585 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:31.011125 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:31.011752 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:31.011729 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chpm2" podUID="a9e3ec89-82d9-45ae-a945-4318350c2074" Jul 03 15:13:31.269149 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:31.267119 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9df89"] Jul 03 15:13:31.269149 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:31.267292 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:31.269149 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:31.267452 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9df89" podUID="37843d47-7c15-44ce-b3af-54b536ace36f" Jul 03 15:13:31.271153 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:31.271123 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gtq6v"] Jul 03 15:13:31.271851 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:31.271820 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-chpm2"] Jul 03 15:13:31.271939 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:31.271892 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:31.271939 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:31.271915 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:31.272037 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:31.271991 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtq6v" podUID="1e8f757a-bb70-43d0-be0c-ba0863018f52" Jul 03 15:13:31.272131 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:31.272090 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chpm2" podUID="a9e3ec89-82d9-45ae-a945-4318350c2074" Jul 03 15:13:32.274875 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:32.274796 2532 generic.go:356] "Generic (PLEG): container finished" podID="e41e9a11-9c6a-42d2-b73f-45707d71798b" containerID="b030621d9f3d4b1aea0a4be3819adc26962b4605dcbbd9200cc6ddc449e38e2c" exitCode=0 Jul 03 15:13:32.274875 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:32.274857 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grc4q" event={"ID":"e41e9a11-9c6a-42d2-b73f-45707d71798b","Type":"ContainerDied","Data":"b030621d9f3d4b1aea0a4be3819adc26962b4605dcbbd9200cc6ddc449e38e2c"} Jul 03 15:13:33.011677 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:33.011610 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:33.011881 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:33.011726 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:33.011881 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:33.011729 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtq6v" podUID="1e8f757a-bb70-43d0-be0c-ba0863018f52" Jul 03 15:13:33.011881 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:33.011784 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:33.012052 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:33.011895 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chpm2" podUID="a9e3ec89-82d9-45ae-a945-4318350c2074" Jul 03 15:13:33.012052 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:33.011976 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9df89" podUID="37843d47-7c15-44ce-b3af-54b536ace36f" Jul 03 15:13:34.281589 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:34.281416 2532 generic.go:356] "Generic (PLEG): container finished" podID="e41e9a11-9c6a-42d2-b73f-45707d71798b" containerID="098f0d4c8df47a828c8ee40a0bde925163c93057688870979485f27b87587978" exitCode=0 Jul 03 15:13:34.281589 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:34.281496 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grc4q" event={"ID":"e41e9a11-9c6a-42d2-b73f-45707d71798b","Type":"ContainerDied","Data":"098f0d4c8df47a828c8ee40a0bde925163c93057688870979485f27b87587978"} Jul 03 15:13:34.727531 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:34.727501 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret\") pod \"global-pull-secret-syncer-9df89\" (UID: \"37843d47-7c15-44ce-b3af-54b536ace36f\") " pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:34.727531 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:34.727539 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs\") pod \"network-metrics-daemon-chpm2\" (UID: \"a9e3ec89-82d9-45ae-a945-4318350c2074\") " pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:34.727784 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:34.727654 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzqkc\" (UniqueName: \"kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc\") pod \"network-check-target-gtq6v\" (UID: \"1e8f757a-bb70-43d0-be0c-ba0863018f52\") " pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:34.727784 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:34.727689 2532 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 15:13:34.727784 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:34.727749 2532 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 15:13:34.727784 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:34.727766 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret podName:37843d47-7c15-44ce-b3af-54b536ace36f nodeName:}" failed. No retries permitted until 2026-07-03 15:14:06.727745564 +0000 UTC m=+65.310769373 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret") pod "global-pull-secret-syncer-9df89" (UID: "37843d47-7c15-44ce-b3af-54b536ace36f") : object "kube-system"/"original-pull-secret" not registered Jul 03 15:13:34.727930 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:34.727792 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 15:13:34.727930 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:34.727811 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs podName:a9e3ec89-82d9-45ae-a945-4318350c2074 nodeName:}" failed. No retries permitted until 2026-07-03 15:14:06.727796029 +0000 UTC m=+65.310819837 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs") pod "network-metrics-daemon-chpm2" (UID: "a9e3ec89-82d9-45ae-a945-4318350c2074") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 15:13:34.727930 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:34.727820 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 15:13:34.727930 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:34.727833 2532 projected.go:196] Error preparing data for projected volume kube-api-access-fzqkc for pod openshift-network-diagnostics/network-check-target-gtq6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 15:13:34.727930 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:34.727869 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc podName:1e8f757a-bb70-43d0-be0c-ba0863018f52 nodeName:}" failed. No retries permitted until 2026-07-03 15:14:06.72785888 +0000 UTC m=+65.310882715 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzqkc" (UniqueName: "kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc") pod "network-check-target-gtq6v" (UID: "1e8f757a-bb70-43d0-be0c-ba0863018f52") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 15:13:35.010841 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:35.010772 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:35.010963 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:35.010772 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:35.011018 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:35.010980 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9df89" podUID="37843d47-7c15-44ce-b3af-54b536ace36f" Jul 03 15:13:35.011018 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:35.010870 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtq6v" podUID="1e8f757a-bb70-43d0-be0c-ba0863018f52" Jul 03 15:13:35.011018 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:35.010772 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:35.011206 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:35.011087 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chpm2" podUID="a9e3ec89-82d9-45ae-a945-4318350c2074" Jul 03 15:13:35.285537 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:35.285454 2532 generic.go:356] "Generic (PLEG): container finished" podID="e41e9a11-9c6a-42d2-b73f-45707d71798b" containerID="760716e48127e1a4b19005686ed4878a1c8ab9e9e461dbb25ebe735b4007edeb" exitCode=0 Jul 03 15:13:35.285537 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:35.285519 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grc4q" event={"ID":"e41e9a11-9c6a-42d2-b73f-45707d71798b","Type":"ContainerDied","Data":"760716e48127e1a4b19005686ed4878a1c8ab9e9e461dbb25ebe735b4007edeb"} Jul 03 15:13:37.011053 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.011023 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:37.011631 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.011018 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:37.011631 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.011147 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chpm2" podUID="a9e3ec89-82d9-45ae-a945-4318350c2074" Jul 03 15:13:37.011631 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.011183 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:37.011631 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.011278 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtq6v" podUID="1e8f757a-bb70-43d0-be0c-ba0863018f52" Jul 03 15:13:37.011631 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.011336 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9df89" podUID="37843d47-7c15-44ce-b3af-54b536ace36f" Jul 03 15:13:37.185655 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.185592 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-176.ec2.internal" event="NodeReady" Jul 03 15:13:37.185826 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.185728 2532 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 03 15:13:37.225286 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.225251 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65b9b77fcb-fj8hl"] Jul 03 15:13:37.228342 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.228266 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.228888 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.228836 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-bc6b7cdc9-l5w6c"] Jul 03 15:13:37.230853 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.230815 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-vfv7v"] Jul 03 15:13:37.231006 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.230894 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ppp7b\"" Jul 03 15:13:37.231006 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.230949 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:37.231229 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.231198 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 03 15:13:37.231578 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.231563 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 03 15:13:37.231876 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.231719 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 03 15:13:37.232910 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.232764 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb"] Jul 03 15:13:37.233052 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.233017 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" Jul 03 15:13:37.233904 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.233883 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 03 15:13:37.234492 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.234472 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-st29z"] Jul 03 15:13:37.234597 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.234580 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb" Jul 03 15:13:37.236225 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.236205 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-srbsr"] Jul 03 15:13:37.236323 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.236308 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-st29z" Jul 03 15:13:37.236756 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.236733 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 03 15:13:37.237988 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.237968 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 03 15:13:37.238072 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.238016 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jxkx5"] Jul 03 15:13:37.238130 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.238081 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 03 15:13:37.238184 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.237968 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 03 15:13:37.238341 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.238326 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xbvnt\"" Jul 03 15:13:37.238423 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.238417 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 03 15:13:37.238541 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.238525 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 03 15:13:37.238541 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.238536 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 03 15:13:37.238767 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.238750 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-srbsr" Jul 03 15:13:37.239074 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.238756 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 03 15:13:37.239074 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.238879 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 03 15:13:37.239993 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.239576 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ws42c\"" Jul 03 15:13:37.239993 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.239607 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 03 15:13:37.239993 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.239615 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pf7lv"] Jul 03 15:13:37.239993 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.239848 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jxkx5" Jul 03 15:13:37.240562 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.240438 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-297zl\"" Jul 03 15:13:37.240660 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.240647 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 03 15:13:37.240908 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.240789 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 03 15:13:37.241009 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.240989 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9l2ls\"" Jul 03 15:13:37.241106 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.241055 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 03 15:13:37.241184 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.241135 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 03 15:13:37.241184 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.241147 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 03 15:13:37.242050 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.242025 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5ffwp"] Jul 03 15:13:37.242473 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.242314 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pf7lv" Jul 03 15:13:37.255420 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.247782 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 03 15:13:37.255420 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.248088 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 03 15:13:37.255420 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.248221 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 03 15:13:37.255420 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.248755 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 03 15:13:37.255420 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.248790 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 03 15:13:37.255420 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.248825 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6mxfj\"" Jul 03 15:13:37.255420 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.248839 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 03 15:13:37.255420 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.248843 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5ffwp" Jul 03 15:13:37.255420 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.248867 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 03 15:13:37.255420 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.248984 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 03 15:13:37.255420 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.252721 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 03 15:13:37.255420 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.249131 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-n5mf9\"" Jul 03 15:13:37.255420 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.249227 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 03 15:13:37.255420 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.249160 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-llpkd\"" Jul 03 15:13:37.255420 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.249486 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 03 15:13:37.255420 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.249918 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-vfv7v"] Jul 03 15:13:37.255420 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.252951 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65b9b77fcb-fj8hl"] Jul 03 15:13:37.255420 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.249018 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 03 15:13:37.257061 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.257039 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 03 15:13:37.257347 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.257244 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bc6b7cdc9-l5w6c"] Jul 03 15:13:37.258654 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.258637 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-st29z"] Jul 03 15:13:37.260844 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.259764 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 03 15:13:37.260844 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.259915 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8xf8p\"" Jul 03 15:13:37.261099 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.261011 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 03 15:13:37.261258 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.261237 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 03 15:13:37.261501 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.261484 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 03 15:13:37.262109 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.262089 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5wr4p"] Jul 03 15:13:37.264357 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.264337 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 03 15:13:37.265388 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.265350 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb"] Jul 03 15:13:37.265470 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.265400 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d5frg"] Jul 03 15:13:37.265470 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.265449 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5wr4p" Jul 03 15:13:37.267044 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.267028 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-fm5jm"] Jul 03 15:13:37.267148 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.267134 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d5frg" Jul 03 15:13:37.269144 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.269072 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w99m5\"" Jul 03 15:13:37.269248 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.269233 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 03 15:13:37.269415 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.269399 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 03 15:13:37.269538 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.269522 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 03 15:13:37.269614 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.269552 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 03 15:13:37.269691 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.269673 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-srbsr"] Jul 03 15:13:37.269767 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.269710 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pf7lv"] Jul 03 15:13:37.269767 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.269738 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5ffwp"] Jul 03 15:13:37.269767 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.269757 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-fm5jm"] Jul 03 15:13:37.269864 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.269819 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fm5jm" Jul 03 15:13:37.270540 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.270514 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dft5m\"" Jul 03 15:13:37.271770 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.271234 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 03 15:13:37.274052 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.274028 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d5frg"] Jul 03 15:13:37.274226 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.274184 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-f6vx6\"" Jul 03 15:13:37.274604 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.274586 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 03 15:13:37.274810 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.274787 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 03 15:13:37.277120 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.277084 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jxkx5"] Jul 03 15:13:37.278731 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.278712 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5wr4p"] Jul 03 15:13:37.349198 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349174 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqr65\" (UniqueName: \"kubernetes.io/projected/c0f2ef42-f6dd-4604-99dd-9a5292e6c645-kube-api-access-zqr65\") pod \"volume-data-source-validator-5d456fdbcd-st29z\" (UID: \"c0f2ef42-f6dd-4604-99dd-9a5292e6c645\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-st29z" Jul 03 15:13:37.349384 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349204 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ea73c27-fbc5-4237-a642-c38f09af95a0-service-ca-bundle\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:37.349384 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349223 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0aed645-6d56-4068-ad5b-fa581068b316-image-registry-private-configuration\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.349384 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349240 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0aed645-6d56-4068-ad5b-fa581068b316-trusted-ca\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.349384 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349261 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-bound-sa-token\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.349384 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349313 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-metrics-certs\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:37.349384 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349338 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-284jg\" (UniqueName: \"kubernetes.io/projected/de92b340-37d1-4df2-867c-09b1d0da425c-kube-api-access-284jg\") pod \"cluster-samples-operator-56fcf86bf-pf7lv\" (UID: \"de92b340-37d1-4df2-867c-09b1d0da425c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pf7lv" Jul 03 15:13:37.349384 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349355 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cd66668-0c47-4f2a-9997-20b41987392c-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-vfv7v\" (UID: \"1cd66668-0c47-4f2a-9997-20b41987392c\") " pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" Jul 03 15:13:37.349957 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349399 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1cd66668-0c47-4f2a-9997-20b41987392c-serving-cert\") pod \"insights-operator-5c847dcfc4-vfv7v\" (UID: \"1cd66668-0c47-4f2a-9997-20b41987392c\") " pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" Jul 03 15:13:37.349957 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349438 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs2jd\" (UniqueName: \"kubernetes.io/projected/25da0080-177d-4f5e-a476-ca1bd2066ca0-kube-api-access-rs2jd\") pod \"kube-storage-version-migrator-operator-846bf668f7-jxkx5\" (UID: \"25da0080-177d-4f5e-a476-ca1bd2066ca0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jxkx5" Jul 03 15:13:37.349957 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349464 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.349957 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349488 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp7gs\" (UniqueName: \"kubernetes.io/projected/00b62b2c-dffe-4879-98e6-41c8ba914d63-kube-api-access-wp7gs\") pod \"console-operator-68b757fb67-srbsr\" (UID: \"00b62b2c-dffe-4879-98e6-41c8ba914d63\") " pod="openshift-console-operator/console-operator-68b757fb67-srbsr" Jul 03 15:13:37.349957 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349511 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0aed645-6d56-4068-ad5b-fa581068b316-installation-pull-secrets\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.349957 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349535 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cd66668-0c47-4f2a-9997-20b41987392c-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-vfv7v\" (UID: \"1cd66668-0c47-4f2a-9997-20b41987392c\") " pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" Jul 03 15:13:37.349957 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349581 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmq4r\" (UniqueName: \"kubernetes.io/projected/5f4d2407-8aa3-4a18-9b68-e50f2bab4663-kube-api-access-xmq4r\") pod \"service-ca-operator-5d46d9ffd4-5ffwp\" (UID: \"5f4d2407-8aa3-4a18-9b68-e50f2bab4663\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5ffwp" Jul 03 15:13:37.349957 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349618 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de92b340-37d1-4df2-867c-09b1d0da425c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-pf7lv\" (UID: \"de92b340-37d1-4df2-867c-09b1d0da425c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pf7lv" Jul 03 15:13:37.349957 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349641 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8mm6\" (UniqueName: \"kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-kube-api-access-n8mm6\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.349957 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349689 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-stats-auth\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:37.349957 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349743 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00b62b2c-dffe-4879-98e6-41c8ba914d63-serving-cert\") pod \"console-operator-68b757fb67-srbsr\" (UID: \"00b62b2c-dffe-4879-98e6-41c8ba914d63\") " pod="openshift-console-operator/console-operator-68b757fb67-srbsr" Jul 03 15:13:37.349957 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349774 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-default-certificate\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:37.349957 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349804 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sqtg\" (UniqueName: \"kubernetes.io/projected/1cd66668-0c47-4f2a-9997-20b41987392c-kube-api-access-2sqtg\") pod \"insights-operator-5c847dcfc4-vfv7v\" (UID: \"1cd66668-0c47-4f2a-9997-20b41987392c\") " pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" Jul 03 15:13:37.349957 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349828 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54z6l\" (UniqueName: \"kubernetes.io/projected/3ea73c27-fbc5-4237-a642-c38f09af95a0-kube-api-access-54z6l\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:37.349957 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349853 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f4d2407-8aa3-4a18-9b68-e50f2bab4663-config\") pod \"service-ca-operator-5d46d9ffd4-5ffwp\" (UID: \"5f4d2407-8aa3-4a18-9b68-e50f2bab4663\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5ffwp" Jul 03 15:13:37.350534 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349879 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/531cd3e1-eb3e-4443-b988-209c350ae15c-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-x8ftb\" (UID: \"531cd3e1-eb3e-4443-b988-209c350ae15c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb" Jul 03 15:13:37.350534 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349933 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cd66668-0c47-4f2a-9997-20b41987392c-tmp\") pod \"insights-operator-5c847dcfc4-vfv7v\" (UID: \"1cd66668-0c47-4f2a-9997-20b41987392c\") " pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" Jul 03 15:13:37.350534 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349961 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/25da0080-177d-4f5e-a476-ca1bd2066ca0-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-jxkx5\" (UID: \"25da0080-177d-4f5e-a476-ca1bd2066ca0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jxkx5" Jul 03 15:13:37.350534 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.349984 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/25da0080-177d-4f5e-a476-ca1bd2066ca0-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-jxkx5\" (UID: \"25da0080-177d-4f5e-a476-ca1bd2066ca0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jxkx5" Jul 03 15:13:37.350534 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.350007 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f4d2407-8aa3-4a18-9b68-e50f2bab4663-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-5ffwp\" (UID: \"5f4d2407-8aa3-4a18-9b68-e50f2bab4663\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5ffwp" Jul 03 15:13:37.350534 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.350063 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccltz\" (UniqueName: \"kubernetes.io/projected/531cd3e1-eb3e-4443-b988-209c350ae15c-kube-api-access-ccltz\") pod \"cluster-monitoring-operator-64786d9cbb-x8ftb\" (UID: \"531cd3e1-eb3e-4443-b988-209c350ae15c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb" Jul 03 15:13:37.350534 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.350110 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1cd66668-0c47-4f2a-9997-20b41987392c-snapshots\") pod \"insights-operator-5c847dcfc4-vfv7v\" (UID: \"1cd66668-0c47-4f2a-9997-20b41987392c\") " pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" Jul 03 15:13:37.350534 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.350134 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0aed645-6d56-4068-ad5b-fa581068b316-registry-certificates\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.350534 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.350165 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/00b62b2c-dffe-4879-98e6-41c8ba914d63-config\") pod \"console-operator-68b757fb67-srbsr\" (UID: \"00b62b2c-dffe-4879-98e6-41c8ba914d63\") " pod="openshift-console-operator/console-operator-68b757fb67-srbsr" Jul 03 15:13:37.350534 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.350213 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/531cd3e1-eb3e-4443-b988-209c350ae15c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x8ftb\" (UID: \"531cd3e1-eb3e-4443-b988-209c350ae15c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb" Jul 03 15:13:37.350534 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.350238 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00b62b2c-dffe-4879-98e6-41c8ba914d63-trusted-ca\") pod \"console-operator-68b757fb67-srbsr\" (UID: \"00b62b2c-dffe-4879-98e6-41c8ba914d63\") " pod="openshift-console-operator/console-operator-68b757fb67-srbsr" Jul 03 15:13:37.350534 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.350266 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0aed645-6d56-4068-ad5b-fa581068b316-ca-trust-extracted\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.399019 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.398976 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:37.450883 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.450804 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1cd66668-0c47-4f2a-9997-20b41987392c-snapshots\") pod \"insights-operator-5c847dcfc4-vfv7v\" (UID: \"1cd66668-0c47-4f2a-9997-20b41987392c\") " pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" Jul 03 15:13:37.450883 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.450845 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d825134a-e7de-4199-a8db-36d954270785-metrics-tls\") pod \"dns-default-5wr4p\" (UID: \"d825134a-e7de-4199-a8db-36d954270785\") " pod="openshift-dns/dns-default-5wr4p" Jul 03 15:13:37.450883 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.450861 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wlcb\" (UniqueName: \"kubernetes.io/projected/d825134a-e7de-4199-a8db-36d954270785-kube-api-access-5wlcb\") pod \"dns-default-5wr4p\" (UID: \"d825134a-e7de-4199-a8db-36d954270785\") " pod="openshift-dns/dns-default-5wr4p" Jul 03 15:13:37.450883 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.450883 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0aed645-6d56-4068-ad5b-fa581068b316-registry-certificates\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.451125 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.450964 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/00b62b2c-dffe-4879-98e6-41c8ba914d63-config\") pod \"console-operator-68b757fb67-srbsr\" (UID: \"00b62b2c-dffe-4879-98e6-41c8ba914d63\") " pod="openshift-console-operator/console-operator-68b757fb67-srbsr" Jul 03 15:13:37.451125 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.450996 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5wjf\" (UniqueName: \"kubernetes.io/projected/33cb2d20-c735-4eb3-827e-e3aad2ae24bb-kube-api-access-q5wjf\") pod \"ingress-canary-d5frg\" (UID: \"33cb2d20-c735-4eb3-827e-e3aad2ae24bb\") " pod="openshift-ingress-canary/ingress-canary-d5frg" Jul 03 15:13:37.451125 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.451029 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/531cd3e1-eb3e-4443-b988-209c350ae15c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x8ftb\" (UID: \"531cd3e1-eb3e-4443-b988-209c350ae15c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb" Jul 03 15:13:37.451125 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.451057 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00b62b2c-dffe-4879-98e6-41c8ba914d63-trusted-ca\") pod \"console-operator-68b757fb67-srbsr\" (UID: \"00b62b2c-dffe-4879-98e6-41c8ba914d63\") " pod="openshift-console-operator/console-operator-68b757fb67-srbsr" Jul 03 15:13:37.451125 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.451076 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0aed645-6d56-4068-ad5b-fa581068b316-ca-trust-extracted\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.451285 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.451095 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqr65\" (UniqueName: \"kubernetes.io/projected/c0f2ef42-f6dd-4604-99dd-9a5292e6c645-kube-api-access-zqr65\") pod \"volume-data-source-validator-5d456fdbcd-st29z\" (UID: \"c0f2ef42-f6dd-4604-99dd-9a5292e6c645\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-st29z" Jul 03 15:13:37.451285 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.451167 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ea73c27-fbc5-4237-a642-c38f09af95a0-service-ca-bundle\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:37.451285 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.451189 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0aed645-6d56-4068-ad5b-fa581068b316-image-registry-private-configuration\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.451285 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.451205 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0aed645-6d56-4068-ad5b-fa581068b316-trusted-ca\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.451285 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.451232 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-bound-sa-token\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.451285 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.451274 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-metrics-certs\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:37.451548 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.451301 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d825134a-e7de-4199-a8db-36d954270785-config-volume\") pod \"dns-default-5wr4p\" (UID: \"d825134a-e7de-4199-a8db-36d954270785\") " pod="openshift-dns/dns-default-5wr4p" Jul 03 15:13:37.451548 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.451336 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-284jg\" (UniqueName: \"kubernetes.io/projected/de92b340-37d1-4df2-867c-09b1d0da425c-kube-api-access-284jg\") pod \"cluster-samples-operator-56fcf86bf-pf7lv\" (UID: \"de92b340-37d1-4df2-867c-09b1d0da425c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pf7lv" Jul 03 15:13:37.451548 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.451361 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cd66668-0c47-4f2a-9997-20b41987392c-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-vfv7v\" (UID: \"1cd66668-0c47-4f2a-9997-20b41987392c\") " pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" Jul 03 15:13:37.451548 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.451403 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1cd66668-0c47-4f2a-9997-20b41987392c-serving-cert\") pod \"insights-operator-5c847dcfc4-vfv7v\" (UID: \"1cd66668-0c47-4f2a-9997-20b41987392c\") " pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" Jul 03 15:13:37.451548 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.451438 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0aed645-6d56-4068-ad5b-fa581068b316-registry-certificates\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.451548 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.451446 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs2jd\" (UniqueName: \"kubernetes.io/projected/25da0080-177d-4f5e-a476-ca1bd2066ca0-kube-api-access-rs2jd\") pod \"kube-storage-version-migrator-operator-846bf668f7-jxkx5\" (UID: \"25da0080-177d-4f5e-a476-ca1bd2066ca0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jxkx5" Jul 03 15:13:37.451548 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.451470 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.451548 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.451540 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1cd66668-0c47-4f2a-9997-20b41987392c-snapshots\") pod \"insights-operator-5c847dcfc4-vfv7v\" (UID: \"1cd66668-0c47-4f2a-9997-20b41987392c\") " pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" Jul 03 15:13:37.451804 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.451548 2532 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 15:13:37.451843 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.451819 2532 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65b9b77fcb-fj8hl: secret "image-registry-tls" not found Jul 03 15:13:37.451876 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.451867 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls podName:d0aed645-6d56-4068-ad5b-fa581068b316 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:37.951854478 +0000 UTC m=+36.534878284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls") pod "image-registry-65b9b77fcb-fj8hl" (UID: "d0aed645-6d56-4068-ad5b-fa581068b316") : secret "image-registry-tls" not found Jul 03 15:13:37.452188 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.452167 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cd66668-0c47-4f2a-9997-20b41987392c-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-vfv7v\" (UID: \"1cd66668-0c47-4f2a-9997-20b41987392c\") " pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" Jul 03 15:13:37.452420 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.451609 2532 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 15:13:37.452528 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.452462 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-metrics-certs podName:3ea73c27-fbc5-4237-a642-c38f09af95a0 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:37.952440427 +0000 UTC m=+36.535464248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-metrics-certs") pod "router-default-bc6b7cdc9-l5w6c" (UID: "3ea73c27-fbc5-4237-a642-c38f09af95a0") : secret "router-metrics-certs-default" not found Jul 03 15:13:37.452835 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.452802 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0aed645-6d56-4068-ad5b-fa581068b316-trusted-ca\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.452932 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.452847 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp7gs\" (UniqueName: \"kubernetes.io/projected/00b62b2c-dffe-4879-98e6-41c8ba914d63-kube-api-access-wp7gs\") pod \"console-operator-68b757fb67-srbsr\" (UID: \"00b62b2c-dffe-4879-98e6-41c8ba914d63\") " pod="openshift-console-operator/console-operator-68b757fb67-srbsr" Jul 03 15:13:37.452932 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.452880 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0aed645-6d56-4068-ad5b-fa581068b316-installation-pull-secrets\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.452932 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.452905 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d825134a-e7de-4199-a8db-36d954270785-tmp-dir\") pod \"dns-default-5wr4p\" (UID: \"d825134a-e7de-4199-a8db-36d954270785\") " pod="openshift-dns/dns-default-5wr4p" Jul 03 15:13:37.453079 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.452936 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cd66668-0c47-4f2a-9997-20b41987392c-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-vfv7v\" (UID: \"1cd66668-0c47-4f2a-9997-20b41987392c\") " pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" Jul 03 15:13:37.453079 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.452965 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmq4r\" (UniqueName: \"kubernetes.io/projected/5f4d2407-8aa3-4a18-9b68-e50f2bab4663-kube-api-access-xmq4r\") pod \"service-ca-operator-5d46d9ffd4-5ffwp\" (UID: \"5f4d2407-8aa3-4a18-9b68-e50f2bab4663\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5ffwp" Jul 03 15:13:37.453079 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.452993 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de92b340-37d1-4df2-867c-09b1d0da425c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-pf7lv\" (UID: \"de92b340-37d1-4df2-867c-09b1d0da425c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pf7lv" Jul 03 15:13:37.453079 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.453016 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4w6f\" (UniqueName: \"kubernetes.io/projected/010c59dc-3916-4fd8-9ddf-2fc0821bf924-kube-api-access-n4w6f\") pod \"network-check-source-989f8b8dc-fm5jm\" (UID: \"010c59dc-3916-4fd8-9ddf-2fc0821bf924\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fm5jm" Jul 03 15:13:37.453079 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.453036 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33cb2d20-c735-4eb3-827e-e3aad2ae24bb-cert\") pod \"ingress-canary-d5frg\" (UID: \"33cb2d20-c735-4eb3-827e-e3aad2ae24bb\") " pod="openshift-ingress-canary/ingress-canary-d5frg" Jul 03 15:13:37.453079 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.453061 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8mm6\" (UniqueName: \"kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-kube-api-access-n8mm6\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.453388 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.453097 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-stats-auth\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:37.453388 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.453119 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00b62b2c-dffe-4879-98e6-41c8ba914d63-serving-cert\") pod \"console-operator-68b757fb67-srbsr\" (UID: \"00b62b2c-dffe-4879-98e6-41c8ba914d63\") " pod="openshift-console-operator/console-operator-68b757fb67-srbsr" Jul 03 15:13:37.453388 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.453138 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-default-certificate\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:37.453388 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.453164 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sqtg\" (UniqueName: \"kubernetes.io/projected/1cd66668-0c47-4f2a-9997-20b41987392c-kube-api-access-2sqtg\") pod \"insights-operator-5c847dcfc4-vfv7v\" (UID: \"1cd66668-0c47-4f2a-9997-20b41987392c\") " pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" Jul 03 15:13:37.453388 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.453184 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54z6l\" (UniqueName: \"kubernetes.io/projected/3ea73c27-fbc5-4237-a642-c38f09af95a0-kube-api-access-54z6l\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:37.453388 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.453208 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f4d2407-8aa3-4a18-9b68-e50f2bab4663-config\") pod \"service-ca-operator-5d46d9ffd4-5ffwp\" (UID: \"5f4d2407-8aa3-4a18-9b68-e50f2bab4663\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5ffwp" Jul 03 15:13:37.453388 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.453239 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/531cd3e1-eb3e-4443-b988-209c350ae15c-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-x8ftb\" (UID: \"531cd3e1-eb3e-4443-b988-209c350ae15c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb" Jul 03 15:13:37.453388 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.453270 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/00b62b2c-dffe-4879-98e6-41c8ba914d63-config\") pod \"console-operator-68b757fb67-srbsr\" (UID: \"00b62b2c-dffe-4879-98e6-41c8ba914d63\") " pod="openshift-console-operator/console-operator-68b757fb67-srbsr" Jul 03 15:13:37.453388 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.453280 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cd66668-0c47-4f2a-9997-20b41987392c-tmp\") pod \"insights-operator-5c847dcfc4-vfv7v\" (UID: \"1cd66668-0c47-4f2a-9997-20b41987392c\") " pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" Jul 03 15:13:37.453388 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.453303 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3ea73c27-fbc5-4237-a642-c38f09af95a0-service-ca-bundle podName:3ea73c27-fbc5-4237-a642-c38f09af95a0 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:37.953287743 +0000 UTC m=+36.536311552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3ea73c27-fbc5-4237-a642-c38f09af95a0-service-ca-bundle") pod "router-default-bc6b7cdc9-l5w6c" (UID: "3ea73c27-fbc5-4237-a642-c38f09af95a0") : configmap references non-existent config key: service-ca.crt Jul 03 15:13:37.453864 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.453444 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00b62b2c-dffe-4879-98e6-41c8ba914d63-trusted-ca\") pod \"console-operator-68b757fb67-srbsr\" (UID: \"00b62b2c-dffe-4879-98e6-41c8ba914d63\") " pod="openshift-console-operator/console-operator-68b757fb67-srbsr" Jul 03 15:13:37.453864 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.453540 2532 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 03 15:13:37.453864 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.453738 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cd66668-0c47-4f2a-9997-20b41987392c-tmp\") pod \"insights-operator-5c847dcfc4-vfv7v\" (UID: \"1cd66668-0c47-4f2a-9997-20b41987392c\") " pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" Jul 03 15:13:37.453864 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.453772 2532 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 15:13:37.454038 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.453208 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0aed645-6d56-4068-ad5b-fa581068b316-ca-trust-extracted\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.454385 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.454339 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f4d2407-8aa3-4a18-9b68-e50f2bab4663-config\") pod \"service-ca-operator-5d46d9ffd4-5ffwp\" (UID: \"5f4d2407-8aa3-4a18-9b68-e50f2bab4663\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5ffwp" Jul 03 15:13:37.454720 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.454693 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/531cd3e1-eb3e-4443-b988-209c350ae15c-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-x8ftb\" (UID: \"531cd3e1-eb3e-4443-b988-209c350ae15c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb" Jul 03 15:13:37.454814 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.454772 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/531cd3e1-eb3e-4443-b988-209c350ae15c-cluster-monitoring-operator-tls podName:531cd3e1-eb3e-4443-b988-209c350ae15c nodeName:}" failed. No retries permitted until 2026-07-03 15:13:37.954752968 +0000 UTC m=+36.537776778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/531cd3e1-eb3e-4443-b988-209c350ae15c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-x8ftb" (UID: "531cd3e1-eb3e-4443-b988-209c350ae15c") : secret "cluster-monitoring-operator-tls" not found Jul 03 15:13:37.454814 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.454797 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de92b340-37d1-4df2-867c-09b1d0da425c-samples-operator-tls podName:de92b340-37d1-4df2-867c-09b1d0da425c nodeName:}" failed. No retries permitted until 2026-07-03 15:13:37.95478807 +0000 UTC m=+36.537811892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de92b340-37d1-4df2-867c-09b1d0da425c-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-pf7lv" (UID: "de92b340-37d1-4df2-867c-09b1d0da425c") : secret "samples-operator-tls" not found Jul 03 15:13:37.454922 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.454833 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/25da0080-177d-4f5e-a476-ca1bd2066ca0-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-jxkx5\" (UID: \"25da0080-177d-4f5e-a476-ca1bd2066ca0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jxkx5" Jul 03 15:13:37.454922 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.454861 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/25da0080-177d-4f5e-a476-ca1bd2066ca0-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-jxkx5\" (UID: \"25da0080-177d-4f5e-a476-ca1bd2066ca0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jxkx5" Jul 03 15:13:37.454922 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.454885 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f4d2407-8aa3-4a18-9b68-e50f2bab4663-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-5ffwp\" (UID: \"5f4d2407-8aa3-4a18-9b68-e50f2bab4663\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5ffwp" Jul 03 15:13:37.454922 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.454917 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccltz\" (UniqueName: \"kubernetes.io/projected/531cd3e1-eb3e-4443-b988-209c350ae15c-kube-api-access-ccltz\") pod \"cluster-monitoring-operator-64786d9cbb-x8ftb\" (UID: \"531cd3e1-eb3e-4443-b988-209c350ae15c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb" Jul 03 15:13:37.455095 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.454977 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cd66668-0c47-4f2a-9997-20b41987392c-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-vfv7v\" (UID: \"1cd66668-0c47-4f2a-9997-20b41987392c\") " pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" Jul 03 15:13:37.455557 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.455537 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/25da0080-177d-4f5e-a476-ca1bd2066ca0-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-jxkx5\" (UID: \"25da0080-177d-4f5e-a476-ca1bd2066ca0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jxkx5" Jul 03 15:13:37.456757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.456708 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0aed645-6d56-4068-ad5b-fa581068b316-installation-pull-secrets\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.456842 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.456711 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0aed645-6d56-4068-ad5b-fa581068b316-image-registry-private-configuration\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.457092 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.457066 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1cd66668-0c47-4f2a-9997-20b41987392c-serving-cert\") pod \"insights-operator-5c847dcfc4-vfv7v\" (UID: \"1cd66668-0c47-4f2a-9997-20b41987392c\") " pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" Jul 03 15:13:37.457980 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.457923 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-default-certificate\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:37.458172 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.458150 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/25da0080-177d-4f5e-a476-ca1bd2066ca0-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-jxkx5\" (UID: \"25da0080-177d-4f5e-a476-ca1bd2066ca0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jxkx5" Jul 03 15:13:37.458321 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.458300 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f4d2407-8aa3-4a18-9b68-e50f2bab4663-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-5ffwp\" (UID: \"5f4d2407-8aa3-4a18-9b68-e50f2bab4663\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5ffwp" Jul 03 15:13:37.458752 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.458732 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00b62b2c-dffe-4879-98e6-41c8ba914d63-serving-cert\") pod \"console-operator-68b757fb67-srbsr\" (UID: \"00b62b2c-dffe-4879-98e6-41c8ba914d63\") " pod="openshift-console-operator/console-operator-68b757fb67-srbsr" Jul 03 15:13:37.458841 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.458736 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-stats-auth\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:37.461792 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.461755 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-bound-sa-token\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.462584 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.462224 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs2jd\" (UniqueName: \"kubernetes.io/projected/25da0080-177d-4f5e-a476-ca1bd2066ca0-kube-api-access-rs2jd\") pod \"kube-storage-version-migrator-operator-846bf668f7-jxkx5\" (UID: \"25da0080-177d-4f5e-a476-ca1bd2066ca0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jxkx5" Jul 03 15:13:37.463354 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.463318 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8mm6\" (UniqueName: \"kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-kube-api-access-n8mm6\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.463981 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.463960 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqr65\" (UniqueName: \"kubernetes.io/projected/c0f2ef42-f6dd-4604-99dd-9a5292e6c645-kube-api-access-zqr65\") pod \"volume-data-source-validator-5d456fdbcd-st29z\" (UID: \"c0f2ef42-f6dd-4604-99dd-9a5292e6c645\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-st29z" Jul 03 15:13:37.464975 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.464950 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-284jg\" (UniqueName: \"kubernetes.io/projected/de92b340-37d1-4df2-867c-09b1d0da425c-kube-api-access-284jg\") pod \"cluster-samples-operator-56fcf86bf-pf7lv\" (UID: \"de92b340-37d1-4df2-867c-09b1d0da425c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pf7lv" Jul 03 15:13:37.465675 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.465619 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccltz\" (UniqueName: \"kubernetes.io/projected/531cd3e1-eb3e-4443-b988-209c350ae15c-kube-api-access-ccltz\") pod \"cluster-monitoring-operator-64786d9cbb-x8ftb\" (UID: \"531cd3e1-eb3e-4443-b988-209c350ae15c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb" Jul 03 15:13:37.465675 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.465625 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp7gs\" (UniqueName: \"kubernetes.io/projected/00b62b2c-dffe-4879-98e6-41c8ba914d63-kube-api-access-wp7gs\") pod \"console-operator-68b757fb67-srbsr\" (UID: \"00b62b2c-dffe-4879-98e6-41c8ba914d63\") " pod="openshift-console-operator/console-operator-68b757fb67-srbsr" Jul 03 15:13:37.466805 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.466783 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmq4r\" (UniqueName: \"kubernetes.io/projected/5f4d2407-8aa3-4a18-9b68-e50f2bab4663-kube-api-access-xmq4r\") pod \"service-ca-operator-5d46d9ffd4-5ffwp\" (UID: \"5f4d2407-8aa3-4a18-9b68-e50f2bab4663\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5ffwp" Jul 03 15:13:37.466942 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.466928 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54z6l\" (UniqueName: \"kubernetes.io/projected/3ea73c27-fbc5-4237-a642-c38f09af95a0-kube-api-access-54z6l\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:37.467551 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.467532 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sqtg\" (UniqueName: \"kubernetes.io/projected/1cd66668-0c47-4f2a-9997-20b41987392c-kube-api-access-2sqtg\") pod \"insights-operator-5c847dcfc4-vfv7v\" (UID: \"1cd66668-0c47-4f2a-9997-20b41987392c\") " pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" Jul 03 15:13:37.487770 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.487746 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:37.555994 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.555960 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5wjf\" (UniqueName: \"kubernetes.io/projected/33cb2d20-c735-4eb3-827e-e3aad2ae24bb-kube-api-access-q5wjf\") pod \"ingress-canary-d5frg\" (UID: \"33cb2d20-c735-4eb3-827e-e3aad2ae24bb\") " pod="openshift-ingress-canary/ingress-canary-d5frg" Jul 03 15:13:37.556112 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.556071 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d825134a-e7de-4199-a8db-36d954270785-config-volume\") pod \"dns-default-5wr4p\" (UID: \"d825134a-e7de-4199-a8db-36d954270785\") " pod="openshift-dns/dns-default-5wr4p" Jul 03 15:13:37.556159 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.556133 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d825134a-e7de-4199-a8db-36d954270785-tmp-dir\") pod \"dns-default-5wr4p\" (UID: \"d825134a-e7de-4199-a8db-36d954270785\") " pod="openshift-dns/dns-default-5wr4p" Jul 03 15:13:37.556204 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.556180 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4w6f\" (UniqueName: \"kubernetes.io/projected/010c59dc-3916-4fd8-9ddf-2fc0821bf924-kube-api-access-n4w6f\") pod \"network-check-source-989f8b8dc-fm5jm\" (UID: \"010c59dc-3916-4fd8-9ddf-2fc0821bf924\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fm5jm" Jul 03 15:13:37.556259 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.556204 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33cb2d20-c735-4eb3-827e-e3aad2ae24bb-cert\") pod \"ingress-canary-d5frg\" (UID: \"33cb2d20-c735-4eb3-827e-e3aad2ae24bb\") " pod="openshift-ingress-canary/ingress-canary-d5frg" Jul 03 15:13:37.556302 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.556278 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d825134a-e7de-4199-a8db-36d954270785-metrics-tls\") pod \"dns-default-5wr4p\" (UID: \"d825134a-e7de-4199-a8db-36d954270785\") " pod="openshift-dns/dns-default-5wr4p" Jul 03 15:13:37.556746 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.556721 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wlcb\" (UniqueName: \"kubernetes.io/projected/d825134a-e7de-4199-a8db-36d954270785-kube-api-access-5wlcb\") pod \"dns-default-5wr4p\" (UID: \"d825134a-e7de-4199-a8db-36d954270785\") " pod="openshift-dns/dns-default-5wr4p" Jul 03 15:13:37.556885 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.556862 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d825134a-e7de-4199-a8db-36d954270785-tmp-dir\") pod \"dns-default-5wr4p\" (UID: \"d825134a-e7de-4199-a8db-36d954270785\") " pod="openshift-dns/dns-default-5wr4p" Jul 03 15:13:37.557080 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.557058 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d825134a-e7de-4199-a8db-36d954270785-config-volume\") pod \"dns-default-5wr4p\" (UID: \"d825134a-e7de-4199-a8db-36d954270785\") " pod="openshift-dns/dns-default-5wr4p" Jul 03 15:13:37.557279 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.557262 2532 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 15:13:37.557346 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.557331 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d825134a-e7de-4199-a8db-36d954270785-metrics-tls podName:d825134a-e7de-4199-a8db-36d954270785 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:38.05731353 +0000 UTC m=+36.640337342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d825134a-e7de-4199-a8db-36d954270785-metrics-tls") pod "dns-default-5wr4p" (UID: "d825134a-e7de-4199-a8db-36d954270785") : secret "dns-default-metrics-tls" not found Jul 03 15:13:37.559572 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.559551 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33cb2d20-c735-4eb3-827e-e3aad2ae24bb-cert\") pod \"ingress-canary-d5frg\" (UID: \"33cb2d20-c735-4eb3-827e-e3aad2ae24bb\") " pod="openshift-ingress-canary/ingress-canary-d5frg" Jul 03 15:13:37.566626 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.566604 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wlcb\" (UniqueName: \"kubernetes.io/projected/d825134a-e7de-4199-a8db-36d954270785-kube-api-access-5wlcb\") pod \"dns-default-5wr4p\" (UID: \"d825134a-e7de-4199-a8db-36d954270785\") " pod="openshift-dns/dns-default-5wr4p" Jul 03 15:13:37.567088 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.567065 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5wjf\" (UniqueName: \"kubernetes.io/projected/33cb2d20-c735-4eb3-827e-e3aad2ae24bb-kube-api-access-q5wjf\") pod \"ingress-canary-d5frg\" (UID: \"33cb2d20-c735-4eb3-827e-e3aad2ae24bb\") " pod="openshift-ingress-canary/ingress-canary-d5frg" Jul 03 15:13:37.567227 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.567158 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4w6f\" (UniqueName: \"kubernetes.io/projected/010c59dc-3916-4fd8-9ddf-2fc0821bf924-kube-api-access-n4w6f\") pod \"network-check-source-989f8b8dc-fm5jm\" (UID: \"010c59dc-3916-4fd8-9ddf-2fc0821bf924\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fm5jm" Jul 03 15:13:37.580143 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.580120 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" Jul 03 15:13:37.586359 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.586340 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-st29z" Jul 03 15:13:37.594156 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.594120 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-srbsr" Jul 03 15:13:37.597430 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.597409 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jxkx5" Jul 03 15:13:37.607899 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.607841 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5ffwp" Jul 03 15:13:37.618175 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.617970 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d5frg" Jul 03 15:13:37.622498 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.622471 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fm5jm" Jul 03 15:13:37.854872 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.854630 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-vfv7v"] Jul 03 15:13:37.858067 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.858039 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-srbsr"] Jul 03 15:13:37.859385 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.859340 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jxkx5"] Jul 03 15:13:37.861176 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.861100 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-st29z"] Jul 03 15:13:37.866447 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:37.866285 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cd66668_0c47_4f2a_9997_20b41987392c.slice/crio-6aaf129f0e627224f8b3497db3ccfbebc446c20d173740cc072836cfb9a3b3e5 WatchSource:0}: Error finding container 6aaf129f0e627224f8b3497db3ccfbebc446c20d173740cc072836cfb9a3b3e5: Status 404 returned error can't find the container with id 6aaf129f0e627224f8b3497db3ccfbebc446c20d173740cc072836cfb9a3b3e5 Jul 03 15:13:37.882302 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.882009 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-fm5jm"] Jul 03 15:13:37.883251 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.883226 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5ffwp"] Jul 03 15:13:37.887141 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:37.887118 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4d2407_8aa3_4a18_9b68_e50f2bab4663.slice/crio-d976e7fd97a2ca6efe2e24094b02566c9f0245d8d1b9ba9ebe32f2b1b25bb9e6 WatchSource:0}: Error finding container d976e7fd97a2ca6efe2e24094b02566c9f0245d8d1b9ba9ebe32f2b1b25bb9e6: Status 404 returned error can't find the container with id d976e7fd97a2ca6efe2e24094b02566c9f0245d8d1b9ba9ebe32f2b1b25bb9e6 Jul 03 15:13:37.887784 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:37.887760 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010c59dc_3916_4fd8_9ddf_2fc0821bf924.slice/crio-4dfd3f2cde9af22838af8372b9e5d26c3db8fac9cbc127448c810569128ccddb WatchSource:0}: Error finding container 4dfd3f2cde9af22838af8372b9e5d26c3db8fac9cbc127448c810569128ccddb: Status 404 returned error can't find the container with id 4dfd3f2cde9af22838af8372b9e5d26c3db8fac9cbc127448c810569128ccddb Jul 03 15:13:37.904092 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.904068 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d5frg"] Jul 03 15:13:37.906420 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:37.906391 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33cb2d20_c735_4eb3_827e_e3aad2ae24bb.slice/crio-3142fcf073c2f269b7afed49ddd283011c4fd145ebab5097f81a2724aa03a70d WatchSource:0}: Error finding container 3142fcf073c2f269b7afed49ddd283011c4fd145ebab5097f81a2724aa03a70d: Status 404 returned error can't find the container with id 3142fcf073c2f269b7afed49ddd283011c4fd145ebab5097f81a2724aa03a70d Jul 03 15:13:37.962360 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.962328 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/531cd3e1-eb3e-4443-b988-209c350ae15c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x8ftb\" (UID: \"531cd3e1-eb3e-4443-b988-209c350ae15c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb" Jul 03 15:13:37.962517 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.962394 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ea73c27-fbc5-4237-a642-c38f09af95a0-service-ca-bundle\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:37.962517 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.962451 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-metrics-certs\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:37.962517 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.962469 2532 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 03 15:13:37.962672 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.962544 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/531cd3e1-eb3e-4443-b988-209c350ae15c-cluster-monitoring-operator-tls podName:531cd3e1-eb3e-4443-b988-209c350ae15c nodeName:}" failed. No retries permitted until 2026-07-03 15:13:38.962522977 +0000 UTC m=+37.545546801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/531cd3e1-eb3e-4443-b988-209c350ae15c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-x8ftb" (UID: "531cd3e1-eb3e-4443-b988-209c350ae15c") : secret "cluster-monitoring-operator-tls" not found Jul 03 15:13:37.962672 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.962548 2532 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 15:13:37.962672 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.962578 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3ea73c27-fbc5-4237-a642-c38f09af95a0-service-ca-bundle podName:3ea73c27-fbc5-4237-a642-c38f09af95a0 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:38.962555689 +0000 UTC m=+37.545579507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3ea73c27-fbc5-4237-a642-c38f09af95a0-service-ca-bundle") pod "router-default-bc6b7cdc9-l5w6c" (UID: "3ea73c27-fbc5-4237-a642-c38f09af95a0") : configmap references non-existent config key: service-ca.crt Jul 03 15:13:37.962672 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.962621 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:37.962672 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:37.962667 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de92b340-37d1-4df2-867c-09b1d0da425c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-pf7lv\" (UID: \"de92b340-37d1-4df2-867c-09b1d0da425c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pf7lv" Jul 03 15:13:37.962904 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.962767 2532 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 15:13:37.962904 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.962804 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de92b340-37d1-4df2-867c-09b1d0da425c-samples-operator-tls podName:de92b340-37d1-4df2-867c-09b1d0da425c nodeName:}" failed. No retries permitted until 2026-07-03 15:13:38.962791682 +0000 UTC m=+37.545815503 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de92b340-37d1-4df2-867c-09b1d0da425c-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-pf7lv" (UID: "de92b340-37d1-4df2-867c-09b1d0da425c") : secret "samples-operator-tls" not found Jul 03 15:13:37.962904 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.962824 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-metrics-certs podName:3ea73c27-fbc5-4237-a642-c38f09af95a0 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:38.962815794 +0000 UTC m=+37.545839608 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-metrics-certs") pod "router-default-bc6b7cdc9-l5w6c" (UID: "3ea73c27-fbc5-4237-a642-c38f09af95a0") : secret "router-metrics-certs-default" not found Jul 03 15:13:37.962904 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.962882 2532 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 15:13:37.962904 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.962892 2532 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65b9b77fcb-fj8hl: secret "image-registry-tls" not found Jul 03 15:13:37.963078 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:37.962927 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls podName:d0aed645-6d56-4068-ad5b-fa581068b316 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:38.96291658 +0000 UTC m=+37.545940406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls") pod "image-registry-65b9b77fcb-fj8hl" (UID: "d0aed645-6d56-4068-ad5b-fa581068b316") : secret "image-registry-tls" not found Jul 03 15:13:38.063289 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:38.063222 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d825134a-e7de-4199-a8db-36d954270785-metrics-tls\") pod \"dns-default-5wr4p\" (UID: \"d825134a-e7de-4199-a8db-36d954270785\") " pod="openshift-dns/dns-default-5wr4p" Jul 03 15:13:38.063838 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:38.063393 2532 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 15:13:38.063838 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:38.063451 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d825134a-e7de-4199-a8db-36d954270785-metrics-tls podName:d825134a-e7de-4199-a8db-36d954270785 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:39.063435766 +0000 UTC m=+37.646459594 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d825134a-e7de-4199-a8db-36d954270785-metrics-tls") pod "dns-default-5wr4p" (UID: "d825134a-e7de-4199-a8db-36d954270785") : secret "dns-default-metrics-tls" not found Jul 03 15:13:38.294234 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:38.294199 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d5frg" event={"ID":"33cb2d20-c735-4eb3-827e-e3aad2ae24bb","Type":"ContainerStarted","Data":"3142fcf073c2f269b7afed49ddd283011c4fd145ebab5097f81a2724aa03a70d"} Jul 03 15:13:38.295263 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:38.295241 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5ffwp" event={"ID":"5f4d2407-8aa3-4a18-9b68-e50f2bab4663","Type":"ContainerStarted","Data":"d976e7fd97a2ca6efe2e24094b02566c9f0245d8d1b9ba9ebe32f2b1b25bb9e6"} Jul 03 15:13:38.296486 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:38.296456 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-st29z" event={"ID":"c0f2ef42-f6dd-4604-99dd-9a5292e6c645","Type":"ContainerStarted","Data":"9a00bf07e7ede918355cc41c486524526257c6463adb57715d61c8c36575a5a5"} Jul 03 15:13:38.297475 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:38.297455 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" event={"ID":"1cd66668-0c47-4f2a-9997-20b41987392c","Type":"ContainerStarted","Data":"6aaf129f0e627224f8b3497db3ccfbebc446c20d173740cc072836cfb9a3b3e5"} Jul 03 15:13:38.298637 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:38.298606 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fm5jm" event={"ID":"010c59dc-3916-4fd8-9ddf-2fc0821bf924","Type":"ContainerStarted","Data":"4dfd3f2cde9af22838af8372b9e5d26c3db8fac9cbc127448c810569128ccddb"} Jul 03 15:13:38.299872 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:38.299849 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jxkx5" event={"ID":"25da0080-177d-4f5e-a476-ca1bd2066ca0","Type":"ContainerStarted","Data":"ec06111d66771a587b08b674e235bd4ea22d2edecf9bc1c2e402b3c01edeb7b7"} Jul 03 15:13:38.301155 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:38.301130 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-srbsr" event={"ID":"00b62b2c-dffe-4879-98e6-41c8ba914d63","Type":"ContainerStarted","Data":"ce40e342d5f14e4f62b70837522ccb3ac31ae4044747359afe3f6ac3ee3fb05f"} Jul 03 15:13:38.575422 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:38.575388 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:38.651776 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:38.651678 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:38.717238 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:38.717137 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:38.972456 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:38.971266 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/531cd3e1-eb3e-4443-b988-209c350ae15c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x8ftb\" (UID: \"531cd3e1-eb3e-4443-b988-209c350ae15c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb" Jul 03 15:13:38.972456 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:38.971314 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ea73c27-fbc5-4237-a642-c38f09af95a0-service-ca-bundle\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:38.972456 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:38.971361 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-metrics-certs\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:38.972456 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:38.971436 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:38.972456 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:38.971473 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de92b340-37d1-4df2-867c-09b1d0da425c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-pf7lv\" (UID: \"de92b340-37d1-4df2-867c-09b1d0da425c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pf7lv" Jul 03 15:13:38.972456 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:38.971600 2532 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 15:13:38.972456 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:38.971666 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de92b340-37d1-4df2-867c-09b1d0da425c-samples-operator-tls podName:de92b340-37d1-4df2-867c-09b1d0da425c nodeName:}" failed. No retries permitted until 2026-07-03 15:13:40.97164643 +0000 UTC m=+39.554670259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de92b340-37d1-4df2-867c-09b1d0da425c-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-pf7lv" (UID: "de92b340-37d1-4df2-867c-09b1d0da425c") : secret "samples-operator-tls" not found Jul 03 15:13:38.972456 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:38.972055 2532 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 03 15:13:38.972456 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:38.972104 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/531cd3e1-eb3e-4443-b988-209c350ae15c-cluster-monitoring-operator-tls podName:531cd3e1-eb3e-4443-b988-209c350ae15c nodeName:}" failed. No retries permitted until 2026-07-03 15:13:40.972086561 +0000 UTC m=+39.555110375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/531cd3e1-eb3e-4443-b988-209c350ae15c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-x8ftb" (UID: "531cd3e1-eb3e-4443-b988-209c350ae15c") : secret "cluster-monitoring-operator-tls" not found Jul 03 15:13:38.972456 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:38.972172 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3ea73c27-fbc5-4237-a642-c38f09af95a0-service-ca-bundle podName:3ea73c27-fbc5-4237-a642-c38f09af95a0 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:40.972161864 +0000 UTC m=+39.555185673 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3ea73c27-fbc5-4237-a642-c38f09af95a0-service-ca-bundle") pod "router-default-bc6b7cdc9-l5w6c" (UID: "3ea73c27-fbc5-4237-a642-c38f09af95a0") : configmap references non-existent config key: service-ca.crt Jul 03 15:13:38.972456 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:38.972229 2532 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 15:13:38.972456 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:38.972258 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-metrics-certs podName:3ea73c27-fbc5-4237-a642-c38f09af95a0 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:40.972247741 +0000 UTC m=+39.555271551 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-metrics-certs") pod "router-default-bc6b7cdc9-l5w6c" (UID: "3ea73c27-fbc5-4237-a642-c38f09af95a0") : secret "router-metrics-certs-default" not found Jul 03 15:13:38.972456 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:38.972318 2532 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 15:13:38.972456 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:38.972329 2532 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65b9b77fcb-fj8hl: secret "image-registry-tls" not found Jul 03 15:13:38.972456 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:38.972358 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls podName:d0aed645-6d56-4068-ad5b-fa581068b316 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:40.972348279 +0000 UTC m=+39.555372090 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls") pod "image-registry-65b9b77fcb-fj8hl" (UID: "d0aed645-6d56-4068-ad5b-fa581068b316") : secret "image-registry-tls" not found Jul 03 15:13:39.012613 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:39.011126 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:13:39.012613 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:39.011587 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:13:39.012613 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:39.011976 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:13:39.016671 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:39.015737 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cq8c8\"" Jul 03 15:13:39.019478 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:39.017077 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 03 15:13:39.019478 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:39.017269 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9nf84\"" Jul 03 15:13:39.019478 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:39.017742 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 03 15:13:39.073319 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:39.073273 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d825134a-e7de-4199-a8db-36d954270785-metrics-tls\") pod \"dns-default-5wr4p\" (UID: \"d825134a-e7de-4199-a8db-36d954270785\") " pod="openshift-dns/dns-default-5wr4p" Jul 03 15:13:39.073714 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:39.073416 2532 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 15:13:39.073714 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:39.073499 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d825134a-e7de-4199-a8db-36d954270785-metrics-tls podName:d825134a-e7de-4199-a8db-36d954270785 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:41.073465902 +0000 UTC m=+39.656489714 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d825134a-e7de-4199-a8db-36d954270785-metrics-tls") pod "dns-default-5wr4p" (UID: "d825134a-e7de-4199-a8db-36d954270785") : secret "dns-default-metrics-tls" not found Jul 03 15:13:39.634012 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:39.633906 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:39.702499 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:39.702336 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:40.996060 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:40.995958 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-metrics-certs\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:40.996060 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:40.996033 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:40.996542 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:40.996074 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de92b340-37d1-4df2-867c-09b1d0da425c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-pf7lv\" (UID: \"de92b340-37d1-4df2-867c-09b1d0da425c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pf7lv" Jul 03 15:13:40.996542 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:40.996156 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/531cd3e1-eb3e-4443-b988-209c350ae15c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x8ftb\" (UID: \"531cd3e1-eb3e-4443-b988-209c350ae15c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb" Jul 03 15:13:40.996542 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:40.996159 2532 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 15:13:40.996542 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:40.996178 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ea73c27-fbc5-4237-a642-c38f09af95a0-service-ca-bundle\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:40.996542 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:40.996195 2532 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 15:13:40.996542 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:40.996215 2532 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65b9b77fcb-fj8hl: secret "image-registry-tls" not found Jul 03 15:13:40.996542 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:40.996238 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-metrics-certs podName:3ea73c27-fbc5-4237-a642-c38f09af95a0 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:44.996216741 +0000 UTC m=+43.579240552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-metrics-certs") pod "router-default-bc6b7cdc9-l5w6c" (UID: "3ea73c27-fbc5-4237-a642-c38f09af95a0") : secret "router-metrics-certs-default" not found Jul 03 15:13:40.996542 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:40.996268 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls podName:d0aed645-6d56-4068-ad5b-fa581068b316 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:44.996250236 +0000 UTC m=+43.579274047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls") pod "image-registry-65b9b77fcb-fj8hl" (UID: "d0aed645-6d56-4068-ad5b-fa581068b316") : secret "image-registry-tls" not found Jul 03 15:13:40.996542 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:40.996293 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3ea73c27-fbc5-4237-a642-c38f09af95a0-service-ca-bundle podName:3ea73c27-fbc5-4237-a642-c38f09af95a0 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:44.996278287 +0000 UTC m=+43.579302111 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3ea73c27-fbc5-4237-a642-c38f09af95a0-service-ca-bundle") pod "router-default-bc6b7cdc9-l5w6c" (UID: "3ea73c27-fbc5-4237-a642-c38f09af95a0") : configmap references non-existent config key: service-ca.crt Jul 03 15:13:40.996542 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:40.996329 2532 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 15:13:40.996542 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:40.996362 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de92b340-37d1-4df2-867c-09b1d0da425c-samples-operator-tls podName:de92b340-37d1-4df2-867c-09b1d0da425c nodeName:}" failed. No retries permitted until 2026-07-03 15:13:44.996351705 +0000 UTC m=+43.579375517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de92b340-37d1-4df2-867c-09b1d0da425c-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-pf7lv" (UID: "de92b340-37d1-4df2-867c-09b1d0da425c") : secret "samples-operator-tls" not found Jul 03 15:13:40.996542 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:40.996384 2532 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 03 15:13:40.996542 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:40.996423 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/531cd3e1-eb3e-4443-b988-209c350ae15c-cluster-monitoring-operator-tls podName:531cd3e1-eb3e-4443-b988-209c350ae15c nodeName:}" failed. No retries permitted until 2026-07-03 15:13:44.996411248 +0000 UTC m=+43.579435057 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/531cd3e1-eb3e-4443-b988-209c350ae15c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-x8ftb" (UID: "531cd3e1-eb3e-4443-b988-209c350ae15c") : secret "cluster-monitoring-operator-tls" not found Jul 03 15:13:41.096574 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:41.096539 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d825134a-e7de-4199-a8db-36d954270785-metrics-tls\") pod \"dns-default-5wr4p\" (UID: \"d825134a-e7de-4199-a8db-36d954270785\") " pod="openshift-dns/dns-default-5wr4p" Jul 03 15:13:41.096752 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:41.096705 2532 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 15:13:41.096798 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:41.096764 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d825134a-e7de-4199-a8db-36d954270785-metrics-tls podName:d825134a-e7de-4199-a8db-36d954270785 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:45.096747633 +0000 UTC m=+43.679771440 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d825134a-e7de-4199-a8db-36d954270785-metrics-tls") pod "dns-default-5wr4p" (UID: "d825134a-e7de-4199-a8db-36d954270785") : secret "dns-default-metrics-tls" not found Jul 03 15:13:41.446107 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:41.446072 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:41.497069 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:41.497023 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:42.594310 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:42.594273 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:42.690007 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:42.689976 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:42.790507 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:42.790471 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:42.802333 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:42.802306 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-fdnfh"] Jul 03 15:13:42.819803 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:42.819778 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-fdnfh"] Jul 03 15:13:42.819949 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:42.819912 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fdnfh" Jul 03 15:13:42.822685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:42.822583 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 03 15:13:42.822800 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:42.822690 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 03 15:13:42.822800 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:42.822586 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-w7bh2\"" Jul 03 15:13:42.911360 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:42.911272 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:42.915408 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:42.915361 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/396f2c56-4cfc-410d-836b-bb5d474c2140-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fdnfh\" (UID: \"396f2c56-4cfc-410d-836b-bb5d474c2140\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fdnfh" Jul 03 15:13:42.915529 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:42.915515 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/396f2c56-4cfc-410d-836b-bb5d474c2140-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-fdnfh\" (UID: \"396f2c56-4cfc-410d-836b-bb5d474c2140\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fdnfh" Jul 03 15:13:42.963419 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:42.963385 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:43.016705 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:43.016674 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/396f2c56-4cfc-410d-836b-bb5d474c2140-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-fdnfh\" (UID: \"396f2c56-4cfc-410d-836b-bb5d474c2140\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fdnfh" Jul 03 15:13:43.016862 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:43.016793 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/396f2c56-4cfc-410d-836b-bb5d474c2140-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fdnfh\" (UID: \"396f2c56-4cfc-410d-836b-bb5d474c2140\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fdnfh" Jul 03 15:13:43.016955 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:43.016932 2532 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 03 15:13:43.017078 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:43.017006 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/396f2c56-4cfc-410d-836b-bb5d474c2140-networking-console-plugin-cert podName:396f2c56-4cfc-410d-836b-bb5d474c2140 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:43.516985787 +0000 UTC m=+42.100009617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/396f2c56-4cfc-410d-836b-bb5d474c2140-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fdnfh" (UID: "396f2c56-4cfc-410d-836b-bb5d474c2140") : secret "networking-console-plugin-cert" not found Jul 03 15:13:43.017551 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:43.017509 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/396f2c56-4cfc-410d-836b-bb5d474c2140-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-fdnfh\" (UID: \"396f2c56-4cfc-410d-836b-bb5d474c2140\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fdnfh" Jul 03 15:13:43.028915 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:43.028828 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:43.126925 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:43.126888 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:43.227798 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:43.227733 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:43.521068 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:43.520990 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/396f2c56-4cfc-410d-836b-bb5d474c2140-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fdnfh\" (UID: \"396f2c56-4cfc-410d-836b-bb5d474c2140\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fdnfh" Jul 03 15:13:43.521239 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:43.521091 2532 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 03 15:13:43.521239 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:43.521174 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/396f2c56-4cfc-410d-836b-bb5d474c2140-networking-console-plugin-cert podName:396f2c56-4cfc-410d-836b-bb5d474c2140 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:44.521155019 +0000 UTC m=+43.104178826 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/396f2c56-4cfc-410d-836b-bb5d474c2140-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fdnfh" (UID: "396f2c56-4cfc-410d-836b-bb5d474c2140") : secret "networking-console-plugin-cert" not found Jul 03 15:13:43.870066 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:43.870023 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:43.923076 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:43.923040 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:44.274384 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:44.274288 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:44.335633 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:44.335603 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:44.422148 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:44.422110 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:44.531239 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:44.531168 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/396f2c56-4cfc-410d-836b-bb5d474c2140-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fdnfh\" (UID: \"396f2c56-4cfc-410d-836b-bb5d474c2140\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fdnfh" Jul 03 15:13:44.531386 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:44.531327 2532 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 03 15:13:44.531429 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:44.531408 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/396f2c56-4cfc-410d-836b-bb5d474c2140-networking-console-plugin-cert podName:396f2c56-4cfc-410d-836b-bb5d474c2140 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:46.531391444 +0000 UTC m=+45.114415255 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/396f2c56-4cfc-410d-836b-bb5d474c2140-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fdnfh" (UID: "396f2c56-4cfc-410d-836b-bb5d474c2140") : secret "networking-console-plugin-cert" not found Jul 03 15:13:44.537948 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:44.537921 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:45.035208 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:45.035175 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/531cd3e1-eb3e-4443-b988-209c350ae15c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x8ftb\" (UID: \"531cd3e1-eb3e-4443-b988-209c350ae15c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb" Jul 03 15:13:45.035731 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:45.035220 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ea73c27-fbc5-4237-a642-c38f09af95a0-service-ca-bundle\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:45.035731 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:45.035266 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-metrics-certs\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:45.035731 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:45.035307 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:45.035731 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:45.035362 2532 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 03 15:13:45.035731 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:45.035440 2532 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 15:13:45.035731 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:45.035455 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/531cd3e1-eb3e-4443-b988-209c350ae15c-cluster-monitoring-operator-tls podName:531cd3e1-eb3e-4443-b988-209c350ae15c nodeName:}" failed. No retries permitted until 2026-07-03 15:13:53.035437492 +0000 UTC m=+51.618461302 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/531cd3e1-eb3e-4443-b988-209c350ae15c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-x8ftb" (UID: "531cd3e1-eb3e-4443-b988-209c350ae15c") : secret "cluster-monitoring-operator-tls" not found Jul 03 15:13:45.035731 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:45.035477 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3ea73c27-fbc5-4237-a642-c38f09af95a0-service-ca-bundle podName:3ea73c27-fbc5-4237-a642-c38f09af95a0 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:53.035466596 +0000 UTC m=+51.618490403 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3ea73c27-fbc5-4237-a642-c38f09af95a0-service-ca-bundle") pod "router-default-bc6b7cdc9-l5w6c" (UID: "3ea73c27-fbc5-4237-a642-c38f09af95a0") : configmap references non-existent config key: service-ca.crt Jul 03 15:13:45.035731 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:45.035456 2532 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65b9b77fcb-fj8hl: secret "image-registry-tls" not found Jul 03 15:13:45.035731 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:45.035509 2532 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 15:13:45.035731 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:45.035514 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls podName:d0aed645-6d56-4068-ad5b-fa581068b316 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:53.035503859 +0000 UTC m=+51.618527668 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls") pod "image-registry-65b9b77fcb-fj8hl" (UID: "d0aed645-6d56-4068-ad5b-fa581068b316") : secret "image-registry-tls" not found Jul 03 15:13:45.035731 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:45.035569 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de92b340-37d1-4df2-867c-09b1d0da425c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-pf7lv\" (UID: \"de92b340-37d1-4df2-867c-09b1d0da425c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pf7lv" Jul 03 15:13:45.035731 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:45.035706 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-metrics-certs podName:3ea73c27-fbc5-4237-a642-c38f09af95a0 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:53.035697442 +0000 UTC m=+51.618721248 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-metrics-certs") pod "router-default-bc6b7cdc9-l5w6c" (UID: "3ea73c27-fbc5-4237-a642-c38f09af95a0") : secret "router-metrics-certs-default" not found Jul 03 15:13:45.035731 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:45.035712 2532 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 15:13:45.036321 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:45.035755 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de92b340-37d1-4df2-867c-09b1d0da425c-samples-operator-tls podName:de92b340-37d1-4df2-867c-09b1d0da425c nodeName:}" failed. No retries permitted until 2026-07-03 15:13:53.035739742 +0000 UTC m=+51.618763567 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de92b340-37d1-4df2-867c-09b1d0da425c-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-pf7lv" (UID: "de92b340-37d1-4df2-867c-09b1d0da425c") : secret "samples-operator-tls" not found Jul 03 15:13:45.066672 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:45.066639 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:45.136882 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:45.136841 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d825134a-e7de-4199-a8db-36d954270785-metrics-tls\") pod \"dns-default-5wr4p\" (UID: \"d825134a-e7de-4199-a8db-36d954270785\") " pod="openshift-dns/dns-default-5wr4p" Jul 03 15:13:45.137062 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:45.137018 2532 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 15:13:45.137129 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:45.137097 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d825134a-e7de-4199-a8db-36d954270785-metrics-tls podName:d825134a-e7de-4199-a8db-36d954270785 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:53.137074602 +0000 UTC m=+51.720098413 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d825134a-e7de-4199-a8db-36d954270785-metrics-tls") pod "dns-default-5wr4p" (UID: "d825134a-e7de-4199-a8db-36d954270785") : secret "dns-default-metrics-tls" not found Jul 03 15:13:45.169598 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:45.169564 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:45.363409 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:45.363360 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:45.465906 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:45.465871 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:45.543836 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:45.543803 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:45.592870 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:45.592836 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:46.549250 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:46.549219 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/396f2c56-4cfc-410d-836b-bb5d474c2140-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fdnfh\" (UID: \"396f2c56-4cfc-410d-836b-bb5d474c2140\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fdnfh" Jul 03 15:13:46.549672 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:46.549392 2532 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 03 15:13:46.549672 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:46.549472 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/396f2c56-4cfc-410d-836b-bb5d474c2140-networking-console-plugin-cert podName:396f2c56-4cfc-410d-836b-bb5d474c2140 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:50.549454255 +0000 UTC m=+49.132478061 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/396f2c56-4cfc-410d-836b-bb5d474c2140-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fdnfh" (UID: "396f2c56-4cfc-410d-836b-bb5d474c2140") : secret "networking-console-plugin-cert" not found Jul 03 15:13:48.335709 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.335671 2532 generic.go:356] "Generic (PLEG): container finished" podID="e41e9a11-9c6a-42d2-b73f-45707d71798b" containerID="2c7649336245e364e20f435c540c44570d91d183296e950f9711c56d2aff8b22" exitCode=0 Jul 03 15:13:48.336134 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.335749 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grc4q" event={"ID":"e41e9a11-9c6a-42d2-b73f-45707d71798b","Type":"ContainerDied","Data":"2c7649336245e364e20f435c540c44570d91d183296e950f9711c56d2aff8b22"} Jul 03 15:13:48.338663 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.338639 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" event={"ID":"1cd66668-0c47-4f2a-9997-20b41987392c","Type":"ContainerStarted","Data":"0d23beb17a046a52090660e384af07f56913618df5efc5571fede1319f0cd4a9"} Jul 03 15:13:48.340278 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.340255 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fm5jm" event={"ID":"010c59dc-3916-4fd8-9ddf-2fc0821bf924","Type":"ContainerStarted","Data":"0e1979599eac00dc590c2c4737c524a90d3a33f2a723e038f53e163bc5f35e8c"} Jul 03 15:13:48.343073 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.343050 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jxkx5" event={"ID":"25da0080-177d-4f5e-a476-ca1bd2066ca0","Type":"ContainerStarted","Data":"52f074e4b717d90e18b250f2ab93934264ad3d141fec1b285ec5f183d66f7279"} Jul 03 15:13:48.345239 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.345222 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/0.log" Jul 03 15:13:48.345336 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.345258 2532 generic.go:356] "Generic (PLEG): container finished" podID="00b62b2c-dffe-4879-98e6-41c8ba914d63" containerID="9234a67d2000c477fd7fc3d4510f8107a876cda0230218e64458207051fc0181" exitCode=255 Jul 03 15:13:48.345424 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.345339 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-srbsr" event={"ID":"00b62b2c-dffe-4879-98e6-41c8ba914d63","Type":"ContainerDied","Data":"9234a67d2000c477fd7fc3d4510f8107a876cda0230218e64458207051fc0181"} Jul 03 15:13:48.345514 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.345500 2532 scope.go:117] "RemoveContainer" containerID="9234a67d2000c477fd7fc3d4510f8107a876cda0230218e64458207051fc0181" Jul 03 15:13:48.347449 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.347427 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d5frg" event={"ID":"33cb2d20-c735-4eb3-827e-e3aad2ae24bb","Type":"ContainerStarted","Data":"006e2fb4f3f04bffdd2fb2a8414643f52a5001e0774795f45bd51aab5f7f62ca"} Jul 03 15:13:48.349044 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.349024 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5ffwp" event={"ID":"5f4d2407-8aa3-4a18-9b68-e50f2bab4663","Type":"ContainerStarted","Data":"a4dd7aa7939067ce9cc3ceb09057f59f90205f86ac3978b6fc1eb1d09005b4f6"} Jul 03 15:13:48.350550 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.350531 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-st29z" event={"ID":"c0f2ef42-f6dd-4604-99dd-9a5292e6c645","Type":"ContainerStarted","Data":"576a28bc04ef720be75edfcb8390962e17953e86b7fc05e09f6d2e22a8532915"} Jul 03 15:13:48.401743 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.401310 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jxkx5" podStartSLOduration=23.77490908 podStartE2EDuration="33.401277618s" totalImagesPullingTime="9.626368538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:48.383429956 +0000 UTC m=+46.966453786" watchObservedRunningTime="2026-07-03 15:13:48.401277618 +0000 UTC m=+46.984301427" Jul 03 15:13:48.401743 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.401440 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5ffwp" podStartSLOduration=23.801511418 podStartE2EDuration="33.401429085s" totalImagesPullingTime="9.599917667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:48.399703494 +0000 UTC m=+46.982727326" watchObservedRunningTime="2026-07-03 15:13:48.401429085 +0000 UTC m=+46.984452915" Jul 03 15:13:48.414761 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.414669 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fm5jm" podStartSLOduration=22.815060809 podStartE2EDuration="32.414649918s" totalImagesPullingTime="9.599589109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:13:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:48.413968342 +0000 UTC m=+46.996992171" watchObservedRunningTime="2026-07-03 15:13:48.414649918 +0000 UTC m=+46.997673728" Jul 03 15:13:48.441099 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.441045 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" podStartSLOduration=33.821715954 podStartE2EDuration="43.441024749s" totalImagesPullingTime="9.619308795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:13:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:48.440305748 +0000 UTC m=+47.023329578" watchObservedRunningTime="2026-07-03 15:13:48.441024749 +0000 UTC m=+47.024048579" Jul 03 15:13:48.460236 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.459567 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d5frg" podStartSLOduration=1.878485607 podStartE2EDuration="11.459547273s" totalImagesPullingTime="9.581061666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:13:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:48.458162595 +0000 UTC m=+47.041186426" watchObservedRunningTime="2026-07-03 15:13:48.459547273 +0000 UTC m=+47.042571103" Jul 03 15:13:48.502150 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.501611 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-st29z" podStartSLOduration=29.406341893 podStartE2EDuration="38.501590614s" totalImagesPullingTime="9.095248721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:13:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:48.476039895 +0000 UTC m=+47.059063724" watchObservedRunningTime="2026-07-03 15:13:48.501590614 +0000 UTC m=+47.084614449" Jul 03 15:13:48.562845 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.562771 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:48.661836 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.661805 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:48.958017 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.957919 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:48.977796 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.977771 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-99glx"] Jul 03 15:13:48.997431 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.997400 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-99glx"] Jul 03 15:13:48.997586 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:48.997522 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-99glx" Jul 03 15:13:49.000559 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.000525 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 03 15:13:49.000701 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.000596 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-w9qcf\"" Jul 03 15:13:49.001278 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.001258 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 03 15:13:49.049930 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.049902 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:49.071053 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.071027 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rrv7\" (UniqueName: \"kubernetes.io/projected/51963809-27dc-4f46-bb10-953fe9401ca0-kube-api-access-2rrv7\") pod \"migrator-d57d58cc9-99glx\" (UID: \"51963809-27dc-4f46-bb10-953fe9401ca0\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-99glx" Jul 03 15:13:49.150302 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.150275 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:49.172449 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.172419 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rrv7\" (UniqueName: \"kubernetes.io/projected/51963809-27dc-4f46-bb10-953fe9401ca0-kube-api-access-2rrv7\") pod \"migrator-d57d58cc9-99glx\" (UID: \"51963809-27dc-4f46-bb10-953fe9401ca0\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-99glx" Jul 03 15:13:49.182064 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.182042 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rrv7\" (UniqueName: \"kubernetes.io/projected/51963809-27dc-4f46-bb10-953fe9401ca0-kube-api-access-2rrv7\") pod \"migrator-d57d58cc9-99glx\" (UID: \"51963809-27dc-4f46-bb10-953fe9401ca0\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-99glx" Jul 03 15:13:49.308060 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.307997 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-99glx" Jul 03 15:13:49.357495 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.357459 2532 generic.go:356] "Generic (PLEG): container finished" podID="e41e9a11-9c6a-42d2-b73f-45707d71798b" containerID="e9354678def12e73f3a41322239d5cdd082a515c8c23d4150e2dab43e339770d" exitCode=0 Jul 03 15:13:49.357950 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.357537 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grc4q" event={"ID":"e41e9a11-9c6a-42d2-b73f-45707d71798b","Type":"ContainerDied","Data":"e9354678def12e73f3a41322239d5cdd082a515c8c23d4150e2dab43e339770d"} Jul 03 15:13:49.359400 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.359361 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/1.log" Jul 03 15:13:49.359799 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.359774 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/0.log" Jul 03 15:13:49.359799 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.359808 2532 generic.go:356] "Generic (PLEG): container finished" podID="00b62b2c-dffe-4879-98e6-41c8ba914d63" containerID="e5c24a98e4a48cd10786c5cd330f2230d6a9d99ea1313fcee5d00012d6887187" exitCode=255 Jul 03 15:13:49.359982 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.359905 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-srbsr" event={"ID":"00b62b2c-dffe-4879-98e6-41c8ba914d63","Type":"ContainerDied","Data":"e5c24a98e4a48cd10786c5cd330f2230d6a9d99ea1313fcee5d00012d6887187"} Jul 03 15:13:49.359982 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.359970 2532 scope.go:117] "RemoveContainer" containerID="9234a67d2000c477fd7fc3d4510f8107a876cda0230218e64458207051fc0181" Jul 03 15:13:49.360278 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.360258 2532 scope.go:117] "RemoveContainer" containerID="e5c24a98e4a48cd10786c5cd330f2230d6a9d99ea1313fcee5d00012d6887187" Jul 03 15:13:49.360453 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:49.360434 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-srbsr_openshift-console-operator(00b62b2c-dffe-4879-98e6-41c8ba914d63)\"" pod="openshift-console-operator/console-operator-68b757fb67-srbsr" podUID="00b62b2c-dffe-4879-98e6-41c8ba914d63" Jul 03 15:13:49.476427 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.476400 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-99glx"] Jul 03 15:13:49.480801 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:13:49.480779 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51963809_27dc_4f46_bb10_953fe9401ca0.slice/crio-b2d3f2dfd06f933ea8e9bd750dc5ebf2c3ba2439336273d8630beab92a416092 WatchSource:0}: Error finding container b2d3f2dfd06f933ea8e9bd750dc5ebf2c3ba2439336273d8630beab92a416092: Status 404 returned error can't find the container with id b2d3f2dfd06f933ea8e9bd750dc5ebf2c3ba2439336273d8630beab92a416092 Jul 03 15:13:49.516607 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.516578 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:49.711475 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.711440 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hc69x"] Jul 03 15:13:49.732043 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.732012 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hc69x"] Jul 03 15:13:49.732199 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.732138 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:49.735961 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.735939 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 03 15:13:49.736113 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.736082 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 03 15:13:49.736472 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.736450 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2xkrx\"" Jul 03 15:13:49.762819 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.762792 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:49.780109 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.780073 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9c966052-a70c-4977-8439-4adbf4f2e71c-crio-socket\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:49.780253 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.780235 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c966052-a70c-4977-8439-4adbf4f2e71c-data-volume\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:49.780323 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.780305 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgss7\" (UniqueName: \"kubernetes.io/projected/9c966052-a70c-4977-8439-4adbf4f2e71c-kube-api-access-pgss7\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:49.780400 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.780341 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c966052-a70c-4977-8439-4adbf4f2e71c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:49.780467 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.780446 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c966052-a70c-4977-8439-4adbf4f2e71c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:49.835726 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.835676 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:49.881501 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.881474 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c966052-a70c-4977-8439-4adbf4f2e71c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:49.881597 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.881533 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9c966052-a70c-4977-8439-4adbf4f2e71c-crio-socket\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:49.881644 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:49.881596 2532 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 15:13:49.881682 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.881644 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9c966052-a70c-4977-8439-4adbf4f2e71c-crio-socket\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:49.881682 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:49.881654 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c966052-a70c-4977-8439-4adbf4f2e71c-kube-rbac-proxy-cm podName:9c966052-a70c-4977-8439-4adbf4f2e71c nodeName:}" failed. No retries permitted until 2026-07-03 15:13:50.381639274 +0000 UTC m=+48.964663081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c966052-a70c-4977-8439-4adbf4f2e71c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hc69x" (UID: "9c966052-a70c-4977-8439-4adbf4f2e71c") : configmap "kube-rbac-proxy" not found Jul 03 15:13:49.881751 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.881703 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c966052-a70c-4977-8439-4adbf4f2e71c-data-volume\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:49.881751 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.881738 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgss7\" (UniqueName: \"kubernetes.io/projected/9c966052-a70c-4977-8439-4adbf4f2e71c-kube-api-access-pgss7\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:49.881811 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.881757 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c966052-a70c-4977-8439-4adbf4f2e71c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:49.881866 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:49.881853 2532 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 15:13:49.881914 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:49.881905 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c966052-a70c-4977-8439-4adbf4f2e71c-insights-runtime-extractor-tls podName:9c966052-a70c-4977-8439-4adbf4f2e71c nodeName:}" failed. No retries permitted until 2026-07-03 15:13:50.381889431 +0000 UTC m=+48.964913252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c966052-a70c-4977-8439-4adbf4f2e71c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hc69x" (UID: "9c966052-a70c-4977-8439-4adbf4f2e71c") : secret "insights-runtime-extractor-tls" not found Jul 03 15:13:49.882037 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.882021 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c966052-a70c-4977-8439-4adbf4f2e71c-data-volume\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:49.890138 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:49.890109 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgss7\" (UniqueName: \"kubernetes.io/projected/9c966052-a70c-4977-8439-4adbf4f2e71c-kube-api-access-pgss7\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:50.257419 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:50.257351 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:50.312610 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:50.312573 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:50.366472 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:50.366439 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grc4q" event={"ID":"e41e9a11-9c6a-42d2-b73f-45707d71798b","Type":"ContainerStarted","Data":"a9ad35c9c576ab72b3f53b08c9e27f2872a53bceed20d0c6dfe8581ad7adddef"} Jul 03 15:13:50.367659 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:50.367628 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-99glx" event={"ID":"51963809-27dc-4f46-bb10-953fe9401ca0","Type":"ContainerStarted","Data":"b2d3f2dfd06f933ea8e9bd750dc5ebf2c3ba2439336273d8630beab92a416092"} Jul 03 15:13:50.369059 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:50.369041 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/1.log" Jul 03 15:13:50.369325 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:50.369311 2532 scope.go:117] "RemoveContainer" containerID="e5c24a98e4a48cd10786c5cd330f2230d6a9d99ea1313fcee5d00012d6887187" Jul 03 15:13:50.369484 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:50.369467 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-srbsr_openshift-console-operator(00b62b2c-dffe-4879-98e6-41c8ba914d63)\"" pod="openshift-console-operator/console-operator-68b757fb67-srbsr" podUID="00b62b2c-dffe-4879-98e6-41c8ba914d63" Jul 03 15:13:50.387459 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:50.387428 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c966052-a70c-4977-8439-4adbf4f2e71c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:50.387552 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:50.387498 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c966052-a70c-4977-8439-4adbf4f2e71c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:50.387607 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:50.387558 2532 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 15:13:50.387654 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:50.387615 2532 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 15:13:50.387693 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:50.387652 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c966052-a70c-4977-8439-4adbf4f2e71c-insights-runtime-extractor-tls podName:9c966052-a70c-4977-8439-4adbf4f2e71c nodeName:}" failed. No retries permitted until 2026-07-03 15:13:51.387633375 +0000 UTC m=+49.970657184 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c966052-a70c-4977-8439-4adbf4f2e71c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hc69x" (UID: "9c966052-a70c-4977-8439-4adbf4f2e71c") : secret "insights-runtime-extractor-tls" not found Jul 03 15:13:50.387693 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:50.387675 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c966052-a70c-4977-8439-4adbf4f2e71c-kube-rbac-proxy-cm podName:9c966052-a70c-4977-8439-4adbf4f2e71c nodeName:}" failed. No retries permitted until 2026-07-03 15:13:51.387663785 +0000 UTC m=+49.970687592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c966052-a70c-4977-8439-4adbf4f2e71c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hc69x" (UID: "9c966052-a70c-4977-8439-4adbf4f2e71c") : configmap "kube-rbac-proxy" not found Jul 03 15:13:50.389349 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:50.389305 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-grc4q" podStartSLOduration=7.958780866 podStartE2EDuration="48.389293944s" totalImagesPullingTime="40.430513078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:50.388819614 +0000 UTC m=+48.971843444" watchObservedRunningTime="2026-07-03 15:13:50.389293944 +0000 UTC m=+48.972317772" Jul 03 15:13:50.507024 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:50.506997 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:50.566104 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:50.566009 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:50.589043 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:50.589021 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/396f2c56-4cfc-410d-836b-bb5d474c2140-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fdnfh\" (UID: \"396f2c56-4cfc-410d-836b-bb5d474c2140\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fdnfh" Jul 03 15:13:50.589175 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:50.589158 2532 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 03 15:13:50.589230 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:50.589221 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/396f2c56-4cfc-410d-836b-bb5d474c2140-networking-console-plugin-cert podName:396f2c56-4cfc-410d-836b-bb5d474c2140 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:58.589206942 +0000 UTC m=+57.172230762 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/396f2c56-4cfc-410d-836b-bb5d474c2140-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fdnfh" (UID: "396f2c56-4cfc-410d-836b-bb5d474c2140") : secret "networking-console-plugin-cert" not found Jul 03 15:13:51.375522 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:51.375429 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-99glx" event={"ID":"51963809-27dc-4f46-bb10-953fe9401ca0","Type":"ContainerStarted","Data":"af0e2f91e0bc71d37adb036751fd83827db75580ab926711ccb47911fd830a97"} Jul 03 15:13:51.375522 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:51.375500 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-99glx" event={"ID":"51963809-27dc-4f46-bb10-953fe9401ca0","Type":"ContainerStarted","Data":"9c4476220c5e53615932981be2fe2b7899da85aa2cfe52ac0a319bf4616f2776"} Jul 03 15:13:51.391258 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:51.391210 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-99glx" podStartSLOduration=1.762743839 podStartE2EDuration="3.391196776s" totalImagesPullingTime="1.628452937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:51.390640573 +0000 UTC m=+49.973664401" watchObservedRunningTime="2026-07-03 15:13:51.391196776 +0000 UTC m=+49.974220606" Jul 03 15:13:51.396969 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:51.396947 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c966052-a70c-4977-8439-4adbf4f2e71c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:51.397055 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:51.397011 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c966052-a70c-4977-8439-4adbf4f2e71c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:51.397118 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:51.397105 2532 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 15:13:51.397167 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:51.397150 2532 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 15:13:51.397201 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:51.397156 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c966052-a70c-4977-8439-4adbf4f2e71c-insights-runtime-extractor-tls podName:9c966052-a70c-4977-8439-4adbf4f2e71c nodeName:}" failed. No retries permitted until 2026-07-03 15:13:53.397144217 +0000 UTC m=+51.980168024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c966052-a70c-4977-8439-4adbf4f2e71c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hc69x" (UID: "9c966052-a70c-4977-8439-4adbf4f2e71c") : secret "insights-runtime-extractor-tls" not found Jul 03 15:13:51.397242 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:51.397216 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c966052-a70c-4977-8439-4adbf4f2e71c-kube-rbac-proxy-cm podName:9c966052-a70c-4977-8439-4adbf4f2e71c nodeName:}" failed. No retries permitted until 2026-07-03 15:13:53.397203041 +0000 UTC m=+51.980226849 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c966052-a70c-4977-8439-4adbf4f2e71c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hc69x" (UID: "9c966052-a70c-4977-8439-4adbf4f2e71c") : configmap "kube-rbac-proxy" not found Jul 03 15:13:51.399865 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:51.399840 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:51.457619 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:51.457589 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:51.516502 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:51.516473 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:51.999334 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:51.999311 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rpqwz_f2d8e1ee-2726-48a1-a016-01e11e8f02bf/dns-node-resolver/0.log" Jul 03 15:13:52.272183 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:52.272101 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:52.598288 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:52.598265 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7pwdd_c481e3d5-ae74-4023-9633-aaeb93addb3a/node-ca/0.log" Jul 03 15:13:53.112513 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:53.112479 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/531cd3e1-eb3e-4443-b988-209c350ae15c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x8ftb\" (UID: \"531cd3e1-eb3e-4443-b988-209c350ae15c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb" Jul 03 15:13:53.112681 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:53.112520 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ea73c27-fbc5-4237-a642-c38f09af95a0-service-ca-bundle\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:53.112681 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:53.112549 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-metrics-certs\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:13:53.112681 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:53.112585 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:13:53.112681 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:53.112620 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de92b340-37d1-4df2-867c-09b1d0da425c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-pf7lv\" (UID: \"de92b340-37d1-4df2-867c-09b1d0da425c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pf7lv" Jul 03 15:13:53.112681 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:53.112636 2532 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 03 15:13:53.112681 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:53.112662 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3ea73c27-fbc5-4237-a642-c38f09af95a0-service-ca-bundle podName:3ea73c27-fbc5-4237-a642-c38f09af95a0 nodeName:}" failed. No retries permitted until 2026-07-03 15:14:09.112642947 +0000 UTC m=+67.695666757 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3ea73c27-fbc5-4237-a642-c38f09af95a0-service-ca-bundle") pod "router-default-bc6b7cdc9-l5w6c" (UID: "3ea73c27-fbc5-4237-a642-c38f09af95a0") : configmap references non-existent config key: service-ca.crt Jul 03 15:13:53.112681 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:53.112678 2532 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 15:13:53.113062 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:53.112695 2532 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 15:13:53.113062 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:53.112698 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/531cd3e1-eb3e-4443-b988-209c350ae15c-cluster-monitoring-operator-tls podName:531cd3e1-eb3e-4443-b988-209c350ae15c nodeName:}" failed. No retries permitted until 2026-07-03 15:14:09.112688398 +0000 UTC m=+67.695712223 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/531cd3e1-eb3e-4443-b988-209c350ae15c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-x8ftb" (UID: "531cd3e1-eb3e-4443-b988-209c350ae15c") : secret "cluster-monitoring-operator-tls" not found Jul 03 15:13:53.113062 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:53.112732 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-metrics-certs podName:3ea73c27-fbc5-4237-a642-c38f09af95a0 nodeName:}" failed. No retries permitted until 2026-07-03 15:14:09.112713924 +0000 UTC m=+67.695737733 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-metrics-certs") pod "router-default-bc6b7cdc9-l5w6c" (UID: "3ea73c27-fbc5-4237-a642-c38f09af95a0") : secret "router-metrics-certs-default" not found Jul 03 15:13:53.113062 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:53.112752 2532 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 15:13:53.113062 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:53.112765 2532 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65b9b77fcb-fj8hl: secret "image-registry-tls" not found Jul 03 15:13:53.113062 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:53.112776 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de92b340-37d1-4df2-867c-09b1d0da425c-samples-operator-tls podName:de92b340-37d1-4df2-867c-09b1d0da425c nodeName:}" failed. No retries permitted until 2026-07-03 15:14:09.112769256 +0000 UTC m=+67.695793063 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de92b340-37d1-4df2-867c-09b1d0da425c-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-pf7lv" (UID: "de92b340-37d1-4df2-867c-09b1d0da425c") : secret "samples-operator-tls" not found Jul 03 15:13:53.113062 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:53.112813 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls podName:d0aed645-6d56-4068-ad5b-fa581068b316 nodeName:}" failed. No retries permitted until 2026-07-03 15:14:09.112802521 +0000 UTC m=+67.695826343 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls") pod "image-registry-65b9b77fcb-fj8hl" (UID: "d0aed645-6d56-4068-ad5b-fa581068b316") : secret "image-registry-tls" not found Jul 03 15:13:53.213259 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:53.213234 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d825134a-e7de-4199-a8db-36d954270785-metrics-tls\") pod \"dns-default-5wr4p\" (UID: \"d825134a-e7de-4199-a8db-36d954270785\") " pod="openshift-dns/dns-default-5wr4p" Jul 03 15:13:53.213416 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:53.213358 2532 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 15:13:53.213469 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:53.213439 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d825134a-e7de-4199-a8db-36d954270785-metrics-tls podName:d825134a-e7de-4199-a8db-36d954270785 nodeName:}" failed. No retries permitted until 2026-07-03 15:14:09.213425437 +0000 UTC m=+67.796449247 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d825134a-e7de-4199-a8db-36d954270785-metrics-tls") pod "dns-default-5wr4p" (UID: "d825134a-e7de-4199-a8db-36d954270785") : secret "dns-default-metrics-tls" not found Jul 03 15:13:53.397280 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:53.397204 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d5frg_33cb2d20-c735-4eb3-827e-e3aad2ae24bb/serve-healthcheck-canary/0.log" Jul 03 15:13:53.414452 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:53.414424 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c966052-a70c-4977-8439-4adbf4f2e71c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:53.414565 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:53.414485 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c966052-a70c-4977-8439-4adbf4f2e71c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:53.414600 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:53.414563 2532 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 15:13:53.414633 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:53.414617 2532 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 15:13:53.414633 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:53.414627 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c966052-a70c-4977-8439-4adbf4f2e71c-insights-runtime-extractor-tls podName:9c966052-a70c-4977-8439-4adbf4f2e71c nodeName:}" failed. No retries permitted until 2026-07-03 15:13:57.4146109 +0000 UTC m=+55.997634737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c966052-a70c-4977-8439-4adbf4f2e71c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hc69x" (UID: "9c966052-a70c-4977-8439-4adbf4f2e71c") : secret "insights-runtime-extractor-tls" not found Jul 03 15:13:53.414712 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:53.414662 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c966052-a70c-4977-8439-4adbf4f2e71c-kube-rbac-proxy-cm podName:9c966052-a70c-4977-8439-4adbf4f2e71c nodeName:}" failed. No retries permitted until 2026-07-03 15:13:57.414651917 +0000 UTC m=+55.997675723 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c966052-a70c-4977-8439-4adbf4f2e71c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hc69x" (UID: "9c966052-a70c-4977-8439-4adbf4f2e71c") : configmap "kube-rbac-proxy" not found Jul 03 15:13:53.602223 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:53.602199 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-99glx_51963809-27dc-4f46-bb10-953fe9401ca0/migrator/0.log" Jul 03 15:13:53.797321 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:53.797246 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-99glx_51963809-27dc-4f46-bb10-953fe9401ca0/graceful-termination/0.log" Jul 03 15:13:53.907694 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:53.907652 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:53.999253 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:53.999221 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-jxkx5_25da0080-177d-4f5e-a476-ca1bd2066ca0/kube-storage-version-migrator-operator/0.log" Jul 03 15:13:55.254502 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:55.254466 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:56.101476 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:56.101436 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:56.166180 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:56.166151 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:56.477290 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:56.477191 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:56.582576 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:56.582548 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:56.678682 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:56.678649 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:56.779501 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:56.779415 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:56.836932 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:56.836899 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:57.177294 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:57.177265 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:57.452062 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:57.451978 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c966052-a70c-4977-8439-4adbf4f2e71c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:57.452062 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:57.452036 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c966052-a70c-4977-8439-4adbf4f2e71c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:57.452232 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:57.452131 2532 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 15:13:57.452232 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:57.452190 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c966052-a70c-4977-8439-4adbf4f2e71c-insights-runtime-extractor-tls podName:9c966052-a70c-4977-8439-4adbf4f2e71c nodeName:}" failed. No retries permitted until 2026-07-03 15:14:05.452175524 +0000 UTC m=+64.035199335 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c966052-a70c-4977-8439-4adbf4f2e71c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hc69x" (UID: "9c966052-a70c-4977-8439-4adbf4f2e71c") : secret "insights-runtime-extractor-tls" not found Jul 03 15:13:57.452595 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:57.452579 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c966052-a70c-4977-8439-4adbf4f2e71c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:13:57.594343 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:57.594308 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-srbsr" Jul 03 15:13:57.594728 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:57.594446 2532 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-srbsr" Jul 03 15:13:57.594728 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:57.594704 2532 scope.go:117] "RemoveContainer" containerID="e5c24a98e4a48cd10786c5cd330f2230d6a9d99ea1313fcee5d00012d6887187" Jul 03 15:13:57.594855 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:57.594837 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-srbsr_openshift-console-operator(00b62b2c-dffe-4879-98e6-41c8ba914d63)\"" pod="openshift-console-operator/console-operator-68b757fb67-srbsr" podUID="00b62b2c-dffe-4879-98e6-41c8ba914d63" Jul 03 15:13:58.170565 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:58.170522 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:58.398209 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:58.398182 2532 scope.go:117] "RemoveContainer" containerID="e5c24a98e4a48cd10786c5cd330f2230d6a9d99ea1313fcee5d00012d6887187" Jul 03 15:13:58.398363 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:58.398326 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-srbsr_openshift-console-operator(00b62b2c-dffe-4879-98e6-41c8ba914d63)\"" pod="openshift-console-operator/console-operator-68b757fb67-srbsr" podUID="00b62b2c-dffe-4879-98e6-41c8ba914d63" Jul 03 15:13:58.583459 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:58.583427 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:58.664624 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:58.664593 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/396f2c56-4cfc-410d-836b-bb5d474c2140-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fdnfh\" (UID: \"396f2c56-4cfc-410d-836b-bb5d474c2140\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fdnfh" Jul 03 15:13:58.665009 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:58.664732 2532 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 03 15:13:58.665009 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:13:58.664789 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/396f2c56-4cfc-410d-836b-bb5d474c2140-networking-console-plugin-cert podName:396f2c56-4cfc-410d-836b-bb5d474c2140 nodeName:}" failed. No retries permitted until 2026-07-03 15:14:14.664775914 +0000 UTC m=+73.247799721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/396f2c56-4cfc-410d-836b-bb5d474c2140-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fdnfh" (UID: "396f2c56-4cfc-410d-836b-bb5d474c2140") : secret "networking-console-plugin-cert" not found Jul 03 15:13:58.777185 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:58.777145 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:58.849205 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:58.849130 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:58.979601 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:58.979567 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:59.381427 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:59.381392 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:13:59.900868 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:13:59.900838 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:00.001587 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:00.001548 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:00.191935 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:00.191854 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:00.413559 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:00.413519 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:00.622028 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:00.621998 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:00.721614 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:00.721577 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:00.822053 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:00.822013 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:00.887600 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:00.887524 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:00.975045 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:00.975012 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:01.387763 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:01.387727 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:01.780007 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:01.779917 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:02.292875 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:02.292833 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:02.293772 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:02.293752 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m5hcn" Jul 03 15:14:02.393822 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:02.393791 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:02.986721 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:02.986690 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:03.179335 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:03.179297 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:03.578436 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:03.578395 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:03.805733 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:03.805652 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:04.382794 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:04.382752 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:04.984385 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:04.984333 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:05.233351 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:05.233320 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:05.378020 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:05.377992 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:05.524281 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:05.524242 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c966052-a70c-4977-8439-4adbf4f2e71c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:14:05.526712 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:05.526689 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c966052-a70c-4977-8439-4adbf4f2e71c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc69x\" (UID: \"9c966052-a70c-4977-8439-4adbf4f2e71c\") " pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:14:05.643899 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:05.643827 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2xkrx\"" Jul 03 15:14:05.651920 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:05.651893 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hc69x" Jul 03 15:14:05.780519 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:05.780495 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hc69x"] Jul 03 15:14:05.783020 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:14:05.782990 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c966052_a70c_4977_8439_4adbf4f2e71c.slice/crio-2937f5c6f49d6eaa186bd49229e4fc0488c611969bac3eaab617915186c9d563 WatchSource:0}: Error finding container 2937f5c6f49d6eaa186bd49229e4fc0488c611969bac3eaab617915186c9d563: Status 404 returned error can't find the container with id 2937f5c6f49d6eaa186bd49229e4fc0488c611969bac3eaab617915186c9d563 Jul 03 15:14:05.783432 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:05.783402 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:06.176184 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:06.176150 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:06.424183 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:06.424147 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hc69x" event={"ID":"9c966052-a70c-4977-8439-4adbf4f2e71c","Type":"ContainerStarted","Data":"2937f5c6f49d6eaa186bd49229e4fc0488c611969bac3eaab617915186c9d563"} Jul 03 15:14:06.736849 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:06.736808 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret\") pod \"global-pull-secret-syncer-9df89\" (UID: \"37843d47-7c15-44ce-b3af-54b536ace36f\") " pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:14:06.737051 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:06.736931 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs\") pod \"network-metrics-daemon-chpm2\" (UID: \"a9e3ec89-82d9-45ae-a945-4318350c2074\") " pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:14:06.737051 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:06.736976 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzqkc\" (UniqueName: \"kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc\") pod \"network-check-target-gtq6v\" (UID: \"1e8f757a-bb70-43d0-be0c-ba0863018f52\") " pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:14:06.740522 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:06.740091 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 03 15:14:06.740522 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:06.740328 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 03 15:14:06.743963 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:06.743940 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzqkc\" (UniqueName: \"kubernetes.io/projected/1e8f757a-bb70-43d0-be0c-ba0863018f52-kube-api-access-fzqkc\") pod \"network-check-target-gtq6v\" (UID: \"1e8f757a-bb70-43d0-be0c-ba0863018f52\") " pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:14:06.751928 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:06.751882 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37843d47-7c15-44ce-b3af-54b536ace36f-original-pull-secret\") pod \"global-pull-secret-syncer-9df89\" (UID: \"37843d47-7c15-44ce-b3af-54b536ace36f\") " pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:14:06.753108 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:06.753060 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e3ec89-82d9-45ae-a945-4318350c2074-metrics-certs\") pod \"network-metrics-daemon-chpm2\" (UID: \"a9e3ec89-82d9-45ae-a945-4318350c2074\") " pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:14:06.778998 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:06.778955 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:06.931314 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:06.931271 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9df89" Jul 03 15:14:06.943726 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:06.943701 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cq8c8\"" Jul 03 15:14:06.952141 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:06.952116 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chpm2" Jul 03 15:14:06.952728 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:06.952709 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9nf84\"" Jul 03 15:14:06.960909 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:06.960887 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:14:06.983295 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:06.983167 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:07.106743 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:07.106710 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9df89"] Jul 03 15:14:07.113493 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:14:07.113462 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37843d47_7c15_44ce_b3af_54b536ace36f.slice/crio-8ec94f0013cd1dbc276d115e3a2f1643fa29382547d2ecd820badd0598105333 WatchSource:0}: Error finding container 8ec94f0013cd1dbc276d115e3a2f1643fa29382547d2ecd820badd0598105333: Status 404 returned error can't find the container with id 8ec94f0013cd1dbc276d115e3a2f1643fa29382547d2ecd820badd0598105333 Jul 03 15:14:07.123504 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:07.123477 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-chpm2"] Jul 03 15:14:07.127272 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:14:07.127244 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9e3ec89_82d9_45ae_a945_4318350c2074.slice/crio-24e31f282f7fae6e64a166b63abdb45dec1fbdb4d445f7a70ad1ecd156428e19 WatchSource:0}: Error finding container 24e31f282f7fae6e64a166b63abdb45dec1fbdb4d445f7a70ad1ecd156428e19: Status 404 returned error can't find the container with id 24e31f282f7fae6e64a166b63abdb45dec1fbdb4d445f7a70ad1ecd156428e19 Jul 03 15:14:07.142943 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:07.142922 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gtq6v"] Jul 03 15:14:07.145691 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:14:07.145662 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e8f757a_bb70_43d0_be0c_ba0863018f52.slice/crio-964618520a2823f3fa38ff29e5b1191e1346b029c1b52b0fd6934862d3d6ce0a WatchSource:0}: Error finding container 964618520a2823f3fa38ff29e5b1191e1346b029c1b52b0fd6934862d3d6ce0a: Status 404 returned error can't find the container with id 964618520a2823f3fa38ff29e5b1191e1346b029c1b52b0fd6934862d3d6ce0a Jul 03 15:14:07.176903 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:07.176877 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:07.428692 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:07.428656 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-chpm2" event={"ID":"a9e3ec89-82d9-45ae-a945-4318350c2074","Type":"ContainerStarted","Data":"24e31f282f7fae6e64a166b63abdb45dec1fbdb4d445f7a70ad1ecd156428e19"} Jul 03 15:14:07.430747 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:07.430335 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gtq6v" event={"ID":"1e8f757a-bb70-43d0-be0c-ba0863018f52","Type":"ContainerStarted","Data":"b9635968085506d0dc519e2ec2eeb2b77054f397f5492e0d9bc1242da674ad63"} Jul 03 15:14:07.430747 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:07.430402 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gtq6v" event={"ID":"1e8f757a-bb70-43d0-be0c-ba0863018f52","Type":"ContainerStarted","Data":"964618520a2823f3fa38ff29e5b1191e1346b029c1b52b0fd6934862d3d6ce0a"} Jul 03 15:14:07.430747 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:07.430451 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:14:07.431483 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:07.431462 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9df89" event={"ID":"37843d47-7c15-44ce-b3af-54b536ace36f","Type":"ContainerStarted","Data":"8ec94f0013cd1dbc276d115e3a2f1643fa29382547d2ecd820badd0598105333"} Jul 03 15:14:07.447469 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:07.447416 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gtq6v" podStartSLOduration=65.447397192 podStartE2EDuration="1m5.447397192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:13:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:07.446294252 +0000 UTC m=+66.029318083" watchObservedRunningTime="2026-07-03 15:14:07.447397192 +0000 UTC m=+66.030421020" Jul 03 15:14:09.159319 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.159276 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/531cd3e1-eb3e-4443-b988-209c350ae15c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x8ftb\" (UID: \"531cd3e1-eb3e-4443-b988-209c350ae15c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb" Jul 03 15:14:09.159881 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.159334 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ea73c27-fbc5-4237-a642-c38f09af95a0-service-ca-bundle\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:14:09.159881 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.159391 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-metrics-certs\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:14:09.159881 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.159429 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:14:09.159881 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.159458 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de92b340-37d1-4df2-867c-09b1d0da425c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-pf7lv\" (UID: \"de92b340-37d1-4df2-867c-09b1d0da425c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pf7lv" Jul 03 15:14:09.160446 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.160423 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ea73c27-fbc5-4237-a642-c38f09af95a0-service-ca-bundle\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:14:09.163243 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.163188 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ea73c27-fbc5-4237-a642-c38f09af95a0-metrics-certs\") pod \"router-default-bc6b7cdc9-l5w6c\" (UID: \"3ea73c27-fbc5-4237-a642-c38f09af95a0\") " pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:14:09.164034 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.164009 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de92b340-37d1-4df2-867c-09b1d0da425c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-pf7lv\" (UID: \"de92b340-37d1-4df2-867c-09b1d0da425c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pf7lv" Jul 03 15:14:09.164272 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.164251 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls\") pod \"image-registry-65b9b77fcb-fj8hl\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:14:09.165398 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.165340 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/531cd3e1-eb3e-4443-b988-209c350ae15c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x8ftb\" (UID: \"531cd3e1-eb3e-4443-b988-209c350ae15c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb" Jul 03 15:14:09.260709 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.260676 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d825134a-e7de-4199-a8db-36d954270785-metrics-tls\") pod \"dns-default-5wr4p\" (UID: \"d825134a-e7de-4199-a8db-36d954270785\") " pod="openshift-dns/dns-default-5wr4p" Jul 03 15:14:09.263437 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.263381 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d825134a-e7de-4199-a8db-36d954270785-metrics-tls\") pod \"dns-default-5wr4p\" (UID: \"d825134a-e7de-4199-a8db-36d954270785\") " pod="openshift-dns/dns-default-5wr4p" Jul 03 15:14:09.348973 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.348779 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ppp7b\"" Jul 03 15:14:09.356736 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.356711 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:14:09.356970 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.356944 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-297zl\"" Jul 03 15:14:09.364853 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.364828 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb" Jul 03 15:14:09.377302 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.377279 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ws42c\"" Jul 03 15:14:09.381340 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.381315 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:14:09.405411 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.405361 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-n5mf9\"" Jul 03 15:14:09.413073 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.413000 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pf7lv" Jul 03 15:14:09.414605 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.414583 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w99m5\"" Jul 03 15:14:09.422983 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.422958 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5wr4p" Jul 03 15:14:09.914013 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:09.913978 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65b9b77fcb-fj8hl"] Jul 03 15:14:10.016982 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:14:10.016915 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0aed645_6d56_4068_ad5b_fa581068b316.slice/crio-c6678cd7777174882dd779e41aa01b4a1a057b0f6177ec3cea43535fd8f98883 WatchSource:0}: Error finding container c6678cd7777174882dd779e41aa01b4a1a057b0f6177ec3cea43535fd8f98883: Status 404 returned error can't find the container with id c6678cd7777174882dd779e41aa01b4a1a057b0f6177ec3cea43535fd8f98883 Jul 03 15:14:10.250307 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:10.249424 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5wr4p"] Jul 03 15:14:10.259665 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:14:10.259631 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd825134a_e7de_4199_a8db_36d954270785.slice/crio-d7f4c049ea4eb1c14db4f5529ac1e80ce73d7f2952bec0f45789fa0434ab86e6 WatchSource:0}: Error finding container d7f4c049ea4eb1c14db4f5529ac1e80ce73d7f2952bec0f45789fa0434ab86e6: Status 404 returned error can't find the container with id d7f4c049ea4eb1c14db4f5529ac1e80ce73d7f2952bec0f45789fa0434ab86e6 Jul 03 15:14:10.264927 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:10.264900 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pf7lv"] Jul 03 15:14:10.275799 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:10.275710 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb"] Jul 03 15:14:10.280408 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:10.280136 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bc6b7cdc9-l5w6c"] Jul 03 15:14:10.446160 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:10.446079 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb" event={"ID":"531cd3e1-eb3e-4443-b988-209c350ae15c","Type":"ContainerStarted","Data":"00ce4c1e1ddb1e9f8e2a3bb82658340def41faa48268f37b970df5502f59d9bd"} Jul 03 15:14:10.447903 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:10.447870 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hc69x" event={"ID":"9c966052-a70c-4977-8439-4adbf4f2e71c","Type":"ContainerStarted","Data":"5ca0f192c47b8b025d836561a2f8195b2b1c5b052821b0dca0d82d9a9930cf00"} Jul 03 15:14:10.449108 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:10.449080 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5wr4p" event={"ID":"d825134a-e7de-4199-a8db-36d954270785","Type":"ContainerStarted","Data":"d7f4c049ea4eb1c14db4f5529ac1e80ce73d7f2952bec0f45789fa0434ab86e6"} Jul 03 15:14:10.451045 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:10.450992 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pf7lv" event={"ID":"de92b340-37d1-4df2-867c-09b1d0da425c","Type":"ContainerStarted","Data":"7cd8530b5a93957736dd411928d22e125e0afc93b27f1b4b29a6a64ecb86de16"} Jul 03 15:14:10.453668 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:10.453143 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-chpm2" event={"ID":"a9e3ec89-82d9-45ae-a945-4318350c2074","Type":"ContainerStarted","Data":"caaf9c308b60fb2d21ac487c0a424ef3f10bdf5cc0d7db6f04adf611c9de6ae9"} Jul 03 15:14:10.453668 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:10.453203 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-chpm2" event={"ID":"a9e3ec89-82d9-45ae-a945-4318350c2074","Type":"ContainerStarted","Data":"f2a4d2d9977f20a0667152af46a752510f8d7ac6990b746e0470f6eece40b38b"} Jul 03 15:14:10.454962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:10.454937 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" event={"ID":"3ea73c27-fbc5-4237-a642-c38f09af95a0","Type":"ContainerStarted","Data":"8a7ff7f7a4243d93a2925bc322bc7dc6dc982cb23c61d27ff2b703b491764cd5"} Jul 03 15:14:10.455043 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:10.454981 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" event={"ID":"3ea73c27-fbc5-4237-a642-c38f09af95a0","Type":"ContainerStarted","Data":"48475652b155c251ef4236447d85965b9b398fbfed393876ef304e95fa41b9d4"} Jul 03 15:14:10.457518 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:10.457455 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" event={"ID":"d0aed645-6d56-4068-ad5b-fa581068b316","Type":"ContainerStarted","Data":"2cecec63e807e8d2b07c7deeeee4a32448b0c2b2c57c21624d749928465dd5d9"} Jul 03 15:14:10.457518 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:10.457490 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" event={"ID":"d0aed645-6d56-4068-ad5b-fa581068b316","Type":"ContainerStarted","Data":"c6678cd7777174882dd779e41aa01b4a1a057b0f6177ec3cea43535fd8f98883"} Jul 03 15:14:10.457693 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:10.457674 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:14:10.470296 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:10.470257 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-chpm2" podStartSLOduration=65.547268259 podStartE2EDuration="1m8.470243192s" totalImagesPullingTime="2.922974933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:10.468925782 +0000 UTC m=+69.051949613" watchObservedRunningTime="2026-07-03 15:14:10.470243192 +0000 UTC m=+69.053266998" Jul 03 15:14:10.488990 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:10.488508 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" podStartSLOduration=67.488489852 podStartE2EDuration="1m7.488489852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:13:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:10.487795967 +0000 UTC m=+69.070819800" watchObservedRunningTime="2026-07-03 15:14:10.488489852 +0000 UTC m=+69.071513682" Jul 03 15:14:10.509883 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:10.509832 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" podStartSLOduration=65.509812734 podStartE2EDuration="1m5.509812734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:13:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:10.508190566 +0000 UTC m=+69.091214397" watchObservedRunningTime="2026-07-03 15:14:10.509812734 +0000 UTC m=+69.092836563" Jul 03 15:14:11.381831 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:11.381800 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:14:11.384822 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:11.384796 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:14:11.467397 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:11.466838 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hc69x" event={"ID":"9c966052-a70c-4977-8439-4adbf4f2e71c","Type":"ContainerStarted","Data":"01f68ac91ac2061d21f0c156e5092f5aec989d3098d680db211c30fc393be608"} Jul 03 15:14:11.468134 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:11.468082 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:14:11.469940 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:11.469752 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-bc6b7cdc9-l5w6c" Jul 03 15:14:12.014429 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:12.014398 2532 scope.go:117] "RemoveContainer" containerID="e5c24a98e4a48cd10786c5cd330f2230d6a9d99ea1313fcee5d00012d6887187" Jul 03 15:14:12.950246 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:12.950207 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b77b94f7d-tw9cs"] Jul 03 15:14:12.955402 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:12.953447 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b77b94f7d-tw9cs" Jul 03 15:14:12.956435 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:12.956413 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 03 15:14:12.957691 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:12.957672 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 03 15:14:12.957787 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:12.957726 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 03 15:14:12.957845 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:12.957726 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 03 15:14:12.957845 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:12.957805 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mq2st\"" Jul 03 15:14:12.968437 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:12.968410 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b77b94f7d-tw9cs"] Jul 03 15:14:12.992734 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:12.992658 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:13.100745 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:13.100708 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-274jk\" (UniqueName: \"kubernetes.io/projected/c252a344-c7c7-4aa1-b17b-bb99ba3774df-kube-api-access-274jk\") pod \"managed-serviceaccount-addon-agent-b77b94f7d-tw9cs\" (UID: \"c252a344-c7c7-4aa1-b17b-bb99ba3774df\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b77b94f7d-tw9cs" Jul 03 15:14:13.100900 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:13.100755 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c252a344-c7c7-4aa1-b17b-bb99ba3774df-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b77b94f7d-tw9cs\" (UID: \"c252a344-c7c7-4aa1-b17b-bb99ba3774df\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b77b94f7d-tw9cs" Jul 03 15:14:13.128271 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:13.128231 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:13.201649 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:13.201573 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-274jk\" (UniqueName: \"kubernetes.io/projected/c252a344-c7c7-4aa1-b17b-bb99ba3774df-kube-api-access-274jk\") pod \"managed-serviceaccount-addon-agent-b77b94f7d-tw9cs\" (UID: \"c252a344-c7c7-4aa1-b17b-bb99ba3774df\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b77b94f7d-tw9cs" Jul 03 15:14:13.201649 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:13.201616 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c252a344-c7c7-4aa1-b17b-bb99ba3774df-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b77b94f7d-tw9cs\" (UID: \"c252a344-c7c7-4aa1-b17b-bb99ba3774df\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b77b94f7d-tw9cs" Jul 03 15:14:13.204347 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:13.204315 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c252a344-c7c7-4aa1-b17b-bb99ba3774df-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b77b94f7d-tw9cs\" (UID: \"c252a344-c7c7-4aa1-b17b-bb99ba3774df\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b77b94f7d-tw9cs" Jul 03 15:14:13.214735 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:13.214712 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-274jk\" (UniqueName: \"kubernetes.io/projected/c252a344-c7c7-4aa1-b17b-bb99ba3774df-kube-api-access-274jk\") pod \"managed-serviceaccount-addon-agent-b77b94f7d-tw9cs\" (UID: \"c252a344-c7c7-4aa1-b17b-bb99ba3774df\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b77b94f7d-tw9cs" Jul 03 15:14:13.241810 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:13.241775 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:13.275978 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:13.275944 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b77b94f7d-tw9cs" Jul 03 15:14:13.338757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:13.338721 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:13.619781 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:13.619747 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:13.721585 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:13.721526 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:14.716232 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:14.716145 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/396f2c56-4cfc-410d-836b-bb5d474c2140-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fdnfh\" (UID: \"396f2c56-4cfc-410d-836b-bb5d474c2140\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fdnfh" Jul 03 15:14:14.718967 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:14.718944 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/396f2c56-4cfc-410d-836b-bb5d474c2140-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fdnfh\" (UID: \"396f2c56-4cfc-410d-836b-bb5d474c2140\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fdnfh" Jul 03 15:14:14.933408 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:14.933356 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-w7bh2\"" Jul 03 15:14:14.941440 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:14.941411 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fdnfh" Jul 03 15:14:15.556508 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:15.556450 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:15.656942 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:15.656900 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:15.757912 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:15.757799 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:15.813503 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:15.813423 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:17.218206 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.218164 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-fdnfh"] Jul 03 15:14:17.229873 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:14:17.229847 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod396f2c56_4cfc_410d_836b_bb5d474c2140.slice/crio-52fd8db2c6fc1208c4bc189cde4fde759ac8ab2992c96b60fc9c66a731296e1a WatchSource:0}: Error finding container 52fd8db2c6fc1208c4bc189cde4fde759ac8ab2992c96b60fc9c66a731296e1a: Status 404 returned error can't find the container with id 52fd8db2c6fc1208c4bc189cde4fde759ac8ab2992c96b60fc9c66a731296e1a Jul 03 15:14:17.247863 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.247511 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b77b94f7d-tw9cs"] Jul 03 15:14:17.257049 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:14:17.257017 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc252a344_c7c7_4aa1_b17b_bb99ba3774df.slice/crio-d2dade231ba808db24e4d1af3d624aadd6314f844b69c0d92f2d0a0dbafd4e4b WatchSource:0}: Error finding container d2dade231ba808db24e4d1af3d624aadd6314f844b69c0d92f2d0a0dbafd4e4b: Status 404 returned error can't find the container with id d2dade231ba808db24e4d1af3d624aadd6314f844b69c0d92f2d0a0dbafd4e4b Jul 03 15:14:17.495854 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.495062 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb" event={"ID":"531cd3e1-eb3e-4443-b988-209c350ae15c","Type":"ContainerStarted","Data":"2770ad0b7b8eac467206a5c9de6ac56bd107ab1ef2ee3261a64fa5b58944dcd2"} Jul 03 15:14:17.500168 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.499698 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hc69x" event={"ID":"9c966052-a70c-4977-8439-4adbf4f2e71c","Type":"ContainerStarted","Data":"0f31a97025845661da8b682c003a751c461075e9c8110d61f1ae692b0e95c736"} Jul 03 15:14:17.502261 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.502232 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pf7lv" event={"ID":"de92b340-37d1-4df2-867c-09b1d0da425c","Type":"ContainerStarted","Data":"ba6be9126e4e97924f2a0ce7ec2b30816495e3b0e1287794d1ca570db33b634c"} Jul 03 15:14:17.502405 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.502283 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pf7lv" event={"ID":"de92b340-37d1-4df2-867c-09b1d0da425c","Type":"ContainerStarted","Data":"df0e9d99e0e638e450906b03255301c9d4e34cec88e43aa7edf4d6783a8d836c"} Jul 03 15:14:17.504598 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.504565 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fdnfh" event={"ID":"396f2c56-4cfc-410d-836b-bb5d474c2140","Type":"ContainerStarted","Data":"52fd8db2c6fc1208c4bc189cde4fde759ac8ab2992c96b60fc9c66a731296e1a"} Jul 03 15:14:17.508770 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.506969 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/1.log" Jul 03 15:14:17.508770 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.507049 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-srbsr" event={"ID":"00b62b2c-dffe-4879-98e6-41c8ba914d63","Type":"ContainerStarted","Data":"7976ac52eee6befcb599f6c6f09b2b704173e238bd4ddc2b691fd13b8074f0cb"} Jul 03 15:14:17.508770 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.507706 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-srbsr" Jul 03 15:14:17.510755 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.510728 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5wr4p" event={"ID":"d825134a-e7de-4199-a8db-36d954270785","Type":"ContainerStarted","Data":"8f2a85b3605d760d8b7bc9587b28a4ba84c512fa092bb4b99caf9169a97a871a"} Jul 03 15:14:17.510845 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.510775 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5wr4p" Jul 03 15:14:17.510845 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.510792 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5wr4p" event={"ID":"d825134a-e7de-4199-a8db-36d954270785","Type":"ContainerStarted","Data":"62df04a8e451678a48be798f2010b6307a1610e1207e7fd3c03814614d1d4209"} Jul 03 15:14:17.512030 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.512012 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b77b94f7d-tw9cs" event={"ID":"c252a344-c7c7-4aa1-b17b-bb99ba3774df","Type":"ContainerStarted","Data":"d2dade231ba808db24e4d1af3d624aadd6314f844b69c0d92f2d0a0dbafd4e4b"} Jul 03 15:14:17.514476 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.514422 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x8ftb" podStartSLOduration=65.745265888 podStartE2EDuration="1m12.514406712s" totalImagesPullingTime="6.769140824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:13:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:17.513348007 +0000 UTC m=+76.096371837" watchObservedRunningTime="2026-07-03 15:14:17.514406712 +0000 UTC m=+76.097430543" Jul 03 15:14:17.514712 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.514487 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9df89" event={"ID":"37843d47-7c15-44ce-b3af-54b536ace36f","Type":"ContainerStarted","Data":"88c69cc99b5142152d782789363336a6aa8b2f1416cb0da08b4f50710e1ae7f4"} Jul 03 15:14:17.536139 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.536011 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pf7lv" podStartSLOduration=61.834280007 podStartE2EDuration="1m8.53599631s" totalImagesPullingTime="6.701716303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:17.534177981 +0000 UTC m=+76.117201812" watchObservedRunningTime="2026-07-03 15:14:17.53599631 +0000 UTC m=+76.119020139" Jul 03 15:14:17.556438 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.556384 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-srbsr" podStartSLOduration=56.937555765 podStartE2EDuration="1m6.556353466s" totalImagesPullingTime="9.618797701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:13:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:17.55581411 +0000 UTC m=+76.138837943" watchObservedRunningTime="2026-07-03 15:14:17.556353466 +0000 UTC m=+76.139377292" Jul 03 15:14:17.569194 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.569115 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:17.573848 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.573797 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5wr4p" podStartSLOduration=33.787172435 podStartE2EDuration="40.573778692s" totalImagesPullingTime="6.786606257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:13:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:17.572173206 +0000 UTC m=+76.155197037" watchObservedRunningTime="2026-07-03 15:14:17.573778692 +0000 UTC m=+76.156802524" Jul 03 15:14:17.595175 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.595129 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hc69x" podStartSLOduration=17.592564645 podStartE2EDuration="28.595112479s" totalImagesPullingTime="11.002547834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:17.594785964 +0000 UTC m=+76.177809795" watchObservedRunningTime="2026-07-03 15:14:17.595112479 +0000 UTC m=+76.178136307" Jul 03 15:14:17.609072 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.609019 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9df89" podStartSLOduration=65.6750455 podStartE2EDuration="1m15.608992579s" totalImagesPullingTime="9.933947079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:17.608576747 +0000 UTC m=+76.191600569" watchObservedRunningTime="2026-07-03 15:14:17.608992579 +0000 UTC m=+76.192016419" Jul 03 15:14:17.663553 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.663513 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:17.731707 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.731673 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:17.982741 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:17.982693 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:18.255008 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:18.254925 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-srbsr" Jul 03 15:14:18.459198 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:18.459164 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:18.557977 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:18.557896 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:18.616692 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:18.616653 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:18.735317 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:18.735281 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:19.364387 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:19.364341 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:19.449243 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:19.449197 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:19.530288 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:19.530257 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:19.758477 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:19.758391 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:19.859299 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:19.859269 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:20.129359 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:20.129327 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:20.305470 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:20.305432 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:20.406604 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:20.406577 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:20.530584 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:20.530549 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fdnfh" event={"ID":"396f2c56-4cfc-410d-836b-bb5d474c2140","Type":"ContainerStarted","Data":"a58875b935c6b2ce55ae69b83f150e1158c5e60b3b55bd1504c6a85218a8c710"} Jul 03 15:14:20.548670 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:20.548618 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fdnfh" podStartSLOduration=35.436083763 podStartE2EDuration="38.548600586s" totalImagesPullingTime="3.112516823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:13:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:20.546986833 +0000 UTC m=+79.130010665" watchObservedRunningTime="2026-07-03 15:14:20.548600586 +0000 UTC m=+79.131624415" Jul 03 15:14:20.698292 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:20.698265 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:20.772420 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:20.772395 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:21.432925 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:21.432883 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:21.533084 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:21.533049 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:21.536477 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:21.536451 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b77b94f7d-tw9cs" event={"ID":"c252a344-c7c7-4aa1-b17b-bb99ba3774df","Type":"ContainerStarted","Data":"3cbc78857f76e962c2fed8b5fa500a8f5a6958e43a79dbb36fa296fd0f8b3bba"} Jul 03 15:14:21.552578 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:21.552527 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b77b94f7d-tw9cs" podStartSLOduration=6.162801613 podStartE2EDuration="9.552511821s" totalImagesPullingTime="3.389710208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:14:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:21.550934189 +0000 UTC m=+80.133958018" watchObservedRunningTime="2026-07-03 15:14:21.552511821 +0000 UTC m=+80.135535650" Jul 03 15:14:21.633518 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:21.633488 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:21.761408 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:21.761298 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:21.836647 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:21.836612 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:21.949394 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:21.949336 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:22.050744 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:22.050615 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:22.282773 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:22.282734 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:22.781032 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:22.780898 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:22.882177 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:22.882146 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:22.981780 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:22.981743 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:25.289600 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:25.289562 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:26.606164 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:26.606135 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:26.693525 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:26.693489 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:26.904871 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:26.904770 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:27.101349 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.101306 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:27.183269 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.183197 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5frvz"] Jul 03 15:14:27.186068 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.186051 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.189353 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.189327 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 03 15:14:27.189488 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.189359 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 03 15:14:27.189488 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.189436 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c2mmx\"" Jul 03 15:14:27.189488 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.189445 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 03 15:14:27.190271 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.190256 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 03 15:14:27.215682 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.215661 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvskl\" (UniqueName: \"kubernetes.io/projected/6a63b9f0-c361-495b-9dac-9cc82b071f4a-kube-api-access-lvskl\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.215799 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.215696 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6a63b9f0-c361-495b-9dac-9cc82b071f4a-node-exporter-accelerators-collector-config\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.215799 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.215717 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a63b9f0-c361-495b-9dac-9cc82b071f4a-sys\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.215799 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.215734 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6a63b9f0-c361-495b-9dac-9cc82b071f4a-node-exporter-wtmp\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.215893 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.215800 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6a63b9f0-c361-495b-9dac-9cc82b071f4a-node-exporter-textfile\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.215893 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.215837 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6a63b9f0-c361-495b-9dac-9cc82b071f4a-node-exporter-tls\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.215893 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.215854 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a63b9f0-c361-495b-9dac-9cc82b071f4a-metrics-client-ca\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.215893 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.215875 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6a63b9f0-c361-495b-9dac-9cc82b071f4a-root\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.216036 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.215894 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a63b9f0-c361-495b-9dac-9cc82b071f4a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.224050 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.224015 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:27.317010 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.316979 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6a63b9f0-c361-495b-9dac-9cc82b071f4a-root\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.317010 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.317013 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a63b9f0-c361-495b-9dac-9cc82b071f4a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.317255 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.317048 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvskl\" (UniqueName: \"kubernetes.io/projected/6a63b9f0-c361-495b-9dac-9cc82b071f4a-kube-api-access-lvskl\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.317255 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.317074 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6a63b9f0-c361-495b-9dac-9cc82b071f4a-node-exporter-accelerators-collector-config\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.317255 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.317095 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a63b9f0-c361-495b-9dac-9cc82b071f4a-sys\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.317255 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.317106 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6a63b9f0-c361-495b-9dac-9cc82b071f4a-root\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.317255 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.317119 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6a63b9f0-c361-495b-9dac-9cc82b071f4a-node-exporter-wtmp\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.317255 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.317181 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6a63b9f0-c361-495b-9dac-9cc82b071f4a-node-exporter-textfile\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.317255 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.317197 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a63b9f0-c361-495b-9dac-9cc82b071f4a-sys\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.317255 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.317234 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6a63b9f0-c361-495b-9dac-9cc82b071f4a-node-exporter-wtmp\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.317669 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.317264 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6a63b9f0-c361-495b-9dac-9cc82b071f4a-node-exporter-tls\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.317669 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.317287 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a63b9f0-c361-495b-9dac-9cc82b071f4a-metrics-client-ca\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.317669 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.317578 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6a63b9f0-c361-495b-9dac-9cc82b071f4a-node-exporter-textfile\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.317929 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.317901 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a63b9f0-c361-495b-9dac-9cc82b071f4a-metrics-client-ca\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.317989 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.317907 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6a63b9f0-c361-495b-9dac-9cc82b071f4a-node-exporter-accelerators-collector-config\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.319963 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.319926 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a63b9f0-c361-495b-9dac-9cc82b071f4a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.320115 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.320100 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6a63b9f0-c361-495b-9dac-9cc82b071f4a-node-exporter-tls\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.326562 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.326540 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvskl\" (UniqueName: \"kubernetes.io/projected/6a63b9f0-c361-495b-9dac-9cc82b071f4a-kube-api-access-lvskl\") pod \"node-exporter-5frvz\" (UID: \"6a63b9f0-c361-495b-9dac-9cc82b071f4a\") " pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.358584 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.358545 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:27.457917 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.457827 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:27.495494 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.495463 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5frvz" Jul 03 15:14:27.506670 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:14:27.506641 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a63b9f0_c361_495b_9dac_9cc82b071f4a.slice/crio-8836850a3552d36cd6b6ba53faddd1ccca2f023ab7e0e7e2c95615cc6d3fe481 WatchSource:0}: Error finding container 8836850a3552d36cd6b6ba53faddd1ccca2f023ab7e0e7e2c95615cc6d3fe481: Status 404 returned error can't find the container with id 8836850a3552d36cd6b6ba53faddd1ccca2f023ab7e0e7e2c95615cc6d3fe481 Jul 03 15:14:27.522831 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.522802 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5wr4p" Jul 03 15:14:27.543629 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.543595 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:27.560671 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.560645 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5frvz" event={"ID":"6a63b9f0-c361-495b-9dac-9cc82b071f4a","Type":"ContainerStarted","Data":"8836850a3552d36cd6b6ba53faddd1ccca2f023ab7e0e7e2c95615cc6d3fe481"} Jul 03 15:14:27.604308 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.604282 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:27.709821 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:27.709743 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:28.150209 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:28.150172 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:28.238117 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:28.238084 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:28.567653 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:28.567609 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5frvz" event={"ID":"6a63b9f0-c361-495b-9dac-9cc82b071f4a","Type":"ContainerStarted","Data":"857e6a253bb8a0712622ea5316e85e66b4b288dcd8793236fbc368afa07f4daf"} Jul 03 15:14:28.899380 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:28.899328 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:29.361544 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:29.361511 2532 patch_prober.go:28] interesting pod/image-registry-65b9b77fcb-fj8hl container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 03 15:14:29.361712 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:29.361574 2532 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" podUID="d0aed645-6d56-4068-ad5b-fa581068b316" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 03 15:14:29.572612 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:29.572579 2532 generic.go:356] "Generic (PLEG): container finished" podID="6a63b9f0-c361-495b-9dac-9cc82b071f4a" containerID="857e6a253bb8a0712622ea5316e85e66b4b288dcd8793236fbc368afa07f4daf" exitCode=0 Jul 03 15:14:29.572786 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:29.572668 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5frvz" event={"ID":"6a63b9f0-c361-495b-9dac-9cc82b071f4a","Type":"ContainerDied","Data":"857e6a253bb8a0712622ea5316e85e66b4b288dcd8793236fbc368afa07f4daf"} Jul 03 15:14:30.119247 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:30.119210 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:30.217832 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:30.217801 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:30.278638 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:30.278599 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:30.549752 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:30.549662 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:30.581294 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:30.581266 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5frvz" event={"ID":"6a63b9f0-c361-495b-9dac-9cc82b071f4a","Type":"ContainerStarted","Data":"aebccebf0731b60a26cc2d9a0e9e2d2ace3c07f1b2dcf29e603eae753d3af92e"} Jul 03 15:14:30.581448 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:30.581314 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5frvz" event={"ID":"6a63b9f0-c361-495b-9dac-9cc82b071f4a","Type":"ContainerStarted","Data":"d5da28a34bcdd1601bbc1b16fba15ff02a780d40a98b4acc056859e83f3c441a"} Jul 03 15:14:30.601879 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:30.601826 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5frvz" podStartSLOduration=2.583230118 podStartE2EDuration="3.601811401s" totalImagesPullingTime="944.786646ms" totalInitContainerRuntime="73.794637ms" isStatefulPod=true podCreationTimestamp="2026-07-03 15:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:30.600549364 +0000 UTC m=+89.183573215" watchObservedRunningTime="2026-07-03 15:14:30.601811401 +0000 UTC m=+89.184835229" Jul 03 15:14:30.617486 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:30.617460 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:31.471813 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:31.471786 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:14:31.702766 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:31.702732 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:31.803567 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:31.803465 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:31.904318 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:31.904289 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:31.963910 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:31.963863 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:32.018191 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:32.018159 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:32.289217 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:32.289184 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:33.394339 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.394304 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:33.562561 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.562525 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-575dddf9c4-2vctw"] Jul 03 15:14:33.565416 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.565396 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:33.568268 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.568237 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 03 15:14:33.568389 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.568265 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 03 15:14:33.568389 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.568289 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 03 15:14:33.569584 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.569562 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 03 15:14:33.569584 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.569582 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 03 15:14:33.569752 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.569563 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 03 15:14:33.569752 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.569624 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 03 15:14:33.569752 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.569642 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jzkqj\"" Jul 03 15:14:33.573895 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.573875 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 03 15:14:33.575182 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.575164 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-575dddf9c4-2vctw"] Jul 03 15:14:33.669238 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.669151 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-console-config\") pod \"console-575dddf9c4-2vctw\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:33.669238 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.669184 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1130c2a-20ba-4d16-aa4d-96f8773dff09-console-oauth-config\") pod \"console-575dddf9c4-2vctw\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:33.669238 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.669202 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-oauth-serving-cert\") pod \"console-575dddf9c4-2vctw\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:33.669238 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.669224 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-trusted-ca-bundle\") pod \"console-575dddf9c4-2vctw\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:33.669514 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.669293 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-service-ca\") pod \"console-575dddf9c4-2vctw\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:33.669514 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.669323 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74fjd\" (UniqueName: \"kubernetes.io/projected/c1130c2a-20ba-4d16-aa4d-96f8773dff09-kube-api-access-74fjd\") pod \"console-575dddf9c4-2vctw\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:33.669514 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.669345 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1130c2a-20ba-4d16-aa4d-96f8773dff09-console-serving-cert\") pod \"console-575dddf9c4-2vctw\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:33.770507 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.770461 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-service-ca\") pod \"console-575dddf9c4-2vctw\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:33.770507 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.770518 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74fjd\" (UniqueName: \"kubernetes.io/projected/c1130c2a-20ba-4d16-aa4d-96f8773dff09-kube-api-access-74fjd\") pod \"console-575dddf9c4-2vctw\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:33.770746 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.770548 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1130c2a-20ba-4d16-aa4d-96f8773dff09-console-serving-cert\") pod \"console-575dddf9c4-2vctw\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:33.770746 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.770577 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-console-config\") pod \"console-575dddf9c4-2vctw\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:33.770746 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.770601 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1130c2a-20ba-4d16-aa4d-96f8773dff09-console-oauth-config\") pod \"console-575dddf9c4-2vctw\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:33.770887 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.770809 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-oauth-serving-cert\") pod \"console-575dddf9c4-2vctw\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:33.770887 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.770855 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-trusted-ca-bundle\") pod \"console-575dddf9c4-2vctw\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:33.771406 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.771313 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-service-ca\") pod \"console-575dddf9c4-2vctw\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:33.771406 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.771334 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-console-config\") pod \"console-575dddf9c4-2vctw\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:33.771406 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.771442 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-oauth-serving-cert\") pod \"console-575dddf9c4-2vctw\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:33.771984 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.771957 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-trusted-ca-bundle\") pod \"console-575dddf9c4-2vctw\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:33.773358 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.773333 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1130c2a-20ba-4d16-aa4d-96f8773dff09-console-oauth-config\") pod \"console-575dddf9c4-2vctw\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:33.773467 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.773431 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1130c2a-20ba-4d16-aa4d-96f8773dff09-console-serving-cert\") pod \"console-575dddf9c4-2vctw\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:33.779153 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.779129 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74fjd\" (UniqueName: \"kubernetes.io/projected/c1130c2a-20ba-4d16-aa4d-96f8773dff09-kube-api-access-74fjd\") pod \"console-575dddf9c4-2vctw\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:33.875445 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:33.875403 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:34.004645 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:34.004613 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-575dddf9c4-2vctw"] Jul 03 15:14:34.007777 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:14:34.007748 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1130c2a_20ba_4d16_aa4d_96f8773dff09.slice/crio-42162f9eb3a7fab0173d3db622645307c0202a8af83e6d811d74113b06af9463 WatchSource:0}: Error finding container 42162f9eb3a7fab0173d3db622645307c0202a8af83e6d811d74113b06af9463: Status 404 returned error can't find the container with id 42162f9eb3a7fab0173d3db622645307c0202a8af83e6d811d74113b06af9463 Jul 03 15:14:34.597739 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:34.597703 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-575dddf9c4-2vctw" event={"ID":"c1130c2a-20ba-4d16-aa4d-96f8773dff09","Type":"ContainerStarted","Data":"42162f9eb3a7fab0173d3db622645307c0202a8af83e6d811d74113b06af9463"} Jul 03 15:14:35.366812 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:35.366760 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:35.429633 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:35.429597 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:35.695402 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:35.695311 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65b9b77fcb-fj8hl"] Jul 03 15:14:35.769860 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:35.769821 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:35.829067 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:35.829034 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:35.935688 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:35.935653 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:36.036843 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:36.036750 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:36.153869 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:36.153823 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:36.209790 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:36.209754 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:36.968021 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:36.967953 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:37.040659 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:37.040623 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:37.613256 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:37.613222 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-575dddf9c4-2vctw" event={"ID":"c1130c2a-20ba-4d16-aa4d-96f8773dff09","Type":"ContainerStarted","Data":"b5b52fbdaf6bf2415eb2af8e6088eba737b64ffd6ce332bdf092ad43732c0d8b"} Jul 03 15:14:37.633137 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:37.633082 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-575dddf9c4-2vctw" podStartSLOduration=1.466185339 podStartE2EDuration="4.633067215s" totalImagesPullingTime="3.166881876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:14:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:37.631054855 +0000 UTC m=+96.214078685" watchObservedRunningTime="2026-07-03 15:14:37.633067215 +0000 UTC m=+96.216091044" Jul 03 15:14:38.438469 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:38.438432 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gtq6v" Jul 03 15:14:39.751300 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:39.751262 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:39.830190 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:39.830154 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:40.575637 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:40.575588 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:40.648406 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:40.648339 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:41.117357 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:41.117324 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:41.217012 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:41.216981 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:43.875866 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:43.875829 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:43.876357 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:43.875893 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:43.880787 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:43.880764 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:44.643746 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:44.643709 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:14:44.787110 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:44.787066 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:44.884956 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:44.884919 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:44.986025 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:44.985930 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:45.591882 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:45.591843 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:45.691400 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:45.691327 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:46.688270 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:46.688224 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:49.651021 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:49.650980 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:49.706406 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:49.706348 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:14:53.672837 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:53.672796 2532 generic.go:356] "Generic (PLEG): container finished" podID="25da0080-177d-4f5e-a476-ca1bd2066ca0" containerID="52f074e4b717d90e18b250f2ab93934264ad3d141fec1b285ec5f183d66f7279" exitCode=0 Jul 03 15:14:53.673198 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:53.672872 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jxkx5" event={"ID":"25da0080-177d-4f5e-a476-ca1bd2066ca0","Type":"ContainerDied","Data":"52f074e4b717d90e18b250f2ab93934264ad3d141fec1b285ec5f183d66f7279"} Jul 03 15:14:53.673198 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:53.673185 2532 scope.go:117] "RemoveContainer" containerID="52f074e4b717d90e18b250f2ab93934264ad3d141fec1b285ec5f183d66f7279" Jul 03 15:14:54.679538 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:54.679487 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jxkx5" event={"ID":"25da0080-177d-4f5e-a476-ca1bd2066ca0","Type":"ContainerStarted","Data":"e6bfa529f704bfb7ba23c497468d251611e3861af7e59d1bd55a3882221d0ab7"} Jul 03 15:14:59.698739 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:59.698702 2532 generic.go:356] "Generic (PLEG): container finished" podID="1cd66668-0c47-4f2a-9997-20b41987392c" containerID="0d23beb17a046a52090660e384af07f56913618df5efc5571fede1319f0cd4a9" exitCode=0 Jul 03 15:14:59.699128 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:59.698776 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" event={"ID":"1cd66668-0c47-4f2a-9997-20b41987392c","Type":"ContainerDied","Data":"0d23beb17a046a52090660e384af07f56913618df5efc5571fede1319f0cd4a9"} Jul 03 15:14:59.699128 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:14:59.699100 2532 scope.go:117] "RemoveContainer" containerID="0d23beb17a046a52090660e384af07f56913618df5efc5571fede1319f0cd4a9" Jul 03 15:15:00.562877 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:00.562843 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:15:00.660160 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:00.660127 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:15:00.703921 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:00.703885 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-vfv7v" event={"ID":"1cd66668-0c47-4f2a-9997-20b41987392c","Type":"ContainerStarted","Data":"45b7d21f0f0598cc73be9589921a1a759db522a33b0a932f00e5248b2ef657a7"} Jul 03 15:15:00.721657 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:00.721625 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" podUID="d0aed645-6d56-4068-ad5b-fa581068b316" containerName="registry" containerID="cri-o://2cecec63e807e8d2b07c7deeeee4a32448b0c2b2c57c21624d749928465dd5d9" gracePeriod=30 Jul 03 15:15:00.955187 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:00.955157 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:15:01.100840 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.100738 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0aed645-6d56-4068-ad5b-fa581068b316-registry-certificates\") pod \"d0aed645-6d56-4068-ad5b-fa581068b316\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " Jul 03 15:15:01.100840 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.100811 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8mm6\" (UniqueName: \"kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-kube-api-access-n8mm6\") pod \"d0aed645-6d56-4068-ad5b-fa581068b316\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " Jul 03 15:15:01.100840 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.100847 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls\") pod \"d0aed645-6d56-4068-ad5b-fa581068b316\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " Jul 03 15:15:01.101128 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.100889 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-bound-sa-token\") pod \"d0aed645-6d56-4068-ad5b-fa581068b316\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " Jul 03 15:15:01.101128 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.100918 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0aed645-6d56-4068-ad5b-fa581068b316-image-registry-private-configuration\") pod \"d0aed645-6d56-4068-ad5b-fa581068b316\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " Jul 03 15:15:01.101128 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.100999 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0aed645-6d56-4068-ad5b-fa581068b316-trusted-ca\") pod \"d0aed645-6d56-4068-ad5b-fa581068b316\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " Jul 03 15:15:01.101128 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.101052 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0aed645-6d56-4068-ad5b-fa581068b316-ca-trust-extracted\") pod \"d0aed645-6d56-4068-ad5b-fa581068b316\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " Jul 03 15:15:01.101128 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.101087 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0aed645-6d56-4068-ad5b-fa581068b316-installation-pull-secrets\") pod \"d0aed645-6d56-4068-ad5b-fa581068b316\" (UID: \"d0aed645-6d56-4068-ad5b-fa581068b316\") " Jul 03 15:15:01.101470 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.101166 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0aed645-6d56-4068-ad5b-fa581068b316-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d0aed645-6d56-4068-ad5b-fa581068b316" (UID: "d0aed645-6d56-4068-ad5b-fa581068b316"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:15:01.101539 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.101507 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0aed645-6d56-4068-ad5b-fa581068b316-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d0aed645-6d56-4068-ad5b-fa581068b316" (UID: "d0aed645-6d56-4068-ad5b-fa581068b316"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:15:01.101597 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.101540 2532 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0aed645-6d56-4068-ad5b-fa581068b316-registry-certificates\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:15:01.103613 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.103585 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d0aed645-6d56-4068-ad5b-fa581068b316" (UID: "d0aed645-6d56-4068-ad5b-fa581068b316"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:15:01.104003 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.103977 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0aed645-6d56-4068-ad5b-fa581068b316-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d0aed645-6d56-4068-ad5b-fa581068b316" (UID: "d0aed645-6d56-4068-ad5b-fa581068b316"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 15:15:01.104110 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.104016 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d0aed645-6d56-4068-ad5b-fa581068b316" (UID: "d0aed645-6d56-4068-ad5b-fa581068b316"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:15:01.104110 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.104072 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0aed645-6d56-4068-ad5b-fa581068b316-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d0aed645-6d56-4068-ad5b-fa581068b316" (UID: "d0aed645-6d56-4068-ad5b-fa581068b316"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 15:15:01.104182 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.104116 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-kube-api-access-n8mm6" (OuterVolumeSpecName: "kube-api-access-n8mm6") pod "d0aed645-6d56-4068-ad5b-fa581068b316" (UID: "d0aed645-6d56-4068-ad5b-fa581068b316"). InnerVolumeSpecName "kube-api-access-n8mm6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:15:01.109599 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.109574 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0aed645-6d56-4068-ad5b-fa581068b316-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d0aed645-6d56-4068-ad5b-fa581068b316" (UID: "d0aed645-6d56-4068-ad5b-fa581068b316"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:15:01.202077 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.202026 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8mm6\" (UniqueName: \"kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-kube-api-access-n8mm6\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:15:01.202077 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.202074 2532 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-registry-tls\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:15:01.202077 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.202088 2532 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0aed645-6d56-4068-ad5b-fa581068b316-bound-sa-token\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:15:01.202315 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.202103 2532 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0aed645-6d56-4068-ad5b-fa581068b316-image-registry-private-configuration\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:15:01.202315 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.202116 2532 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0aed645-6d56-4068-ad5b-fa581068b316-trusted-ca\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:15:01.202315 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.202127 2532 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0aed645-6d56-4068-ad5b-fa581068b316-ca-trust-extracted\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:15:01.202315 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.202138 2532 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0aed645-6d56-4068-ad5b-fa581068b316-installation-pull-secrets\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:15:01.708576 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.708540 2532 generic.go:356] "Generic (PLEG): container finished" podID="d0aed645-6d56-4068-ad5b-fa581068b316" containerID="2cecec63e807e8d2b07c7deeeee4a32448b0c2b2c57c21624d749928465dd5d9" exitCode=0 Jul 03 15:15:01.708962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.708585 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" Jul 03 15:15:01.708962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.708604 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" event={"ID":"d0aed645-6d56-4068-ad5b-fa581068b316","Type":"ContainerDied","Data":"2cecec63e807e8d2b07c7deeeee4a32448b0c2b2c57c21624d749928465dd5d9"} Jul 03 15:15:01.708962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.708652 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65b9b77fcb-fj8hl" event={"ID":"d0aed645-6d56-4068-ad5b-fa581068b316","Type":"ContainerDied","Data":"c6678cd7777174882dd779e41aa01b4a1a057b0f6177ec3cea43535fd8f98883"} Jul 03 15:15:01.708962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.708678 2532 scope.go:117] "RemoveContainer" containerID="2cecec63e807e8d2b07c7deeeee4a32448b0c2b2c57c21624d749928465dd5d9" Jul 03 15:15:01.717444 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.717425 2532 scope.go:117] "RemoveContainer" containerID="2cecec63e807e8d2b07c7deeeee4a32448b0c2b2c57c21624d749928465dd5d9" Jul 03 15:15:01.717706 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:15:01.717686 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cecec63e807e8d2b07c7deeeee4a32448b0c2b2c57c21624d749928465dd5d9\": container with ID starting with 2cecec63e807e8d2b07c7deeeee4a32448b0c2b2c57c21624d749928465dd5d9 not found: ID does not exist" containerID="2cecec63e807e8d2b07c7deeeee4a32448b0c2b2c57c21624d749928465dd5d9" Jul 03 15:15:01.717745 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.717713 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cecec63e807e8d2b07c7deeeee4a32448b0c2b2c57c21624d749928465dd5d9"} err="failed to get container status \"2cecec63e807e8d2b07c7deeeee4a32448b0c2b2c57c21624d749928465dd5d9\": rpc error: code = NotFound desc = could not find container \"2cecec63e807e8d2b07c7deeeee4a32448b0c2b2c57c21624d749928465dd5d9\": container with ID starting with 2cecec63e807e8d2b07c7deeeee4a32448b0c2b2c57c21624d749928465dd5d9 not found: ID does not exist" Jul 03 15:15:01.729023 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.728998 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65b9b77fcb-fj8hl"] Jul 03 15:15:01.732593 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:01.732571 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65b9b77fcb-fj8hl"] Jul 03 15:15:02.015644 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:02.015567 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0aed645-6d56-4068-ad5b-fa581068b316" path="/var/lib/kubelet/pods/d0aed645-6d56-4068-ad5b-fa581068b316/volumes" Jul 03 15:15:03.717538 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:03.717504 2532 generic.go:356] "Generic (PLEG): container finished" podID="5f4d2407-8aa3-4a18-9b68-e50f2bab4663" containerID="a4dd7aa7939067ce9cc3ceb09057f59f90205f86ac3978b6fc1eb1d09005b4f6" exitCode=0 Jul 03 15:15:03.717922 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:03.717561 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5ffwp" event={"ID":"5f4d2407-8aa3-4a18-9b68-e50f2bab4663","Type":"ContainerDied","Data":"a4dd7aa7939067ce9cc3ceb09057f59f90205f86ac3978b6fc1eb1d09005b4f6"} Jul 03 15:15:03.717922 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:03.717886 2532 scope.go:117] "RemoveContainer" containerID="a4dd7aa7939067ce9cc3ceb09057f59f90205f86ac3978b6fc1eb1d09005b4f6" Jul 03 15:15:04.726544 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:04.725579 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5ffwp" event={"ID":"5f4d2407-8aa3-4a18-9b68-e50f2bab4663","Type":"ContainerStarted","Data":"99126bb4501212d933c76f2afd956e82589c0493669495febf94a7939c4e6db2"} Jul 03 15:15:06.164348 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:06.164316 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:15:06.217962 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:06.217925 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:15:46.369863 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:46.369812 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:15:46.569066 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:46.569016 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:15:54.853507 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.853413 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55889bb496-q7gnb"] Jul 03 15:15:54.854048 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.853827 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0aed645-6d56-4068-ad5b-fa581068b316" containerName="registry" Jul 03 15:15:54.854048 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.853844 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0aed645-6d56-4068-ad5b-fa581068b316" containerName="registry" Jul 03 15:15:54.854048 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.853921 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0aed645-6d56-4068-ad5b-fa581068b316" containerName="registry" Jul 03 15:15:54.856137 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.856115 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:54.866910 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.866886 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55889bb496-q7gnb"] Jul 03 15:15:54.894842 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.894816 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-console-config\") pod \"console-55889bb496-q7gnb\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:54.894968 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.894850 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-service-ca\") pod \"console-55889bb496-q7gnb\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:54.894968 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.894878 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-oauth-serving-cert\") pod \"console-55889bb496-q7gnb\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:54.894968 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.894907 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-trusted-ca-bundle\") pod \"console-55889bb496-q7gnb\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:54.894968 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.894943 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-console-serving-cert\") pod \"console-55889bb496-q7gnb\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:54.894968 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.894960 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcc7c\" (UniqueName: \"kubernetes.io/projected/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-kube-api-access-hcc7c\") pod \"console-55889bb496-q7gnb\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:54.895128 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.894987 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-console-oauth-config\") pod \"console-55889bb496-q7gnb\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:54.919558 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.919533 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:15:54.978084 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.978059 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:15:54.995742 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.995710 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-console-oauth-config\") pod \"console-55889bb496-q7gnb\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:54.995855 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.995774 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-console-config\") pod \"console-55889bb496-q7gnb\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:54.995855 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.995811 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-service-ca\") pod \"console-55889bb496-q7gnb\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:54.995855 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.995833 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-oauth-serving-cert\") pod \"console-55889bb496-q7gnb\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:54.996010 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.995855 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-trusted-ca-bundle\") pod \"console-55889bb496-q7gnb\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:54.996010 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.995893 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-console-serving-cert\") pod \"console-55889bb496-q7gnb\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:54.996010 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.995919 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcc7c\" (UniqueName: \"kubernetes.io/projected/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-kube-api-access-hcc7c\") pod \"console-55889bb496-q7gnb\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:54.996750 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.996725 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-service-ca\") pod \"console-55889bb496-q7gnb\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:54.996867 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.996762 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-oauth-serving-cert\") pod \"console-55889bb496-q7gnb\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:54.996931 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.996784 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-console-config\") pod \"console-55889bb496-q7gnb\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:54.996974 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.996944 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-trusted-ca-bundle\") pod \"console-55889bb496-q7gnb\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:54.999040 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.999012 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-console-oauth-config\") pod \"console-55889bb496-q7gnb\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:54.999124 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:54.999078 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-console-serving-cert\") pod \"console-55889bb496-q7gnb\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:55.003913 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:55.003885 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcc7c\" (UniqueName: \"kubernetes.io/projected/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-kube-api-access-hcc7c\") pod \"console-55889bb496-q7gnb\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:55.166776 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:55.166691 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:15:55.294390 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:55.294338 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55889bb496-q7gnb"] Jul 03 15:15:55.297205 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:15:55.297179 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e03ef4_f8c8_40d9_9664_60a05ce1189d.slice/crio-11e7074dae844e125ba6ad462a0a76c9bb5f95c1c377fc3f51965e8f74af9124 WatchSource:0}: Error finding container 11e7074dae844e125ba6ad462a0a76c9bb5f95c1c377fc3f51965e8f74af9124: Status 404 returned error can't find the container with id 11e7074dae844e125ba6ad462a0a76c9bb5f95c1c377fc3f51965e8f74af9124 Jul 03 15:15:55.916416 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:55.916360 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55889bb496-q7gnb" event={"ID":"d4e03ef4-f8c8-40d9-9664-60a05ce1189d","Type":"ContainerStarted","Data":"bd3e8c35a9ed2b28de5eae94ede8f508bd3c1e5c63432a0178cad510f7d5b632"} Jul 03 15:15:55.916825 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:55.916436 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55889bb496-q7gnb" event={"ID":"d4e03ef4-f8c8-40d9-9664-60a05ce1189d","Type":"ContainerStarted","Data":"11e7074dae844e125ba6ad462a0a76c9bb5f95c1c377fc3f51965e8f74af9124"} Jul 03 15:15:55.934010 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:15:55.933961 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55889bb496-q7gnb" podStartSLOduration=1.933946423 podStartE2EDuration="1.933946423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:15:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:15:55.93286704 +0000 UTC m=+174.515890869" watchObservedRunningTime="2026-07-03 15:15:55.933946423 +0000 UTC m=+174.516970302" Jul 03 15:16:05.167009 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:05.166975 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:16:05.167405 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:05.167032 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:16:05.171837 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:05.171805 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:16:05.956193 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:05.956164 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:16:05.992610 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:05.992577 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-575dddf9c4-2vctw"] Jul 03 15:16:06.084612 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:06.084577 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:16:06.185619 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:06.185587 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:16:06.242248 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:06.242174 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:16:30.468351 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:30.468312 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:16:30.519116 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:30.519085 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:16:31.017359 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.017302 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-575dddf9c4-2vctw" podUID="c1130c2a-20ba-4d16-aa4d-96f8773dff09" containerName="console" containerID="cri-o://b5b52fbdaf6bf2415eb2af8e6088eba737b64ffd6ce332bdf092ad43732c0d8b" gracePeriod=15 Jul 03 15:16:31.266562 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.266539 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:16:31.375833 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.375793 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1130c2a-20ba-4d16-aa4d-96f8773dff09-console-oauth-config\") pod \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " Jul 03 15:16:31.375833 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.375837 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-service-ca\") pod \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " Jul 03 15:16:31.376059 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.375882 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-trusted-ca-bundle\") pod \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " Jul 03 15:16:31.376059 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.375909 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-oauth-serving-cert\") pod \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " Jul 03 15:16:31.376059 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.375961 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74fjd\" (UniqueName: \"kubernetes.io/projected/c1130c2a-20ba-4d16-aa4d-96f8773dff09-kube-api-access-74fjd\") pod \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " Jul 03 15:16:31.376206 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.376114 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1130c2a-20ba-4d16-aa4d-96f8773dff09-console-serving-cert\") pod \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " Jul 03 15:16:31.376206 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.376171 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-console-config\") pod \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\" (UID: \"c1130c2a-20ba-4d16-aa4d-96f8773dff09\") " Jul 03 15:16:31.376300 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.376258 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-service-ca" (OuterVolumeSpecName: "service-ca") pod "c1130c2a-20ba-4d16-aa4d-96f8773dff09" (UID: "c1130c2a-20ba-4d16-aa4d-96f8773dff09"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:16:31.376356 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.376336 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c1130c2a-20ba-4d16-aa4d-96f8773dff09" (UID: "c1130c2a-20ba-4d16-aa4d-96f8773dff09"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:16:31.376498 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.376363 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c1130c2a-20ba-4d16-aa4d-96f8773dff09" (UID: "c1130c2a-20ba-4d16-aa4d-96f8773dff09"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:16:31.376498 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.376475 2532 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-service-ca\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:16:31.376606 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.376590 2532 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-trusted-ca-bundle\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:16:31.376644 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.376610 2532 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-oauth-serving-cert\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:16:31.376847 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.376820 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-console-config" (OuterVolumeSpecName: "console-config") pod "c1130c2a-20ba-4d16-aa4d-96f8773dff09" (UID: "c1130c2a-20ba-4d16-aa4d-96f8773dff09"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:16:31.378212 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.378193 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1130c2a-20ba-4d16-aa4d-96f8773dff09-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c1130c2a-20ba-4d16-aa4d-96f8773dff09" (UID: "c1130c2a-20ba-4d16-aa4d-96f8773dff09"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 15:16:31.378721 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.378701 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1130c2a-20ba-4d16-aa4d-96f8773dff09-kube-api-access-74fjd" (OuterVolumeSpecName: "kube-api-access-74fjd") pod "c1130c2a-20ba-4d16-aa4d-96f8773dff09" (UID: "c1130c2a-20ba-4d16-aa4d-96f8773dff09"). InnerVolumeSpecName "kube-api-access-74fjd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:16:31.378721 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.378705 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1130c2a-20ba-4d16-aa4d-96f8773dff09-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c1130c2a-20ba-4d16-aa4d-96f8773dff09" (UID: "c1130c2a-20ba-4d16-aa4d-96f8773dff09"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 15:16:31.477446 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.477421 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74fjd\" (UniqueName: \"kubernetes.io/projected/c1130c2a-20ba-4d16-aa4d-96f8773dff09-kube-api-access-74fjd\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:16:31.477446 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.477445 2532 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1130c2a-20ba-4d16-aa4d-96f8773dff09-console-serving-cert\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:16:31.477806 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.477455 2532 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1130c2a-20ba-4d16-aa4d-96f8773dff09-console-config\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:16:31.477806 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:31.477463 2532 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1130c2a-20ba-4d16-aa4d-96f8773dff09-console-oauth-config\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:16:32.046779 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:32.046751 2532 generic.go:356] "Generic (PLEG): container finished" podID="c1130c2a-20ba-4d16-aa4d-96f8773dff09" containerID="b5b52fbdaf6bf2415eb2af8e6088eba737b64ffd6ce332bdf092ad43732c0d8b" exitCode=0 Jul 03 15:16:32.046904 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:32.046791 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-575dddf9c4-2vctw" Jul 03 15:16:32.046904 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:32.046795 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-575dddf9c4-2vctw" event={"ID":"c1130c2a-20ba-4d16-aa4d-96f8773dff09","Type":"ContainerDied","Data":"b5b52fbdaf6bf2415eb2af8e6088eba737b64ffd6ce332bdf092ad43732c0d8b"} Jul 03 15:16:32.046904 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:32.046890 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-575dddf9c4-2vctw" event={"ID":"c1130c2a-20ba-4d16-aa4d-96f8773dff09","Type":"ContainerDied","Data":"42162f9eb3a7fab0173d3db622645307c0202a8af83e6d811d74113b06af9463"} Jul 03 15:16:32.047007 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:32.046909 2532 scope.go:117] "RemoveContainer" containerID="b5b52fbdaf6bf2415eb2af8e6088eba737b64ffd6ce332bdf092ad43732c0d8b" Jul 03 15:16:32.054942 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:32.054926 2532 scope.go:117] "RemoveContainer" containerID="b5b52fbdaf6bf2415eb2af8e6088eba737b64ffd6ce332bdf092ad43732c0d8b" Jul 03 15:16:32.055172 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:16:32.055154 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5b52fbdaf6bf2415eb2af8e6088eba737b64ffd6ce332bdf092ad43732c0d8b\": container with ID starting with b5b52fbdaf6bf2415eb2af8e6088eba737b64ffd6ce332bdf092ad43732c0d8b not found: ID does not exist" containerID="b5b52fbdaf6bf2415eb2af8e6088eba737b64ffd6ce332bdf092ad43732c0d8b" Jul 03 15:16:32.055214 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:32.055180 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5b52fbdaf6bf2415eb2af8e6088eba737b64ffd6ce332bdf092ad43732c0d8b"} err="failed to get container status \"b5b52fbdaf6bf2415eb2af8e6088eba737b64ffd6ce332bdf092ad43732c0d8b\": rpc error: code = NotFound desc = could not find container \"b5b52fbdaf6bf2415eb2af8e6088eba737b64ffd6ce332bdf092ad43732c0d8b\": container with ID starting with b5b52fbdaf6bf2415eb2af8e6088eba737b64ffd6ce332bdf092ad43732c0d8b not found: ID does not exist" Jul 03 15:16:32.063404 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:32.063383 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-575dddf9c4-2vctw"] Jul 03 15:16:32.067033 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:32.067014 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-575dddf9c4-2vctw"] Jul 03 15:16:34.016522 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:34.016486 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1130c2a-20ba-4d16-aa4d-96f8773dff09" path="/var/lib/kubelet/pods/c1130c2a-20ba-4d16-aa4d-96f8773dff09/volumes" Jul 03 15:16:53.064229 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:16:53.064197 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:17:01.610010 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:01.609969 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:17:01.713012 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:01.712980 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:17:13.483952 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:13.483909 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:17:13.541971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:13.541943 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:17:14.428985 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.428955 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d846c95c7-48qg9"] Jul 03 15:17:14.429227 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.429215 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1130c2a-20ba-4d16-aa4d-96f8773dff09" containerName="console" Jul 03 15:17:14.429274 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.429229 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1130c2a-20ba-4d16-aa4d-96f8773dff09" containerName="console" Jul 03 15:17:14.429307 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.429291 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1130c2a-20ba-4d16-aa4d-96f8773dff09" containerName="console" Jul 03 15:17:14.431887 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.431866 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.447050 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.447026 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d846c95c7-48qg9"] Jul 03 15:17:14.483729 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.483695 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-service-ca\") pod \"console-6d846c95c7-48qg9\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.483729 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.483730 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-console-serving-cert\") pod \"console-6d846c95c7-48qg9\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.483894 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.483750 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-console-oauth-config\") pod \"console-6d846c95c7-48qg9\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.483894 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.483811 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r2tn\" (UniqueName: \"kubernetes.io/projected/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-kube-api-access-8r2tn\") pod \"console-6d846c95c7-48qg9\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.483894 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.483828 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-oauth-serving-cert\") pod \"console-6d846c95c7-48qg9\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.483894 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.483876 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-console-config\") pod \"console-6d846c95c7-48qg9\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.484268 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.483902 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-trusted-ca-bundle\") pod \"console-6d846c95c7-48qg9\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.522090 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.522065 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:17:14.577992 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.577961 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:17:14.584565 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.584542 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r2tn\" (UniqueName: \"kubernetes.io/projected/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-kube-api-access-8r2tn\") pod \"console-6d846c95c7-48qg9\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.584646 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.584569 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-oauth-serving-cert\") pod \"console-6d846c95c7-48qg9\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.584646 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.584590 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-console-config\") pod \"console-6d846c95c7-48qg9\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.584646 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.584607 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-trusted-ca-bundle\") pod \"console-6d846c95c7-48qg9\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.584646 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.584634 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-service-ca\") pod \"console-6d846c95c7-48qg9\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.584831 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.584662 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-console-serving-cert\") pod \"console-6d846c95c7-48qg9\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.584831 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.584788 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-console-oauth-config\") pod \"console-6d846c95c7-48qg9\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.585285 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.585259 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-oauth-serving-cert\") pod \"console-6d846c95c7-48qg9\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.585393 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.585332 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-service-ca\") pod \"console-6d846c95c7-48qg9\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.585446 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.585408 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-console-config\") pod \"console-6d846c95c7-48qg9\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.585581 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.585563 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-trusted-ca-bundle\") pod \"console-6d846c95c7-48qg9\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.587852 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.587831 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-console-serving-cert\") pod \"console-6d846c95c7-48qg9\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.587953 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.587932 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-console-oauth-config\") pod \"console-6d846c95c7-48qg9\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.592555 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.592539 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r2tn\" (UniqueName: \"kubernetes.io/projected/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-kube-api-access-8r2tn\") pod \"console-6d846c95c7-48qg9\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.741762 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.741694 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:14.876069 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:14.876037 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d846c95c7-48qg9"] Jul 03 15:17:14.880528 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:17:14.880502 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c920e6a_3b6c_4dcf_a065_60447a5f8cf4.slice/crio-7e64f5d335ef81cd8a565e18a05caa7ad5ac291d8ba01249f01ea219ccad8970 WatchSource:0}: Error finding container 7e64f5d335ef81cd8a565e18a05caa7ad5ac291d8ba01249f01ea219ccad8970: Status 404 returned error can't find the container with id 7e64f5d335ef81cd8a565e18a05caa7ad5ac291d8ba01249f01ea219ccad8970 Jul 03 15:17:15.200192 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:15.200160 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d846c95c7-48qg9" event={"ID":"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4","Type":"ContainerStarted","Data":"cad395c59256139e0dc6b041821afce108bdc28aa8d09871abb3a402cb9b9769"} Jul 03 15:17:15.200354 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:15.200214 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d846c95c7-48qg9" event={"ID":"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4","Type":"ContainerStarted","Data":"7e64f5d335ef81cd8a565e18a05caa7ad5ac291d8ba01249f01ea219ccad8970"} Jul 03 15:17:15.218740 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:15.218690 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d846c95c7-48qg9" podStartSLOduration=1.218676092 podStartE2EDuration="1.218676092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:17:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:17:15.217896553 +0000 UTC m=+253.800920396" watchObservedRunningTime="2026-07-03 15:17:15.218676092 +0000 UTC m=+253.801699920" Jul 03 15:17:18.795301 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:18.795251 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:17:24.742286 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:24.742202 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:24.742286 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:24.742261 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:24.747289 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:24.747271 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:25.240060 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:25.240032 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:17:25.285431 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:25.285400 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55889bb496-q7gnb"] Jul 03 15:17:25.394653 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:25.394618 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:17:25.495581 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:25.495499 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:17:25.545901 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:25.545877 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:17:30.577186 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:30.577146 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:17:30.676639 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:30.676608 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:17:50.117077 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.117042 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:17:50.308936 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.308893 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-55889bb496-q7gnb" podUID="d4e03ef4-f8c8-40d9-9664-60a05ce1189d" containerName="console" containerID="cri-o://bd3e8c35a9ed2b28de5eae94ede8f508bd3c1e5c63432a0178cad510f7d5b632" gracePeriod=15 Jul 03 15:17:50.545936 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.545914 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:17:50.645631 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.645607 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcc7c\" (UniqueName: \"kubernetes.io/projected/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-kube-api-access-hcc7c\") pod \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " Jul 03 15:17:50.645783 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.645646 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-service-ca\") pod \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " Jul 03 15:17:50.645783 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.645675 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-oauth-serving-cert\") pod \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " Jul 03 15:17:50.645783 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.645694 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-console-config\") pod \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " Jul 03 15:17:50.645783 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.645742 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-trusted-ca-bundle\") pod \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " Jul 03 15:17:50.645999 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.645786 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-console-serving-cert\") pod \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " Jul 03 15:17:50.645999 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.645819 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-console-oauth-config\") pod \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\" (UID: \"d4e03ef4-f8c8-40d9-9664-60a05ce1189d\") " Jul 03 15:17:50.646123 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.646079 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d4e03ef4-f8c8-40d9-9664-60a05ce1189d" (UID: "d4e03ef4-f8c8-40d9-9664-60a05ce1189d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:17:50.646123 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.646091 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-service-ca" (OuterVolumeSpecName: "service-ca") pod "d4e03ef4-f8c8-40d9-9664-60a05ce1189d" (UID: "d4e03ef4-f8c8-40d9-9664-60a05ce1189d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:17:50.646217 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.646188 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d4e03ef4-f8c8-40d9-9664-60a05ce1189d" (UID: "d4e03ef4-f8c8-40d9-9664-60a05ce1189d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:17:50.646217 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.646195 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-console-config" (OuterVolumeSpecName: "console-config") pod "d4e03ef4-f8c8-40d9-9664-60a05ce1189d" (UID: "d4e03ef4-f8c8-40d9-9664-60a05ce1189d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:17:50.647976 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.647945 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d4e03ef4-f8c8-40d9-9664-60a05ce1189d" (UID: "d4e03ef4-f8c8-40d9-9664-60a05ce1189d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 15:17:50.648093 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.647976 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d4e03ef4-f8c8-40d9-9664-60a05ce1189d" (UID: "d4e03ef4-f8c8-40d9-9664-60a05ce1189d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 15:17:50.648093 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.648051 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-kube-api-access-hcc7c" (OuterVolumeSpecName: "kube-api-access-hcc7c") pod "d4e03ef4-f8c8-40d9-9664-60a05ce1189d" (UID: "d4e03ef4-f8c8-40d9-9664-60a05ce1189d"). InnerVolumeSpecName "kube-api-access-hcc7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:17:50.746573 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.746513 2532 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-console-oauth-config\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:17:50.746573 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.746536 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcc7c\" (UniqueName: \"kubernetes.io/projected/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-kube-api-access-hcc7c\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:17:50.746573 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.746548 2532 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-service-ca\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:17:50.746573 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.746563 2532 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-oauth-serving-cert\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:17:50.746755 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.746575 2532 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-console-config\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:17:50.746755 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.746587 2532 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-trusted-ca-bundle\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:17:50.746755 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:50.746598 2532 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4e03ef4-f8c8-40d9-9664-60a05ce1189d-console-serving-cert\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:17:51.338354 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:51.338312 2532 generic.go:356] "Generic (PLEG): container finished" podID="d4e03ef4-f8c8-40d9-9664-60a05ce1189d" containerID="bd3e8c35a9ed2b28de5eae94ede8f508bd3c1e5c63432a0178cad510f7d5b632" exitCode=0 Jul 03 15:17:51.338354 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:51.338359 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55889bb496-q7gnb" Jul 03 15:17:51.338835 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:51.338404 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55889bb496-q7gnb" event={"ID":"d4e03ef4-f8c8-40d9-9664-60a05ce1189d","Type":"ContainerDied","Data":"bd3e8c35a9ed2b28de5eae94ede8f508bd3c1e5c63432a0178cad510f7d5b632"} Jul 03 15:17:51.338835 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:51.338462 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55889bb496-q7gnb" event={"ID":"d4e03ef4-f8c8-40d9-9664-60a05ce1189d","Type":"ContainerDied","Data":"11e7074dae844e125ba6ad462a0a76c9bb5f95c1c377fc3f51965e8f74af9124"} Jul 03 15:17:51.338835 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:51.338485 2532 scope.go:117] "RemoveContainer" containerID="bd3e8c35a9ed2b28de5eae94ede8f508bd3c1e5c63432a0178cad510f7d5b632" Jul 03 15:17:51.347667 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:51.347648 2532 scope.go:117] "RemoveContainer" containerID="bd3e8c35a9ed2b28de5eae94ede8f508bd3c1e5c63432a0178cad510f7d5b632" Jul 03 15:17:51.347930 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:17:51.347910 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd3e8c35a9ed2b28de5eae94ede8f508bd3c1e5c63432a0178cad510f7d5b632\": container with ID starting with bd3e8c35a9ed2b28de5eae94ede8f508bd3c1e5c63432a0178cad510f7d5b632 not found: ID does not exist" containerID="bd3e8c35a9ed2b28de5eae94ede8f508bd3c1e5c63432a0178cad510f7d5b632" Jul 03 15:17:51.347977 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:51.347938 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd3e8c35a9ed2b28de5eae94ede8f508bd3c1e5c63432a0178cad510f7d5b632"} err="failed to get container status \"bd3e8c35a9ed2b28de5eae94ede8f508bd3c1e5c63432a0178cad510f7d5b632\": rpc error: code = NotFound desc = could not find container \"bd3e8c35a9ed2b28de5eae94ede8f508bd3c1e5c63432a0178cad510f7d5b632\": container with ID starting with bd3e8c35a9ed2b28de5eae94ede8f508bd3c1e5c63432a0178cad510f7d5b632 not found: ID does not exist" Jul 03 15:17:51.359466 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:51.359438 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55889bb496-q7gnb"] Jul 03 15:17:51.365120 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:51.365100 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55889bb496-q7gnb"] Jul 03 15:17:51.676222 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:51.676135 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:17:52.015662 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:17:52.015587 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4e03ef4-f8c8-40d9-9664-60a05ce1189d" path="/var/lib/kubelet/pods/d4e03ef4-f8c8-40d9-9664-60a05ce1189d/volumes" Jul 03 15:18:01.861123 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:01.861096 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/1.log" Jul 03 15:18:01.864351 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:01.864327 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5hcn_df460999-eb58-4575-91fc-8130653c6f5b/ovn-acl-logging/0.log" Jul 03 15:18:01.868274 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:01.868251 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/1.log" Jul 03 15:18:01.871979 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:01.871957 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5hcn_df460999-eb58-4575-91fc-8130653c6f5b/ovn-acl-logging/0.log" Jul 03 15:18:01.872092 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:01.872077 2532 kubelet.go:1648] "Image garbage collection succeeded" Jul 03 15:18:15.082279 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:15.082242 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:18:22.304331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:22.304297 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:18:23.108192 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:23.108142 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:18:24.240998 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:24.240964 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjg8w"] Jul 03 15:18:24.241385 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:24.241241 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4e03ef4-f8c8-40d9-9664-60a05ce1189d" containerName="console" Jul 03 15:18:24.241385 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:24.241252 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4e03ef4-f8c8-40d9-9664-60a05ce1189d" containerName="console" Jul 03 15:18:24.241385 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:24.241332 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4e03ef4-f8c8-40d9-9664-60a05ce1189d" containerName="console" Jul 03 15:18:24.243478 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:24.243456 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjg8w" Jul 03 15:18:24.245964 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:24.245938 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 03 15:18:24.246076 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:24.246058 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 03 15:18:24.246198 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:24.246183 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-6k2sp\"" Jul 03 15:18:24.259042 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:24.259016 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjg8w"] Jul 03 15:18:24.395485 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:24.395450 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bf9a910-2119-49cf-9126-6e3e0fa61c67-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wjg8w\" (UID: \"7bf9a910-2119-49cf-9126-6e3e0fa61c67\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjg8w" Jul 03 15:18:24.395485 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:24.395487 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fshd\" (UniqueName: \"kubernetes.io/projected/7bf9a910-2119-49cf-9126-6e3e0fa61c67-kube-api-access-2fshd\") pod \"cert-manager-operator-controller-manager-55c444bf86-wjg8w\" (UID: \"7bf9a910-2119-49cf-9126-6e3e0fa61c67\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjg8w" Jul 03 15:18:24.496407 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:24.496308 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bf9a910-2119-49cf-9126-6e3e0fa61c67-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wjg8w\" (UID: \"7bf9a910-2119-49cf-9126-6e3e0fa61c67\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjg8w" Jul 03 15:18:24.496407 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:24.496344 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fshd\" (UniqueName: \"kubernetes.io/projected/7bf9a910-2119-49cf-9126-6e3e0fa61c67-kube-api-access-2fshd\") pod \"cert-manager-operator-controller-manager-55c444bf86-wjg8w\" (UID: \"7bf9a910-2119-49cf-9126-6e3e0fa61c67\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjg8w" Jul 03 15:18:24.496718 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:24.496696 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bf9a910-2119-49cf-9126-6e3e0fa61c67-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wjg8w\" (UID: \"7bf9a910-2119-49cf-9126-6e3e0fa61c67\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjg8w" Jul 03 15:18:24.505285 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:24.505251 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fshd\" (UniqueName: \"kubernetes.io/projected/7bf9a910-2119-49cf-9126-6e3e0fa61c67-kube-api-access-2fshd\") pod \"cert-manager-operator-controller-manager-55c444bf86-wjg8w\" (UID: \"7bf9a910-2119-49cf-9126-6e3e0fa61c67\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjg8w" Jul 03 15:18:24.553081 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:24.553049 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjg8w" Jul 03 15:18:24.691226 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:24.691193 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjg8w"] Jul 03 15:18:24.695157 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:18:24.695135 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bf9a910_2119_49cf_9126_6e3e0fa61c67.slice/crio-d27b7d44efd2b300699f2b5d0b487a2ddb63fe478065c14cd4fbeb7bdf17f020 WatchSource:0}: Error finding container d27b7d44efd2b300699f2b5d0b487a2ddb63fe478065c14cd4fbeb7bdf17f020: Status 404 returned error can't find the container with id d27b7d44efd2b300699f2b5d0b487a2ddb63fe478065c14cd4fbeb7bdf17f020 Jul 03 15:18:24.698875 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:24.698855 2532 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 15:18:25.462350 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:25.462314 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjg8w" event={"ID":"7bf9a910-2119-49cf-9126-6e3e0fa61c67","Type":"ContainerStarted","Data":"d27b7d44efd2b300699f2b5d0b487a2ddb63fe478065c14cd4fbeb7bdf17f020"} Jul 03 15:18:25.934297 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:25.934258 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:18:26.032795 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:26.032752 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:18:27.472475 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:27.472397 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjg8w" event={"ID":"7bf9a910-2119-49cf-9126-6e3e0fa61c67","Type":"ContainerStarted","Data":"89fe1f5d2e95dbf5de5873997411b0554b3388e84bd48b4d32c18508ff59192c"} Jul 03 15:18:27.494836 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:27.494786 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjg8w" podStartSLOduration=1.041352013 podStartE2EDuration="3.494771178s" totalImagesPullingTime="2.453419165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:18:27.492439593 +0000 UTC m=+326.075463425" watchObservedRunningTime="2026-07-03 15:18:27.494771178 +0000 UTC m=+326.077795008" Jul 03 15:18:27.868318 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:27.868279 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:18:27.996836 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:27.996807 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:18:30.214002 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:30.213969 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:18:30.638664 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:30.638633 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:18:32.715478 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:32.715433 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:18:32.815235 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:32.815203 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:18:34.596209 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:34.596172 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mxdnt"] Jul 03 15:18:34.599363 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:34.599343 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mxdnt" Jul 03 15:18:34.601949 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:34.601927 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 03 15:18:34.602037 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:34.601987 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 03 15:18:34.602849 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:34.602832 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zn4z7\"" Jul 03 15:18:34.606647 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:34.606609 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mxdnt"] Jul 03 15:18:34.780649 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:34.780617 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj9tw\" (UniqueName: \"kubernetes.io/projected/24ca88b6-5c58-469a-8a5d-17aa68f0f16f-kube-api-access-xj9tw\") pod \"cert-manager-cainjector-559cdd8c87-mxdnt\" (UID: \"24ca88b6-5c58-469a-8a5d-17aa68f0f16f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mxdnt" Jul 03 15:18:34.780812 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:34.780675 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24ca88b6-5c58-469a-8a5d-17aa68f0f16f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mxdnt\" (UID: \"24ca88b6-5c58-469a-8a5d-17aa68f0f16f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mxdnt" Jul 03 15:18:34.881536 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:34.881463 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj9tw\" (UniqueName: \"kubernetes.io/projected/24ca88b6-5c58-469a-8a5d-17aa68f0f16f-kube-api-access-xj9tw\") pod \"cert-manager-cainjector-559cdd8c87-mxdnt\" (UID: \"24ca88b6-5c58-469a-8a5d-17aa68f0f16f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mxdnt" Jul 03 15:18:34.881536 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:34.881517 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24ca88b6-5c58-469a-8a5d-17aa68f0f16f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mxdnt\" (UID: \"24ca88b6-5c58-469a-8a5d-17aa68f0f16f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mxdnt" Jul 03 15:18:34.889727 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:34.889702 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24ca88b6-5c58-469a-8a5d-17aa68f0f16f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mxdnt\" (UID: \"24ca88b6-5c58-469a-8a5d-17aa68f0f16f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mxdnt" Jul 03 15:18:34.889848 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:34.889735 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj9tw\" (UniqueName: \"kubernetes.io/projected/24ca88b6-5c58-469a-8a5d-17aa68f0f16f-kube-api-access-xj9tw\") pod \"cert-manager-cainjector-559cdd8c87-mxdnt\" (UID: \"24ca88b6-5c58-469a-8a5d-17aa68f0f16f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mxdnt" Jul 03 15:18:34.909024 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:34.909005 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mxdnt" Jul 03 15:18:35.036266 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:35.036243 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mxdnt"] Jul 03 15:18:35.038114 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:18:35.038089 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24ca88b6_5c58_469a_8a5d_17aa68f0f16f.slice/crio-dcbc4481e4e8c37891a952cec3123cbe46ca52f296d3723be4d28c24f4daff04 WatchSource:0}: Error finding container dcbc4481e4e8c37891a952cec3123cbe46ca52f296d3723be4d28c24f4daff04: Status 404 returned error can't find the container with id dcbc4481e4e8c37891a952cec3123cbe46ca52f296d3723be4d28c24f4daff04 Jul 03 15:18:35.507967 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:35.507934 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mxdnt" event={"ID":"24ca88b6-5c58-469a-8a5d-17aa68f0f16f","Type":"ContainerStarted","Data":"dcbc4481e4e8c37891a952cec3123cbe46ca52f296d3723be4d28c24f4daff04"} Jul 03 15:18:37.477787 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:37.477740 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:18:38.523207 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:38.523160 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:18:38.524816 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:38.524789 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mxdnt" event={"ID":"24ca88b6-5c58-469a-8a5d-17aa68f0f16f","Type":"ContainerStarted","Data":"7e198d26436d6b3545a32e76b6c7ec86512f7d501327ba0d157363ae90f5cef6"} Jul 03 15:18:38.542337 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:38.542285 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mxdnt" podStartSLOduration=1.5696053129999998 podStartE2EDuration="4.542269232s" totalImagesPullingTime="2.972663919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:18:38.54105093 +0000 UTC m=+337.124074758" watchObservedRunningTime="2026-07-03 15:18:38.542269232 +0000 UTC m=+337.125293060" Jul 03 15:18:38.623427 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:38.623391 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:18:38.788967 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:38.788871 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:18:38.839178 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:38.839150 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:18:44.336718 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:44.336679 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:18:44.438352 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:44.438322 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:18:46.193597 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:46.193559 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:18:48.122506 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:48.122471 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:18:48.180525 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:18:48.180499 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:03.345608 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:03.345522 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:03.441808 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:03.441780 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:03.940709 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:03.940679 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:04.162310 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.162273 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:04.254230 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.254155 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:04.274188 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.274157 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk"] Jul 03 15:19:04.279445 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.279427 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" Jul 03 15:19:04.281961 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.281937 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 03 15:19:04.282076 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.281990 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 03 15:19:04.282076 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.282032 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 03 15:19:04.282456 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.282439 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 03 15:19:04.283242 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.283219 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4hhbk\"" Jul 03 15:19:04.291147 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.291129 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk"] Jul 03 15:19:04.409649 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.409619 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/566ec0d5-d122-4ddc-97ed-28f769563ed2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86b59fc499-ltlvk\" (UID: \"566ec0d5-d122-4ddc-97ed-28f769563ed2\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" Jul 03 15:19:04.410047 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.409663 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/566ec0d5-d122-4ddc-97ed-28f769563ed2-manifests\") pod \"opendatahub-operator-controller-manager-86b59fc499-ltlvk\" (UID: \"566ec0d5-d122-4ddc-97ed-28f769563ed2\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" Jul 03 15:19:04.410047 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.409682 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/566ec0d5-d122-4ddc-97ed-28f769563ed2-tmp\") pod \"opendatahub-operator-controller-manager-86b59fc499-ltlvk\" (UID: \"566ec0d5-d122-4ddc-97ed-28f769563ed2\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" Jul 03 15:19:04.410047 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.409774 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sd7q\" (UniqueName: \"kubernetes.io/projected/566ec0d5-d122-4ddc-97ed-28f769563ed2-kube-api-access-7sd7q\") pod \"opendatahub-operator-controller-manager-86b59fc499-ltlvk\" (UID: \"566ec0d5-d122-4ddc-97ed-28f769563ed2\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" Jul 03 15:19:04.410047 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.409822 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/566ec0d5-d122-4ddc-97ed-28f769563ed2-webhook-cert\") pod \"opendatahub-operator-controller-manager-86b59fc499-ltlvk\" (UID: \"566ec0d5-d122-4ddc-97ed-28f769563ed2\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" Jul 03 15:19:04.480884 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.480854 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:04.510466 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.510406 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/566ec0d5-d122-4ddc-97ed-28f769563ed2-manifests\") pod \"opendatahub-operator-controller-manager-86b59fc499-ltlvk\" (UID: \"566ec0d5-d122-4ddc-97ed-28f769563ed2\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" Jul 03 15:19:04.510466 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.510435 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/566ec0d5-d122-4ddc-97ed-28f769563ed2-tmp\") pod \"opendatahub-operator-controller-manager-86b59fc499-ltlvk\" (UID: \"566ec0d5-d122-4ddc-97ed-28f769563ed2\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" Jul 03 15:19:04.510466 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.510458 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sd7q\" (UniqueName: \"kubernetes.io/projected/566ec0d5-d122-4ddc-97ed-28f769563ed2-kube-api-access-7sd7q\") pod \"opendatahub-operator-controller-manager-86b59fc499-ltlvk\" (UID: \"566ec0d5-d122-4ddc-97ed-28f769563ed2\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" Jul 03 15:19:04.510664 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.510477 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/566ec0d5-d122-4ddc-97ed-28f769563ed2-webhook-cert\") pod \"opendatahub-operator-controller-manager-86b59fc499-ltlvk\" (UID: \"566ec0d5-d122-4ddc-97ed-28f769563ed2\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" Jul 03 15:19:04.510664 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.510520 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/566ec0d5-d122-4ddc-97ed-28f769563ed2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86b59fc499-ltlvk\" (UID: \"566ec0d5-d122-4ddc-97ed-28f769563ed2\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" Jul 03 15:19:04.510833 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.510813 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/566ec0d5-d122-4ddc-97ed-28f769563ed2-manifests\") pod \"opendatahub-operator-controller-manager-86b59fc499-ltlvk\" (UID: \"566ec0d5-d122-4ddc-97ed-28f769563ed2\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" Jul 03 15:19:04.512948 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.512929 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/566ec0d5-d122-4ddc-97ed-28f769563ed2-tmp\") pod \"opendatahub-operator-controller-manager-86b59fc499-ltlvk\" (UID: \"566ec0d5-d122-4ddc-97ed-28f769563ed2\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" Jul 03 15:19:04.513077 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.513060 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/566ec0d5-d122-4ddc-97ed-28f769563ed2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86b59fc499-ltlvk\" (UID: \"566ec0d5-d122-4ddc-97ed-28f769563ed2\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" Jul 03 15:19:04.513128 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.513107 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/566ec0d5-d122-4ddc-97ed-28f769563ed2-webhook-cert\") pod \"opendatahub-operator-controller-manager-86b59fc499-ltlvk\" (UID: \"566ec0d5-d122-4ddc-97ed-28f769563ed2\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" Jul 03 15:19:04.519970 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.519944 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sd7q\" (UniqueName: \"kubernetes.io/projected/566ec0d5-d122-4ddc-97ed-28f769563ed2-kube-api-access-7sd7q\") pod \"opendatahub-operator-controller-manager-86b59fc499-ltlvk\" (UID: \"566ec0d5-d122-4ddc-97ed-28f769563ed2\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" Jul 03 15:19:04.581954 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.581926 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:04.591380 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.591349 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" Jul 03 15:19:04.682539 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.682506 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:04.724446 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.724415 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk"] Jul 03 15:19:04.727899 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:19:04.727866 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod566ec0d5_d122_4ddc_97ed_28f769563ed2.slice/crio-46b88207740031ffbf8d7af4e08f8c507309616e08cacdd637288157f37fa049 WatchSource:0}: Error finding container 46b88207740031ffbf8d7af4e08f8c507309616e08cacdd637288157f37fa049: Status 404 returned error can't find the container with id 46b88207740031ffbf8d7af4e08f8c507309616e08cacdd637288157f37fa049 Jul 03 15:19:04.757206 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.757181 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:04.828117 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:04.828070 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:05.639588 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:05.639545 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" event={"ID":"566ec0d5-d122-4ddc-97ed-28f769563ed2","Type":"ContainerStarted","Data":"46b88207740031ffbf8d7af4e08f8c507309616e08cacdd637288157f37fa049"} Jul 03 15:19:07.649438 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:07.649406 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" event={"ID":"566ec0d5-d122-4ddc-97ed-28f769563ed2","Type":"ContainerStarted","Data":"e98a839f26a8a63fc8d372b5c19e3d5306a6493374aa73d11c055c2c69fa5e1d"} Jul 03 15:19:07.866527 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:07.866445 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:07.977698 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:07.977655 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:09.660186 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:09.660150 2532 generic.go:356] "Generic (PLEG): container finished" podID="566ec0d5-d122-4ddc-97ed-28f769563ed2" containerID="e98a839f26a8a63fc8d372b5c19e3d5306a6493374aa73d11c055c2c69fa5e1d" exitCode=0 Jul 03 15:19:09.660584 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:09.660226 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" event={"ID":"566ec0d5-d122-4ddc-97ed-28f769563ed2","Type":"ContainerDied","Data":"e98a839f26a8a63fc8d372b5c19e3d5306a6493374aa73d11c055c2c69fa5e1d"} Jul 03 15:19:10.666526 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:10.666490 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" event={"ID":"566ec0d5-d122-4ddc-97ed-28f769563ed2","Type":"ContainerStarted","Data":"e5d7d79984ab2c8e37fda41159e7730c22454afc49d94375bb23325001c25cfa"} Jul 03 15:19:10.666902 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:10.666707 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" Jul 03 15:19:10.687177 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:10.687136 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" podStartSLOduration=2.528245341 podStartE2EDuration="6.687122716s" totalImagesPullingTime="3.145021653s" totalInitContainerRuntime="1.013855722s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:19:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:19:10.685779321 +0000 UTC m=+369.268803129" watchObservedRunningTime="2026-07-03 15:19:10.687122716 +0000 UTC m=+369.270146544" Jul 03 15:19:16.149909 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:16.149874 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:16.249643 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:16.249610 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:21.672626 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:21.672592 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-ltlvk" Jul 03 15:19:23.317661 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:23.317620 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:23.652152 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:23.652123 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:24.204973 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:24.204936 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:24.247403 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:24.247357 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-9d497994-bssgs"] Jul 03 15:19:24.250414 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:24.250398 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9d497994-bssgs" Jul 03 15:19:24.253400 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:24.253382 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 03 15:19:24.253974 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:24.253956 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 03 15:19:24.254423 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:24.254403 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cqq5h\"" Jul 03 15:19:24.268084 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:24.268059 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9d497994-bssgs"] Jul 03 15:19:24.378906 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:24.378879 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7742w\" (UniqueName: \"kubernetes.io/projected/36ad7435-8983-428c-8ee1-4ec96914f6a7-kube-api-access-7742w\") pod \"kube-auth-proxy-9d497994-bssgs\" (UID: \"36ad7435-8983-428c-8ee1-4ec96914f6a7\") " pod="openshift-ingress/kube-auth-proxy-9d497994-bssgs" Jul 03 15:19:24.379256 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:24.378995 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36ad7435-8983-428c-8ee1-4ec96914f6a7-tls-certs\") pod \"kube-auth-proxy-9d497994-bssgs\" (UID: \"36ad7435-8983-428c-8ee1-4ec96914f6a7\") " pod="openshift-ingress/kube-auth-proxy-9d497994-bssgs" Jul 03 15:19:24.379256 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:24.379045 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36ad7435-8983-428c-8ee1-4ec96914f6a7-tmp\") pod \"kube-auth-proxy-9d497994-bssgs\" (UID: \"36ad7435-8983-428c-8ee1-4ec96914f6a7\") " pod="openshift-ingress/kube-auth-proxy-9d497994-bssgs" Jul 03 15:19:24.479988 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:24.479910 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36ad7435-8983-428c-8ee1-4ec96914f6a7-tls-certs\") pod \"kube-auth-proxy-9d497994-bssgs\" (UID: \"36ad7435-8983-428c-8ee1-4ec96914f6a7\") " pod="openshift-ingress/kube-auth-proxy-9d497994-bssgs" Jul 03 15:19:24.479988 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:24.479962 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36ad7435-8983-428c-8ee1-4ec96914f6a7-tmp\") pod \"kube-auth-proxy-9d497994-bssgs\" (UID: \"36ad7435-8983-428c-8ee1-4ec96914f6a7\") " pod="openshift-ingress/kube-auth-proxy-9d497994-bssgs" Jul 03 15:19:24.480205 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:24.479999 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7742w\" (UniqueName: \"kubernetes.io/projected/36ad7435-8983-428c-8ee1-4ec96914f6a7-kube-api-access-7742w\") pod \"kube-auth-proxy-9d497994-bssgs\" (UID: \"36ad7435-8983-428c-8ee1-4ec96914f6a7\") " pod="openshift-ingress/kube-auth-proxy-9d497994-bssgs" Jul 03 15:19:24.480205 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:19:24.480057 2532 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 03 15:19:24.480205 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:19:24.480147 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36ad7435-8983-428c-8ee1-4ec96914f6a7-tls-certs podName:36ad7435-8983-428c-8ee1-4ec96914f6a7 nodeName:}" failed. No retries permitted until 2026-07-03 15:19:24.980128138 +0000 UTC m=+383.563151948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/36ad7435-8983-428c-8ee1-4ec96914f6a7-tls-certs") pod "kube-auth-proxy-9d497994-bssgs" (UID: "36ad7435-8983-428c-8ee1-4ec96914f6a7") : secret "kube-auth-proxy-tls" not found Jul 03 15:19:24.482473 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:24.482440 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36ad7435-8983-428c-8ee1-4ec96914f6a7-tmp\") pod \"kube-auth-proxy-9d497994-bssgs\" (UID: \"36ad7435-8983-428c-8ee1-4ec96914f6a7\") " pod="openshift-ingress/kube-auth-proxy-9d497994-bssgs" Jul 03 15:19:24.494970 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:24.494946 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7742w\" (UniqueName: \"kubernetes.io/projected/36ad7435-8983-428c-8ee1-4ec96914f6a7-kube-api-access-7742w\") pod \"kube-auth-proxy-9d497994-bssgs\" (UID: \"36ad7435-8983-428c-8ee1-4ec96914f6a7\") " pod="openshift-ingress/kube-auth-proxy-9d497994-bssgs" Jul 03 15:19:24.530998 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:24.530954 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:24.654070 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:24.654031 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:24.751956 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:24.751879 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:24.931248 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:24.931200 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:24.984319 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:24.984280 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36ad7435-8983-428c-8ee1-4ec96914f6a7-tls-certs\") pod \"kube-auth-proxy-9d497994-bssgs\" (UID: \"36ad7435-8983-428c-8ee1-4ec96914f6a7\") " pod="openshift-ingress/kube-auth-proxy-9d497994-bssgs" Jul 03 15:19:24.987013 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:24.986986 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36ad7435-8983-428c-8ee1-4ec96914f6a7-tls-certs\") pod \"kube-auth-proxy-9d497994-bssgs\" (UID: \"36ad7435-8983-428c-8ee1-4ec96914f6a7\") " pod="openshift-ingress/kube-auth-proxy-9d497994-bssgs" Jul 03 15:19:25.165475 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.165348 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9d497994-bssgs" Jul 03 15:19:25.328848 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.328826 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9d497994-bssgs"] Jul 03 15:19:25.331264 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:19:25.331236 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36ad7435_8983_428c_8ee1_4ec96914f6a7.slice/crio-0ba8010d5b32373c26f6dd77dabb6fca5d94c3326bdf859d9d0ee0edd202bbea WatchSource:0}: Error finding container 0ba8010d5b32373c26f6dd77dabb6fca5d94c3326bdf859d9d0ee0edd202bbea: Status 404 returned error can't find the container with id 0ba8010d5b32373c26f6dd77dabb6fca5d94c3326bdf859d9d0ee0edd202bbea Jul 03 15:19:25.463422 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.463306 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:25.476487 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.476461 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-j9wqv"] Jul 03 15:19:25.480710 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.480690 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-j9wqv" Jul 03 15:19:25.483416 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.483387 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 03 15:19:25.483638 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.483623 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-zdfm4\"" Jul 03 15:19:25.492388 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.492343 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-j9wqv"] Jul 03 15:19:25.583999 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.583964 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:25.589056 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.589033 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ffed699-1e91-4b84-bdbc-ba0522db6921-tls-certs\") pod \"model-serving-api-54d89bd5fc-j9wqv\" (UID: \"0ffed699-1e91-4b84-bdbc-ba0522db6921\") " pod="opendatahub/model-serving-api-54d89bd5fc-j9wqv" Jul 03 15:19:25.589160 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.589141 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkpkc\" (UniqueName: \"kubernetes.io/projected/0ffed699-1e91-4b84-bdbc-ba0522db6921-kube-api-access-nkpkc\") pod \"model-serving-api-54d89bd5fc-j9wqv\" (UID: \"0ffed699-1e91-4b84-bdbc-ba0522db6921\") " pod="opendatahub/model-serving-api-54d89bd5fc-j9wqv" Jul 03 15:19:25.690400 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.690350 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkpkc\" (UniqueName: \"kubernetes.io/projected/0ffed699-1e91-4b84-bdbc-ba0522db6921-kube-api-access-nkpkc\") pod \"model-serving-api-54d89bd5fc-j9wqv\" (UID: \"0ffed699-1e91-4b84-bdbc-ba0522db6921\") " pod="opendatahub/model-serving-api-54d89bd5fc-j9wqv" Jul 03 15:19:25.690601 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.690443 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ffed699-1e91-4b84-bdbc-ba0522db6921-tls-certs\") pod \"model-serving-api-54d89bd5fc-j9wqv\" (UID: \"0ffed699-1e91-4b84-bdbc-ba0522db6921\") " pod="opendatahub/model-serving-api-54d89bd5fc-j9wqv" Jul 03 15:19:25.692847 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.692820 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ffed699-1e91-4b84-bdbc-ba0522db6921-tls-certs\") pod \"model-serving-api-54d89bd5fc-j9wqv\" (UID: \"0ffed699-1e91-4b84-bdbc-ba0522db6921\") " pod="opendatahub/model-serving-api-54d89bd5fc-j9wqv" Jul 03 15:19:25.705692 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.705670 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkpkc\" (UniqueName: \"kubernetes.io/projected/0ffed699-1e91-4b84-bdbc-ba0522db6921-kube-api-access-nkpkc\") pod \"model-serving-api-54d89bd5fc-j9wqv\" (UID: \"0ffed699-1e91-4b84-bdbc-ba0522db6921\") " pod="opendatahub/model-serving-api-54d89bd5fc-j9wqv" Jul 03 15:19:25.709976 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.709958 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:25.715150 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.715101 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw"] Jul 03 15:19:25.718257 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.718243 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:25.722356 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.722338 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 03 15:19:25.722532 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.722514 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 03 15:19:25.722764 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.722746 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 03 15:19:25.722832 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.722790 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-54jz8\"" Jul 03 15:19:25.722917 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.722902 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 03 15:19:25.729071 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.729050 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9d497994-bssgs" event={"ID":"36ad7435-8983-428c-8ee1-4ec96914f6a7","Type":"ContainerStarted","Data":"0ba8010d5b32373c26f6dd77dabb6fca5d94c3326bdf859d9d0ee0edd202bbea"} Jul 03 15:19:25.752609 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.752589 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw"] Jul 03 15:19:25.798935 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.798910 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-j9wqv" Jul 03 15:19:25.861743 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.861701 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:25.892545 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.892125 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9s2kw\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:25.892545 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.892202 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqdfn\" (UniqueName: \"kubernetes.io/projected/587ecf9c-2796-4fed-9290-1942b48cd26c-kube-api-access-cqdfn\") pod \"istiod-openshift-gateway-7574459656-9s2kw\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:25.892545 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.892256 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/587ecf9c-2796-4fed-9290-1942b48cd26c-local-certs\") pod \"istiod-openshift-gateway-7574459656-9s2kw\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:25.892545 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.892305 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9s2kw\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:25.892545 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.892391 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-token\") pod \"istiod-openshift-gateway-7574459656-9s2kw\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:25.892545 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.892417 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9s2kw\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:25.892545 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.892451 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/587ecf9c-2796-4fed-9290-1942b48cd26c-cacerts\") pod \"istiod-openshift-gateway-7574459656-9s2kw\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:25.944018 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.943990 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-j9wqv"] Jul 03 15:19:25.946773 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:19:25.946733 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ffed699_1e91_4b84_bdbc_ba0522db6921.slice/crio-2b8a5422283a2aad877acada3ceb27eb9fa61a33297ce9598fb62c7c8de06f6b WatchSource:0}: Error finding container 2b8a5422283a2aad877acada3ceb27eb9fa61a33297ce9598fb62c7c8de06f6b: Status 404 returned error can't find the container with id 2b8a5422283a2aad877acada3ceb27eb9fa61a33297ce9598fb62c7c8de06f6b Jul 03 15:19:25.993417 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.993327 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-token\") pod \"istiod-openshift-gateway-7574459656-9s2kw\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:25.993417 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.993360 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9s2kw\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:25.993417 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.993410 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/587ecf9c-2796-4fed-9290-1942b48cd26c-cacerts\") pod \"istiod-openshift-gateway-7574459656-9s2kw\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:25.993682 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.993461 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9s2kw\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:25.993737 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.993640 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqdfn\" (UniqueName: \"kubernetes.io/projected/587ecf9c-2796-4fed-9290-1942b48cd26c-kube-api-access-cqdfn\") pod \"istiod-openshift-gateway-7574459656-9s2kw\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:25.994151 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.993940 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/587ecf9c-2796-4fed-9290-1942b48cd26c-local-certs\") pod \"istiod-openshift-gateway-7574459656-9s2kw\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:25.994151 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.993982 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9s2kw\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:25.994314 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.994242 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9s2kw\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:25.996663 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.996644 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/587ecf9c-2796-4fed-9290-1942b48cd26c-local-certs\") pod \"istiod-openshift-gateway-7574459656-9s2kw\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:25.996663 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.996666 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9s2kw\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:25.996839 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.996683 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/587ecf9c-2796-4fed-9290-1942b48cd26c-cacerts\") pod \"istiod-openshift-gateway-7574459656-9s2kw\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:25.997403 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:25.997360 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9s2kw\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:26.001752 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:26.001730 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqdfn\" (UniqueName: \"kubernetes.io/projected/587ecf9c-2796-4fed-9290-1942b48cd26c-kube-api-access-cqdfn\") pod \"istiod-openshift-gateway-7574459656-9s2kw\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:26.002823 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:26.002804 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-token\") pod \"istiod-openshift-gateway-7574459656-9s2kw\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:26.028221 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:26.028195 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:26.184659 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:26.184628 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw"] Jul 03 15:19:26.186949 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:19:26.186917 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod587ecf9c_2796_4fed_9290_1942b48cd26c.slice/crio-46e7bca80ebbe801b326bcc484cd2cf3d402ac331d097e694ed80d7806c52b83 WatchSource:0}: Error finding container 46e7bca80ebbe801b326bcc484cd2cf3d402ac331d097e694ed80d7806c52b83: Status 404 returned error can't find the container with id 46e7bca80ebbe801b326bcc484cd2cf3d402ac331d097e694ed80d7806c52b83 Jul 03 15:19:26.736272 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:26.736235 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" event={"ID":"587ecf9c-2796-4fed-9290-1942b48cd26c","Type":"ContainerStarted","Data":"46e7bca80ebbe801b326bcc484cd2cf3d402ac331d097e694ed80d7806c52b83"} Jul 03 15:19:26.737653 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:26.737624 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-j9wqv" event={"ID":"0ffed699-1e91-4b84-bdbc-ba0522db6921","Type":"ContainerStarted","Data":"2b8a5422283a2aad877acada3ceb27eb9fa61a33297ce9598fb62c7c8de06f6b"} Jul 03 15:19:26.898802 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:26.898721 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:29.505933 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:29.505903 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:19:29.506211 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:29.505961 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:19:29.756634 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:29.756537 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" event={"ID":"587ecf9c-2796-4fed-9290-1942b48cd26c","Type":"ContainerStarted","Data":"1d797fd4969d76b813f806b5784848e8fbb93240e92911db17310b408ccbd911"} Jul 03 15:19:29.756790 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:29.756717 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:29.758305 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:29.758274 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-j9wqv" event={"ID":"0ffed699-1e91-4b84-bdbc-ba0522db6921","Type":"ContainerStarted","Data":"b2a6e08d09c033e1854c470339ec26d5392e657aa96d9e4c9f56a7130e57c71f"} Jul 03 15:19:29.758452 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:29.758394 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-j9wqv" Jul 03 15:19:29.759743 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:29.759719 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9d497994-bssgs" event={"ID":"36ad7435-8983-428c-8ee1-4ec96914f6a7","Type":"ContainerStarted","Data":"b4d9f14ddd77afeec4c36be12c091ab29414f81ffdbb448a3a02fb5e24708943"} Jul 03 15:19:29.780566 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:29.780525 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" podStartSLOduration=1.463728297 podStartE2EDuration="4.780512615s" totalImagesPullingTime="3.316784318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:19:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:19:29.778189165 +0000 UTC m=+388.361213018" watchObservedRunningTime="2026-07-03 15:19:29.780512615 +0000 UTC m=+388.363536444" Jul 03 15:19:29.795823 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:29.795776 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-9d497994-bssgs" podStartSLOduration=1.62877812 podStartE2EDuration="5.795763481s" totalImagesPullingTime="4.166985361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:19:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:19:29.795172238 +0000 UTC m=+388.378196071" watchObservedRunningTime="2026-07-03 15:19:29.795763481 +0000 UTC m=+388.378787310" Jul 03 15:19:29.810589 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:29.810542 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-j9wqv" podStartSLOduration=1.259295295 podStartE2EDuration="4.810525478s" totalImagesPullingTime="3.551230183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:19:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:19:29.810167102 +0000 UTC m=+388.393190934" watchObservedRunningTime="2026-07-03 15:19:29.810525478 +0000 UTC m=+388.393549309" Jul 03 15:19:30.007002 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:30.006910 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:30.105163 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:30.105125 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:30.615434 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:30.615382 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:30.766881 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:30.766850 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:30.918190 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:30.918113 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:31.047534 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:31.047497 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:36.020163 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.020122 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:36.331825 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.331793 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lbx65"] Jul 03 15:19:36.336266 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.336246 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbx65" Jul 03 15:19:36.339423 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.339397 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 03 15:19:36.339836 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.339819 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-l4vc5"] Jul 03 15:19:36.340559 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.340540 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-kt82v\"" Jul 03 15:19:36.344393 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.344356 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l4vc5" Jul 03 15:19:36.351544 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.351522 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 03 15:19:36.351654 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.351615 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-rvm72\"" Jul 03 15:19:36.378765 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.378736 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-l4vc5"] Jul 03 15:19:36.382153 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.382125 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lbx65"] Jul 03 15:19:36.389296 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.389275 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40aecff7-c519-485e-85c3-aa2106577b99-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-l4vc5\" (UID: \"40aecff7-c519-485e-85c3-aa2106577b99\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l4vc5" Jul 03 15:19:36.389425 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.389315 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf45q\" (UniqueName: \"kubernetes.io/projected/dc903bff-bf1d-4ffc-ab4b-413e1ff847a5-kube-api-access-lf45q\") pod \"kserve-controller-manager-d6f4b65b8-lbx65\" (UID: \"dc903bff-bf1d-4ffc-ab4b-413e1ff847a5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbx65" Jul 03 15:19:36.389425 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.389345 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc903bff-bf1d-4ffc-ab4b-413e1ff847a5-cert\") pod \"kserve-controller-manager-d6f4b65b8-lbx65\" (UID: \"dc903bff-bf1d-4ffc-ab4b-413e1ff847a5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbx65" Jul 03 15:19:36.389425 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.389395 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn6lk\" (UniqueName: \"kubernetes.io/projected/40aecff7-c519-485e-85c3-aa2106577b99-kube-api-access-fn6lk\") pod \"llmisvc-controller-manager-777c6bd7d5-l4vc5\" (UID: \"40aecff7-c519-485e-85c3-aa2106577b99\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l4vc5" Jul 03 15:19:36.409470 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.409435 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:36.490140 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.490112 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc903bff-bf1d-4ffc-ab4b-413e1ff847a5-cert\") pod \"kserve-controller-manager-d6f4b65b8-lbx65\" (UID: \"dc903bff-bf1d-4ffc-ab4b-413e1ff847a5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbx65" Jul 03 15:19:36.490270 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.490149 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn6lk\" (UniqueName: \"kubernetes.io/projected/40aecff7-c519-485e-85c3-aa2106577b99-kube-api-access-fn6lk\") pod \"llmisvc-controller-manager-777c6bd7d5-l4vc5\" (UID: \"40aecff7-c519-485e-85c3-aa2106577b99\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l4vc5" Jul 03 15:19:36.490270 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.490203 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40aecff7-c519-485e-85c3-aa2106577b99-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-l4vc5\" (UID: \"40aecff7-c519-485e-85c3-aa2106577b99\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l4vc5" Jul 03 15:19:36.490270 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.490234 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf45q\" (UniqueName: \"kubernetes.io/projected/dc903bff-bf1d-4ffc-ab4b-413e1ff847a5-kube-api-access-lf45q\") pod \"kserve-controller-manager-d6f4b65b8-lbx65\" (UID: \"dc903bff-bf1d-4ffc-ab4b-413e1ff847a5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbx65" Jul 03 15:19:36.492659 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.492635 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc903bff-bf1d-4ffc-ab4b-413e1ff847a5-cert\") pod \"kserve-controller-manager-d6f4b65b8-lbx65\" (UID: \"dc903bff-bf1d-4ffc-ab4b-413e1ff847a5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbx65" Jul 03 15:19:36.492772 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.492727 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40aecff7-c519-485e-85c3-aa2106577b99-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-l4vc5\" (UID: \"40aecff7-c519-485e-85c3-aa2106577b99\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l4vc5" Jul 03 15:19:36.513811 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.513776 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn6lk\" (UniqueName: \"kubernetes.io/projected/40aecff7-c519-485e-85c3-aa2106577b99-kube-api-access-fn6lk\") pod \"llmisvc-controller-manager-777c6bd7d5-l4vc5\" (UID: \"40aecff7-c519-485e-85c3-aa2106577b99\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l4vc5" Jul 03 15:19:36.515263 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.515238 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf45q\" (UniqueName: \"kubernetes.io/projected/dc903bff-bf1d-4ffc-ab4b-413e1ff847a5-kube-api-access-lf45q\") pod \"kserve-controller-manager-d6f4b65b8-lbx65\" (UID: \"dc903bff-bf1d-4ffc-ab4b-413e1ff847a5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbx65" Jul 03 15:19:36.556068 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.556025 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:36.647073 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.646998 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbx65" Jul 03 15:19:36.654143 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.654120 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l4vc5" Jul 03 15:19:36.732734 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.732701 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:36.808587 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.808545 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lbx65"] Jul 03 15:19:36.813168 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:19:36.813142 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc903bff_bf1d_4ffc_ab4b_413e1ff847a5.slice/crio-d94055259fe319650539bf01d34826f2f2395fe07201b6d9a8dec95fc44aa81c WatchSource:0}: Error finding container d94055259fe319650539bf01d34826f2f2395fe07201b6d9a8dec95fc44aa81c: Status 404 returned error can't find the container with id d94055259fe319650539bf01d34826f2f2395fe07201b6d9a8dec95fc44aa81c Jul 03 15:19:36.851892 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.851866 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-l4vc5"] Jul 03 15:19:36.854595 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:19:36.854569 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod40aecff7_c519_485e_85c3_aa2106577b99.slice/crio-97b8a0fafae310cfa21126adbdc5f6b864b88bce2e37c5565a767324861cf42d WatchSource:0}: Error finding container 97b8a0fafae310cfa21126adbdc5f6b864b88bce2e37c5565a767324861cf42d: Status 404 returned error can't find the container with id 97b8a0fafae310cfa21126adbdc5f6b864b88bce2e37c5565a767324861cf42d Jul 03 15:19:36.876144 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:36.876115 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:37.050238 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:37.050137 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:19:37.798181 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:37.798147 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l4vc5" event={"ID":"40aecff7-c519-485e-85c3-aa2106577b99","Type":"ContainerStarted","Data":"97b8a0fafae310cfa21126adbdc5f6b864b88bce2e37c5565a767324861cf42d"} Jul 03 15:19:37.799427 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:37.799401 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbx65" event={"ID":"dc903bff-bf1d-4ffc-ab4b-413e1ff847a5","Type":"ContainerStarted","Data":"d94055259fe319650539bf01d34826f2f2395fe07201b6d9a8dec95fc44aa81c"} Jul 03 15:19:40.769620 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:40.769537 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-j9wqv" Jul 03 15:19:40.816564 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:40.816509 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbx65" event={"ID":"dc903bff-bf1d-4ffc-ab4b-413e1ff847a5","Type":"ContainerStarted","Data":"f635def0550920f7cf56659d9ba846c39a312e245ad1c75f00607b1185f83b80"} Jul 03 15:19:40.816744 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:40.816588 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbx65" Jul 03 15:19:40.818233 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:40.818204 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l4vc5" event={"ID":"40aecff7-c519-485e-85c3-aa2106577b99","Type":"ContainerStarted","Data":"3a91a8a8ba36af35cab0e9a7c06f04d6c19564fc3f56abb3416d115397eb8a45"} Jul 03 15:19:40.818385 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:40.818273 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l4vc5" Jul 03 15:19:40.854663 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:40.854613 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbx65" podStartSLOduration=1.5636873709999999 podStartE2EDuration="4.854593716s" totalImagesPullingTime="3.290906345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:19:40.837342184 +0000 UTC m=+399.420366014" watchObservedRunningTime="2026-07-03 15:19:40.854593716 +0000 UTC m=+399.437617548" Jul 03 15:19:40.854806 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:40.854694 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l4vc5" podStartSLOduration=1.329684566 podStartE2EDuration="4.854688821s" totalImagesPullingTime="3.525004255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:19:40.853932148 +0000 UTC m=+399.436955977" watchObservedRunningTime="2026-07-03 15:19:40.854688821 +0000 UTC m=+399.437712650" Jul 03 15:19:46.091532 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.091497 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw"] Jul 03 15:19:46.091925 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.091680 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" podUID="587ecf9c-2796-4fed-9290-1942b48cd26c" containerName="discovery" containerID="cri-o://1d797fd4969d76b813f806b5784848e8fbb93240e92911db17310b408ccbd911" gracePeriod=30 Jul 03 15:19:46.333754 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.333729 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:46.382517 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.382444 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-kubeconfig\") pod \"587ecf9c-2796-4fed-9290-1942b48cd26c\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " Jul 03 15:19:46.382517 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.382493 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-token\") pod \"587ecf9c-2796-4fed-9290-1942b48cd26c\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " Jul 03 15:19:46.382720 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.382525 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqdfn\" (UniqueName: \"kubernetes.io/projected/587ecf9c-2796-4fed-9290-1942b48cd26c-kube-api-access-cqdfn\") pod \"587ecf9c-2796-4fed-9290-1942b48cd26c\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " Jul 03 15:19:46.382720 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.382559 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-csr-dns-cert\") pod \"587ecf9c-2796-4fed-9290-1942b48cd26c\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " Jul 03 15:19:46.382720 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.382692 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/587ecf9c-2796-4fed-9290-1942b48cd26c-local-certs\") pod \"587ecf9c-2796-4fed-9290-1942b48cd26c\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " Jul 03 15:19:46.382873 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.382765 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-csr-ca-configmap\") pod \"587ecf9c-2796-4fed-9290-1942b48cd26c\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " Jul 03 15:19:46.382873 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.382811 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/587ecf9c-2796-4fed-9290-1942b48cd26c-cacerts\") pod \"587ecf9c-2796-4fed-9290-1942b48cd26c\" (UID: \"587ecf9c-2796-4fed-9290-1942b48cd26c\") " Jul 03 15:19:46.383416 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.383248 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "587ecf9c-2796-4fed-9290-1942b48cd26c" (UID: "587ecf9c-2796-4fed-9290-1942b48cd26c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:19:46.385097 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.385023 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/587ecf9c-2796-4fed-9290-1942b48cd26c-kube-api-access-cqdfn" (OuterVolumeSpecName: "kube-api-access-cqdfn") pod "587ecf9c-2796-4fed-9290-1942b48cd26c" (UID: "587ecf9c-2796-4fed-9290-1942b48cd26c"). InnerVolumeSpecName "kube-api-access-cqdfn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:19:46.385186 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.385095 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "587ecf9c-2796-4fed-9290-1942b48cd26c" (UID: "587ecf9c-2796-4fed-9290-1942b48cd26c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 15:19:46.385353 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.385323 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-token" (OuterVolumeSpecName: "istio-token") pod "587ecf9c-2796-4fed-9290-1942b48cd26c" (UID: "587ecf9c-2796-4fed-9290-1942b48cd26c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:19:46.385473 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.385432 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/587ecf9c-2796-4fed-9290-1942b48cd26c-local-certs" (OuterVolumeSpecName: "local-certs") pod "587ecf9c-2796-4fed-9290-1942b48cd26c" (UID: "587ecf9c-2796-4fed-9290-1942b48cd26c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:19:46.385532 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.385487 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "587ecf9c-2796-4fed-9290-1942b48cd26c" (UID: "587ecf9c-2796-4fed-9290-1942b48cd26c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 15:19:46.385571 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.385557 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/587ecf9c-2796-4fed-9290-1942b48cd26c-cacerts" (OuterVolumeSpecName: "cacerts") pod "587ecf9c-2796-4fed-9290-1942b48cd26c" (UID: "587ecf9c-2796-4fed-9290-1942b48cd26c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 15:19:46.483856 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.483824 2532 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/587ecf9c-2796-4fed-9290-1942b48cd26c-cacerts\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:19:46.483856 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.483850 2532 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-kubeconfig\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:19:46.483856 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.483860 2532 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-token\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:19:46.483856 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.483868 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqdfn\" (UniqueName: \"kubernetes.io/projected/587ecf9c-2796-4fed-9290-1942b48cd26c-kube-api-access-cqdfn\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:19:46.484098 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.483876 2532 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-csr-dns-cert\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:19:46.484098 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.483884 2532 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/587ecf9c-2796-4fed-9290-1942b48cd26c-local-certs\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:19:46.484098 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.483892 2532 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/587ecf9c-2796-4fed-9290-1942b48cd26c-istio-csr-ca-configmap\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:19:46.853661 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.853626 2532 generic.go:356] "Generic (PLEG): container finished" podID="587ecf9c-2796-4fed-9290-1942b48cd26c" containerID="1d797fd4969d76b813f806b5784848e8fbb93240e92911db17310b408ccbd911" exitCode=0 Jul 03 15:19:46.853862 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.853676 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" Jul 03 15:19:46.853862 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.853668 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" event={"ID":"587ecf9c-2796-4fed-9290-1942b48cd26c","Type":"ContainerDied","Data":"1d797fd4969d76b813f806b5784848e8fbb93240e92911db17310b408ccbd911"} Jul 03 15:19:46.853862 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.853741 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw" event={"ID":"587ecf9c-2796-4fed-9290-1942b48cd26c","Type":"ContainerDied","Data":"46e7bca80ebbe801b326bcc484cd2cf3d402ac331d097e694ed80d7806c52b83"} Jul 03 15:19:46.853862 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.853771 2532 scope.go:117] "RemoveContainer" containerID="1d797fd4969d76b813f806b5784848e8fbb93240e92911db17310b408ccbd911" Jul 03 15:19:46.862351 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.862338 2532 scope.go:117] "RemoveContainer" containerID="1d797fd4969d76b813f806b5784848e8fbb93240e92911db17310b408ccbd911" Jul 03 15:19:46.862616 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:19:46.862597 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d797fd4969d76b813f806b5784848e8fbb93240e92911db17310b408ccbd911\": container with ID starting with 1d797fd4969d76b813f806b5784848e8fbb93240e92911db17310b408ccbd911 not found: ID does not exist" containerID="1d797fd4969d76b813f806b5784848e8fbb93240e92911db17310b408ccbd911" Jul 03 15:19:46.862674 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.862625 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d797fd4969d76b813f806b5784848e8fbb93240e92911db17310b408ccbd911"} err="failed to get container status \"1d797fd4969d76b813f806b5784848e8fbb93240e92911db17310b408ccbd911\": rpc error: code = NotFound desc = could not find container \"1d797fd4969d76b813f806b5784848e8fbb93240e92911db17310b408ccbd911\": container with ID starting with 1d797fd4969d76b813f806b5784848e8fbb93240e92911db17310b408ccbd911 not found: ID does not exist" Jul 03 15:19:46.875552 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.875530 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw"] Jul 03 15:19:46.881198 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:46.881178 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9s2kw"] Jul 03 15:19:48.017207 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:19:48.017170 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="587ecf9c-2796-4fed-9290-1942b48cd26c" path="/var/lib/kubelet/pods/587ecf9c-2796-4fed-9290-1942b48cd26c/volumes" Jul 03 15:20:11.824921 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:11.824889 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l4vc5" Jul 03 15:20:11.828001 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:11.827979 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbx65" Jul 03 15:20:16.317823 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:16.317779 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:20:16.418717 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:16.418681 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:20:18.076567 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:18.076528 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:20:24.983842 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:24.983748 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:20:25.079466 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.079421 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:20:25.104100 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.104069 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-468jf"] Jul 03 15:20:25.104393 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.104381 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="587ecf9c-2796-4fed-9290-1942b48cd26c" containerName="discovery" Jul 03 15:20:25.104439 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.104395 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="587ecf9c-2796-4fed-9290-1942b48cd26c" containerName="discovery" Jul 03 15:20:25.104476 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.104459 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="587ecf9c-2796-4fed-9290-1942b48cd26c" containerName="discovery" Jul 03 15:20:25.107038 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.107019 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-468jf" Jul 03 15:20:25.109625 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.109606 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 03 15:20:25.109732 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.109624 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 03 15:20:25.110558 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.110542 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-r4xtr\"" Jul 03 15:20:25.117948 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.117924 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-468jf"] Jul 03 15:20:25.164297 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.164267 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:20:25.202311 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.202277 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njjqz\" (UniqueName: \"kubernetes.io/projected/634ac042-7917-4d86-92a2-05261e49e102-kube-api-access-njjqz\") pod \"kuadrant-operator-catalog-468jf\" (UID: \"634ac042-7917-4d86-92a2-05261e49e102\") " pod="kuadrant-system/kuadrant-operator-catalog-468jf" Jul 03 15:20:25.302939 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.302853 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njjqz\" (UniqueName: \"kubernetes.io/projected/634ac042-7917-4d86-92a2-05261e49e102-kube-api-access-njjqz\") pod \"kuadrant-operator-catalog-468jf\" (UID: \"634ac042-7917-4d86-92a2-05261e49e102\") " pod="kuadrant-system/kuadrant-operator-catalog-468jf" Jul 03 15:20:25.311132 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.311101 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njjqz\" (UniqueName: \"kubernetes.io/projected/634ac042-7917-4d86-92a2-05261e49e102-kube-api-access-njjqz\") pod \"kuadrant-operator-catalog-468jf\" (UID: \"634ac042-7917-4d86-92a2-05261e49e102\") " pod="kuadrant-system/kuadrant-operator-catalog-468jf" Jul 03 15:20:25.417059 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.417020 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-468jf" Jul 03 15:20:25.473740 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.473707 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-468jf"] Jul 03 15:20:25.546972 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.546940 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-468jf"] Jul 03 15:20:25.550051 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:20:25.550020 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod634ac042_7917_4d86_92a2_05261e49e102.slice/crio-0aa493d461ef5f5b951cb6c181a8d0438108eb82a21c652f1ecc435ee825907b WatchSource:0}: Error finding container 0aa493d461ef5f5b951cb6c181a8d0438108eb82a21c652f1ecc435ee825907b: Status 404 returned error can't find the container with id 0aa493d461ef5f5b951cb6c181a8d0438108eb82a21c652f1ecc435ee825907b Jul 03 15:20:25.683053 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.683023 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tkhj8"] Jul 03 15:20:25.687384 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.687354 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tkhj8" Jul 03 15:20:25.693299 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.693268 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tkhj8"] Jul 03 15:20:25.706878 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.706852 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrmxn\" (UniqueName: \"kubernetes.io/projected/4a19be4a-33c5-47da-a95a-d2f302ada4f6-kube-api-access-lrmxn\") pod \"kuadrant-operator-catalog-tkhj8\" (UID: \"4a19be4a-33c5-47da-a95a-d2f302ada4f6\") " pod="kuadrant-system/kuadrant-operator-catalog-tkhj8" Jul 03 15:20:25.808142 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.808050 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrmxn\" (UniqueName: \"kubernetes.io/projected/4a19be4a-33c5-47da-a95a-d2f302ada4f6-kube-api-access-lrmxn\") pod \"kuadrant-operator-catalog-tkhj8\" (UID: \"4a19be4a-33c5-47da-a95a-d2f302ada4f6\") " pod="kuadrant-system/kuadrant-operator-catalog-tkhj8" Jul 03 15:20:25.816733 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.816705 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrmxn\" (UniqueName: \"kubernetes.io/projected/4a19be4a-33c5-47da-a95a-d2f302ada4f6-kube-api-access-lrmxn\") pod \"kuadrant-operator-catalog-tkhj8\" (UID: \"4a19be4a-33c5-47da-a95a-d2f302ada4f6\") " pod="kuadrant-system/kuadrant-operator-catalog-tkhj8" Jul 03 15:20:25.911563 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.908006 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:20:25.997480 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:25.997449 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tkhj8" Jul 03 15:20:26.026145 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:26.026108 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-468jf" event={"ID":"634ac042-7917-4d86-92a2-05261e49e102","Type":"ContainerStarted","Data":"0aa493d461ef5f5b951cb6c181a8d0438108eb82a21c652f1ecc435ee825907b"} Jul 03 15:20:26.125493 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:26.125457 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:20:26.135263 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:26.135234 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tkhj8"] Jul 03 15:20:26.151267 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:20:26.151239 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a19be4a_33c5_47da_a95a_d2f302ada4f6.slice/crio-a30c100e135ffa8171955256cb9be9f29d95715f736e60444c4eebafca201a8b WatchSource:0}: Error finding container a30c100e135ffa8171955256cb9be9f29d95715f736e60444c4eebafca201a8b: Status 404 returned error can't find the container with id a30c100e135ffa8171955256cb9be9f29d95715f736e60444c4eebafca201a8b Jul 03 15:20:27.032453 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:27.032410 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tkhj8" event={"ID":"4a19be4a-33c5-47da-a95a-d2f302ada4f6","Type":"ContainerStarted","Data":"a30c100e135ffa8171955256cb9be9f29d95715f736e60444c4eebafca201a8b"} Jul 03 15:20:28.037624 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:28.037582 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-468jf" event={"ID":"634ac042-7917-4d86-92a2-05261e49e102","Type":"ContainerStarted","Data":"73666c6caca27934a8b93186a08d5a2bbca18eec7c17df570d1c327ebc9c6250"} Jul 03 15:20:28.038056 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:28.037630 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-468jf" podUID="634ac042-7917-4d86-92a2-05261e49e102" containerName="registry-server" containerID="cri-o://73666c6caca27934a8b93186a08d5a2bbca18eec7c17df570d1c327ebc9c6250" gracePeriod=2 Jul 03 15:20:28.039457 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:28.039432 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tkhj8" event={"ID":"4a19be4a-33c5-47da-a95a-d2f302ada4f6","Type":"ContainerStarted","Data":"1962fdeaf70cb17bb2397aec3335055ab80eaa6d7f591f123efa06ab093efadf"} Jul 03 15:20:28.053508 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:28.053469 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-468jf" podStartSLOduration=1.064583874 podStartE2EDuration="3.053454576s" totalImagesPullingTime="1.988870702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:20:28.052513994 +0000 UTC m=+446.635537825" watchObservedRunningTime="2026-07-03 15:20:28.053454576 +0000 UTC m=+446.636478405" Jul 03 15:20:28.067572 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:28.067510 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-tkhj8" podStartSLOduration=1.683513476 podStartE2EDuration="3.067491359s" totalImagesPullingTime="1.383977883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:20:28.067291923 +0000 UTC m=+446.650315752" watchObservedRunningTime="2026-07-03 15:20:28.067491359 +0000 UTC m=+446.650515189" Jul 03 15:20:28.280037 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:28.280014 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-468jf" Jul 03 15:20:28.330354 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:28.330323 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njjqz\" (UniqueName: \"kubernetes.io/projected/634ac042-7917-4d86-92a2-05261e49e102-kube-api-access-njjqz\") pod \"634ac042-7917-4d86-92a2-05261e49e102\" (UID: \"634ac042-7917-4d86-92a2-05261e49e102\") " Jul 03 15:20:28.332510 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:28.332491 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/634ac042-7917-4d86-92a2-05261e49e102-kube-api-access-njjqz" (OuterVolumeSpecName: "kube-api-access-njjqz") pod "634ac042-7917-4d86-92a2-05261e49e102" (UID: "634ac042-7917-4d86-92a2-05261e49e102"). InnerVolumeSpecName "kube-api-access-njjqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:20:28.431255 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:28.431226 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njjqz\" (UniqueName: \"kubernetes.io/projected/634ac042-7917-4d86-92a2-05261e49e102-kube-api-access-njjqz\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:20:29.044716 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:29.044683 2532 generic.go:356] "Generic (PLEG): container finished" podID="634ac042-7917-4d86-92a2-05261e49e102" containerID="73666c6caca27934a8b93186a08d5a2bbca18eec7c17df570d1c327ebc9c6250" exitCode=0 Jul 03 15:20:29.044716 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:29.044719 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-468jf" Jul 03 15:20:29.045141 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:29.044755 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-468jf" event={"ID":"634ac042-7917-4d86-92a2-05261e49e102","Type":"ContainerDied","Data":"73666c6caca27934a8b93186a08d5a2bbca18eec7c17df570d1c327ebc9c6250"} Jul 03 15:20:29.045141 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:29.044796 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-468jf" event={"ID":"634ac042-7917-4d86-92a2-05261e49e102","Type":"ContainerDied","Data":"0aa493d461ef5f5b951cb6c181a8d0438108eb82a21c652f1ecc435ee825907b"} Jul 03 15:20:29.045141 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:29.044817 2532 scope.go:117] "RemoveContainer" containerID="73666c6caca27934a8b93186a08d5a2bbca18eec7c17df570d1c327ebc9c6250" Jul 03 15:20:29.053578 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:29.053558 2532 scope.go:117] "RemoveContainer" containerID="73666c6caca27934a8b93186a08d5a2bbca18eec7c17df570d1c327ebc9c6250" Jul 03 15:20:29.053844 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:20:29.053826 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73666c6caca27934a8b93186a08d5a2bbca18eec7c17df570d1c327ebc9c6250\": container with ID starting with 73666c6caca27934a8b93186a08d5a2bbca18eec7c17df570d1c327ebc9c6250 not found: ID does not exist" containerID="73666c6caca27934a8b93186a08d5a2bbca18eec7c17df570d1c327ebc9c6250" Jul 03 15:20:29.053893 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:29.053852 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73666c6caca27934a8b93186a08d5a2bbca18eec7c17df570d1c327ebc9c6250"} err="failed to get container status \"73666c6caca27934a8b93186a08d5a2bbca18eec7c17df570d1c327ebc9c6250\": rpc error: code = NotFound desc = could not find container \"73666c6caca27934a8b93186a08d5a2bbca18eec7c17df570d1c327ebc9c6250\": container with ID starting with 73666c6caca27934a8b93186a08d5a2bbca18eec7c17df570d1c327ebc9c6250 not found: ID does not exist" Jul 03 15:20:29.081811 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:29.081780 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-468jf"] Jul 03 15:20:29.104096 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:29.104069 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-468jf"] Jul 03 15:20:30.016770 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:30.016736 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="634ac042-7917-4d86-92a2-05261e49e102" path="/var/lib/kubelet/pods/634ac042-7917-4d86-92a2-05261e49e102/volumes" Jul 03 15:20:35.998330 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:35.998294 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-tkhj8" Jul 03 15:20:35.998736 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:35.998386 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-tkhj8" Jul 03 15:20:36.022128 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:36.022102 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-tkhj8" Jul 03 15:20:36.098203 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:36.098180 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-tkhj8" Jul 03 15:20:50.892768 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:50.892732 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:20:53.536337 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:53.536294 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx"] Jul 03 15:20:53.536716 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:53.536644 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="634ac042-7917-4d86-92a2-05261e49e102" containerName="registry-server" Jul 03 15:20:53.536716 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:53.536656 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="634ac042-7917-4d86-92a2-05261e49e102" containerName="registry-server" Jul 03 15:20:53.536716 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:53.536712 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="634ac042-7917-4d86-92a2-05261e49e102" containerName="registry-server" Jul 03 15:20:53.539500 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:53.539482 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" Jul 03 15:20:53.542002 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:53.541981 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-slrxf\"" Jul 03 15:20:53.551555 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:53.551535 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx"] Jul 03 15:20:53.635043 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:53.635013 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7bnw\" (UniqueName: \"kubernetes.io/projected/fba656ce-f027-443b-ad1a-d867a46c2305-kube-api-access-z7bnw\") pod \"limitador-operator-controller-manager-859d7b78bd-m57gx\" (UID: \"fba656ce-f027-443b-ad1a-d867a46c2305\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" Jul 03 15:20:53.736236 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:53.736202 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7bnw\" (UniqueName: \"kubernetes.io/projected/fba656ce-f027-443b-ad1a-d867a46c2305-kube-api-access-z7bnw\") pod \"limitador-operator-controller-manager-859d7b78bd-m57gx\" (UID: \"fba656ce-f027-443b-ad1a-d867a46c2305\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" Jul 03 15:20:53.744440 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:53.744410 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7bnw\" (UniqueName: \"kubernetes.io/projected/fba656ce-f027-443b-ad1a-d867a46c2305-kube-api-access-z7bnw\") pod \"limitador-operator-controller-manager-859d7b78bd-m57gx\" (UID: \"fba656ce-f027-443b-ad1a-d867a46c2305\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" Jul 03 15:20:53.849048 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:53.849012 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" Jul 03 15:20:53.982522 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:53.982496 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx"] Jul 03 15:20:53.984596 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:20:53.984562 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfba656ce_f027_443b_ad1a_d867a46c2305.slice/crio-b5dd430a271789305b420c73133ea3347d3ff198537c9ef4c2e25dfc64d3dec3 WatchSource:0}: Error finding container b5dd430a271789305b420c73133ea3347d3ff198537c9ef4c2e25dfc64d3dec3: Status 404 returned error can't find the container with id b5dd430a271789305b420c73133ea3347d3ff198537c9ef4c2e25dfc64d3dec3 Jul 03 15:20:54.151272 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:54.151208 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" event={"ID":"fba656ce-f027-443b-ad1a-d867a46c2305","Type":"ContainerStarted","Data":"b5dd430a271789305b420c73133ea3347d3ff198537c9ef4c2e25dfc64d3dec3"} Jul 03 15:20:55.102875 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.102830 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:20:55.643045 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.643009 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86c687b48f-5qhjk"] Jul 03 15:20:55.646310 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.646293 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:55.668319 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.668287 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86c687b48f-5qhjk"] Jul 03 15:20:55.751710 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.751675 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cdfa343-81c5-4671-b66d-c16fcdebf6ca-oauth-serving-cert\") pod \"console-86c687b48f-5qhjk\" (UID: \"6cdfa343-81c5-4671-b66d-c16fcdebf6ca\") " pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:55.751854 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.751729 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cdfa343-81c5-4671-b66d-c16fcdebf6ca-trusted-ca-bundle\") pod \"console-86c687b48f-5qhjk\" (UID: \"6cdfa343-81c5-4671-b66d-c16fcdebf6ca\") " pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:55.751854 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.751805 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cdfa343-81c5-4671-b66d-c16fcdebf6ca-console-serving-cert\") pod \"console-86c687b48f-5qhjk\" (UID: \"6cdfa343-81c5-4671-b66d-c16fcdebf6ca\") " pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:55.751854 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.751829 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k4fx\" (UniqueName: \"kubernetes.io/projected/6cdfa343-81c5-4671-b66d-c16fcdebf6ca-kube-api-access-6k4fx\") pod \"console-86c687b48f-5qhjk\" (UID: \"6cdfa343-81c5-4671-b66d-c16fcdebf6ca\") " pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:55.751996 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.751859 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cdfa343-81c5-4671-b66d-c16fcdebf6ca-console-oauth-config\") pod \"console-86c687b48f-5qhjk\" (UID: \"6cdfa343-81c5-4671-b66d-c16fcdebf6ca\") " pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:55.751996 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.751932 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cdfa343-81c5-4671-b66d-c16fcdebf6ca-console-config\") pod \"console-86c687b48f-5qhjk\" (UID: \"6cdfa343-81c5-4671-b66d-c16fcdebf6ca\") " pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:55.752103 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.752035 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cdfa343-81c5-4671-b66d-c16fcdebf6ca-service-ca\") pod \"console-86c687b48f-5qhjk\" (UID: \"6cdfa343-81c5-4671-b66d-c16fcdebf6ca\") " pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:55.790085 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.790055 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:20:55.853293 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.853260 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cdfa343-81c5-4671-b66d-c16fcdebf6ca-console-serving-cert\") pod \"console-86c687b48f-5qhjk\" (UID: \"6cdfa343-81c5-4671-b66d-c16fcdebf6ca\") " pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:55.853498 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.853302 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k4fx\" (UniqueName: \"kubernetes.io/projected/6cdfa343-81c5-4671-b66d-c16fcdebf6ca-kube-api-access-6k4fx\") pod \"console-86c687b48f-5qhjk\" (UID: \"6cdfa343-81c5-4671-b66d-c16fcdebf6ca\") " pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:55.853498 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.853327 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cdfa343-81c5-4671-b66d-c16fcdebf6ca-console-oauth-config\") pod \"console-86c687b48f-5qhjk\" (UID: \"6cdfa343-81c5-4671-b66d-c16fcdebf6ca\") " pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:55.853498 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.853410 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cdfa343-81c5-4671-b66d-c16fcdebf6ca-console-config\") pod \"console-86c687b48f-5qhjk\" (UID: \"6cdfa343-81c5-4671-b66d-c16fcdebf6ca\") " pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:55.853498 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.853458 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cdfa343-81c5-4671-b66d-c16fcdebf6ca-service-ca\") pod \"console-86c687b48f-5qhjk\" (UID: \"6cdfa343-81c5-4671-b66d-c16fcdebf6ca\") " pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:55.853727 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.853536 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cdfa343-81c5-4671-b66d-c16fcdebf6ca-oauth-serving-cert\") pod \"console-86c687b48f-5qhjk\" (UID: \"6cdfa343-81c5-4671-b66d-c16fcdebf6ca\") " pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:55.853727 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.853589 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cdfa343-81c5-4671-b66d-c16fcdebf6ca-trusted-ca-bundle\") pod \"console-86c687b48f-5qhjk\" (UID: \"6cdfa343-81c5-4671-b66d-c16fcdebf6ca\") " pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:55.854658 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.854580 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cdfa343-81c5-4671-b66d-c16fcdebf6ca-trusted-ca-bundle\") pod \"console-86c687b48f-5qhjk\" (UID: \"6cdfa343-81c5-4671-b66d-c16fcdebf6ca\") " pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:55.854658 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.854609 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cdfa343-81c5-4671-b66d-c16fcdebf6ca-service-ca\") pod \"console-86c687b48f-5qhjk\" (UID: \"6cdfa343-81c5-4671-b66d-c16fcdebf6ca\") " pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:55.854658 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.854609 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cdfa343-81c5-4671-b66d-c16fcdebf6ca-oauth-serving-cert\") pod \"console-86c687b48f-5qhjk\" (UID: \"6cdfa343-81c5-4671-b66d-c16fcdebf6ca\") " pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:55.854887 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.854767 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cdfa343-81c5-4671-b66d-c16fcdebf6ca-console-config\") pod \"console-86c687b48f-5qhjk\" (UID: \"6cdfa343-81c5-4671-b66d-c16fcdebf6ca\") " pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:55.856293 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.856268 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cdfa343-81c5-4671-b66d-c16fcdebf6ca-console-oauth-config\") pod \"console-86c687b48f-5qhjk\" (UID: \"6cdfa343-81c5-4671-b66d-c16fcdebf6ca\") " pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:55.856435 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.856322 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cdfa343-81c5-4671-b66d-c16fcdebf6ca-console-serving-cert\") pod \"console-86c687b48f-5qhjk\" (UID: \"6cdfa343-81c5-4671-b66d-c16fcdebf6ca\") " pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:55.865983 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.865960 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k4fx\" (UniqueName: \"kubernetes.io/projected/6cdfa343-81c5-4671-b66d-c16fcdebf6ca-kube-api-access-6k4fx\") pod \"console-86c687b48f-5qhjk\" (UID: \"6cdfa343-81c5-4671-b66d-c16fcdebf6ca\") " pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:55.894667 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.894605 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:20:55.957358 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:55.957310 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:20:56.219404 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:56.219360 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86c687b48f-5qhjk"] Jul 03 15:20:56.220906 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:20:56.220883 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cdfa343_81c5_4671_b66d_c16fcdebf6ca.slice/crio-360da3164e653d1dfe31e8e0ea2d0adc3bb6f72a72d1eee17fb012ba888e0973 WatchSource:0}: Error finding container 360da3164e653d1dfe31e8e0ea2d0adc3bb6f72a72d1eee17fb012ba888e0973: Status 404 returned error can't find the container with id 360da3164e653d1dfe31e8e0ea2d0adc3bb6f72a72d1eee17fb012ba888e0973 Jul 03 15:20:57.110151 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:57.110119 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-n2rm2"] Jul 03 15:20:57.114501 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:57.114483 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-n2rm2" Jul 03 15:20:57.118612 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:57.118594 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qcbgx\"" Jul 03 15:20:57.127610 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:57.127593 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 03 15:20:57.136091 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:57.136071 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-n2rm2"] Jul 03 15:20:57.164898 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:57.164871 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nts94\" (UniqueName: \"kubernetes.io/projected/4d9386b1-89b2-4919-974c-18c9721dfd35-kube-api-access-nts94\") pod \"dns-operator-controller-manager-864dd78c4c-n2rm2\" (UID: \"4d9386b1-89b2-4919-974c-18c9721dfd35\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-n2rm2" Jul 03 15:20:57.167242 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:57.167219 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86c687b48f-5qhjk" event={"ID":"6cdfa343-81c5-4671-b66d-c16fcdebf6ca","Type":"ContainerStarted","Data":"bf325d13e6536896fc893c060011b42ae4c04f6db7886cde204767dff7dfdb81"} Jul 03 15:20:57.167323 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:57.167258 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86c687b48f-5qhjk" event={"ID":"6cdfa343-81c5-4671-b66d-c16fcdebf6ca","Type":"ContainerStarted","Data":"360da3164e653d1dfe31e8e0ea2d0adc3bb6f72a72d1eee17fb012ba888e0973"} Jul 03 15:20:57.168826 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:57.168803 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" event={"ID":"fba656ce-f027-443b-ad1a-d867a46c2305","Type":"ContainerStarted","Data":"0de5ebd396913b6884f40c2d94cfde153887c9d94d5f1ace886f8b496f585077"} Jul 03 15:20:57.168909 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:57.168856 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" Jul 03 15:20:57.217149 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:57.217109 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" podStartSLOduration=2.061353334 podStartE2EDuration="4.217095428s" totalImagesPullingTime="2.155742094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:20:57.214059444 +0000 UTC m=+475.797083272" watchObservedRunningTime="2026-07-03 15:20:57.217095428 +0000 UTC m=+475.800119257" Jul 03 15:20:57.247772 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:57.247728 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86c687b48f-5qhjk" podStartSLOduration=2.247715276 podStartE2EDuration="2.247715276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:20:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:20:57.246429253 +0000 UTC m=+475.829453075" watchObservedRunningTime="2026-07-03 15:20:57.247715276 +0000 UTC m=+475.830739106" Jul 03 15:20:57.265830 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:57.265797 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nts94\" (UniqueName: \"kubernetes.io/projected/4d9386b1-89b2-4919-974c-18c9721dfd35-kube-api-access-nts94\") pod \"dns-operator-controller-manager-864dd78c4c-n2rm2\" (UID: \"4d9386b1-89b2-4919-974c-18c9721dfd35\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-n2rm2" Jul 03 15:20:57.280971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:57.280952 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nts94\" (UniqueName: \"kubernetes.io/projected/4d9386b1-89b2-4919-974c-18c9721dfd35-kube-api-access-nts94\") pod \"dns-operator-controller-manager-864dd78c4c-n2rm2\" (UID: \"4d9386b1-89b2-4919-974c-18c9721dfd35\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-n2rm2" Jul 03 15:20:57.424883 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:57.424822 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-n2rm2" Jul 03 15:20:57.556532 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:57.556491 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-n2rm2"] Jul 03 15:20:57.558894 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:20:57.558863 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d9386b1_89b2_4919_974c_18c9721dfd35.slice/crio-f6e224738a949a572191cb37e770f534239887273197b3b2d7b24c2e591a88a7 WatchSource:0}: Error finding container f6e224738a949a572191cb37e770f534239887273197b3b2d7b24c2e591a88a7: Status 404 returned error can't find the container with id f6e224738a949a572191cb37e770f534239887273197b3b2d7b24c2e591a88a7 Jul 03 15:20:57.970428 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:57.970391 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:20:58.175992 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:58.175955 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-n2rm2" event={"ID":"4d9386b1-89b2-4919-974c-18c9721dfd35","Type":"ContainerStarted","Data":"f6e224738a949a572191cb37e770f534239887273197b3b2d7b24c2e591a88a7"} Jul 03 15:20:59.235069 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:20:59.234970 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:00.188457 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:00.188425 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-n2rm2" event={"ID":"4d9386b1-89b2-4919-974c-18c9721dfd35","Type":"ContainerStarted","Data":"7dc363370e211e8506a2457be271e7a86b7383f3dcda541f6be6918fcee9d0ec"} Jul 03 15:21:00.188653 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:00.188519 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-n2rm2" Jul 03 15:21:00.227795 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:00.227750 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-n2rm2" podStartSLOduration=1.2200601070000001 podStartE2EDuration="3.227736959s" totalImagesPullingTime="2.007676852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:21:00.226125343 +0000 UTC m=+478.809149173" watchObservedRunningTime="2026-07-03 15:21:00.227736959 +0000 UTC m=+478.810760787" Jul 03 15:21:00.712959 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:00.712914 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:02.472303 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:02.472264 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:02.788197 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:02.788120 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r"] Jul 03 15:21:02.792868 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:02.792848 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" Jul 03 15:21:02.801202 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:02.801185 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tdvnd\"" Jul 03 15:21:02.819509 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:02.819488 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r"] Jul 03 15:21:02.819825 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:02.819801 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:02.914446 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:02.914414 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvt6b\" (UniqueName: \"kubernetes.io/projected/9b89c335-ce04-47ef-b696-053858964026-kube-api-access-rvt6b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fnb8r\" (UID: \"9b89c335-ce04-47ef-b696-053858964026\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" Jul 03 15:21:02.914573 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:02.914482 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b89c335-ce04-47ef-b696-053858964026-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fnb8r\" (UID: \"9b89c335-ce04-47ef-b696-053858964026\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" Jul 03 15:21:03.014981 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:03.014955 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvt6b\" (UniqueName: \"kubernetes.io/projected/9b89c335-ce04-47ef-b696-053858964026-kube-api-access-rvt6b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fnb8r\" (UID: \"9b89c335-ce04-47ef-b696-053858964026\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" Jul 03 15:21:03.015120 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:03.015009 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b89c335-ce04-47ef-b696-053858964026-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fnb8r\" (UID: \"9b89c335-ce04-47ef-b696-053858964026\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" Jul 03 15:21:03.015312 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:03.015297 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b89c335-ce04-47ef-b696-053858964026-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fnb8r\" (UID: \"9b89c335-ce04-47ef-b696-053858964026\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" Jul 03 15:21:03.024957 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:03.024923 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvt6b\" (UniqueName: \"kubernetes.io/projected/9b89c335-ce04-47ef-b696-053858964026-kube-api-access-rvt6b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fnb8r\" (UID: \"9b89c335-ce04-47ef-b696-053858964026\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" Jul 03 15:21:03.103267 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:03.103241 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" Jul 03 15:21:03.255492 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:03.255451 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r"] Jul 03 15:21:03.258792 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:21:03.258759 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b89c335_ce04_47ef_b696_053858964026.slice/crio-43263a5a38919e1798367ef24b163344bf22f6fe7033063010db3e98c1d03fce WatchSource:0}: Error finding container 43263a5a38919e1798367ef24b163344bf22f6fe7033063010db3e98c1d03fce: Status 404 returned error can't find the container with id 43263a5a38919e1798367ef24b163344bf22f6fe7033063010db3e98c1d03fce Jul 03 15:21:03.561028 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:03.560940 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:04.211123 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:04.211089 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" event={"ID":"9b89c335-ce04-47ef-b696-053858964026","Type":"ContainerStarted","Data":"43263a5a38919e1798367ef24b163344bf22f6fe7033063010db3e98c1d03fce"} Jul 03 15:21:04.547593 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:04.547508 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:05.154089 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:05.154046 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:05.326095 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:05.326057 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:05.957444 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:05.957409 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:21:05.957620 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:05.957472 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:21:05.962409 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:05.962386 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:21:06.224887 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:06.224816 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86c687b48f-5qhjk" Jul 03 15:21:06.409624 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:06.409590 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d846c95c7-48qg9"] Jul 03 15:21:06.424543 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:06.424514 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-twxr6"] Jul 03 15:21:06.437885 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:06.437244 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-twxr6" Jul 03 15:21:06.441091 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:06.441022 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-nr7xc\"" Jul 03 15:21:06.457137 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:06.457112 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-twxr6"] Jul 03 15:21:06.546285 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:06.546204 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zrvz\" (UniqueName: \"kubernetes.io/projected/2112a5da-f5aa-499a-9e04-18e9591ffecf-kube-api-access-9zrvz\") pod \"authorino-operator-75cc8d5cb7-twxr6\" (UID: \"2112a5da-f5aa-499a-9e04-18e9591ffecf\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-twxr6" Jul 03 15:21:06.596799 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:06.596763 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:06.647635 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:06.647597 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zrvz\" (UniqueName: \"kubernetes.io/projected/2112a5da-f5aa-499a-9e04-18e9591ffecf-kube-api-access-9zrvz\") pod \"authorino-operator-75cc8d5cb7-twxr6\" (UID: \"2112a5da-f5aa-499a-9e04-18e9591ffecf\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-twxr6" Jul 03 15:21:06.663656 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:06.663618 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zrvz\" (UniqueName: \"kubernetes.io/projected/2112a5da-f5aa-499a-9e04-18e9591ffecf-kube-api-access-9zrvz\") pod \"authorino-operator-75cc8d5cb7-twxr6\" (UID: \"2112a5da-f5aa-499a-9e04-18e9591ffecf\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-twxr6" Jul 03 15:21:06.718467 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:06.718434 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:06.751963 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:06.751936 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-twxr6" Jul 03 15:21:06.834627 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:06.834592 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:06.911619 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:06.911584 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-twxr6"] Jul 03 15:21:06.915947 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:21:06.915923 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2112a5da_f5aa_499a_9e04_18e9591ffecf.slice/crio-3bcc3b191849244696711ecaa50201d4cd138b10fd04ebe2e0e8455ed37054df WatchSource:0}: Error finding container 3bcc3b191849244696711ecaa50201d4cd138b10fd04ebe2e0e8455ed37054df: Status 404 returned error can't find the container with id 3bcc3b191849244696711ecaa50201d4cd138b10fd04ebe2e0e8455ed37054df Jul 03 15:21:07.226963 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:07.226918 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-twxr6" event={"ID":"2112a5da-f5aa-499a-9e04-18e9591ffecf","Type":"ContainerStarted","Data":"3bcc3b191849244696711ecaa50201d4cd138b10fd04ebe2e0e8455ed37054df"} Jul 03 15:21:07.785726 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:07.785683 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:07.901757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:07.901720 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:08.178337 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:08.178308 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" Jul 03 15:21:09.244359 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:09.244220 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" event={"ID":"9b89c335-ce04-47ef-b696-053858964026","Type":"ContainerStarted","Data":"faa309a81ca20f37dc36c13425e66e0849f029be9f49f313ab73b448042e66a1"} Jul 03 15:21:09.244847 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:09.244769 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" Jul 03 15:21:09.291538 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:09.291210 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" podStartSLOduration=2.103562852 podStartE2EDuration="7.291193516s" totalImagesPullingTime="5.187630664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:21:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:21:09.289122278 +0000 UTC m=+487.872146107" watchObservedRunningTime="2026-07-03 15:21:09.291193516 +0000 UTC m=+487.874217348" Jul 03 15:21:09.404027 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:09.403992 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:09.490345 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:09.490304 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:11.195733 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:11.195701 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-n2rm2" Jul 03 15:21:11.257361 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:11.257327 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-twxr6" event={"ID":"2112a5da-f5aa-499a-9e04-18e9591ffecf","Type":"ContainerStarted","Data":"a476e1faf269444704eba509d19abe6b5afd3493fbd4074e539faa61b15387fc"} Jul 03 15:21:11.257539 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:11.257406 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-twxr6" Jul 03 15:21:11.275713 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:11.275662 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-twxr6" podStartSLOduration=1.778232139 podStartE2EDuration="5.275647775s" totalImagesPullingTime="3.497415636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:21:11.274392191 +0000 UTC m=+489.857416021" watchObservedRunningTime="2026-07-03 15:21:11.275647775 +0000 UTC m=+489.858671604" Jul 03 15:21:11.681010 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:11.680983 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5q82r"] Jul 03 15:21:11.684298 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:11.684277 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5q82r" Jul 03 15:21:11.688571 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:11.688550 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 03 15:21:11.693808 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:11.693782 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dp9v2\"" Jul 03 15:21:11.694206 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:11.694192 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 03 15:21:11.715792 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:11.715767 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5q82r"] Jul 03 15:21:11.721143 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:11.721098 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:11.789067 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:11.789039 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6feba469-332f-4e04-b026-35df37bc51d7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5q82r\" (UID: \"6feba469-332f-4e04-b026-35df37bc51d7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5q82r" Jul 03 15:21:11.789176 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:11.789070 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vrbt\" (UniqueName: \"kubernetes.io/projected/6feba469-332f-4e04-b026-35df37bc51d7-kube-api-access-8vrbt\") pod \"kuadrant-console-plugin-66b5774985-5q82r\" (UID: \"6feba469-332f-4e04-b026-35df37bc51d7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5q82r" Jul 03 15:21:11.789176 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:11.789160 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6feba469-332f-4e04-b026-35df37bc51d7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5q82r\" (UID: \"6feba469-332f-4e04-b026-35df37bc51d7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5q82r" Jul 03 15:21:11.845332 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:11.845306 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:11.889918 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:11.889890 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6feba469-332f-4e04-b026-35df37bc51d7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5q82r\" (UID: \"6feba469-332f-4e04-b026-35df37bc51d7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5q82r" Jul 03 15:21:11.889992 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:11.889939 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6feba469-332f-4e04-b026-35df37bc51d7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5q82r\" (UID: \"6feba469-332f-4e04-b026-35df37bc51d7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5q82r" Jul 03 15:21:11.889992 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:11.889966 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vrbt\" (UniqueName: \"kubernetes.io/projected/6feba469-332f-4e04-b026-35df37bc51d7-kube-api-access-8vrbt\") pod \"kuadrant-console-plugin-66b5774985-5q82r\" (UID: \"6feba469-332f-4e04-b026-35df37bc51d7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5q82r" Jul 03 15:21:11.890632 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:11.890611 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6feba469-332f-4e04-b026-35df37bc51d7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5q82r\" (UID: \"6feba469-332f-4e04-b026-35df37bc51d7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5q82r" Jul 03 15:21:11.892507 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:11.892481 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6feba469-332f-4e04-b026-35df37bc51d7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5q82r\" (UID: \"6feba469-332f-4e04-b026-35df37bc51d7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5q82r" Jul 03 15:21:11.902948 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:11.902925 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vrbt\" (UniqueName: \"kubernetes.io/projected/6feba469-332f-4e04-b026-35df37bc51d7-kube-api-access-8vrbt\") pod \"kuadrant-console-plugin-66b5774985-5q82r\" (UID: \"6feba469-332f-4e04-b026-35df37bc51d7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5q82r" Jul 03 15:21:11.993587 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:11.993535 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5q82r" Jul 03 15:21:12.138065 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:12.138021 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5q82r"] Jul 03 15:21:12.140114 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:21:12.140086 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6feba469_332f_4e04_b026_35df37bc51d7.slice/crio-60cda6000acdc4b2022aca62742f2ee11ab8a6b29784219ba8396e1ad0c46c98 WatchSource:0}: Error finding container 60cda6000acdc4b2022aca62742f2ee11ab8a6b29784219ba8396e1ad0c46c98: Status 404 returned error can't find the container with id 60cda6000acdc4b2022aca62742f2ee11ab8a6b29784219ba8396e1ad0c46c98 Jul 03 15:21:12.263011 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:12.262931 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5q82r" event={"ID":"6feba469-332f-4e04-b026-35df37bc51d7","Type":"ContainerStarted","Data":"60cda6000acdc4b2022aca62742f2ee11ab8a6b29784219ba8396e1ad0c46c98"} Jul 03 15:21:14.498657 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:14.498616 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:14.599760 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:14.599732 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:18.450816 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:18.450777 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:20.253288 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:20.253246 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" Jul 03 15:21:21.414469 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:21.414431 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lrrq5"] Jul 03 15:21:21.434889 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:21.434845 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lrrq5"] Jul 03 15:21:21.435062 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:21.434984 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lrrq5" Jul 03 15:21:21.520053 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:21.520020 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lrrq5"] Jul 03 15:21:21.520317 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:21.520292 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-bfgr8], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lrrq5" podUID="d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb" Jul 03 15:21:21.576983 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:21.576946 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfgr8\" (UniqueName: \"kubernetes.io/projected/d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb-kube-api-access-bfgr8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lrrq5\" (UID: \"d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lrrq5" Jul 03 15:21:21.577169 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:21.577045 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lrrq5\" (UID: \"d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lrrq5" Jul 03 15:21:21.678000 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:21.677922 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lrrq5\" (UID: \"d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lrrq5" Jul 03 15:21:21.678157 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:21.678021 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfgr8\" (UniqueName: \"kubernetes.io/projected/d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb-kube-api-access-bfgr8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lrrq5\" (UID: \"d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lrrq5" Jul 03 15:21:21.678324 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:21.678299 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lrrq5\" (UID: \"d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lrrq5" Jul 03 15:21:21.692393 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:21.692348 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfgr8\" (UniqueName: \"kubernetes.io/projected/d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb-kube-api-access-bfgr8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lrrq5\" (UID: \"d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lrrq5" Jul 03 15:21:22.040357 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.040286 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lrrq5"] Jul 03 15:21:22.047529 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.047501 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lrrq5"] Jul 03 15:21:22.057869 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.057841 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r"] Jul 03 15:21:22.058054 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.058030 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" podUID="9b89c335-ce04-47ef-b696-053858964026" containerName="manager" containerID="cri-o://faa309a81ca20f37dc36c13425e66e0849f029be9f49f313ab73b448042e66a1" gracePeriod=2 Jul 03 15:21:22.071650 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.071586 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r"] Jul 03 15:21:22.071789 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:22.071759 2532 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9b89c335-ce04-47ef-b696-053858964026\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-fnb8r\": pods \"kuadrant-operator-controller-manager-8684c9ff49-fnb8r\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" Jul 03 15:21:22.086514 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.086488 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s"] Jul 03 15:21:22.087031 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.086982 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b89c335-ce04-47ef-b696-053858964026" containerName="manager" Jul 03 15:21:22.087031 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.087005 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b89c335-ce04-47ef-b696-053858964026" containerName="manager" Jul 03 15:21:22.087185 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.087145 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b89c335-ce04-47ef-b696-053858964026" containerName="manager" Jul 03 15:21:22.090585 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.090561 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx"] Jul 03 15:21:22.090697 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.090681 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s" Jul 03 15:21:22.090936 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.090758 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" podUID="fba656ce-f027-443b-ad1a-d867a46c2305" containerName="manager" containerID="cri-o://0de5ebd396913b6884f40c2d94cfde153887c9d94d5f1ace886f8b496f585077" gracePeriod=2 Jul 03 15:21:22.098014 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.097988 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx"] Jul 03 15:21:22.108184 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.108154 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s"] Jul 03 15:21:22.111903 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.111857 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqzsl"] Jul 03 15:21:22.112249 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.112231 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fba656ce-f027-443b-ad1a-d867a46c2305" containerName="manager" Jul 03 15:21:22.112357 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.112253 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="fba656ce-f027-443b-ad1a-d867a46c2305" containerName="manager" Jul 03 15:21:22.112357 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.112323 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="fba656ce-f027-443b-ad1a-d867a46c2305" containerName="manager" Jul 03 15:21:22.120958 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.120935 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqzsl" Jul 03 15:21:22.128578 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:22.128542 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fnb8r\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="9b89c335-ce04-47ef-b696-053858964026" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" Jul 03 15:21:22.131138 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.130558 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqzsl"] Jul 03 15:21:22.131138 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:22.130686 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m57gx\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="fba656ce-f027-443b-ad1a-d867a46c2305" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" Jul 03 15:21:22.132990 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:22.132924 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fnb8r\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="9b89c335-ce04-47ef-b696-053858964026" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" Jul 03 15:21:22.135268 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:22.135246 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m57gx\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="fba656ce-f027-443b-ad1a-d867a46c2305" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" Jul 03 15:21:22.184445 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.184419 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckzd6\" (UniqueName: \"kubernetes.io/projected/b9bb98f1-c859-46ae-b268-e20265dfe765-kube-api-access-ckzd6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ph86s\" (UID: \"b9bb98f1-c859-46ae-b268-e20265dfe765\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s" Jul 03 15:21:22.184564 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.184548 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b9bb98f1-c859-46ae-b268-e20265dfe765-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ph86s\" (UID: \"b9bb98f1-c859-46ae-b268-e20265dfe765\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s" Jul 03 15:21:22.265942 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.265908 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-twxr6" Jul 03 15:21:22.285659 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.285625 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b9bb98f1-c859-46ae-b268-e20265dfe765-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ph86s\" (UID: \"b9bb98f1-c859-46ae-b268-e20265dfe765\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s" Jul 03 15:21:22.285814 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.285705 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckzd6\" (UniqueName: \"kubernetes.io/projected/b9bb98f1-c859-46ae-b268-e20265dfe765-kube-api-access-ckzd6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ph86s\" (UID: \"b9bb98f1-c859-46ae-b268-e20265dfe765\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s" Jul 03 15:21:22.285814 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.285760 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfmn7\" (UniqueName: \"kubernetes.io/projected/fd0e5e48-462b-4bd7-8d65-0fd969b8cf64-kube-api-access-tfmn7\") pod \"limitador-operator-controller-manager-859d7b78bd-cqzsl\" (UID: \"fd0e5e48-462b-4bd7-8d65-0fd969b8cf64\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqzsl" Jul 03 15:21:22.286126 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.286069 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b9bb98f1-c859-46ae-b268-e20265dfe765-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ph86s\" (UID: \"b9bb98f1-c859-46ae-b268-e20265dfe765\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s" Jul 03 15:21:22.286656 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:22.286629 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fnb8r\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="9b89c335-ce04-47ef-b696-053858964026" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" Jul 03 15:21:22.288973 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:22.288947 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m57gx\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="fba656ce-f027-443b-ad1a-d867a46c2305" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" Jul 03 15:21:22.303277 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.303205 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckzd6\" (UniqueName: \"kubernetes.io/projected/b9bb98f1-c859-46ae-b268-e20265dfe765-kube-api-access-ckzd6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ph86s\" (UID: \"b9bb98f1-c859-46ae-b268-e20265dfe765\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s" Jul 03 15:21:22.317465 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.317438 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lrrq5" Jul 03 15:21:22.321278 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:22.321243 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fnb8r\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="9b89c335-ce04-47ef-b696-053858964026" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" Jul 03 15:21:22.323447 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:22.323414 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m57gx\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="fba656ce-f027-443b-ad1a-d867a46c2305" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" Jul 03 15:21:22.325702 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:22.325672 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-lrrq5\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lrrq5" Jul 03 15:21:22.329662 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.329644 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lrrq5" Jul 03 15:21:22.332346 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:22.332323 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fnb8r\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="9b89c335-ce04-47ef-b696-053858964026" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" Jul 03 15:21:22.335678 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:22.335654 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m57gx\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="fba656ce-f027-443b-ad1a-d867a46c2305" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" Jul 03 15:21:22.339177 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:22.339149 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-lrrq5\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lrrq5" Jul 03 15:21:22.387041 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.387010 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfmn7\" (UniqueName: \"kubernetes.io/projected/fd0e5e48-462b-4bd7-8d65-0fd969b8cf64-kube-api-access-tfmn7\") pod \"limitador-operator-controller-manager-859d7b78bd-cqzsl\" (UID: \"fd0e5e48-462b-4bd7-8d65-0fd969b8cf64\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqzsl" Jul 03 15:21:22.397869 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.397848 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfmn7\" (UniqueName: \"kubernetes.io/projected/fd0e5e48-462b-4bd7-8d65-0fd969b8cf64-kube-api-access-tfmn7\") pod \"limitador-operator-controller-manager-859d7b78bd-cqzsl\" (UID: \"fd0e5e48-462b-4bd7-8d65-0fd969b8cf64\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqzsl" Jul 03 15:21:22.487846 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.487814 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfgr8\" (UniqueName: \"kubernetes.io/projected/d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb-kube-api-access-bfgr8\") pod \"d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb\" (UID: \"d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb\") " Jul 03 15:21:22.488188 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.487915 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb-extensions-socket-volume\") pod \"d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb\" (UID: \"d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb\") " Jul 03 15:21:22.488265 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.488234 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb" (UID: "d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:21:22.489347 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.489313 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s" Jul 03 15:21:22.490281 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.490254 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb-kube-api-access-bfgr8" (OuterVolumeSpecName: "kube-api-access-bfgr8") pod "d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb" (UID: "d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb"). InnerVolumeSpecName "kube-api-access-bfgr8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:21:22.497019 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.496985 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqzsl" Jul 03 15:21:22.588912 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.588877 2532 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb-extensions-socket-volume\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:21:22.588912 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:22.588906 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfgr8\" (UniqueName: \"kubernetes.io/projected/d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb-kube-api-access-bfgr8\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:21:23.212867 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:23.212830 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:23.311135 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:23.311100 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:23.322218 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:23.322189 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lrrq5" Jul 03 15:21:23.324911 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:23.324876 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-lrrq5\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lrrq5" Jul 03 15:21:23.328082 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:23.328007 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fnb8r\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="9b89c335-ce04-47ef-b696-053858964026" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" Jul 03 15:21:23.330180 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:23.330111 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m57gx\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="fba656ce-f027-443b-ad1a-d867a46c2305" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" Jul 03 15:21:23.332291 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:23.332261 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-lrrq5\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lrrq5" Jul 03 15:21:23.334274 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:23.334248 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fnb8r\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="9b89c335-ce04-47ef-b696-053858964026" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" Jul 03 15:21:23.336333 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:23.336311 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m57gx\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="fba656ce-f027-443b-ad1a-d867a46c2305" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" Jul 03 15:21:23.668600 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:23.668558 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:24.017879 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:24.017805 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb" path="/var/lib/kubelet/pods/d3b1b4c8-971b-4de8-8fc2-fc27de0ca0eb/volumes" Jul 03 15:21:25.037650 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:25.037610 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:25.810926 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:25.810895 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:25.977472 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:25.977425 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:28.769205 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:28.769156 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:28.866934 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:28.866899 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:31.437946 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:31.437905 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6d846c95c7-48qg9" podUID="3c920e6a-3b6c-4dcf-a065-60447a5f8cf4" containerName="console" containerID="cri-o://cad395c59256139e0dc6b041821afce108bdc28aa8d09871abb3a402cb9b9769" gracePeriod=15 Jul 03 15:21:32.598548 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:32.598511 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:32.673521 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:32.673472 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:33.397753 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.397621 2532 generic.go:356] "Generic (PLEG): container finished" podID="fba656ce-f027-443b-ad1a-d867a46c2305" containerID="0de5ebd396913b6884f40c2d94cfde153887c9d94d5f1ace886f8b496f585077" exitCode=0 Jul 03 15:21:33.401271 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.401156 2532 generic.go:356] "Generic (PLEG): container finished" podID="3c920e6a-3b6c-4dcf-a065-60447a5f8cf4" containerID="cad395c59256139e0dc6b041821afce108bdc28aa8d09871abb3a402cb9b9769" exitCode=0 Jul 03 15:21:33.401271 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.401202 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d846c95c7-48qg9" event={"ID":"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4","Type":"ContainerDied","Data":"cad395c59256139e0dc6b041821afce108bdc28aa8d09871abb3a402cb9b9769"} Jul 03 15:21:33.403565 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.403386 2532 generic.go:356] "Generic (PLEG): container finished" podID="9b89c335-ce04-47ef-b696-053858964026" containerID="faa309a81ca20f37dc36c13425e66e0849f029be9f49f313ab73b448042e66a1" exitCode=0 Jul 03 15:21:33.459947 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.459650 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:21:33.488822 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.488579 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-oauth-serving-cert\") pod \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " Jul 03 15:21:33.488822 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.488651 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8r2tn\" (UniqueName: \"kubernetes.io/projected/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-kube-api-access-8r2tn\") pod \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " Jul 03 15:21:33.488822 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.488681 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-service-ca\") pod \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " Jul 03 15:21:33.489655 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.489506 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-console-oauth-config\") pod \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " Jul 03 15:21:33.489922 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.489886 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" Jul 03 15:21:33.490920 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.489898 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3c920e6a-3b6c-4dcf-a065-60447a5f8cf4" (UID: "3c920e6a-3b6c-4dcf-a065-60447a5f8cf4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:21:33.490920 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.490868 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-service-ca" (OuterVolumeSpecName: "service-ca") pod "3c920e6a-3b6c-4dcf-a065-60447a5f8cf4" (UID: "3c920e6a-3b6c-4dcf-a065-60447a5f8cf4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:21:33.491075 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.491009 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-trusted-ca-bundle\") pod \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " Jul 03 15:21:33.491075 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.491048 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-console-serving-cert\") pod \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " Jul 03 15:21:33.491181 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.491112 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-console-config\") pod \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\" (UID: \"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4\") " Jul 03 15:21:33.491572 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.491552 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3c920e6a-3b6c-4dcf-a065-60447a5f8cf4" (UID: "3c920e6a-3b6c-4dcf-a065-60447a5f8cf4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:21:33.491779 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.491556 2532 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-service-ca\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:21:33.491895 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.491880 2532 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-oauth-serving-cert\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:21:33.491895 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.491812 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-console-config" (OuterVolumeSpecName: "console-config") pod "3c920e6a-3b6c-4dcf-a065-60447a5f8cf4" (UID: "3c920e6a-3b6c-4dcf-a065-60447a5f8cf4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:21:33.501175 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.493040 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3c920e6a-3b6c-4dcf-a065-60447a5f8cf4" (UID: "3c920e6a-3b6c-4dcf-a065-60447a5f8cf4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 15:21:33.501175 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.493249 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s"] Jul 03 15:21:33.501175 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:33.493302 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m57gx\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="fba656ce-f027-443b-ad1a-d867a46c2305" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" Jul 03 15:21:33.501175 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.494016 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3c920e6a-3b6c-4dcf-a065-60447a5f8cf4" (UID: "3c920e6a-3b6c-4dcf-a065-60447a5f8cf4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 15:21:33.502024 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.501882 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-kube-api-access-8r2tn" (OuterVolumeSpecName: "kube-api-access-8r2tn") pod "3c920e6a-3b6c-4dcf-a065-60447a5f8cf4" (UID: "3c920e6a-3b6c-4dcf-a065-60447a5f8cf4"). InnerVolumeSpecName "kube-api-access-8r2tn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:21:33.502361 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.502320 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" Jul 03 15:21:33.504761 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:33.504734 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fnb8r\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="9b89c335-ce04-47ef-b696-053858964026" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" Jul 03 15:21:33.505471 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:21:33.505448 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9bb98f1_c859_46ae_b268_e20265dfe765.slice/crio-4c42303d16e2ca09939d28be11b00b07a0ca6acbd7037204924be30ecd411e71 WatchSource:0}: Error finding container 4c42303d16e2ca09939d28be11b00b07a0ca6acbd7037204924be30ecd411e71: Status 404 returned error can't find the container with id 4c42303d16e2ca09939d28be11b00b07a0ca6acbd7037204924be30ecd411e71 Jul 03 15:21:33.507635 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:33.507613 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m57gx\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="fba656ce-f027-443b-ad1a-d867a46c2305" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" Jul 03 15:21:33.516750 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.516731 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqzsl"] Jul 03 15:21:33.518859 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:21:33.518811 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd0e5e48_462b_4bd7_8d65_0fd969b8cf64.slice/crio-73967d71a07dcb8167bac9ecb7e3ed5813b49dabaa3a6a6e12746ada4794a908 WatchSource:0}: Error finding container 73967d71a07dcb8167bac9ecb7e3ed5813b49dabaa3a6a6e12746ada4794a908: Status 404 returned error can't find the container with id 73967d71a07dcb8167bac9ecb7e3ed5813b49dabaa3a6a6e12746ada4794a908 Jul 03 15:21:33.592466 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.592441 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvt6b\" (UniqueName: \"kubernetes.io/projected/9b89c335-ce04-47ef-b696-053858964026-kube-api-access-rvt6b\") pod \"9b89c335-ce04-47ef-b696-053858964026\" (UID: \"9b89c335-ce04-47ef-b696-053858964026\") " Jul 03 15:21:33.592576 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.592544 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7bnw\" (UniqueName: \"kubernetes.io/projected/fba656ce-f027-443b-ad1a-d867a46c2305-kube-api-access-z7bnw\") pod \"fba656ce-f027-443b-ad1a-d867a46c2305\" (UID: \"fba656ce-f027-443b-ad1a-d867a46c2305\") " Jul 03 15:21:33.592647 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.592577 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b89c335-ce04-47ef-b696-053858964026-extensions-socket-volume\") pod \"9b89c335-ce04-47ef-b696-053858964026\" (UID: \"9b89c335-ce04-47ef-b696-053858964026\") " Jul 03 15:21:33.592805 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.592786 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r2tn\" (UniqueName: \"kubernetes.io/projected/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-kube-api-access-8r2tn\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:21:33.592873 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.592811 2532 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-console-oauth-config\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:21:33.592873 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.592824 2532 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-trusted-ca-bundle\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:21:33.592873 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.592838 2532 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-console-serving-cert\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:21:33.592873 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.592852 2532 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4-console-config\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:21:33.593109 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.593089 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b89c335-ce04-47ef-b696-053858964026-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9b89c335-ce04-47ef-b696-053858964026" (UID: "9b89c335-ce04-47ef-b696-053858964026"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:21:33.594465 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.594445 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b89c335-ce04-47ef-b696-053858964026-kube-api-access-rvt6b" (OuterVolumeSpecName: "kube-api-access-rvt6b") pod "9b89c335-ce04-47ef-b696-053858964026" (UID: "9b89c335-ce04-47ef-b696-053858964026"). InnerVolumeSpecName "kube-api-access-rvt6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:21:33.594616 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.594597 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fba656ce-f027-443b-ad1a-d867a46c2305-kube-api-access-z7bnw" (OuterVolumeSpecName: "kube-api-access-z7bnw") pod "fba656ce-f027-443b-ad1a-d867a46c2305" (UID: "fba656ce-f027-443b-ad1a-d867a46c2305"). InnerVolumeSpecName "kube-api-access-z7bnw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:21:33.693931 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.693904 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7bnw\" (UniqueName: \"kubernetes.io/projected/fba656ce-f027-443b-ad1a-d867a46c2305-kube-api-access-z7bnw\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:21:33.693931 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.693927 2532 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b89c335-ce04-47ef-b696-053858964026-extensions-socket-volume\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:21:33.693931 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:33.693937 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvt6b\" (UniqueName: \"kubernetes.io/projected/9b89c335-ce04-47ef-b696-053858964026-kube-api-access-rvt6b\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:21:34.017520 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:34.017490 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b89c335-ce04-47ef-b696-053858964026" path="/var/lib/kubelet/pods/9b89c335-ce04-47ef-b696-053858964026/volumes" Jul 03 15:21:34.017850 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:34.017836 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fba656ce-f027-443b-ad1a-d867a46c2305" path="/var/lib/kubelet/pods/fba656ce-f027-443b-ad1a-d867a46c2305/volumes" Jul 03 15:21:34.409532 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:34.409495 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5q82r" event={"ID":"6feba469-332f-4e04-b026-35df37bc51d7","Type":"ContainerStarted","Data":"160c3ab987a5255def0f329e30ea4f874ae57b4aa44878263957bb612f78504e"} Jul 03 15:21:34.410804 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:34.410789 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" Jul 03 15:21:34.410930 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:34.410805 2532 scope.go:117] "RemoveContainer" containerID="0de5ebd396913b6884f40c2d94cfde153887c9d94d5f1ace886f8b496f585077" Jul 03 15:21:34.412185 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:34.412164 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d846c95c7-48qg9" event={"ID":"3c920e6a-3b6c-4dcf-a065-60447a5f8cf4","Type":"ContainerDied","Data":"7e64f5d335ef81cd8a565e18a05caa7ad5ac291d8ba01249f01ea219ccad8970"} Jul 03 15:21:34.412254 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:34.412202 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d846c95c7-48qg9" Jul 03 15:21:34.413991 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:34.413970 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s" event={"ID":"b9bb98f1-c859-46ae-b268-e20265dfe765","Type":"ContainerStarted","Data":"1feb32b30a50b815eba6c09472659a81578c964f0f8c90c99e03b1f1f3dacc96"} Jul 03 15:21:34.414106 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:34.414014 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s" event={"ID":"b9bb98f1-c859-46ae-b268-e20265dfe765","Type":"ContainerStarted","Data":"4c42303d16e2ca09939d28be11b00b07a0ca6acbd7037204924be30ecd411e71"} Jul 03 15:21:34.414106 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:34.414045 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s" Jul 03 15:21:34.415737 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:34.415724 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" Jul 03 15:21:34.417577 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:34.417554 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqzsl" event={"ID":"fd0e5e48-462b-4bd7-8d65-0fd969b8cf64","Type":"ContainerStarted","Data":"79012ebc54fc12029605a628769d735752bf6e44c9c530e2db2ecc75f4bdd27b"} Jul 03 15:21:34.417662 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:34.417601 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqzsl" event={"ID":"fd0e5e48-462b-4bd7-8d65-0fd969b8cf64","Type":"ContainerStarted","Data":"73967d71a07dcb8167bac9ecb7e3ed5813b49dabaa3a6a6e12746ada4794a908"} Jul 03 15:21:34.417662 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:34.417648 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqzsl" Jul 03 15:21:34.420086 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:34.420071 2532 scope.go:117] "RemoveContainer" containerID="cad395c59256139e0dc6b041821afce108bdc28aa8d09871abb3a402cb9b9769" Jul 03 15:21:34.427612 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:34.427595 2532 scope.go:117] "RemoveContainer" containerID="faa309a81ca20f37dc36c13425e66e0849f029be9f49f313ab73b448042e66a1" Jul 03 15:21:34.431640 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:34.431600 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5q82r" podStartSLOduration=2.227316816 podStartE2EDuration="23.431585575s" totalImagesPullingTime="21.204268759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:21:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:21:34.429574765 +0000 UTC m=+513.012598595" watchObservedRunningTime="2026-07-03 15:21:34.431585575 +0000 UTC m=+513.014609409" Jul 03 15:21:34.451541 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:34.451513 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d846c95c7-48qg9"] Jul 03 15:21:34.464669 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:34.464639 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d846c95c7-48qg9"] Jul 03 15:21:34.506084 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:34.506037 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s" podStartSLOduration=12.506021552 podStartE2EDuration="12.506021552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:21:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:21:34.505314854 +0000 UTC m=+513.088338683" watchObservedRunningTime="2026-07-03 15:21:34.506021552 +0000 UTC m=+513.089045453" Jul 03 15:21:34.508097 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:34.508070 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fnb8r\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="9b89c335-ce04-47ef-b696-053858964026" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fnb8r" Jul 03 15:21:34.510270 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:34.510247 2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m57gx\" is forbidden: User \"system:node:ip-10-0-142-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-176.ec2.internal' and this object" podUID="fba656ce-f027-443b-ad1a-d867a46c2305" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m57gx" Jul 03 15:21:34.530908 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:34.530820 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqzsl" podStartSLOduration=12.530802891 podStartE2EDuration="12.530802891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:21:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:21:34.529630118 +0000 UTC m=+513.112653946" watchObservedRunningTime="2026-07-03 15:21:34.530802891 +0000 UTC m=+513.113826722" Jul 03 15:21:36.017511 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:36.017481 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c920e6a-3b6c-4dcf-a065-60447a5f8cf4" path="/var/lib/kubelet/pods/3c920e6a-3b6c-4dcf-a065-60447a5f8cf4/volumes" Jul 03 15:21:38.589708 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:38.589676 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s"] Jul 03 15:21:38.590140 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:38.589877 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s" podUID="b9bb98f1-c859-46ae-b268-e20265dfe765" containerName="manager" containerID="cri-o://1feb32b30a50b815eba6c09472659a81578c964f0f8c90c99e03b1f1f3dacc96" gracePeriod=10 Jul 03 15:21:38.591691 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:38.591666 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s" Jul 03 15:21:38.862188 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:38.862113 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s" Jul 03 15:21:38.937077 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:38.937042 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b9bb98f1-c859-46ae-b268-e20265dfe765-extensions-socket-volume\") pod \"b9bb98f1-c859-46ae-b268-e20265dfe765\" (UID: \"b9bb98f1-c859-46ae-b268-e20265dfe765\") " Jul 03 15:21:38.937218 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:38.937106 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckzd6\" (UniqueName: \"kubernetes.io/projected/b9bb98f1-c859-46ae-b268-e20265dfe765-kube-api-access-ckzd6\") pod \"b9bb98f1-c859-46ae-b268-e20265dfe765\" (UID: \"b9bb98f1-c859-46ae-b268-e20265dfe765\") " Jul 03 15:21:38.937523 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:38.937499 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9bb98f1-c859-46ae-b268-e20265dfe765-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b9bb98f1-c859-46ae-b268-e20265dfe765" (UID: "b9bb98f1-c859-46ae-b268-e20265dfe765"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:21:38.939338 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:38.939317 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9bb98f1-c859-46ae-b268-e20265dfe765-kube-api-access-ckzd6" (OuterVolumeSpecName: "kube-api-access-ckzd6") pod "b9bb98f1-c859-46ae-b268-e20265dfe765" (UID: "b9bb98f1-c859-46ae-b268-e20265dfe765"). InnerVolumeSpecName "kube-api-access-ckzd6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:21:38.946956 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:38.946935 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c"] Jul 03 15:21:38.947269 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:38.947258 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c920e6a-3b6c-4dcf-a065-60447a5f8cf4" containerName="console" Jul 03 15:21:38.947315 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:38.947271 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c920e6a-3b6c-4dcf-a065-60447a5f8cf4" containerName="console" Jul 03 15:21:38.947315 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:38.947288 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9bb98f1-c859-46ae-b268-e20265dfe765" containerName="manager" Jul 03 15:21:38.947315 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:38.947294 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9bb98f1-c859-46ae-b268-e20265dfe765" containerName="manager" Jul 03 15:21:38.947419 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:38.947350 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c920e6a-3b6c-4dcf-a065-60447a5f8cf4" containerName="console" Jul 03 15:21:38.947419 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:38.947359 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9bb98f1-c859-46ae-b268-e20265dfe765" containerName="manager" Jul 03 15:21:38.970975 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:38.970946 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c"] Jul 03 15:21:38.971131 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:38.971035 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c" Jul 03 15:21:39.038682 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:39.038634 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgl4c\" (UniqueName: \"kubernetes.io/projected/2168d604-68c8-4c66-b59f-8fcd9805ada5-kube-api-access-wgl4c\") pod \"kuadrant-operator-controller-manager-86878c769f-cn28c\" (UID: \"2168d604-68c8-4c66-b59f-8fcd9805ada5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c" Jul 03 15:21:39.038852 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:39.038692 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2168d604-68c8-4c66-b59f-8fcd9805ada5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cn28c\" (UID: \"2168d604-68c8-4c66-b59f-8fcd9805ada5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c" Jul 03 15:21:39.038902 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:39.038872 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckzd6\" (UniqueName: \"kubernetes.io/projected/b9bb98f1-c859-46ae-b268-e20265dfe765-kube-api-access-ckzd6\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:21:39.038902 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:39.038897 2532 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b9bb98f1-c859-46ae-b268-e20265dfe765-extensions-socket-volume\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:21:39.139496 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:39.139406 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2168d604-68c8-4c66-b59f-8fcd9805ada5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cn28c\" (UID: \"2168d604-68c8-4c66-b59f-8fcd9805ada5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c" Jul 03 15:21:39.139656 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:39.139499 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgl4c\" (UniqueName: \"kubernetes.io/projected/2168d604-68c8-4c66-b59f-8fcd9805ada5-kube-api-access-wgl4c\") pod \"kuadrant-operator-controller-manager-86878c769f-cn28c\" (UID: \"2168d604-68c8-4c66-b59f-8fcd9805ada5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c" Jul 03 15:21:39.139802 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:39.139780 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2168d604-68c8-4c66-b59f-8fcd9805ada5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cn28c\" (UID: \"2168d604-68c8-4c66-b59f-8fcd9805ada5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c" Jul 03 15:21:39.148144 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:39.148117 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgl4c\" (UniqueName: \"kubernetes.io/projected/2168d604-68c8-4c66-b59f-8fcd9805ada5-kube-api-access-wgl4c\") pod \"kuadrant-operator-controller-manager-86878c769f-cn28c\" (UID: \"2168d604-68c8-4c66-b59f-8fcd9805ada5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c" Jul 03 15:21:39.281116 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:39.281083 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c" Jul 03 15:21:39.435649 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:39.435571 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c"] Jul 03 15:21:39.439238 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:21:39.439211 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2168d604_68c8_4c66_b59f_8fcd9805ada5.slice/crio-e7118206075c2bce4a6012a812ff5fe15d1036178dae4f7725d77f35fcba80df WatchSource:0}: Error finding container e7118206075c2bce4a6012a812ff5fe15d1036178dae4f7725d77f35fcba80df: Status 404 returned error can't find the container with id e7118206075c2bce4a6012a812ff5fe15d1036178dae4f7725d77f35fcba80df Jul 03 15:21:39.447064 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:39.447040 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c" event={"ID":"2168d604-68c8-4c66-b59f-8fcd9805ada5","Type":"ContainerStarted","Data":"e7118206075c2bce4a6012a812ff5fe15d1036178dae4f7725d77f35fcba80df"} Jul 03 15:21:39.448252 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:39.448230 2532 generic.go:356] "Generic (PLEG): container finished" podID="b9bb98f1-c859-46ae-b268-e20265dfe765" containerID="1feb32b30a50b815eba6c09472659a81578c964f0f8c90c99e03b1f1f3dacc96" exitCode=0 Jul 03 15:21:39.448358 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:39.448267 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s" Jul 03 15:21:39.448358 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:39.448271 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s" event={"ID":"b9bb98f1-c859-46ae-b268-e20265dfe765","Type":"ContainerDied","Data":"1feb32b30a50b815eba6c09472659a81578c964f0f8c90c99e03b1f1f3dacc96"} Jul 03 15:21:39.448358 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:39.448317 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s" event={"ID":"b9bb98f1-c859-46ae-b268-e20265dfe765","Type":"ContainerDied","Data":"4c42303d16e2ca09939d28be11b00b07a0ca6acbd7037204924be30ecd411e71"} Jul 03 15:21:39.448358 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:39.448347 2532 scope.go:117] "RemoveContainer" containerID="1feb32b30a50b815eba6c09472659a81578c964f0f8c90c99e03b1f1f3dacc96" Jul 03 15:21:39.456958 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:39.456935 2532 scope.go:117] "RemoveContainer" containerID="1feb32b30a50b815eba6c09472659a81578c964f0f8c90c99e03b1f1f3dacc96" Jul 03 15:21:39.457237 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:21:39.457214 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1feb32b30a50b815eba6c09472659a81578c964f0f8c90c99e03b1f1f3dacc96\": container with ID starting with 1feb32b30a50b815eba6c09472659a81578c964f0f8c90c99e03b1f1f3dacc96 not found: ID does not exist" containerID="1feb32b30a50b815eba6c09472659a81578c964f0f8c90c99e03b1f1f3dacc96" Jul 03 15:21:39.457329 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:39.457244 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1feb32b30a50b815eba6c09472659a81578c964f0f8c90c99e03b1f1f3dacc96"} err="failed to get container status \"1feb32b30a50b815eba6c09472659a81578c964f0f8c90c99e03b1f1f3dacc96\": rpc error: code = NotFound desc = could not find container \"1feb32b30a50b815eba6c09472659a81578c964f0f8c90c99e03b1f1f3dacc96\": container with ID starting with 1feb32b30a50b815eba6c09472659a81578c964f0f8c90c99e03b1f1f3dacc96 not found: ID does not exist" Jul 03 15:21:39.471966 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:39.471941 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s"] Jul 03 15:21:39.475867 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:39.475846 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph86s"] Jul 03 15:21:40.017409 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:40.017351 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9bb98f1-c859-46ae-b268-e20265dfe765" path="/var/lib/kubelet/pods/b9bb98f1-c859-46ae-b268-e20265dfe765/volumes" Jul 03 15:21:40.455422 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:40.455389 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c" event={"ID":"2168d604-68c8-4c66-b59f-8fcd9805ada5","Type":"ContainerStarted","Data":"c015c88da6874d59ae456c5ce6fdf440b69a34f3d13374d8dbc0adc968e9b23a"} Jul 03 15:21:40.455593 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:40.455488 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c" Jul 03 15:21:40.498236 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:40.498185 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c" podStartSLOduration=2.498170367 podStartE2EDuration="2.498170367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:21:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:21:40.49593837 +0000 UTC m=+519.078962196" watchObservedRunningTime="2026-07-03 15:21:40.498170367 +0000 UTC m=+519.081194195" Jul 03 15:21:41.222692 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:41.222649 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:41.317065 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:41.317032 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:45.428942 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:45.428912 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqzsl" Jul 03 15:21:51.462535 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:51.462503 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c" Jul 03 15:21:54.971590 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:54.971507 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6"] Jul 03 15:21:54.998615 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:54.998569 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:55.002407 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.002356 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6"] Jul 03 15:21:55.002524 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.002475 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.005013 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.004995 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-t6hll\"" Jul 03 15:21:55.005184 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.005171 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 03 15:21:55.068284 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.068262 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c33415d-a4bf-4a55-b755-0507d510f68c-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.068434 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.068295 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c33415d-a4bf-4a55-b755-0507d510f68c-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.068434 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.068323 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c33415d-a4bf-4a55-b755-0507d510f68c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.068434 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.068345 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c33415d-a4bf-4a55-b755-0507d510f68c-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.068434 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.068412 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxhz9\" (UniqueName: \"kubernetes.io/projected/4c33415d-a4bf-4a55-b755-0507d510f68c-kube-api-access-sxhz9\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.068599 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.068447 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c33415d-a4bf-4a55-b755-0507d510f68c-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.068599 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.068464 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c33415d-a4bf-4a55-b755-0507d510f68c-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.068599 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.068486 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c33415d-a4bf-4a55-b755-0507d510f68c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.068599 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.068544 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c33415d-a4bf-4a55-b755-0507d510f68c-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.169716 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.169688 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c33415d-a4bf-4a55-b755-0507d510f68c-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.169887 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.169725 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c33415d-a4bf-4a55-b755-0507d510f68c-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.169887 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.169756 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c33415d-a4bf-4a55-b755-0507d510f68c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.170009 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.169886 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c33415d-a4bf-4a55-b755-0507d510f68c-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.170009 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.169915 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxhz9\" (UniqueName: \"kubernetes.io/projected/4c33415d-a4bf-4a55-b755-0507d510f68c-kube-api-access-sxhz9\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.170009 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.169951 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c33415d-a4bf-4a55-b755-0507d510f68c-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.170009 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.169974 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c33415d-a4bf-4a55-b755-0507d510f68c-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.170009 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.170009 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c33415d-a4bf-4a55-b755-0507d510f68c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.170257 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.170063 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c33415d-a4bf-4a55-b755-0507d510f68c-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.170257 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.170156 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c33415d-a4bf-4a55-b755-0507d510f68c-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.170430 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.170411 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c33415d-a4bf-4a55-b755-0507d510f68c-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.170504 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.170447 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c33415d-a4bf-4a55-b755-0507d510f68c-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.170556 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.170495 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c33415d-a4bf-4a55-b755-0507d510f68c-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.170556 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.170540 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c33415d-a4bf-4a55-b755-0507d510f68c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.172260 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.172244 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c33415d-a4bf-4a55-b755-0507d510f68c-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.172594 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.172575 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c33415d-a4bf-4a55-b755-0507d510f68c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.177617 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.177584 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c33415d-a4bf-4a55-b755-0507d510f68c-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.177709 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.177690 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxhz9\" (UniqueName: \"kubernetes.io/projected/4c33415d-a4bf-4a55-b755-0507d510f68c-kube-api-access-sxhz9\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lpvh6\" (UID: \"4c33415d-a4bf-4a55-b755-0507d510f68c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.313490 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.313426 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:55.346506 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.346471 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:21:55.463128 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.463101 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6"] Jul 03 15:21:55.465326 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:21:55.465297 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c33415d_a4bf_4a55_b755_0507d510f68c.slice/crio-7879a7694bb06b4cc08dfc7f8690d771bdb4daa22eb8256fa9e3c2d182f13800 WatchSource:0}: Error finding container 7879a7694bb06b4cc08dfc7f8690d771bdb4daa22eb8256fa9e3c2d182f13800: Status 404 returned error can't find the container with id 7879a7694bb06b4cc08dfc7f8690d771bdb4daa22eb8256fa9e3c2d182f13800 Jul 03 15:21:55.529304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:55.529280 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" event={"ID":"4c33415d-a4bf-4a55-b755-0507d510f68c","Type":"ContainerStarted","Data":"7879a7694bb06b4cc08dfc7f8690d771bdb4daa22eb8256fa9e3c2d182f13800"} Jul 03 15:21:58.291413 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:58.291352 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:21:58.291774 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:58.291478 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:21:58.291774 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:58.291536 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:21:58.547720 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:58.547639 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" event={"ID":"4c33415d-a4bf-4a55-b755-0507d510f68c","Type":"ContainerStarted","Data":"a417634254ceefc2c56989e46d75077ee7ca0366d8f7dce5d34607726378a8b8"} Jul 03 15:21:59.314445 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:59.314410 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:59.319599 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:59.319577 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:59.351712 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:59.351651 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" podStartSLOduration=2.527826406 podStartE2EDuration="5.351631784s" totalImagesPullingTime="2.823805378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:21:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:21:58.596832722 +0000 UTC m=+537.179856551" watchObservedRunningTime="2026-07-03 15:21:59.351631784 +0000 UTC m=+537.934655615" Jul 03 15:21:59.553273 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:59.553247 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:21:59.554408 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:21:59.554387 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:22:13.508500 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:13.508463 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:22:13.612982 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:13.612928 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:22:13.676989 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:13.676960 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:22:13.826416 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:13.826362 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:22:13.886657 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:13.886623 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:22:13.886839 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:13.886673 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:22:13.886839 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:13.886744 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-fp4ww" Jul 03 15:22:13.889175 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:13.889157 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 03 15:22:14.027761 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:14.027726 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2lqm\" (UniqueName: \"kubernetes.io/projected/a20b67b9-8e5e-4984-b17b-215797565d70-kube-api-access-c2lqm\") pod \"limitador-limitador-54d6d988d5-fp4ww\" (UID: \"a20b67b9-8e5e-4984-b17b-215797565d70\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fp4ww" Jul 03 15:22:14.027919 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:14.027820 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a20b67b9-8e5e-4984-b17b-215797565d70-config-file\") pod \"limitador-limitador-54d6d988d5-fp4ww\" (UID: \"a20b67b9-8e5e-4984-b17b-215797565d70\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fp4ww" Jul 03 15:22:14.129095 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:14.129013 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a20b67b9-8e5e-4984-b17b-215797565d70-config-file\") pod \"limitador-limitador-54d6d988d5-fp4ww\" (UID: \"a20b67b9-8e5e-4984-b17b-215797565d70\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fp4ww" Jul 03 15:22:14.129095 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:14.129075 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2lqm\" (UniqueName: \"kubernetes.io/projected/a20b67b9-8e5e-4984-b17b-215797565d70-kube-api-access-c2lqm\") pod \"limitador-limitador-54d6d988d5-fp4ww\" (UID: \"a20b67b9-8e5e-4984-b17b-215797565d70\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fp4ww" Jul 03 15:22:14.129644 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:14.129625 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a20b67b9-8e5e-4984-b17b-215797565d70-config-file\") pod \"limitador-limitador-54d6d988d5-fp4ww\" (UID: \"a20b67b9-8e5e-4984-b17b-215797565d70\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fp4ww" Jul 03 15:22:14.136929 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:14.136902 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2lqm\" (UniqueName: \"kubernetes.io/projected/a20b67b9-8e5e-4984-b17b-215797565d70-kube-api-access-c2lqm\") pod \"limitador-limitador-54d6d988d5-fp4ww\" (UID: \"a20b67b9-8e5e-4984-b17b-215797565d70\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fp4ww" Jul 03 15:22:14.197310 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:14.197281 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-fp4ww" Jul 03 15:22:14.332852 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:14.332831 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:22:14.335233 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:22:14.335206 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda20b67b9_8e5e_4984_b17b_215797565d70.slice/crio-f65c19e3bde09d7175187554be1dbc15f37542e7425d31b3132e76a7ee79a2df WatchSource:0}: Error finding container f65c19e3bde09d7175187554be1dbc15f37542e7425d31b3132e76a7ee79a2df: Status 404 returned error can't find the container with id f65c19e3bde09d7175187554be1dbc15f37542e7425d31b3132e76a7ee79a2df Jul 03 15:22:14.342206 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:14.342179 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:22:14.407249 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:14.407182 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:22:14.625146 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:14.625114 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-fp4ww" event={"ID":"a20b67b9-8e5e-4984-b17b-215797565d70","Type":"ContainerStarted","Data":"f65c19e3bde09d7175187554be1dbc15f37542e7425d31b3132e76a7ee79a2df"} Jul 03 15:22:17.643247 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:17.643211 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-fp4ww" event={"ID":"a20b67b9-8e5e-4984-b17b-215797565d70","Type":"ContainerStarted","Data":"a830fe75bb7d0489bf7d4298b3ea8279c7e8f90e865e849520b8b1ec5b06e654"} Jul 03 15:22:17.643715 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:17.643353 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-fp4ww" Jul 03 15:22:17.661656 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:17.661612 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-fp4ww" podStartSLOduration=2.109120222 podStartE2EDuration="4.661598388s" totalImagesPullingTime="2.552478166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:22:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:22:17.65961829 +0000 UTC m=+556.242642119" watchObservedRunningTime="2026-07-03 15:22:17.661598388 +0000 UTC m=+556.244622225" Jul 03 15:22:28.648897 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:28.648868 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-fp4ww" Jul 03 15:22:31.547212 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:31.547171 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:22:44.222706 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.222673 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:22:44.340974 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.340934 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:22:44.649206 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.649175 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-v97rb"] Jul 03 15:22:44.662246 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.662214 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-v97rb"] Jul 03 15:22:44.662451 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.662312 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-v97rb" Jul 03 15:22:44.666410 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.666356 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 03 15:22:44.666551 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.666419 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-q7cf6\"" Jul 03 15:22:44.695305 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.695280 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-v97rb"] Jul 03 15:22:44.695507 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:22:44.695489 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7zdgh tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-7zdgh tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-v97rb" podUID="8bd159bf-8b6d-477c-8f08-43570dac6a22" Jul 03 15:22:44.730913 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.730890 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-757dcc4969-v84sn"] Jul 03 15:22:44.734327 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.734311 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-757dcc4969-v84sn" Jul 03 15:22:44.742766 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.742743 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-757dcc4969-v84sn"] Jul 03 15:22:44.772885 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.772863 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-v97rb" Jul 03 15:22:44.773151 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.773127 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zdgh\" (UniqueName: \"kubernetes.io/projected/8bd159bf-8b6d-477c-8f08-43570dac6a22-kube-api-access-7zdgh\") pod \"authorino-76877994-v97rb\" (UID: \"8bd159bf-8b6d-477c-8f08-43570dac6a22\") " pod="kuadrant-system/authorino-76877994-v97rb" Jul 03 15:22:44.773242 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.773180 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbpw9\" (UniqueName: \"kubernetes.io/projected/864aa6f6-148d-4e77-ac0a-be3edccb1016-kube-api-access-mbpw9\") pod \"authorino-757dcc4969-v84sn\" (UID: \"864aa6f6-148d-4e77-ac0a-be3edccb1016\") " pod="kuadrant-system/authorino-757dcc4969-v84sn" Jul 03 15:22:44.773299 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.773245 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8bd159bf-8b6d-477c-8f08-43570dac6a22-tls-cert\") pod \"authorino-76877994-v97rb\" (UID: \"8bd159bf-8b6d-477c-8f08-43570dac6a22\") " pod="kuadrant-system/authorino-76877994-v97rb" Jul 03 15:22:44.773299 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.773278 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/864aa6f6-148d-4e77-ac0a-be3edccb1016-tls-cert\") pod \"authorino-757dcc4969-v84sn\" (UID: \"864aa6f6-148d-4e77-ac0a-be3edccb1016\") " pod="kuadrant-system/authorino-757dcc4969-v84sn" Jul 03 15:22:44.779636 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.779619 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-v97rb" Jul 03 15:22:44.873994 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.873963 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/864aa6f6-148d-4e77-ac0a-be3edccb1016-tls-cert\") pod \"authorino-757dcc4969-v84sn\" (UID: \"864aa6f6-148d-4e77-ac0a-be3edccb1016\") " pod="kuadrant-system/authorino-757dcc4969-v84sn" Jul 03 15:22:44.874129 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.874012 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zdgh\" (UniqueName: \"kubernetes.io/projected/8bd159bf-8b6d-477c-8f08-43570dac6a22-kube-api-access-7zdgh\") pod \"authorino-76877994-v97rb\" (UID: \"8bd159bf-8b6d-477c-8f08-43570dac6a22\") " pod="kuadrant-system/authorino-76877994-v97rb" Jul 03 15:22:44.874129 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.874037 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbpw9\" (UniqueName: \"kubernetes.io/projected/864aa6f6-148d-4e77-ac0a-be3edccb1016-kube-api-access-mbpw9\") pod \"authorino-757dcc4969-v84sn\" (UID: \"864aa6f6-148d-4e77-ac0a-be3edccb1016\") " pod="kuadrant-system/authorino-757dcc4969-v84sn" Jul 03 15:22:44.874129 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.874088 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8bd159bf-8b6d-477c-8f08-43570dac6a22-tls-cert\") pod \"authorino-76877994-v97rb\" (UID: \"8bd159bf-8b6d-477c-8f08-43570dac6a22\") " pod="kuadrant-system/authorino-76877994-v97rb" Jul 03 15:22:44.876538 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.876515 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8bd159bf-8b6d-477c-8f08-43570dac6a22-tls-cert\") pod \"authorino-76877994-v97rb\" (UID: \"8bd159bf-8b6d-477c-8f08-43570dac6a22\") " pod="kuadrant-system/authorino-76877994-v97rb" Jul 03 15:22:44.876622 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.876596 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/864aa6f6-148d-4e77-ac0a-be3edccb1016-tls-cert\") pod \"authorino-757dcc4969-v84sn\" (UID: \"864aa6f6-148d-4e77-ac0a-be3edccb1016\") " pod="kuadrant-system/authorino-757dcc4969-v84sn" Jul 03 15:22:44.883501 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.883481 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbpw9\" (UniqueName: \"kubernetes.io/projected/864aa6f6-148d-4e77-ac0a-be3edccb1016-kube-api-access-mbpw9\") pod \"authorino-757dcc4969-v84sn\" (UID: \"864aa6f6-148d-4e77-ac0a-be3edccb1016\") " pod="kuadrant-system/authorino-757dcc4969-v84sn" Jul 03 15:22:44.883720 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.883699 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zdgh\" (UniqueName: \"kubernetes.io/projected/8bd159bf-8b6d-477c-8f08-43570dac6a22-kube-api-access-7zdgh\") pod \"authorino-76877994-v97rb\" (UID: \"8bd159bf-8b6d-477c-8f08-43570dac6a22\") " pod="kuadrant-system/authorino-76877994-v97rb" Jul 03 15:22:44.974614 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.974556 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8bd159bf-8b6d-477c-8f08-43570dac6a22-tls-cert\") pod \"8bd159bf-8b6d-477c-8f08-43570dac6a22\" (UID: \"8bd159bf-8b6d-477c-8f08-43570dac6a22\") " Jul 03 15:22:44.974723 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.974631 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zdgh\" (UniqueName: \"kubernetes.io/projected/8bd159bf-8b6d-477c-8f08-43570dac6a22-kube-api-access-7zdgh\") pod \"8bd159bf-8b6d-477c-8f08-43570dac6a22\" (UID: \"8bd159bf-8b6d-477c-8f08-43570dac6a22\") " Jul 03 15:22:44.976542 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.976514 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bd159bf-8b6d-477c-8f08-43570dac6a22-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "8bd159bf-8b6d-477c-8f08-43570dac6a22" (UID: "8bd159bf-8b6d-477c-8f08-43570dac6a22"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 15:22:44.976637 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:44.976625 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bd159bf-8b6d-477c-8f08-43570dac6a22-kube-api-access-7zdgh" (OuterVolumeSpecName: "kube-api-access-7zdgh") pod "8bd159bf-8b6d-477c-8f08-43570dac6a22" (UID: "8bd159bf-8b6d-477c-8f08-43570dac6a22"). InnerVolumeSpecName "kube-api-access-7zdgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:22:45.043291 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:45.043257 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-757dcc4969-v84sn" Jul 03 15:22:45.076074 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:45.076032 2532 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8bd159bf-8b6d-477c-8f08-43570dac6a22-tls-cert\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:22:45.076074 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:45.076073 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zdgh\" (UniqueName: \"kubernetes.io/projected/8bd159bf-8b6d-477c-8f08-43570dac6a22-kube-api-access-7zdgh\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:22:45.179950 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:45.179922 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-757dcc4969-v84sn"] Jul 03 15:22:45.182247 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:22:45.182211 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod864aa6f6_148d_4e77_ac0a_be3edccb1016.slice/crio-b67d6cea341a8df7e5fdd2fcbffc51191a983ab8f9573e320f205be9ea8b3509 WatchSource:0}: Error finding container b67d6cea341a8df7e5fdd2fcbffc51191a983ab8f9573e320f205be9ea8b3509: Status 404 returned error can't find the container with id b67d6cea341a8df7e5fdd2fcbffc51191a983ab8f9573e320f205be9ea8b3509 Jul 03 15:22:45.780821 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:45.780774 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-v97rb" Jul 03 15:22:45.781429 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:45.781395 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-757dcc4969-v84sn" event={"ID":"864aa6f6-148d-4e77-ac0a-be3edccb1016","Type":"ContainerStarted","Data":"b67d6cea341a8df7e5fdd2fcbffc51191a983ab8f9573e320f205be9ea8b3509"} Jul 03 15:22:45.817762 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:45.817722 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-v97rb"] Jul 03 15:22:45.821428 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:45.821407 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-v97rb"] Jul 03 15:22:46.019903 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:46.019872 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bd159bf-8b6d-477c-8f08-43570dac6a22" path="/var/lib/kubelet/pods/8bd159bf-8b6d-477c-8f08-43570dac6a22/volumes" Jul 03 15:22:48.798602 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:48.798511 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-757dcc4969-v84sn" event={"ID":"864aa6f6-148d-4e77-ac0a-be3edccb1016","Type":"ContainerStarted","Data":"e083fa407311007bfeca816957c3c6fd7fa044d5b13f5612f4dcaed0e91f42d6"} Jul 03 15:22:48.816805 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:48.816759 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-757dcc4969-v84sn" podStartSLOduration=1.646502716 podStartE2EDuration="4.816743889s" totalImagesPullingTime="3.170241173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:22:48.814960756 +0000 UTC m=+587.397984586" watchObservedRunningTime="2026-07-03 15:22:48.816743889 +0000 UTC m=+587.399767717" Jul 03 15:22:53.257786 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:53.257745 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:22:54.548841 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:54.548800 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:22:56.204431 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:56.204388 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:22:56.306915 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:22:56.306874 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:23:01.900248 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:01.900216 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/1.log" Jul 03 15:23:01.900920 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:01.900903 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/1.log" Jul 03 15:23:01.903190 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:01.903171 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5hcn_df460999-eb58-4575-91fc-8130653c6f5b/ovn-acl-logging/0.log" Jul 03 15:23:01.903789 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:01.903771 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5hcn_df460999-eb58-4575-91fc-8130653c6f5b/ovn-acl-logging/0.log" Jul 03 15:23:28.668445 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:28.668342 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:23:29.173347 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:29.173317 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:23:29.622981 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:29.622949 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:23:29.718581 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:29.718519 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:23:29.824619 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:29.824578 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:23:29.825274 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:29.825254 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:23:38.036583 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:38.036549 2532 generic.go:356] "Generic (PLEG): container finished" podID="4c33415d-a4bf-4a55-b755-0507d510f68c" containerID="a417634254ceefc2c56989e46d75077ee7ca0366d8f7dce5d34607726378a8b8" exitCode=0 Jul 03 15:23:38.037003 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:38.036622 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" event={"ID":"4c33415d-a4bf-4a55-b755-0507d510f68c","Type":"ContainerDied","Data":"a417634254ceefc2c56989e46d75077ee7ca0366d8f7dce5d34607726378a8b8"} Jul 03 15:23:38.037003 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:38.036941 2532 scope.go:117] "RemoveContainer" containerID="a417634254ceefc2c56989e46d75077ee7ca0366d8f7dce5d34607726378a8b8" Jul 03 15:23:38.037825 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:38.037789 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:23:38.037920 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:38.037860 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:23:38.037920 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:38.037893 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:23:39.045797 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:39.045754 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" event={"ID":"4c33415d-a4bf-4a55-b755-0507d510f68c","Type":"ContainerStarted","Data":"82dd6e6174b28cc0e1295d57142b4d58dbcff9b0cbc99175add58f9b8c5e57a1"} Jul 03 15:23:39.314185 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:39.314105 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:23:39.314334 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:39.314275 2532 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-lpvh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 03 15:23:39.314334 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:39.314314 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" podUID="4c33415d-a4bf-4a55-b755-0507d510f68c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 03 15:23:40.314266 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:40.314234 2532 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-lpvh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 03 15:23:40.314671 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:40.314297 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" podUID="4c33415d-a4bf-4a55-b755-0507d510f68c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 03 15:23:41.167982 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:41.167940 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:23:41.262482 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:41.262441 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:23:41.314412 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:41.314352 2532 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-lpvh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 03 15:23:41.314756 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:41.314456 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" podUID="4c33415d-a4bf-4a55-b755-0507d510f68c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 03 15:23:42.314197 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:42.314160 2532 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-lpvh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 03 15:23:42.314363 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:42.314217 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" podUID="4c33415d-a4bf-4a55-b755-0507d510f68c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 03 15:23:43.318395 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:43.318332 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:23:43.318777 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:43.318652 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:23:43.319361 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:43.319340 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lpvh6" Jul 03 15:23:45.450825 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:23:45.450787 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:24:00.125767 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:00.125723 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:24:00.441952 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:00.441862 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:24:17.933595 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:17.933559 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:24:18.640688 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:18.640651 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:24:23.884205 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:23.884168 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:24:23.933438 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:23.933404 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:24:26.638201 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:26.638163 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:24:26.738966 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:26.738920 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:24:34.118604 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:34.118545 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:24:35.105261 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:35.105224 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:24:40.225898 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:40.225864 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:24:41.599437 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:41.599355 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:24:46.156128 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:46.156091 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:24:47.600659 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:47.600627 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:24:49.879316 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:49.879283 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6"] Jul 03 15:24:49.883220 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:49.883200 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:24:49.886709 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:49.886682 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 03 15:24:49.886822 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:49.886683 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hxtbm\"" Jul 03 15:24:49.886822 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:49.886749 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 03 15:24:49.886822 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:49.886784 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 03 15:24:49.892590 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:49.892571 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6"] Jul 03 15:24:49.906725 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:49.906697 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:24:50.010336 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:50.010300 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kktf\" (UniqueName: \"kubernetes.io/projected/dede305e-5f97-494b-8006-12ec145445c8-kube-api-access-5kktf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6\" (UID: \"dede305e-5f97-494b-8006-12ec145445c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:24:50.010522 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:50.010389 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dede305e-5f97-494b-8006-12ec145445c8-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6\" (UID: \"dede305e-5f97-494b-8006-12ec145445c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:24:50.010522 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:50.010451 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dede305e-5f97-494b-8006-12ec145445c8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6\" (UID: \"dede305e-5f97-494b-8006-12ec145445c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:24:50.010522 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:50.010492 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dede305e-5f97-494b-8006-12ec145445c8-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6\" (UID: \"dede305e-5f97-494b-8006-12ec145445c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:24:50.010674 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:50.010553 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dede305e-5f97-494b-8006-12ec145445c8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6\" (UID: \"dede305e-5f97-494b-8006-12ec145445c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:24:50.010674 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:50.010589 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dede305e-5f97-494b-8006-12ec145445c8-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6\" (UID: \"dede305e-5f97-494b-8006-12ec145445c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:24:50.111750 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:50.111717 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kktf\" (UniqueName: \"kubernetes.io/projected/dede305e-5f97-494b-8006-12ec145445c8-kube-api-access-5kktf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6\" (UID: \"dede305e-5f97-494b-8006-12ec145445c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:24:50.111927 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:50.111862 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dede305e-5f97-494b-8006-12ec145445c8-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6\" (UID: \"dede305e-5f97-494b-8006-12ec145445c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:24:50.111927 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:50.111898 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dede305e-5f97-494b-8006-12ec145445c8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6\" (UID: \"dede305e-5f97-494b-8006-12ec145445c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:24:50.112043 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:50.111927 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dede305e-5f97-494b-8006-12ec145445c8-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6\" (UID: \"dede305e-5f97-494b-8006-12ec145445c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:24:50.112043 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:50.111994 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dede305e-5f97-494b-8006-12ec145445c8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6\" (UID: \"dede305e-5f97-494b-8006-12ec145445c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:24:50.112043 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:50.112019 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dede305e-5f97-494b-8006-12ec145445c8-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6\" (UID: \"dede305e-5f97-494b-8006-12ec145445c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:24:50.112362 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:50.112337 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dede305e-5f97-494b-8006-12ec145445c8-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6\" (UID: \"dede305e-5f97-494b-8006-12ec145445c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:24:50.112475 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:50.112445 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dede305e-5f97-494b-8006-12ec145445c8-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6\" (UID: \"dede305e-5f97-494b-8006-12ec145445c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:24:50.112535 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:50.112473 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dede305e-5f97-494b-8006-12ec145445c8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6\" (UID: \"dede305e-5f97-494b-8006-12ec145445c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:24:50.114411 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:50.114388 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dede305e-5f97-494b-8006-12ec145445c8-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6\" (UID: \"dede305e-5f97-494b-8006-12ec145445c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:24:50.114643 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:50.114624 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dede305e-5f97-494b-8006-12ec145445c8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6\" (UID: \"dede305e-5f97-494b-8006-12ec145445c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:24:50.119842 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:50.119819 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kktf\" (UniqueName: \"kubernetes.io/projected/dede305e-5f97-494b-8006-12ec145445c8-kube-api-access-5kktf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6\" (UID: \"dede305e-5f97-494b-8006-12ec145445c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:24:50.192919 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:50.192857 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:24:50.328637 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:50.328613 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6"] Jul 03 15:24:50.330811 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:24:50.330784 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddede305e_5f97_494b_8006_12ec145445c8.slice/crio-e28a671291e9e699e8ade0b1be92bd372dbaf15a7e358c5751c1cfca230a8066 WatchSource:0}: Error finding container e28a671291e9e699e8ade0b1be92bd372dbaf15a7e358c5751c1cfca230a8066: Status 404 returned error can't find the container with id e28a671291e9e699e8ade0b1be92bd372dbaf15a7e358c5751c1cfca230a8066 Jul 03 15:24:50.332127 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:50.332109 2532 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 15:24:50.414477 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:50.414443 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" event={"ID":"dede305e-5f97-494b-8006-12ec145445c8","Type":"ContainerStarted","Data":"e28a671291e9e699e8ade0b1be92bd372dbaf15a7e358c5751c1cfca230a8066"} Jul 03 15:24:52.428948 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:52.428909 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" event={"ID":"dede305e-5f97-494b-8006-12ec145445c8","Type":"ContainerStarted","Data":"c7e5fd9f89a3d97fc499dc447e27cedcdcc5bed314917370bab412a2a89b5b87"} Jul 03 15:24:52.449598 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:52.449550 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" podStartSLOduration=2.4208169 podStartE2EDuration="3.449530374s" totalImagesPullingTime="1.028713474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:24:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:24:52.447726565 +0000 UTC m=+711.030750395" watchObservedRunningTime="2026-07-03 15:24:52.449530374 +0000 UTC m=+711.032554201" Jul 03 15:24:57.494732 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:24:57.494698 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:25:00.193229 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:25:00.193190 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:25:00.193740 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:25:00.193245 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:25:00.205984 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:25:00.205960 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:25:00.482810 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:25:00.482729 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6" Jul 03 15:25:53.057136 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:25:53.057096 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:26:11.638240 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:11.638198 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:26:11.738264 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:11.738223 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:26:12.640530 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:12.640495 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-757dcc4969-v84sn"] Jul 03 15:26:12.641025 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:12.640687 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-757dcc4969-v84sn" podUID="864aa6f6-148d-4e77-ac0a-be3edccb1016" containerName="authorino" containerID="cri-o://e083fa407311007bfeca816957c3c6fd7fa044d5b13f5612f4dcaed0e91f42d6" gracePeriod=30 Jul 03 15:26:12.743180 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:12.743148 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:26:12.829932 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:12.829899 2532 generic.go:356] "Generic (PLEG): container finished" podID="864aa6f6-148d-4e77-ac0a-be3edccb1016" containerID="e083fa407311007bfeca816957c3c6fd7fa044d5b13f5612f4dcaed0e91f42d6" exitCode=0 Jul 03 15:26:12.830068 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:12.829970 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-757dcc4969-v84sn" event={"ID":"864aa6f6-148d-4e77-ac0a-be3edccb1016","Type":"ContainerDied","Data":"e083fa407311007bfeca816957c3c6fd7fa044d5b13f5612f4dcaed0e91f42d6"} Jul 03 15:26:12.848098 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:12.848070 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:26:12.900782 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:12.900724 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-757dcc4969-v84sn" Jul 03 15:26:13.009997 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:13.009966 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/864aa6f6-148d-4e77-ac0a-be3edccb1016-tls-cert\") pod \"864aa6f6-148d-4e77-ac0a-be3edccb1016\" (UID: \"864aa6f6-148d-4e77-ac0a-be3edccb1016\") " Jul 03 15:26:13.010149 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:13.010071 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbpw9\" (UniqueName: \"kubernetes.io/projected/864aa6f6-148d-4e77-ac0a-be3edccb1016-kube-api-access-mbpw9\") pod \"864aa6f6-148d-4e77-ac0a-be3edccb1016\" (UID: \"864aa6f6-148d-4e77-ac0a-be3edccb1016\") " Jul 03 15:26:13.012262 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:13.012235 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/864aa6f6-148d-4e77-ac0a-be3edccb1016-kube-api-access-mbpw9" (OuterVolumeSpecName: "kube-api-access-mbpw9") pod "864aa6f6-148d-4e77-ac0a-be3edccb1016" (UID: "864aa6f6-148d-4e77-ac0a-be3edccb1016"). InnerVolumeSpecName "kube-api-access-mbpw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:26:13.020801 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:13.020779 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/864aa6f6-148d-4e77-ac0a-be3edccb1016-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "864aa6f6-148d-4e77-ac0a-be3edccb1016" (UID: "864aa6f6-148d-4e77-ac0a-be3edccb1016"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 15:26:13.111385 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:13.111345 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbpw9\" (UniqueName: \"kubernetes.io/projected/864aa6f6-148d-4e77-ac0a-be3edccb1016-kube-api-access-mbpw9\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:26:13.111483 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:13.111387 2532 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/864aa6f6-148d-4e77-ac0a-be3edccb1016-tls-cert\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:26:13.836929 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:13.836896 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-757dcc4969-v84sn" event={"ID":"864aa6f6-148d-4e77-ac0a-be3edccb1016","Type":"ContainerDied","Data":"b67d6cea341a8df7e5fdd2fcbffc51191a983ab8f9573e320f205be9ea8b3509"} Jul 03 15:26:13.837346 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:13.836947 2532 scope.go:117] "RemoveContainer" containerID="e083fa407311007bfeca816957c3c6fd7fa044d5b13f5612f4dcaed0e91f42d6" Jul 03 15:26:13.837346 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:13.836901 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-757dcc4969-v84sn" Jul 03 15:26:13.892837 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:13.892809 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-757dcc4969-v84sn"] Jul 03 15:26:13.909061 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:13.909041 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-757dcc4969-v84sn"] Jul 03 15:26:14.018338 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:14.018310 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="864aa6f6-148d-4e77-ac0a-be3edccb1016" path="/var/lib/kubelet/pods/864aa6f6-148d-4e77-ac0a-be3edccb1016/volumes" Jul 03 15:26:47.796540 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:47.796506 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:26:58.601743 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:26:58.601706 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:27:07.701147 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:27:07.701109 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:27:17.601660 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:27:17.601629 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:27:27.898566 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:27:27.898527 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:27:30.728971 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:27:30.728927 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:27:32.039902 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:27:32.039863 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:27:59.953977 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:27:59.953936 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:28:00.982091 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:28:00.982058 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:28:01.930166 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:28:01.930135 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/1.log" Jul 03 15:28:01.932954 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:28:01.932931 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/1.log" Jul 03 15:28:01.933428 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:28:01.933410 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5hcn_df460999-eb58-4575-91fc-8130653c6f5b/ovn-acl-logging/0.log" Jul 03 15:28:01.935801 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:28:01.935783 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5hcn_df460999-eb58-4575-91fc-8130653c6f5b/ovn-acl-logging/0.log" Jul 03 15:28:07.626686 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:28:07.626646 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:28:07.725758 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:28:07.725714 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:28:07.854893 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:28:07.854856 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:28:13.774668 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:28:13.774627 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:28:13.836185 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:28:13.836150 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:28:13.904891 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:28:13.904860 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:28:14.005559 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:28:14.005526 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:28:14.112819 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:28:14.112784 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:28:19.828662 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:28:19.828625 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:28:19.901227 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:28:19.901174 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:28:36.102331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:28:36.102294 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:28:43.591773 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:28:43.591740 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:28:53.896694 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:28:53.896656 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:28:59.793658 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:28:59.793621 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:29:10.196789 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:29:10.196750 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:29:18.991614 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:29:18.991581 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:29:31.105233 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:29:31.105136 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:29:40.700142 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:29:40.700106 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:30:00.501404 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:30:00.501349 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:30:03.604246 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:30:03.604212 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:30:15.489956 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:30:15.489914 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:30:37.895822 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:30:37.895786 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:30:49.706022 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:30:49.705980 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:31:04.196595 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:31:04.196508 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:31:13.295383 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:31:13.295329 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:31:22.499232 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:31:22.499195 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:31:32.900470 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:31:32.900432 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:31:41.497512 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:31:41.497475 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:32:08.564829 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:32:08.564787 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c"] Jul 03 15:32:08.565339 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:32:08.565015 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c" podUID="2168d604-68c8-4c66-b59f-8fcd9805ada5" containerName="manager" containerID="cri-o://c015c88da6874d59ae456c5ce6fdf440b69a34f3d13374d8dbc0adc968e9b23a" gracePeriod=10 Jul 03 15:32:10.829790 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:32:10.829763 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c" Jul 03 15:32:10.951184 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:32:10.951086 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2168d604-68c8-4c66-b59f-8fcd9805ada5-extensions-socket-volume\") pod \"2168d604-68c8-4c66-b59f-8fcd9805ada5\" (UID: \"2168d604-68c8-4c66-b59f-8fcd9805ada5\") " Jul 03 15:32:10.951360 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:32:10.951208 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgl4c\" (UniqueName: \"kubernetes.io/projected/2168d604-68c8-4c66-b59f-8fcd9805ada5-kube-api-access-wgl4c\") pod \"2168d604-68c8-4c66-b59f-8fcd9805ada5\" (UID: \"2168d604-68c8-4c66-b59f-8fcd9805ada5\") " Jul 03 15:32:10.951506 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:32:10.951482 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2168d604-68c8-4c66-b59f-8fcd9805ada5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2168d604-68c8-4c66-b59f-8fcd9805ada5" (UID: "2168d604-68c8-4c66-b59f-8fcd9805ada5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:32:10.953415 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:32:10.953385 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2168d604-68c8-4c66-b59f-8fcd9805ada5-kube-api-access-wgl4c" (OuterVolumeSpecName: "kube-api-access-wgl4c") pod "2168d604-68c8-4c66-b59f-8fcd9805ada5" (UID: "2168d604-68c8-4c66-b59f-8fcd9805ada5"). InnerVolumeSpecName "kube-api-access-wgl4c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:32:11.052126 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:32:11.052090 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgl4c\" (UniqueName: \"kubernetes.io/projected/2168d604-68c8-4c66-b59f-8fcd9805ada5-kube-api-access-wgl4c\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:32:11.052126 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:32:11.052118 2532 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2168d604-68c8-4c66-b59f-8fcd9805ada5-extensions-socket-volume\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:32:11.620565 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:32:11.620531 2532 generic.go:356] "Generic (PLEG): container finished" podID="2168d604-68c8-4c66-b59f-8fcd9805ada5" containerID="c015c88da6874d59ae456c5ce6fdf440b69a34f3d13374d8dbc0adc968e9b23a" exitCode=0 Jul 03 15:32:11.620735 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:32:11.620582 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c" Jul 03 15:32:11.620735 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:32:11.620620 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c" event={"ID":"2168d604-68c8-4c66-b59f-8fcd9805ada5","Type":"ContainerDied","Data":"c015c88da6874d59ae456c5ce6fdf440b69a34f3d13374d8dbc0adc968e9b23a"} Jul 03 15:32:11.620735 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:32:11.620677 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c" event={"ID":"2168d604-68c8-4c66-b59f-8fcd9805ada5","Type":"ContainerDied","Data":"e7118206075c2bce4a6012a812ff5fe15d1036178dae4f7725d77f35fcba80df"} Jul 03 15:32:11.620735 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:32:11.620704 2532 scope.go:117] "RemoveContainer" containerID="c015c88da6874d59ae456c5ce6fdf440b69a34f3d13374d8dbc0adc968e9b23a" Jul 03 15:32:11.630828 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:32:11.630811 2532 scope.go:117] "RemoveContainer" containerID="c015c88da6874d59ae456c5ce6fdf440b69a34f3d13374d8dbc0adc968e9b23a" Jul 03 15:32:11.631081 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:32:11.631061 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c015c88da6874d59ae456c5ce6fdf440b69a34f3d13374d8dbc0adc968e9b23a\": container with ID starting with c015c88da6874d59ae456c5ce6fdf440b69a34f3d13374d8dbc0adc968e9b23a not found: ID does not exist" containerID="c015c88da6874d59ae456c5ce6fdf440b69a34f3d13374d8dbc0adc968e9b23a" Jul 03 15:32:11.631154 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:32:11.631090 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c015c88da6874d59ae456c5ce6fdf440b69a34f3d13374d8dbc0adc968e9b23a"} err="failed to get container status \"c015c88da6874d59ae456c5ce6fdf440b69a34f3d13374d8dbc0adc968e9b23a\": rpc error: code = NotFound desc = could not find container \"c015c88da6874d59ae456c5ce6fdf440b69a34f3d13374d8dbc0adc968e9b23a\": container with ID starting with c015c88da6874d59ae456c5ce6fdf440b69a34f3d13374d8dbc0adc968e9b23a not found: ID does not exist" Jul 03 15:32:11.640831 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:32:11.640807 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c"] Jul 03 15:32:11.648472 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:32:11.648451 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cn28c"] Jul 03 15:32:12.017326 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:32:12.017248 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2168d604-68c8-4c66-b59f-8fcd9805ada5" path="/var/lib/kubelet/pods/2168d604-68c8-4c66-b59f-8fcd9805ada5/volumes" Jul 03 15:33:01.958942 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:01.958911 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/1.log" Jul 03 15:33:01.961717 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:01.961697 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5hcn_df460999-eb58-4575-91fc-8130653c6f5b/ovn-acl-logging/0.log" Jul 03 15:33:01.962910 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:01.962891 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/1.log" Jul 03 15:33:01.965703 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:01.965685 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5hcn_df460999-eb58-4575-91fc-8130653c6f5b/ovn-acl-logging/0.log" Jul 03 15:33:09.746141 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:09.746102 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jrs6"] Jul 03 15:33:09.746526 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:09.746497 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="864aa6f6-148d-4e77-ac0a-be3edccb1016" containerName="authorino" Jul 03 15:33:09.746526 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:09.746509 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="864aa6f6-148d-4e77-ac0a-be3edccb1016" containerName="authorino" Jul 03 15:33:09.746526 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:09.746523 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2168d604-68c8-4c66-b59f-8fcd9805ada5" containerName="manager" Jul 03 15:33:09.746625 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:09.746529 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="2168d604-68c8-4c66-b59f-8fcd9805ada5" containerName="manager" Jul 03 15:33:09.746625 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:09.746580 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="864aa6f6-148d-4e77-ac0a-be3edccb1016" containerName="authorino" Jul 03 15:33:09.746625 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:09.746593 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="2168d604-68c8-4c66-b59f-8fcd9805ada5" containerName="manager" Jul 03 15:33:09.750780 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:09.750761 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jrs6" Jul 03 15:33:09.754257 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:09.754234 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tdvnd\"" Jul 03 15:33:09.781871 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:09.781846 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jrs6"] Jul 03 15:33:09.851969 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:09.851937 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b9d1f2b-ceaa-495f-9681-c925c22bfc44-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4jrs6\" (UID: \"5b9d1f2b-ceaa-495f-9681-c925c22bfc44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jrs6" Jul 03 15:33:09.852130 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:09.851979 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x99jr\" (UniqueName: \"kubernetes.io/projected/5b9d1f2b-ceaa-495f-9681-c925c22bfc44-kube-api-access-x99jr\") pod \"kuadrant-operator-controller-manager-86878c769f-4jrs6\" (UID: \"5b9d1f2b-ceaa-495f-9681-c925c22bfc44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jrs6" Jul 03 15:33:09.953067 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:09.953027 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b9d1f2b-ceaa-495f-9681-c925c22bfc44-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4jrs6\" (UID: \"5b9d1f2b-ceaa-495f-9681-c925c22bfc44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jrs6" Jul 03 15:33:09.953239 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:09.953085 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x99jr\" (UniqueName: \"kubernetes.io/projected/5b9d1f2b-ceaa-495f-9681-c925c22bfc44-kube-api-access-x99jr\") pod \"kuadrant-operator-controller-manager-86878c769f-4jrs6\" (UID: \"5b9d1f2b-ceaa-495f-9681-c925c22bfc44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jrs6" Jul 03 15:33:09.953426 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:09.953403 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b9d1f2b-ceaa-495f-9681-c925c22bfc44-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4jrs6\" (UID: \"5b9d1f2b-ceaa-495f-9681-c925c22bfc44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jrs6" Jul 03 15:33:09.962775 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:09.962746 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x99jr\" (UniqueName: \"kubernetes.io/projected/5b9d1f2b-ceaa-495f-9681-c925c22bfc44-kube-api-access-x99jr\") pod \"kuadrant-operator-controller-manager-86878c769f-4jrs6\" (UID: \"5b9d1f2b-ceaa-495f-9681-c925c22bfc44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jrs6" Jul 03 15:33:10.061325 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:10.061242 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jrs6" Jul 03 15:33:10.203499 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:10.203465 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jrs6"] Jul 03 15:33:10.207160 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:33:10.207131 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b9d1f2b_ceaa_495f_9681_c925c22bfc44.slice/crio-3b531dbadbe2370fcc613a1a495ebeaf5b2ae44f0f8ebf8b1c551e7cffc6c366 WatchSource:0}: Error finding container 3b531dbadbe2370fcc613a1a495ebeaf5b2ae44f0f8ebf8b1c551e7cffc6c366: Status 404 returned error can't find the container with id 3b531dbadbe2370fcc613a1a495ebeaf5b2ae44f0f8ebf8b1c551e7cffc6c366 Jul 03 15:33:10.914381 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:10.914326 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jrs6" event={"ID":"5b9d1f2b-ceaa-495f-9681-c925c22bfc44","Type":"ContainerStarted","Data":"93ec1a12413e9ce24c8e8fbddf629e90dd0f4fb89dab3123d759ed84ddf45f06"} Jul 03 15:33:10.914762 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:10.914412 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jrs6" event={"ID":"5b9d1f2b-ceaa-495f-9681-c925c22bfc44","Type":"ContainerStarted","Data":"3b531dbadbe2370fcc613a1a495ebeaf5b2ae44f0f8ebf8b1c551e7cffc6c366"} Jul 03 15:33:10.914762 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:10.914545 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jrs6" Jul 03 15:33:10.936032 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:10.935975 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jrs6" podStartSLOduration=1.935955812 podStartE2EDuration="1.935955812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:33:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:33:10.934565604 +0000 UTC m=+1209.517589433" watchObservedRunningTime="2026-07-03 15:33:10.935955812 +0000 UTC m=+1209.518979641" Jul 03 15:33:18.621897 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:18.621862 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:33:21.922174 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:21.922146 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jrs6" Jul 03 15:33:32.999531 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:32.999464 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:33:41.498187 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:41.498151 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:33:54.101144 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:33:54.101048 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:34:03.100655 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:34:03.100616 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:34:11.803340 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:34:11.803303 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:34:21.802139 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:34:21.802102 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:34:31.604268 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:34:31.604231 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:34:42.093701 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:34:42.093666 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:34:49.499489 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:34:49.499439 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:34:58.600710 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:34:58.600672 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:35:06.102427 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:35:06.102394 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:35:14.598921 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:35:14.598887 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:35:20.991430 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:35:20.991395 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:35:27.434644 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:35:27.434554 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:35:42.398479 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:35:42.398444 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:35:50.896731 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:35:50.896695 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:36:03.415304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:36:03.415268 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:36:13.800656 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:36:13.800619 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:36:29.605979 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:36:29.605939 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:36:38.893280 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:36:38.893241 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:36:48.314751 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:36:48.314715 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:36:55.507296 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:36:55.507210 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:36:55.560749 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:36:55.560718 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:36:58.000142 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:36:58.000105 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:37:07.101580 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:37:07.101545 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:37:16.398481 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:37:16.398443 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:37:28.005626 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:37:28.005590 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:37:37.924496 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:37:37.924460 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:37:48.800461 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:37:48.800423 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:37:57.699552 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:37:57.699517 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:38:01.989710 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:38:01.989681 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/1.log" Jul 03 15:38:01.992785 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:38:01.992759 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/1.log" Jul 03 15:38:01.992921 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:38:01.992868 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5hcn_df460999-eb58-4575-91fc-8130653c6f5b/ovn-acl-logging/0.log" Jul 03 15:38:01.995926 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:38:01.995906 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5hcn_df460999-eb58-4575-91fc-8130653c6f5b/ovn-acl-logging/0.log" Jul 03 15:38:06.601481 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:38:06.601440 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:38:18.295875 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:38:18.295834 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:38:35.901087 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:38:35.901052 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:38:46.803735 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:38:46.803696 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:38:57.493238 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:38:57.493201 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:39:01.784794 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:01.784756 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:05.809215 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:05.809181 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:39:10.007584 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:10.007546 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:10.070662 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:10.070625 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:11.593601 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:11.593562 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:15.798908 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:15.798870 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:39:19.847432 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:19.847392 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:24.698413 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:24.698379 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:39:24.934665 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:24.934629 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:27.746140 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:27.746099 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:27.844290 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:27.844252 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:28.244529 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:28.244488 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:33.722758 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:33.722723 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:33.801210 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:33.801177 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:39:33.804000 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:33.803969 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:33.902058 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:33.902019 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d"] Jul 03 15:39:33.905706 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:33.905533 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:33.909567 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:33.909540 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-bb2882d3-openshift-default-dockercfg-d4kzm\"" Jul 03 15:39:33.931403 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:33.931380 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d"] Jul 03 15:39:33.933702 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:33.933673 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:33.941407 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:33.941354 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bql27\" (UniqueName: \"kubernetes.io/projected/7f5a313f-fe48-47d9-b0d5-849de4c17f14-kube-api-access-bql27\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:33.941530 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:33.941435 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-workload-certs\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:33.941530 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:33.941510 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-workload-socket\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:33.941663 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:33.941548 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-credential-socket\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:33.941663 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:33.941647 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-token\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:33.941773 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:33.941682 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istiod-ca-cert\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:33.941773 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:33.941711 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-envoy\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:33.941897 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:33.941781 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-data\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:33.941897 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:33.941804 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-podinfo\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:34.033911 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.033812 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:34.042705 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.042679 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-token\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:34.042870 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.042723 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istiod-ca-cert\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:34.042870 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.042754 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-envoy\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:34.042870 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.042828 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-data\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:34.042870 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.042854 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-podinfo\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:34.043078 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.042885 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bql27\" (UniqueName: \"kubernetes.io/projected/7f5a313f-fe48-47d9-b0d5-849de4c17f14-kube-api-access-bql27\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:34.043078 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.042925 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-workload-certs\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:34.043078 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.042979 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-workload-socket\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:34.043078 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.043003 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-credential-socket\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:34.044175 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.044149 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-workload-certs\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:34.044288 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.044230 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-credential-socket\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:34.044430 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.044399 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-data\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:34.044656 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.044633 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-workload-socket\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:34.045039 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.045015 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istiod-ca-cert\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:34.046434 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.046412 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-envoy\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:34.046890 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.046874 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-podinfo\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:34.051461 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.051431 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bql27\" (UniqueName: \"kubernetes.io/projected/7f5a313f-fe48-47d9-b0d5-849de4c17f14-kube-api-access-bql27\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:34.051797 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.051778 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-token\") pod \"e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:34.216932 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.216899 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:34.358008 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.357975 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d"] Jul 03 15:39:34.359463 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:39:34.359439 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5a313f_fe48_47d9_b0d5_849de4c17f14.slice/crio-8815f71ce90ef2007b450ea3b3aa67a18418a9a1b98df2effcfe571771f582f7 WatchSource:0}: Error finding container 8815f71ce90ef2007b450ea3b3aa67a18418a9a1b98df2effcfe571771f582f7: Status 404 returned error can't find the container with id 8815f71ce90ef2007b450ea3b3aa67a18418a9a1b98df2effcfe571771f582f7 Jul 03 15:39:34.361696 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.361643 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:39:34.361766 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.361745 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:39:34.361809 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.361792 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:39:34.869693 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.869657 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" event={"ID":"7f5a313f-fe48-47d9-b0d5-849de4c17f14","Type":"ContainerStarted","Data":"1fc2de3c5378d2bdb0e231feed49df066873c78768c4a3be701a85d23ea48c33"} Jul 03 15:39:34.870086 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.869710 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" event={"ID":"7f5a313f-fe48-47d9-b0d5-849de4c17f14","Type":"ContainerStarted","Data":"8815f71ce90ef2007b450ea3b3aa67a18418a9a1b98df2effcfe571771f582f7"} Jul 03 15:39:34.894310 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:34.894250 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" podStartSLOduration=1.894237116 podStartE2EDuration="1.894237116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:39:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:39:34.892299093 +0000 UTC m=+1593.475322923" watchObservedRunningTime="2026-07-03 15:39:34.894237116 +0000 UTC m=+1593.477260945" Jul 03 15:39:35.118466 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:35.118422 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:35.216661 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:35.216574 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:35.217299 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:35.217287 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:35.221992 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:35.221968 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:35.449616 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:35.449573 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:35.550590 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:35.550496 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:35.868591 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:35.868548 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:35.874960 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:35.874935 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:35.876016 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:35.876000 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:35.970710 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:35.970676 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:37.510604 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:37.510563 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:40.364391 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:40.360035 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:40.469048 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:40.468998 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d"] Jul 03 15:39:40.469287 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:40.469238 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" podUID="7f5a313f-fe48-47d9-b0d5-849de4c17f14" containerName="istio-proxy" containerID="cri-o://1fc2de3c5378d2bdb0e231feed49df066873c78768c4a3be701a85d23ea48c33" gracePeriod=30 Jul 03 15:39:40.492829 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:40.492787 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:40.593080 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:40.593049 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:40.762573 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:40.762477 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:42.268421 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:42.268389 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:46.242253 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.242204 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:46.310513 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.310469 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:46.414084 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.414051 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd"] Jul 03 15:39:46.419875 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.419855 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.422450 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.422425 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-39081e64-openshift-default-dockercfg-4kks8\"" Jul 03 15:39:46.428877 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.428857 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd"] Jul 03 15:39:46.446818 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.446785 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:46.545926 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.545825 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:46.564863 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.564821 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-credential-socket\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.565022 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.564866 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-workload-certs\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.565022 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.564898 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-data\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.565104 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.565029 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-envoy\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.565104 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.565071 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-podinfo\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.565171 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.565133 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4vgt\" (UniqueName: \"kubernetes.io/projected/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-kube-api-access-b4vgt\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.565205 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.565179 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istiod-ca-cert\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.565205 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.565199 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-workload-socket\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.565297 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.565214 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-token\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.666304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.666268 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-data\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.666534 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.666339 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-envoy\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.666534 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.666362 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-podinfo\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.666534 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.666423 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4vgt\" (UniqueName: \"kubernetes.io/projected/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-kube-api-access-b4vgt\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.666534 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.666474 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istiod-ca-cert\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.666534 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.666499 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-workload-socket\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.666534 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.666523 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-token\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.666922 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.666617 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-credential-socket\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.666922 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.666641 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-workload-certs\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.666922 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.666835 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-data\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.666922 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.666853 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-workload-socket\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.667308 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.667274 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-workload-certs\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.667524 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.667504 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-credential-socket\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.667762 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.667742 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istiod-ca-cert\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.668858 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.668833 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-envoy\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.669592 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.669572 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-podinfo\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.687362 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.687332 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-token\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.688465 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.688446 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4vgt\" (UniqueName: \"kubernetes.io/projected/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-kube-api-access-b4vgt\") pod \"e2e-ait-39081e64-openshift-default-757d5b6d99-chphd\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.734233 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.734193 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:46.905197 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.905167 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd"] Jul 03 15:39:46.912712 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:39:46.912685 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf45ecb7_3cfc_4fee_bd66_e6ecfd7655a6.slice/crio-6d844c019c4396901980e60e52e03679acb176b5c10f0df3dc281e36f91e6b33 WatchSource:0}: Error finding container 6d844c019c4396901980e60e52e03679acb176b5c10f0df3dc281e36f91e6b33: Status 404 returned error can't find the container with id 6d844c019c4396901980e60e52e03679acb176b5c10f0df3dc281e36f91e6b33 Jul 03 15:39:46.915225 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.915192 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:39:46.915310 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.915258 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:39:46.915310 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.915286 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:39:46.936165 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.936132 2532 generic.go:356] "Generic (PLEG): container finished" podID="7f5a313f-fe48-47d9-b0d5-849de4c17f14" containerID="1fc2de3c5378d2bdb0e231feed49df066873c78768c4a3be701a85d23ea48c33" exitCode=0 Jul 03 15:39:46.936280 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.936203 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" event={"ID":"7f5a313f-fe48-47d9-b0d5-849de4c17f14","Type":"ContainerDied","Data":"1fc2de3c5378d2bdb0e231feed49df066873c78768c4a3be701a85d23ea48c33"} Jul 03 15:39:46.937494 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:46.937467 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" event={"ID":"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6","Type":"ContainerStarted","Data":"6d844c019c4396901980e60e52e03679acb176b5c10f0df3dc281e36f91e6b33"} Jul 03 15:39:47.021494 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.021470 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:47.170275 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.170176 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-credential-socket\") pod \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " Jul 03 15:39:47.170275 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.170248 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-data\") pod \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " Jul 03 15:39:47.170528 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.170280 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bql27\" (UniqueName: \"kubernetes.io/projected/7f5a313f-fe48-47d9-b0d5-849de4c17f14-kube-api-access-bql27\") pod \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " Jul 03 15:39:47.170528 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.170320 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istiod-ca-cert\") pod \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " Jul 03 15:39:47.170528 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.170350 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-workload-socket\") pod \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " Jul 03 15:39:47.170528 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.170415 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-podinfo\") pod \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " Jul 03 15:39:47.170528 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.170459 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-envoy\") pod \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " Jul 03 15:39:47.170528 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.170473 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7f5a313f-fe48-47d9-b0d5-849de4c17f14" (UID: "7f5a313f-fe48-47d9-b0d5-849de4c17f14"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:39:47.170528 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.170490 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-workload-certs\") pod \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " Jul 03 15:39:47.170878 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.170584 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-token\") pod \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\" (UID: \"7f5a313f-fe48-47d9-b0d5-849de4c17f14\") " Jul 03 15:39:47.170878 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.170625 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7f5a313f-fe48-47d9-b0d5-849de4c17f14" (UID: "7f5a313f-fe48-47d9-b0d5-849de4c17f14"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:39:47.170982 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.170958 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7f5a313f-fe48-47d9-b0d5-849de4c17f14" (UID: "7f5a313f-fe48-47d9-b0d5-849de4c17f14"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:39:47.171214 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.171179 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-data" (OuterVolumeSpecName: "istio-data") pod "7f5a313f-fe48-47d9-b0d5-849de4c17f14" (UID: "7f5a313f-fe48-47d9-b0d5-849de4c17f14"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:39:47.171214 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.171194 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7f5a313f-fe48-47d9-b0d5-849de4c17f14" (UID: "7f5a313f-fe48-47d9-b0d5-849de4c17f14"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:39:47.171425 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.171410 2532 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-credential-socket\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:39:47.171481 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.171431 2532 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-data\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:39:47.171481 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.171446 2532 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istiod-ca-cert\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:39:47.171481 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.171460 2532 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-workload-socket\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:39:47.171481 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.171474 2532 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-workload-certs\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:39:47.173271 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.173231 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7f5a313f-fe48-47d9-b0d5-849de4c17f14" (UID: "7f5a313f-fe48-47d9-b0d5-849de4c17f14"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:39:47.173271 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.173251 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7f5a313f-fe48-47d9-b0d5-849de4c17f14" (UID: "7f5a313f-fe48-47d9-b0d5-849de4c17f14"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 03 15:39:47.173476 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.173395 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f5a313f-fe48-47d9-b0d5-849de4c17f14-kube-api-access-bql27" (OuterVolumeSpecName: "kube-api-access-bql27") pod "7f5a313f-fe48-47d9-b0d5-849de4c17f14" (UID: "7f5a313f-fe48-47d9-b0d5-849de4c17f14"). InnerVolumeSpecName "kube-api-access-bql27". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:39:47.173603 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.173586 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-token" (OuterVolumeSpecName: "istio-token") pod "7f5a313f-fe48-47d9-b0d5-849de4c17f14" (UID: "7f5a313f-fe48-47d9-b0d5-849de4c17f14"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:39:47.272577 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.272542 2532 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-token\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:39:47.272577 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.272570 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bql27\" (UniqueName: \"kubernetes.io/projected/7f5a313f-fe48-47d9-b0d5-849de4c17f14-kube-api-access-bql27\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:39:47.272577 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.272584 2532 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-podinfo\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:39:47.273020 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.272599 2532 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f5a313f-fe48-47d9-b0d5-849de4c17f14-istio-envoy\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:39:47.777679 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.777639 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:47.902689 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.902652 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:47.944702 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.944620 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" Jul 03 15:39:47.944702 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.944660 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d" event={"ID":"7f5a313f-fe48-47d9-b0d5-849de4c17f14","Type":"ContainerDied","Data":"8815f71ce90ef2007b450ea3b3aa67a18418a9a1b98df2effcfe571771f582f7"} Jul 03 15:39:47.944908 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.944729 2532 scope.go:117] "RemoveContainer" containerID="1fc2de3c5378d2bdb0e231feed49df066873c78768c4a3be701a85d23ea48c33" Jul 03 15:39:47.946549 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.946525 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" event={"ID":"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6","Type":"ContainerStarted","Data":"f5e66ee4a66021097d590aab26fdab95b7ea19a24f402da9f09d7642721a9aad"} Jul 03 15:39:47.990562 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:47.990510 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" podStartSLOduration=1.990492652 podStartE2EDuration="1.990492652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:39:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:39:47.989309068 +0000 UTC m=+1606.572332898" watchObservedRunningTime="2026-07-03 15:39:47.990492652 +0000 UTC m=+1606.573516480" Jul 03 15:39:48.029800 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:48.029765 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d"] Jul 03 15:39:48.041864 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:48.041817 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:48.042343 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:48.042319 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-bb2882d3-openshift-default-7b9fb76857-qzm2d"] Jul 03 15:39:48.575421 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:48.575380 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:48.687731 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:48.687693 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:48.734707 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:48.734674 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:48.758090 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:48.758060 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:48.952941 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:48.952860 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:48.953933 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:48.953911 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:39:49.560254 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:49.560220 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:50.017571 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:50.017539 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f5a313f-fe48-47d9-b0d5-849de4c17f14" path="/var/lib/kubelet/pods/7f5a313f-fe48-47d9-b0d5-849de4c17f14/volumes" Jul 03 15:39:51.311783 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:51.311746 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:39:52.780846 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:52.780760 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:53.283800 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:53.283755 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:59.007796 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:59.007701 2532 generic.go:356] "Generic (PLEG): container finished" podID="af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6" containerID="f5e66ee4a66021097d590aab26fdab95b7ea19a24f402da9f09d7642721a9aad" exitCode=0 Jul 03 15:39:59.007796 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:59.007768 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" event={"ID":"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6","Type":"ContainerDied","Data":"f5e66ee4a66021097d590aab26fdab95b7ea19a24f402da9f09d7642721a9aad"} Jul 03 15:39:59.008221 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:59.008184 2532 scope.go:117] "RemoveContainer" containerID="f5e66ee4a66021097d590aab26fdab95b7ea19a24f402da9f09d7642721a9aad" Jul 03 15:39:59.009245 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:59.009213 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:39:59.009338 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:59.009286 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:39:59.009338 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:59.009325 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:39:59.177632 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:59.177589 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd"] Jul 03 15:39:59.210211 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:59.210177 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:39:59.300738 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:39:59.300638 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:00.014799 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:00.014768 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" podUID="af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6" containerName="istio-proxy" containerID="cri-o://36c3e4bd818e56609ebc65fc5a137891c1cd24a4efcf570279c5dd1a0c404e51" gracePeriod=30 Jul 03 15:40:00.016733 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:00.016708 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" event={"ID":"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6","Type":"ContainerStarted","Data":"36c3e4bd818e56609ebc65fc5a137891c1cd24a4efcf570279c5dd1a0c404e51"} Jul 03 15:40:01.042849 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:01.042815 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:02.613558 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:02.613527 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:40:03.953707 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:03.953673 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:40:05.180616 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.180576 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:05.260687 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.260640 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:05.268780 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.268760 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:40:05.364683 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.364653 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs"] Jul 03 15:40:05.365052 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.365039 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6" containerName="istio-proxy" Jul 03 15:40:05.365096 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.365054 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6" containerName="istio-proxy" Jul 03 15:40:05.365096 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.365071 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5a313f-fe48-47d9-b0d5-849de4c17f14" containerName="istio-proxy" Jul 03 15:40:05.365096 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.365077 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5a313f-fe48-47d9-b0d5-849de4c17f14" containerName="istio-proxy" Jul 03 15:40:05.365186 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.365145 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6" containerName="istio-proxy" Jul 03 15:40:05.365186 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.365153 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6" containerName="istio-proxy" Jul 03 15:40:05.365186 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.365161 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f5a313f-fe48-47d9-b0d5-849de4c17f14" containerName="istio-proxy" Jul 03 15:40:05.368319 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.368304 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.371003 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.370981 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-162414cd-openshift-default-dockercfg-rbg6l\"" Jul 03 15:40:05.382937 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.382915 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs"] Jul 03 15:40:05.419841 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.419815 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:05.451561 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.451537 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-credential-socket\") pod \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " Jul 03 15:40:05.451709 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.451571 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istiod-ca-cert\") pod \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " Jul 03 15:40:05.451709 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.451590 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4vgt\" (UniqueName: \"kubernetes.io/projected/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-kube-api-access-b4vgt\") pod \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " Jul 03 15:40:05.451709 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.451608 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-data\") pod \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " Jul 03 15:40:05.451709 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.451674 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-token\") pod \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " Jul 03 15:40:05.451919 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.451722 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-workload-socket\") pod \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " Jul 03 15:40:05.451919 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.451758 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-envoy\") pod \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " Jul 03 15:40:05.451919 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.451786 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-workload-certs\") pod \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " Jul 03 15:40:05.451919 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.451814 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-podinfo\") pod \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\" (UID: \"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6\") " Jul 03 15:40:05.451919 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.451830 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6" (UID: "af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:40:05.452145 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.451976 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6" (UID: "af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:40:05.452145 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.452072 2532 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-workload-certs\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:40:05.452145 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.452090 2532 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-credential-socket\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:40:05.452395 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.452277 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6" (UID: "af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:40:05.452395 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.452311 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6" (UID: "af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:40:05.452781 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.452756 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-data" (OuterVolumeSpecName: "istio-data") pod "af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6" (UID: "af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:40:05.454076 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.454052 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-token" (OuterVolumeSpecName: "istio-token") pod "af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6" (UID: "af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:40:05.454177 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.454118 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6" (UID: "af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:40:05.454571 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.454550 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6" (UID: "af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 03 15:40:05.454571 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.454554 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-kube-api-access-b4vgt" (OuterVolumeSpecName: "kube-api-access-b4vgt") pod "af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6" (UID: "af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6"). InnerVolumeSpecName "kube-api-access-b4vgt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:40:05.516833 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.516798 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:05.553418 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.553382 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f013141-3256-4e12-ba83-a2588d117bec-istio-podinfo\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.553574 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.553429 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f013141-3256-4e12-ba83-a2588d117bec-istio-token\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.553574 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.553449 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-istio-envoy\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.553574 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.553512 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-credential-socket\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.553574 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.553535 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f013141-3256-4e12-ba83-a2588d117bec-istiod-ca-cert\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.553574 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.553562 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fv5r\" (UniqueName: \"kubernetes.io/projected/2f013141-3256-4e12-ba83-a2588d117bec-kube-api-access-2fv5r\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.553759 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.553591 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-istio-data\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.553759 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.553613 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-workload-socket\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.553759 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.553682 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-workload-certs\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.553875 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.553766 2532 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-envoy\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:40:05.553875 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.553793 2532 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-podinfo\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:40:05.553875 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.553807 2532 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istiod-ca-cert\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:40:05.553875 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.553821 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4vgt\" (UniqueName: \"kubernetes.io/projected/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-kube-api-access-b4vgt\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:40:05.553875 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.553837 2532 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-data\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:40:05.553875 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.553851 2532 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-istio-token\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:40:05.553875 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.553871 2532 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6-workload-socket\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:40:05.655260 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.655178 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-istio-envoy\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.655260 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.655227 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-credential-socket\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.655260 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.655249 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f013141-3256-4e12-ba83-a2588d117bec-istiod-ca-cert\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.655531 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.655276 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fv5r\" (UniqueName: \"kubernetes.io/projected/2f013141-3256-4e12-ba83-a2588d117bec-kube-api-access-2fv5r\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.655531 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.655316 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-istio-data\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.655531 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.655349 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-workload-socket\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.655531 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.655416 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-workload-certs\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.655531 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.655445 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f013141-3256-4e12-ba83-a2588d117bec-istio-podinfo\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.655531 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.655486 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f013141-3256-4e12-ba83-a2588d117bec-istio-token\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.656024 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.655823 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-workload-certs\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.656092 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.656071 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f013141-3256-4e12-ba83-a2588d117bec-istiod-ca-cert\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.656148 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.656107 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-workload-socket\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.656325 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.656300 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-credential-socket\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.656410 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.656311 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-istio-data\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.657604 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.657583 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-istio-envoy\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.658568 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.658546 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f013141-3256-4e12-ba83-a2588d117bec-istio-podinfo\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.664307 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.664283 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f013141-3256-4e12-ba83-a2588d117bec-istio-token\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.664435 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.664305 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fv5r\" (UniqueName: \"kubernetes.io/projected/2f013141-3256-4e12-ba83-a2588d117bec-kube-api-access-2fv5r\") pod \"e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.679647 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.679613 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:05.823528 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.823505 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs"] Jul 03 15:40:05.825713 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:40:05.825687 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f013141_3256_4e12_ba83_a2588d117bec.slice/crio-808a4e247c3076191678eeebeb999c511e7ef572ee4a70009f9f494c82214d6b WatchSource:0}: Error finding container 808a4e247c3076191678eeebeb999c511e7ef572ee4a70009f9f494c82214d6b: Status 404 returned error can't find the container with id 808a4e247c3076191678eeebeb999c511e7ef572ee4a70009f9f494c82214d6b Jul 03 15:40:05.827865 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.827823 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:40:05.827945 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.827892 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:40:05.827945 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:05.827927 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:40:06.053328 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:06.053293 2532 generic.go:356] "Generic (PLEG): container finished" podID="af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6" containerID="36c3e4bd818e56609ebc65fc5a137891c1cd24a4efcf570279c5dd1a0c404e51" exitCode=0 Jul 03 15:40:06.053500 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:06.053394 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" Jul 03 15:40:06.053500 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:06.053396 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" event={"ID":"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6","Type":"ContainerDied","Data":"36c3e4bd818e56609ebc65fc5a137891c1cd24a4efcf570279c5dd1a0c404e51"} Jul 03 15:40:06.053623 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:06.053530 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd" event={"ID":"af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6","Type":"ContainerDied","Data":"6d844c019c4396901980e60e52e03679acb176b5c10f0df3dc281e36f91e6b33"} Jul 03 15:40:06.053623 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:06.053565 2532 scope.go:117] "RemoveContainer" containerID="36c3e4bd818e56609ebc65fc5a137891c1cd24a4efcf570279c5dd1a0c404e51" Jul 03 15:40:06.056342 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:06.056318 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" event={"ID":"2f013141-3256-4e12-ba83-a2588d117bec","Type":"ContainerStarted","Data":"4960d69ad12b75b44f416a0afb88152c6f51a4cd5a0f57099c0f35f5a110b1b2"} Jul 03 15:40:06.056452 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:06.056400 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" event={"ID":"2f013141-3256-4e12-ba83-a2588d117bec","Type":"ContainerStarted","Data":"808a4e247c3076191678eeebeb999c511e7ef572ee4a70009f9f494c82214d6b"} Jul 03 15:40:06.065200 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:06.065182 2532 scope.go:117] "RemoveContainer" containerID="f5e66ee4a66021097d590aab26fdab95b7ea19a24f402da9f09d7642721a9aad" Jul 03 15:40:06.074424 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:06.074408 2532 scope.go:117] "RemoveContainer" containerID="36c3e4bd818e56609ebc65fc5a137891c1cd24a4efcf570279c5dd1a0c404e51" Jul 03 15:40:06.074677 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:40:06.074654 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36c3e4bd818e56609ebc65fc5a137891c1cd24a4efcf570279c5dd1a0c404e51\": container with ID starting with 36c3e4bd818e56609ebc65fc5a137891c1cd24a4efcf570279c5dd1a0c404e51 not found: ID does not exist" containerID="36c3e4bd818e56609ebc65fc5a137891c1cd24a4efcf570279c5dd1a0c404e51" Jul 03 15:40:06.074752 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:06.074685 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36c3e4bd818e56609ebc65fc5a137891c1cd24a4efcf570279c5dd1a0c404e51"} err="failed to get container status \"36c3e4bd818e56609ebc65fc5a137891c1cd24a4efcf570279c5dd1a0c404e51\": rpc error: code = NotFound desc = could not find container \"36c3e4bd818e56609ebc65fc5a137891c1cd24a4efcf570279c5dd1a0c404e51\": container with ID starting with 36c3e4bd818e56609ebc65fc5a137891c1cd24a4efcf570279c5dd1a0c404e51 not found: ID does not exist" Jul 03 15:40:06.074752 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:06.074702 2532 scope.go:117] "RemoveContainer" containerID="f5e66ee4a66021097d590aab26fdab95b7ea19a24f402da9f09d7642721a9aad" Jul 03 15:40:06.074948 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:40:06.074924 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5e66ee4a66021097d590aab26fdab95b7ea19a24f402da9f09d7642721a9aad\": container with ID starting with f5e66ee4a66021097d590aab26fdab95b7ea19a24f402da9f09d7642721a9aad not found: ID does not exist" containerID="f5e66ee4a66021097d590aab26fdab95b7ea19a24f402da9f09d7642721a9aad" Jul 03 15:40:06.075007 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:06.074969 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5e66ee4a66021097d590aab26fdab95b7ea19a24f402da9f09d7642721a9aad"} err="failed to get container status \"f5e66ee4a66021097d590aab26fdab95b7ea19a24f402da9f09d7642721a9aad\": rpc error: code = NotFound desc = could not find container \"f5e66ee4a66021097d590aab26fdab95b7ea19a24f402da9f09d7642721a9aad\": container with ID starting with f5e66ee4a66021097d590aab26fdab95b7ea19a24f402da9f09d7642721a9aad not found: ID does not exist" Jul 03 15:40:06.079975 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:06.079922 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" podStartSLOduration=1.079903929 podStartE2EDuration="1.079903929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:40:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:40:06.078427178 +0000 UTC m=+1624.661451028" watchObservedRunningTime="2026-07-03 15:40:06.079903929 +0000 UTC m=+1624.662927759" Jul 03 15:40:06.093118 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:06.093095 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd"] Jul 03 15:40:06.097353 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:06.097323 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-39081e64-openshift-default-757d5b6d99-chphd"] Jul 03 15:40:06.585190 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:06.585149 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:06.680431 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:06.680401 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:06.683984 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:06.683952 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:06.685325 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:06.685302 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:06.757677 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:06.757639 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:07.063410 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:07.063319 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:07.064185 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:07.064164 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:07.315952 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:07.315863 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:07.415784 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:07.415749 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:08.018450 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:08.018419 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6" path="/var/lib/kubelet/pods/af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6/volumes" Jul 03 15:40:08.482239 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:08.482210 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:10.301640 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:10.301609 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:40:11.060934 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:11.060896 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:11.230896 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:11.230865 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs"] Jul 03 15:40:11.231107 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:11.231076 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" podUID="2f013141-3256-4e12-ba83-a2588d117bec" containerName="istio-proxy" containerID="cri-o://4960d69ad12b75b44f416a0afb88152c6f51a4cd5a0f57099c0f35f5a110b1b2" gracePeriod=30 Jul 03 15:40:11.259456 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:11.259255 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:11.359277 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:11.359244 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:11.451450 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:11.451416 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:14.888312 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:14.888277 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:17.024088 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:17.024049 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:17.126360 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:17.126324 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:17.503692 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:17.503660 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:17.600118 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:17.600082 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:17.699577 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:17.699532 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:18.324635 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.324611 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:18.370236 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.370163 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-istio-data\") pod \"2f013141-3256-4e12-ba83-a2588d117bec\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " Jul 03 15:40:18.370236 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.370199 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f013141-3256-4e12-ba83-a2588d117bec-istiod-ca-cert\") pod \"2f013141-3256-4e12-ba83-a2588d117bec\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " Jul 03 15:40:18.370236 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.370222 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f013141-3256-4e12-ba83-a2588d117bec-istio-podinfo\") pod \"2f013141-3256-4e12-ba83-a2588d117bec\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " Jul 03 15:40:18.370494 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.370251 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f013141-3256-4e12-ba83-a2588d117bec-istio-token\") pod \"2f013141-3256-4e12-ba83-a2588d117bec\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " Jul 03 15:40:18.370494 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.370274 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-workload-socket\") pod \"2f013141-3256-4e12-ba83-a2588d117bec\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " Jul 03 15:40:18.370494 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.370338 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fv5r\" (UniqueName: \"kubernetes.io/projected/2f013141-3256-4e12-ba83-a2588d117bec-kube-api-access-2fv5r\") pod \"2f013141-3256-4e12-ba83-a2588d117bec\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " Jul 03 15:40:18.370494 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.370392 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-istio-envoy\") pod \"2f013141-3256-4e12-ba83-a2588d117bec\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " Jul 03 15:40:18.370494 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.370426 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-credential-socket\") pod \"2f013141-3256-4e12-ba83-a2588d117bec\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " Jul 03 15:40:18.370494 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.370452 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-workload-certs\") pod \"2f013141-3256-4e12-ba83-a2588d117bec\" (UID: \"2f013141-3256-4e12-ba83-a2588d117bec\") " Jul 03 15:40:18.370797 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.370634 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f013141-3256-4e12-ba83-a2588d117bec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2f013141-3256-4e12-ba83-a2588d117bec" (UID: "2f013141-3256-4e12-ba83-a2588d117bec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:40:18.370797 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.370786 2532 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f013141-3256-4e12-ba83-a2588d117bec-istiod-ca-cert\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:40:18.370980 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.370946 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2f013141-3256-4e12-ba83-a2588d117bec" (UID: "2f013141-3256-4e12-ba83-a2588d117bec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:40:18.370980 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.370956 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2f013141-3256-4e12-ba83-a2588d117bec" (UID: "2f013141-3256-4e12-ba83-a2588d117bec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:40:18.371108 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.370965 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2f013141-3256-4e12-ba83-a2588d117bec" (UID: "2f013141-3256-4e12-ba83-a2588d117bec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:40:18.371216 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.371187 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-istio-data" (OuterVolumeSpecName: "istio-data") pod "2f013141-3256-4e12-ba83-a2588d117bec" (UID: "2f013141-3256-4e12-ba83-a2588d117bec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:40:18.372556 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.372529 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2f013141-3256-4e12-ba83-a2588d117bec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2f013141-3256-4e12-ba83-a2588d117bec" (UID: "2f013141-3256-4e12-ba83-a2588d117bec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 03 15:40:18.373069 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.373036 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f013141-3256-4e12-ba83-a2588d117bec-istio-token" (OuterVolumeSpecName: "istio-token") pod "2f013141-3256-4e12-ba83-a2588d117bec" (UID: "2f013141-3256-4e12-ba83-a2588d117bec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:40:18.373069 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.373036 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f013141-3256-4e12-ba83-a2588d117bec-kube-api-access-2fv5r" (OuterVolumeSpecName: "kube-api-access-2fv5r") pod "2f013141-3256-4e12-ba83-a2588d117bec" (UID: "2f013141-3256-4e12-ba83-a2588d117bec"). InnerVolumeSpecName "kube-api-access-2fv5r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:40:18.373317 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.373165 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2f013141-3256-4e12-ba83-a2588d117bec" (UID: "2f013141-3256-4e12-ba83-a2588d117bec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:40:18.471829 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.471789 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fv5r\" (UniqueName: \"kubernetes.io/projected/2f013141-3256-4e12-ba83-a2588d117bec-kube-api-access-2fv5r\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:40:18.471829 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.471823 2532 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-istio-envoy\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:40:18.471829 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.471836 2532 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-credential-socket\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:40:18.472066 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.471848 2532 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-workload-certs\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:40:18.472066 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.471862 2532 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-istio-data\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:40:18.472066 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.471874 2532 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f013141-3256-4e12-ba83-a2588d117bec-istio-podinfo\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:40:18.472066 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.471883 2532 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f013141-3256-4e12-ba83-a2588d117bec-istio-token\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:40:18.472066 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:18.471895 2532 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f013141-3256-4e12-ba83-a2588d117bec-workload-socket\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:40:19.135270 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:19.135239 2532 generic.go:356] "Generic (PLEG): container finished" podID="2f013141-3256-4e12-ba83-a2588d117bec" containerID="4960d69ad12b75b44f416a0afb88152c6f51a4cd5a0f57099c0f35f5a110b1b2" exitCode=0 Jul 03 15:40:19.135603 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:19.135285 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" Jul 03 15:40:19.135603 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:19.135289 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" event={"ID":"2f013141-3256-4e12-ba83-a2588d117bec","Type":"ContainerDied","Data":"4960d69ad12b75b44f416a0afb88152c6f51a4cd5a0f57099c0f35f5a110b1b2"} Jul 03 15:40:19.135603 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:19.135444 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs" event={"ID":"2f013141-3256-4e12-ba83-a2588d117bec","Type":"ContainerDied","Data":"808a4e247c3076191678eeebeb999c511e7ef572ee4a70009f9f494c82214d6b"} Jul 03 15:40:19.135603 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:19.135476 2532 scope.go:117] "RemoveContainer" containerID="4960d69ad12b75b44f416a0afb88152c6f51a4cd5a0f57099c0f35f5a110b1b2" Jul 03 15:40:19.146131 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:19.146111 2532 scope.go:117] "RemoveContainer" containerID="4960d69ad12b75b44f416a0afb88152c6f51a4cd5a0f57099c0f35f5a110b1b2" Jul 03 15:40:19.146405 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:40:19.146362 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4960d69ad12b75b44f416a0afb88152c6f51a4cd5a0f57099c0f35f5a110b1b2\": container with ID starting with 4960d69ad12b75b44f416a0afb88152c6f51a4cd5a0f57099c0f35f5a110b1b2 not found: ID does not exist" containerID="4960d69ad12b75b44f416a0afb88152c6f51a4cd5a0f57099c0f35f5a110b1b2" Jul 03 15:40:19.146493 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:19.146416 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4960d69ad12b75b44f416a0afb88152c6f51a4cd5a0f57099c0f35f5a110b1b2"} err="failed to get container status \"4960d69ad12b75b44f416a0afb88152c6f51a4cd5a0f57099c0f35f5a110b1b2\": rpc error: code = NotFound desc = could not find container \"4960d69ad12b75b44f416a0afb88152c6f51a4cd5a0f57099c0f35f5a110b1b2\": container with ID starting with 4960d69ad12b75b44f416a0afb88152c6f51a4cd5a0f57099c0f35f5a110b1b2 not found: ID does not exist" Jul 03 15:40:19.150899 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:19.150877 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:19.177454 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:19.177427 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs"] Jul 03 15:40:19.189131 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:19.189110 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-162414cd-openshift-default-84f7d9fcf5-r8zqs"] Jul 03 15:40:20.017052 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:20.017015 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f013141-3256-4e12-ba83-a2588d117bec" path="/var/lib/kubelet/pods/2f013141-3256-4e12-ba83-a2588d117bec/volumes" Jul 03 15:40:21.202556 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:21.202524 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:40:24.963876 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:24.963840 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:25.113359 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:25.113324 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:25.199771 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:25.199731 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:25.300861 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:25.300771 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:25.654513 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:25.654477 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:51.624998 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:51.624955 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:57.482487 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:57.482448 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:57.610888 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:57.610850 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:40:57.766883 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:40:57.766788 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:13.623606 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:13.623569 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:19.333445 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:19.333401 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:19.441980 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:19.441940 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:19.564976 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:19.564942 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:30.078653 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:30.078550 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:30.879277 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:30.879245 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:36.939633 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:36.939590 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:37.060158 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:37.060119 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:37.160162 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:37.160123 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:37.264902 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:37.264797 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:38.029796 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:38.029762 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:38.130042 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:38.130009 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:38.232730 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:38.232695 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:39.104061 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:39.104027 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:41:39.848649 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:39.848613 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:45.879997 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:45.879960 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:45.959060 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:45.959020 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:46.424611 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:46.424572 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:41:46.595935 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:46.595894 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:52.724561 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:52.724498 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:52.838918 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:52.838866 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:52.986354 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:52.986263 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:53.264518 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.264441 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb"] Jul 03 15:41:53.264874 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.264859 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f013141-3256-4e12-ba83-a2588d117bec" containerName="istio-proxy" Jul 03 15:41:53.264953 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.264877 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f013141-3256-4e12-ba83-a2588d117bec" containerName="istio-proxy" Jul 03 15:41:53.264953 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.264891 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6" containerName="istio-proxy" Jul 03 15:41:53.264953 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.264896 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="af45ecb7-3cfc-4fee-bd66-e6ecfd7655a6" containerName="istio-proxy" Jul 03 15:41:53.265082 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.264972 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f013141-3256-4e12-ba83-a2588d117bec" containerName="istio-proxy" Jul 03 15:41:53.268165 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.268147 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.270801 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.270781 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f7d4fbbe-openshift-default-dockercfg-kkqx5\"" Jul 03 15:41:53.292943 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.292919 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb"] Jul 03 15:41:53.298069 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.298020 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:53.299182 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.299160 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t968m\" (UniqueName: \"kubernetes.io/projected/c9cb9d6f-7468-4d70-a110-18bae208f484-kube-api-access-t968m\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.299273 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.299190 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9cb9d6f-7468-4d70-a110-18bae208f484-istiod-ca-cert\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.299273 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.299225 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-data\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.299380 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.299304 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-credential-socket\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.299380 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.299335 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-envoy\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.299463 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.299360 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-workload-certs\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.299463 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.299432 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-workload-socket\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.299463 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.299455 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-token\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.299564 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.299471 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-podinfo\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.400699 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.400660 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t968m\" (UniqueName: \"kubernetes.io/projected/c9cb9d6f-7468-4d70-a110-18bae208f484-kube-api-access-t968m\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.400891 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.400702 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9cb9d6f-7468-4d70-a110-18bae208f484-istiod-ca-cert\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.400891 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.400744 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-data\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.400891 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.400787 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-credential-socket\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.401070 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.400931 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-envoy\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.401070 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.400979 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-workload-certs\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.401174 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.401100 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-workload-socket\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.401174 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.401148 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-token\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.401571 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.401172 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-podinfo\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.401571 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.401214 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-credential-socket\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.401571 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.401247 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-data\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.401571 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.401455 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-workload-socket\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.401969 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.401604 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-workload-certs\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.401969 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.401654 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9cb9d6f-7468-4d70-a110-18bae208f484-istiod-ca-cert\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.403427 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.403407 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-envoy\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.403668 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.403649 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-podinfo\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.410510 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.410488 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t968m\" (UniqueName: \"kubernetes.io/projected/c9cb9d6f-7468-4d70-a110-18bae208f484-kube-api-access-t968m\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.411407 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.411385 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-token\") pod \"e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.462873 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.462846 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:53.579403 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.579360 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:53.608795 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.608768 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:41:53.725980 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.725956 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb"] Jul 03 15:41:53.728122 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:41:53.728099 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9cb9d6f_7468_4d70_a110_18bae208f484.slice/crio-c0268189ba423c0e86bfbba7d5fc5db8a083dbeaeba897f5ff4c38bb5768b09b WatchSource:0}: Error finding container c0268189ba423c0e86bfbba7d5fc5db8a083dbeaeba897f5ff4c38bb5768b09b: Status 404 returned error can't find the container with id c0268189ba423c0e86bfbba7d5fc5db8a083dbeaeba897f5ff4c38bb5768b09b Jul 03 15:41:53.730325 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.730289 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:41:53.730415 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.730394 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:41:53.730466 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:53.730447 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:41:54.607229 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:54.607196 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" event={"ID":"c9cb9d6f-7468-4d70-a110-18bae208f484","Type":"ContainerStarted","Data":"c988cb562b8b51675c1519744dc0bf61a948a94881fe412c9085ddd41faa6ae2"} Jul 03 15:41:54.607431 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:54.607248 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" event={"ID":"c9cb9d6f-7468-4d70-a110-18bae208f484","Type":"ContainerStarted","Data":"c0268189ba423c0e86bfbba7d5fc5db8a083dbeaeba897f5ff4c38bb5768b09b"} Jul 03 15:41:54.628777 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:54.628717 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" podStartSLOduration=1.62870285 podStartE2EDuration="1.62870285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:41:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:41:54.628512544 +0000 UTC m=+1733.211536375" watchObservedRunningTime="2026-07-03 15:41:54.62870285 +0000 UTC m=+1733.211726678" Jul 03 15:41:55.580330 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:55.580291 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:55.584883 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:55.584863 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:55.613511 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:55.613482 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:55.614412 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:55.614360 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:41:56.670072 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:56.670034 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:56.764444 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:56.764410 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:56.863485 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:56.863448 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:57.210901 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:57.210866 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:57.430404 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:57.430355 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:41:57.535069 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:41:57.534978 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:01.147568 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:01.147525 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:01.509502 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:01.509416 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:42:01.811695 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:01.811600 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:01.920995 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:01.920951 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:02.271322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:02.271281 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:08.004743 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:08.004700 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:08.067788 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:08.067751 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:08.420536 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:08.420498 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:08.754934 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:08.754853 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:08.854166 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:08.854125 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:09.695960 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:09.695859 2532 generic.go:356] "Generic (PLEG): container finished" podID="c9cb9d6f-7468-4d70-a110-18bae208f484" containerID="c988cb562b8b51675c1519744dc0bf61a948a94881fe412c9085ddd41faa6ae2" exitCode=0 Jul 03 15:42:09.695960 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:09.695948 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" event={"ID":"c9cb9d6f-7468-4d70-a110-18bae208f484","Type":"ContainerDied","Data":"c988cb562b8b51675c1519744dc0bf61a948a94881fe412c9085ddd41faa6ae2"} Jul 03 15:42:09.696467 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:09.696410 2532 scope.go:117] "RemoveContainer" containerID="c988cb562b8b51675c1519744dc0bf61a948a94881fe412c9085ddd41faa6ae2" Jul 03 15:42:09.697422 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:09.697396 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:42:09.697492 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:09.697461 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:42:09.697532 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:09.697501 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:42:10.613958 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:10.613920 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:42:10.703776 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:10.703742 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" event={"ID":"c9cb9d6f-7468-4d70-a110-18bae208f484","Type":"ContainerStarted","Data":"3c9a9a7358413a52dcd8b0e4071637f57927df43ef730723b3907f3df007857f"} Jul 03 15:42:11.509932 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:11.509899 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:42:11.579821 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:11.579785 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:42:11.580963 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:11.580938 2532 patch_prober.go:28] interesting pod/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 03 15:42:11.581093 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:11.580996 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" podUID="c9cb9d6f-7468-4d70-a110-18bae208f484" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 03 15:42:12.579855 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:12.579821 2532 patch_prober.go:28] interesting pod/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 03 15:42:12.580259 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:12.579887 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" podUID="c9cb9d6f-7468-4d70-a110-18bae208f484" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 03 15:42:13.579952 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:13.579918 2532 patch_prober.go:28] interesting pod/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 03 15:42:13.580333 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:13.579986 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" podUID="c9cb9d6f-7468-4d70-a110-18bae208f484" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 03 15:42:14.584125 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:14.584094 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:42:14.584518 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:14.584385 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:42:14.585090 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:14.585071 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:42:14.989629 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:14.989544 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:15.086280 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:15.086244 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:15.223467 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:15.223431 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb"] Jul 03 15:42:15.250872 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:15.250779 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:15.472972 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:15.472938 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:15.612636 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:15.612598 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:15.711115 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:15.711083 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:15.730357 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:15.730330 2532 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" secret="" err="secret \"e2e-mt-f7d4fbbe-openshift-default-dockercfg-kkqx5\" not found" Jul 03 15:42:15.813183 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:15.813150 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:16.735147 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:16.735076 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" podUID="c9cb9d6f-7468-4d70-a110-18bae208f484" containerName="istio-proxy" containerID="cri-o://3c9a9a7358413a52dcd8b0e4071637f57927df43ef730723b3907f3df007857f" gracePeriod=30 Jul 03 15:42:21.740959 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:21.740921 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:21.814736 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:21.814699 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:21.908053 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:21.908018 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:21.998935 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:21.998880 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:42:22.004468 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.004437 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:22.104696 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.104663 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:22.162720 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.162684 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9cb9d6f-7468-4d70-a110-18bae208f484-istiod-ca-cert\") pod \"c9cb9d6f-7468-4d70-a110-18bae208f484\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " Jul 03 15:42:22.162720 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.162721 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-workload-certs\") pod \"c9cb9d6f-7468-4d70-a110-18bae208f484\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " Jul 03 15:42:22.162975 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.162744 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-token\") pod \"c9cb9d6f-7468-4d70-a110-18bae208f484\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " Jul 03 15:42:22.162975 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.162797 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-data\") pod \"c9cb9d6f-7468-4d70-a110-18bae208f484\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " Jul 03 15:42:22.162975 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.162818 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-envoy\") pod \"c9cb9d6f-7468-4d70-a110-18bae208f484\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " Jul 03 15:42:22.162975 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.162862 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-workload-socket\") pod \"c9cb9d6f-7468-4d70-a110-18bae208f484\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " Jul 03 15:42:22.162975 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.162894 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-credential-socket\") pod \"c9cb9d6f-7468-4d70-a110-18bae208f484\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " Jul 03 15:42:22.162975 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.162916 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-podinfo\") pod \"c9cb9d6f-7468-4d70-a110-18bae208f484\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " Jul 03 15:42:22.162975 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.162962 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t968m\" (UniqueName: \"kubernetes.io/projected/c9cb9d6f-7468-4d70-a110-18bae208f484-kube-api-access-t968m\") pod \"c9cb9d6f-7468-4d70-a110-18bae208f484\" (UID: \"c9cb9d6f-7468-4d70-a110-18bae208f484\") " Jul 03 15:42:22.163326 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.163032 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c9cb9d6f-7468-4d70-a110-18bae208f484" (UID: "c9cb9d6f-7468-4d70-a110-18bae208f484"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:42:22.163326 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.163203 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c9cb9d6f-7468-4d70-a110-18bae208f484" (UID: "c9cb9d6f-7468-4d70-a110-18bae208f484"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:42:22.163326 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.163219 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9cb9d6f-7468-4d70-a110-18bae208f484-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c9cb9d6f-7468-4d70-a110-18bae208f484" (UID: "c9cb9d6f-7468-4d70-a110-18bae208f484"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:42:22.163326 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.163210 2532 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-workload-certs\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:42:22.163326 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.163304 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c9cb9d6f-7468-4d70-a110-18bae208f484" (UID: "c9cb9d6f-7468-4d70-a110-18bae208f484"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:42:22.164315 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.164285 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-data" (OuterVolumeSpecName: "istio-data") pod "c9cb9d6f-7468-4d70-a110-18bae208f484" (UID: "c9cb9d6f-7468-4d70-a110-18bae208f484"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:42:22.165414 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.165363 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9cb9d6f-7468-4d70-a110-18bae208f484-kube-api-access-t968m" (OuterVolumeSpecName: "kube-api-access-t968m") pod "c9cb9d6f-7468-4d70-a110-18bae208f484" (UID: "c9cb9d6f-7468-4d70-a110-18bae208f484"). InnerVolumeSpecName "kube-api-access-t968m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:42:22.165519 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.165434 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-token" (OuterVolumeSpecName: "istio-token") pod "c9cb9d6f-7468-4d70-a110-18bae208f484" (UID: "c9cb9d6f-7468-4d70-a110-18bae208f484"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:42:22.165604 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.165583 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c9cb9d6f-7468-4d70-a110-18bae208f484" (UID: "c9cb9d6f-7468-4d70-a110-18bae208f484"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 03 15:42:22.165649 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.165590 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c9cb9d6f-7468-4d70-a110-18bae208f484" (UID: "c9cb9d6f-7468-4d70-a110-18bae208f484"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:42:22.263919 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.263822 2532 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-envoy\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:42:22.263919 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.263846 2532 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-workload-socket\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:42:22.263919 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.263855 2532 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-credential-socket\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:42:22.263919 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.263865 2532 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-podinfo\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:42:22.263919 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.263874 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t968m\" (UniqueName: \"kubernetes.io/projected/c9cb9d6f-7468-4d70-a110-18bae208f484-kube-api-access-t968m\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:42:22.263919 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.263883 2532 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9cb9d6f-7468-4d70-a110-18bae208f484-istiod-ca-cert\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:42:22.263919 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.263891 2532 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-token\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:42:22.263919 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.263898 2532 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9cb9d6f-7468-4d70-a110-18bae208f484-istio-data\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:42:22.768656 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.768621 2532 generic.go:356] "Generic (PLEG): container finished" podID="c9cb9d6f-7468-4d70-a110-18bae208f484" containerID="3c9a9a7358413a52dcd8b0e4071637f57927df43ef730723b3907f3df007857f" exitCode=0 Jul 03 15:42:22.769159 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.768668 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" event={"ID":"c9cb9d6f-7468-4d70-a110-18bae208f484","Type":"ContainerDied","Data":"3c9a9a7358413a52dcd8b0e4071637f57927df43ef730723b3907f3df007857f"} Jul 03 15:42:22.769159 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.768692 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" Jul 03 15:42:22.769159 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.768710 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb" event={"ID":"c9cb9d6f-7468-4d70-a110-18bae208f484","Type":"ContainerDied","Data":"c0268189ba423c0e86bfbba7d5fc5db8a083dbeaeba897f5ff4c38bb5768b09b"} Jul 03 15:42:22.769159 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.768734 2532 scope.go:117] "RemoveContainer" containerID="3c9a9a7358413a52dcd8b0e4071637f57927df43ef730723b3907f3df007857f" Jul 03 15:42:22.778107 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.778088 2532 scope.go:117] "RemoveContainer" containerID="c988cb562b8b51675c1519744dc0bf61a948a94881fe412c9085ddd41faa6ae2" Jul 03 15:42:22.786795 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.786778 2532 scope.go:117] "RemoveContainer" containerID="3c9a9a7358413a52dcd8b0e4071637f57927df43ef730723b3907f3df007857f" Jul 03 15:42:22.787077 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:42:22.787056 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c9a9a7358413a52dcd8b0e4071637f57927df43ef730723b3907f3df007857f\": container with ID starting with 3c9a9a7358413a52dcd8b0e4071637f57927df43ef730723b3907f3df007857f not found: ID does not exist" containerID="3c9a9a7358413a52dcd8b0e4071637f57927df43ef730723b3907f3df007857f" Jul 03 15:42:22.787138 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.787084 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c9a9a7358413a52dcd8b0e4071637f57927df43ef730723b3907f3df007857f"} err="failed to get container status \"3c9a9a7358413a52dcd8b0e4071637f57927df43ef730723b3907f3df007857f\": rpc error: code = NotFound desc = could not find container \"3c9a9a7358413a52dcd8b0e4071637f57927df43ef730723b3907f3df007857f\": container with ID starting with 3c9a9a7358413a52dcd8b0e4071637f57927df43ef730723b3907f3df007857f not found: ID does not exist" Jul 03 15:42:22.787138 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.787104 2532 scope.go:117] "RemoveContainer" containerID="c988cb562b8b51675c1519744dc0bf61a948a94881fe412c9085ddd41faa6ae2" Jul 03 15:42:22.787345 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:42:22.787322 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c988cb562b8b51675c1519744dc0bf61a948a94881fe412c9085ddd41faa6ae2\": container with ID starting with c988cb562b8b51675c1519744dc0bf61a948a94881fe412c9085ddd41faa6ae2 not found: ID does not exist" containerID="c988cb562b8b51675c1519744dc0bf61a948a94881fe412c9085ddd41faa6ae2" Jul 03 15:42:22.787460 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.787346 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c988cb562b8b51675c1519744dc0bf61a948a94881fe412c9085ddd41faa6ae2"} err="failed to get container status \"c988cb562b8b51675c1519744dc0bf61a948a94881fe412c9085ddd41faa6ae2\": rpc error: code = NotFound desc = could not find container \"c988cb562b8b51675c1519744dc0bf61a948a94881fe412c9085ddd41faa6ae2\": container with ID starting with c988cb562b8b51675c1519744dc0bf61a948a94881fe412c9085ddd41faa6ae2 not found: ID does not exist" Jul 03 15:42:22.798526 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.798504 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb"] Jul 03 15:42:22.802459 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:22.802440 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f7d4fbbe-openshift-default-866d96667f-dnqgb"] Jul 03 15:42:24.017382 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:24.017345 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9cb9d6f-7468-4d70-a110-18bae208f484" path="/var/lib/kubelet/pods/c9cb9d6f-7468-4d70-a110-18bae208f484/volumes" Jul 03 15:42:27.828175 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:27.828138 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:27.927455 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:27.927429 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:34.246023 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.245987 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:34.522417 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.522311 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p"] Jul 03 15:42:34.522805 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.522786 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9cb9d6f-7468-4d70-a110-18bae208f484" containerName="istio-proxy" Jul 03 15:42:34.522896 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.522808 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9cb9d6f-7468-4d70-a110-18bae208f484" containerName="istio-proxy" Jul 03 15:42:34.522896 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.522826 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9cb9d6f-7468-4d70-a110-18bae208f484" containerName="istio-proxy" Jul 03 15:42:34.522896 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.522834 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9cb9d6f-7468-4d70-a110-18bae208f484" containerName="istio-proxy" Jul 03 15:42:34.523043 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.522926 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9cb9d6f-7468-4d70-a110-18bae208f484" containerName="istio-proxy" Jul 03 15:42:34.523043 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.522938 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9cb9d6f-7468-4d70-a110-18bae208f484" containerName="istio-proxy" Jul 03 15:42:34.525050 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.525030 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.529351 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.529331 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-37d20861-openshift-default-dockercfg-l4gz5\"" Jul 03 15:42:34.542908 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.542875 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p"] Jul 03 15:42:34.561186 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.561155 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:34.675461 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.675424 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99v4w\" (UniqueName: \"kubernetes.io/projected/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-kube-api-access-99v4w\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.675686 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.675473 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-credential-socket\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.675686 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.675502 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-workload-certs\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.675686 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.675547 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-podinfo\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.675686 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.675572 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-token\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.675686 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.675657 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-workload-socket\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.675854 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.675687 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istiod-ca-cert\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.675854 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.675707 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-envoy\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.675854 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.675771 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-data\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.777238 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.777151 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-workload-socket\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.777238 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.777202 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istiod-ca-cert\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.777238 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.777227 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-envoy\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.777568 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.777269 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-data\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.777568 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.777404 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99v4w\" (UniqueName: \"kubernetes.io/projected/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-kube-api-access-99v4w\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.777568 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.777467 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-credential-socket\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.777568 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.777512 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-workload-certs\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.777568 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.777522 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-workload-socket\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.777568 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.777557 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-podinfo\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.777890 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.777600 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-token\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.777890 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.777748 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-workload-certs\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.777890 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.777823 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-credential-socket\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.778049 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.777957 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istiod-ca-cert\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.778049 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.778007 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-data\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.779627 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.779607 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-envoy\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.780001 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.779985 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-podinfo\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.785867 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.785846 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-token\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.786405 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.786360 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99v4w\" (UniqueName: \"kubernetes.io/projected/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-kube-api-access-99v4w\") pod \"e2e-mt-37d20861-openshift-default-748c688c87-nct2p\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.835318 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.835289 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:34.860013 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.859969 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:34.981831 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.981796 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p"] Jul 03 15:42:34.984443 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:42:34.984417 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd89ec53b_e284_4d5a_b466_5daf8cbd63f7.slice/crio-39ee4476175953c88e9a198a698888cd6a7475ce2a101cf31f8b9a9f96de2b34 WatchSource:0}: Error finding container 39ee4476175953c88e9a198a698888cd6a7475ce2a101cf31f8b9a9f96de2b34: Status 404 returned error can't find the container with id 39ee4476175953c88e9a198a698888cd6a7475ce2a101cf31f8b9a9f96de2b34 Jul 03 15:42:34.986534 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.986499 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:42:34.986651 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.986577 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:42:34.986651 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:34.986625 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:42:35.836501 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:35.836471 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" event={"ID":"d89ec53b-e284-4d5a-b466-5daf8cbd63f7","Type":"ContainerStarted","Data":"0b21c9d6d1d7b052fd29260bd7cc91459221ae0a325d926eb240068f8b05af61"} Jul 03 15:42:35.836916 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:35.836518 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" event={"ID":"d89ec53b-e284-4d5a-b466-5daf8cbd63f7","Type":"ContainerStarted","Data":"39ee4476175953c88e9a198a698888cd6a7475ce2a101cf31f8b9a9f96de2b34"} Jul 03 15:42:35.875009 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:35.874953 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" podStartSLOduration=1.874938826 podStartE2EDuration="1.874938826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:42:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:42:35.873611883 +0000 UTC m=+1774.456635711" watchObservedRunningTime="2026-07-03 15:42:35.874938826 +0000 UTC m=+1774.457962655" Jul 03 15:42:36.835684 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:36.835653 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:36.841850 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:36.841816 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:36.843477 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:36.843420 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:36.844212 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:36.844193 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:37.974602 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:37.974569 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:38.073457 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:38.073422 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:38.174028 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:38.173995 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:38.474168 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:38.474137 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:38.726633 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:38.726530 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:38.869495 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:38.869461 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:40.206555 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:40.206523 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:42:42.373348 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:42.373300 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:47.903938 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:47.903848 2532 generic.go:356] "Generic (PLEG): container finished" podID="d89ec53b-e284-4d5a-b466-5daf8cbd63f7" containerID="0b21c9d6d1d7b052fd29260bd7cc91459221ae0a325d926eb240068f8b05af61" exitCode=0 Jul 03 15:42:47.903938 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:47.903921 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" event={"ID":"d89ec53b-e284-4d5a-b466-5daf8cbd63f7","Type":"ContainerDied","Data":"0b21c9d6d1d7b052fd29260bd7cc91459221ae0a325d926eb240068f8b05af61"} Jul 03 15:42:47.904526 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:47.904449 2532 scope.go:117] "RemoveContainer" containerID="0b21c9d6d1d7b052fd29260bd7cc91459221ae0a325d926eb240068f8b05af61" Jul 03 15:42:47.905506 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:47.905476 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:42:47.905614 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:47.905581 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:42:47.905718 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:47.905630 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:42:48.910282 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:48.910245 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" event={"ID":"d89ec53b-e284-4d5a-b466-5daf8cbd63f7","Type":"ContainerStarted","Data":"f0f979b5051a1f188b4d04166293d281499141e05504067e8b6241d2e0b5f13e"} Jul 03 15:42:49.836468 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:49.836428 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:49.837783 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:49.837744 2532 patch_prober.go:28] interesting pod/e2e-mt-37d20861-openshift-default-748c688c87-nct2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 03 15:42:49.837947 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:49.837817 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" podUID="d89ec53b-e284-4d5a-b466-5daf8cbd63f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 03 15:42:50.836689 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:50.836653 2532 patch_prober.go:28] interesting pod/e2e-mt-37d20861-openshift-default-748c688c87-nct2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 03 15:42:50.837069 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:50.836715 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" podUID="d89ec53b-e284-4d5a-b466-5daf8cbd63f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 03 15:42:51.836429 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:51.836393 2532 patch_prober.go:28] interesting pod/e2e-mt-37d20861-openshift-default-748c688c87-nct2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 03 15:42:51.836611 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:51.836460 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" podUID="d89ec53b-e284-4d5a-b466-5daf8cbd63f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 03 15:42:51.844392 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:51.844333 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:52.840573 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:52.840490 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:52.841382 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:52.841350 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:42:55.576615 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:55.576577 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:55.681068 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:55.681027 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:58.924137 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:58.924102 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2"] Jul 03 15:42:58.927963 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:58.927945 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:42:58.930858 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:58.930839 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-37d20861\"/\"kube-root-ca.crt\"" Jul 03 15:42:58.931667 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:58.931646 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-37d20861\"/\"openshift-service-ca.crt\"" Jul 03 15:42:58.931773 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:58.931676 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-37d20861\"/\"default-dockercfg-xz4cd\"" Jul 03 15:42:58.931773 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:58.931714 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-37d20861\"/\"e2e-lifecycle-model-37d20861-kserve-self-signed-certs\"" Jul 03 15:42:58.941846 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:58.941816 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2"] Jul 03 15:42:58.967409 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:58.967358 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:58.987606 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:58.987574 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-home\") pod \"e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:42:58.987712 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:58.987621 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-model-cache\") pod \"e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:42:58.987712 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:58.987641 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-tmp-dir\") pod \"e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:42:58.987789 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:58.987711 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-dshm\") pod \"e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:42:58.987789 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:58.987742 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwthh\" (UniqueName: \"kubernetes.io/projected/38514223-4db3-4377-817c-e7243961de08-kube-api-access-cwthh\") pod \"e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:42:58.987857 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:58.987787 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38514223-4db3-4377-817c-e7243961de08-tls-certs\") pod \"e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:42:59.088411 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:59.088352 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-dshm\") pod \"e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:42:59.088411 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:59.088405 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwthh\" (UniqueName: \"kubernetes.io/projected/38514223-4db3-4377-817c-e7243961de08-kube-api-access-cwthh\") pod \"e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:42:59.088624 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:59.088450 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38514223-4db3-4377-817c-e7243961de08-tls-certs\") pod \"e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:42:59.088624 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:59.088501 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-home\") pod \"e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:42:59.088624 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:59.088563 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-model-cache\") pod \"e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:42:59.088624 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:59.088604 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-tmp-dir\") pod \"e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:42:59.088925 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:59.088904 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-home\") pod \"e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:42:59.089004 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:59.088948 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-tmp-dir\") pod \"e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:42:59.089004 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:59.088972 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-model-cache\") pod \"e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:42:59.090844 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:59.090828 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-dshm\") pod \"e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:42:59.091096 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:59.091080 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38514223-4db3-4377-817c-e7243961de08-tls-certs\") pod \"e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:42:59.101558 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:59.101530 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwthh\" (UniqueName: \"kubernetes.io/projected/38514223-4db3-4377-817c-e7243961de08-kube-api-access-cwthh\") pod \"e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:42:59.237635 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:59.237541 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:42:59.383731 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:59.383705 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2"] Jul 03 15:42:59.385360 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:42:59.385329 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38514223_4db3_4377_817c_e7243961de08.slice/crio-b95977309b010c67e8247d4ec36f38a87509b17f2afcd11423ab3e48aa06f361 WatchSource:0}: Error finding container b95977309b010c67e8247d4ec36f38a87509b17f2afcd11423ab3e48aa06f361: Status 404 returned error can't find the container with id b95977309b010c67e8247d4ec36f38a87509b17f2afcd11423ab3e48aa06f361 Jul 03 15:42:59.548528 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:59.548441 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:59.671432 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:59.671391 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:42:59.970185 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:59.970150 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" event={"ID":"38514223-4db3-4377-817c-e7243961de08","Type":"ContainerStarted","Data":"6ff090dc942cfd12fd441140f390968bbb0825650563fa93cb83333dfd1b5e71"} Jul 03 15:42:59.970653 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:59.970195 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" event={"ID":"38514223-4db3-4377-817c-e7243961de08","Type":"ContainerStarted","Data":"b95977309b010c67e8247d4ec36f38a87509b17f2afcd11423ab3e48aa06f361"} Jul 03 15:42:59.996137 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:42:59.996089 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" podStartSLOduration=1.9960743170000002 podStartE2EDuration="1.996074317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:42:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:42:59.993427352 +0000 UTC m=+1798.576451182" watchObservedRunningTime="2026-07-03 15:42:59.996074317 +0000 UTC m=+1798.579098146" Jul 03 15:43:02.025533 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:02.025492 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:43:02.031841 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:02.031819 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/1.log" Jul 03 15:43:02.033626 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:02.033604 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/1.log" Jul 03 15:43:02.035062 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:02.035041 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5hcn_df460999-eb58-4575-91fc-8130653c6f5b/ovn-acl-logging/0.log" Jul 03 15:43:02.036939 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:02.036922 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5hcn_df460999-eb58-4575-91fc-8130653c6f5b/ovn-acl-logging/0.log" Jul 03 15:43:09.238498 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:09.238462 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:43:09.238936 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:09.238513 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:43:09.251218 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:09.251193 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:43:10.033306 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:10.033278 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:43:17.522214 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:17.522176 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:43:20.029898 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:20.029858 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:43:20.432142 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:20.432083 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:43:26.081699 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:26.081669 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:43:31.199028 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:31.198994 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2"] Jul 03 15:43:31.302863 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:31.302828 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:43:31.340032 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:31.339983 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:43:46.220362 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:46.220292 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" podUID="38514223-4db3-4377-817c-e7243961de08" containerName="main" containerID="cri-o://6ff090dc942cfd12fd441140f390968bbb0825650563fa93cb83333dfd1b5e71" gracePeriod=45 Jul 03 15:43:46.482056 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:46.481997 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:43:46.517153 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:46.517127 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-model-cache\") pod \"38514223-4db3-4377-817c-e7243961de08\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " Jul 03 15:43:46.517322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:46.517188 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-tmp-dir\") pod \"38514223-4db3-4377-817c-e7243961de08\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " Jul 03 15:43:46.517322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:46.517222 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwthh\" (UniqueName: \"kubernetes.io/projected/38514223-4db3-4377-817c-e7243961de08-kube-api-access-cwthh\") pod \"38514223-4db3-4377-817c-e7243961de08\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " Jul 03 15:43:46.517322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:46.517254 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-dshm\") pod \"38514223-4db3-4377-817c-e7243961de08\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " Jul 03 15:43:46.517322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:46.517279 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38514223-4db3-4377-817c-e7243961de08-tls-certs\") pod \"38514223-4db3-4377-817c-e7243961de08\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " Jul 03 15:43:46.517572 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:46.517392 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-home\") pod \"38514223-4db3-4377-817c-e7243961de08\" (UID: \"38514223-4db3-4377-817c-e7243961de08\") " Jul 03 15:43:46.517572 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:46.517484 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-model-cache" (OuterVolumeSpecName: "model-cache") pod "38514223-4db3-4377-817c-e7243961de08" (UID: "38514223-4db3-4377-817c-e7243961de08"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:43:46.517678 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:46.517579 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "38514223-4db3-4377-817c-e7243961de08" (UID: "38514223-4db3-4377-817c-e7243961de08"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:43:46.517744 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:46.517684 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-home" (OuterVolumeSpecName: "home") pod "38514223-4db3-4377-817c-e7243961de08" (UID: "38514223-4db3-4377-817c-e7243961de08"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:43:46.517799 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:46.517765 2532 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-home\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:43:46.517799 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:46.517785 2532 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-model-cache\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:43:46.517911 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:46.517800 2532 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-tmp-dir\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:43:46.519768 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:46.519732 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-dshm" (OuterVolumeSpecName: "dshm") pod "38514223-4db3-4377-817c-e7243961de08" (UID: "38514223-4db3-4377-817c-e7243961de08"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:43:46.519768 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:46.519735 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38514223-4db3-4377-817c-e7243961de08-kube-api-access-cwthh" (OuterVolumeSpecName: "kube-api-access-cwthh") pod "38514223-4db3-4377-817c-e7243961de08" (UID: "38514223-4db3-4377-817c-e7243961de08"). InnerVolumeSpecName "kube-api-access-cwthh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:43:46.520073 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:46.520050 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38514223-4db3-4377-817c-e7243961de08-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "38514223-4db3-4377-817c-e7243961de08" (UID: "38514223-4db3-4377-817c-e7243961de08"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 15:43:46.619107 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:46.619075 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwthh\" (UniqueName: \"kubernetes.io/projected/38514223-4db3-4377-817c-e7243961de08-kube-api-access-cwthh\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:43:46.619107 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:46.619105 2532 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38514223-4db3-4377-817c-e7243961de08-dshm\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:43:46.619107 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:46.619115 2532 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38514223-4db3-4377-817c-e7243961de08-tls-certs\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:43:47.214627 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:47.214586 2532 generic.go:356] "Generic (PLEG): container finished" podID="38514223-4db3-4377-817c-e7243961de08" containerID="6ff090dc942cfd12fd441140f390968bbb0825650563fa93cb83333dfd1b5e71" exitCode=0 Jul 03 15:43:47.214627 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:47.214630 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" Jul 03 15:43:47.214849 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:47.214644 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" event={"ID":"38514223-4db3-4377-817c-e7243961de08","Type":"ContainerDied","Data":"6ff090dc942cfd12fd441140f390968bbb0825650563fa93cb83333dfd1b5e71"} Jul 03 15:43:47.214849 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:47.214684 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2" event={"ID":"38514223-4db3-4377-817c-e7243961de08","Type":"ContainerDied","Data":"b95977309b010c67e8247d4ec36f38a87509b17f2afcd11423ab3e48aa06f361"} Jul 03 15:43:47.214849 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:47.214707 2532 scope.go:117] "RemoveContainer" containerID="6ff090dc942cfd12fd441140f390968bbb0825650563fa93cb83333dfd1b5e71" Jul 03 15:43:47.224059 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:47.223843 2532 scope.go:117] "RemoveContainer" containerID="6ff090dc942cfd12fd441140f390968bbb0825650563fa93cb83333dfd1b5e71" Jul 03 15:43:47.224291 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:43:47.224107 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ff090dc942cfd12fd441140f390968bbb0825650563fa93cb83333dfd1b5e71\": container with ID starting with 6ff090dc942cfd12fd441140f390968bbb0825650563fa93cb83333dfd1b5e71 not found: ID does not exist" containerID="6ff090dc942cfd12fd441140f390968bbb0825650563fa93cb83333dfd1b5e71" Jul 03 15:43:47.224291 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:47.224128 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ff090dc942cfd12fd441140f390968bbb0825650563fa93cb83333dfd1b5e71"} err="failed to get container status \"6ff090dc942cfd12fd441140f390968bbb0825650563fa93cb83333dfd1b5e71\": rpc error: code = NotFound desc = could not find container \"6ff090dc942cfd12fd441140f390968bbb0825650563fa93cb83333dfd1b5e71\": container with ID starting with 6ff090dc942cfd12fd441140f390968bbb0825650563fa93cb83333dfd1b5e71 not found: ID does not exist" Jul 03 15:43:47.236959 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:47.236930 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2"] Jul 03 15:43:47.240656 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:47.240636 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-37d20861/e2e-lifecycle-model-37d20861-kserve-889c78f8c-bzpt2"] Jul 03 15:43:48.017748 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:43:48.017717 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38514223-4db3-4377-817c-e7243961de08" path="/var/lib/kubelet/pods/38514223-4db3-4377-817c-e7243961de08/volumes" Jul 03 15:44:07.490539 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:07.490507 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:44:08.692635 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:08.692602 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:44:10.801969 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:10.801932 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:44:14.223765 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:14.223730 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:44:14.299251 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:14.299212 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:44:14.561123 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:14.561040 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p"] Jul 03 15:44:14.561273 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:14.561243 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" podUID="d89ec53b-e284-4d5a-b466-5daf8cbd63f7" containerName="istio-proxy" containerID="cri-o://f0f979b5051a1f188b4d04166293d281499141e05504067e8b6241d2e0b5f13e" gracePeriod=30 Jul 03 15:44:14.573993 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:14.573955 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:44:14.766184 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:14.766153 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:44:15.852862 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:15.852805 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:44:15.938532 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:15.938489 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:44:16.040385 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:16.040324 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:44:16.761471 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:16.761442 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:44:16.852951 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:16.852918 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:44:16.953181 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:16.953140 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:44:18.353053 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:18.353019 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:44:19.508298 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.508263 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:44:19.819837 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.819813 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:44:19.824598 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.824578 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99v4w\" (UniqueName: \"kubernetes.io/projected/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-kube-api-access-99v4w\") pod \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " Jul 03 15:44:19.824701 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.824607 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-token\") pod \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " Jul 03 15:44:19.824701 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.824625 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-podinfo\") pod \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " Jul 03 15:44:19.824701 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.824661 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-credential-socket\") pod \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " Jul 03 15:44:19.824869 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.824703 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istiod-ca-cert\") pod \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " Jul 03 15:44:19.824869 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.824757 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-workload-socket\") pod \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " Jul 03 15:44:19.824869 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.824799 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-workload-certs\") pod \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " Jul 03 15:44:19.824869 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.824824 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-envoy\") pod \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " Jul 03 15:44:19.824869 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.824849 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-data\") pod \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\" (UID: \"d89ec53b-e284-4d5a-b466-5daf8cbd63f7\") " Jul 03 15:44:19.825635 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.825170 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d89ec53b-e284-4d5a-b466-5daf8cbd63f7" (UID: "d89ec53b-e284-4d5a-b466-5daf8cbd63f7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:44:19.825635 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.825194 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d89ec53b-e284-4d5a-b466-5daf8cbd63f7" (UID: "d89ec53b-e284-4d5a-b466-5daf8cbd63f7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:44:19.825635 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.825286 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d89ec53b-e284-4d5a-b466-5daf8cbd63f7" (UID: "d89ec53b-e284-4d5a-b466-5daf8cbd63f7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:44:19.825866 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.825739 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d89ec53b-e284-4d5a-b466-5daf8cbd63f7" (UID: "d89ec53b-e284-4d5a-b466-5daf8cbd63f7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:44:19.826403 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.826354 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-data" (OuterVolumeSpecName: "istio-data") pod "d89ec53b-e284-4d5a-b466-5daf8cbd63f7" (UID: "d89ec53b-e284-4d5a-b466-5daf8cbd63f7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:44:19.827095 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.827075 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-kube-api-access-99v4w" (OuterVolumeSpecName: "kube-api-access-99v4w") pod "d89ec53b-e284-4d5a-b466-5daf8cbd63f7" (UID: "d89ec53b-e284-4d5a-b466-5daf8cbd63f7"). InnerVolumeSpecName "kube-api-access-99v4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:44:19.827188 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.827135 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-token" (OuterVolumeSpecName: "istio-token") pod "d89ec53b-e284-4d5a-b466-5daf8cbd63f7" (UID: "d89ec53b-e284-4d5a-b466-5daf8cbd63f7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:44:19.827188 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.827174 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d89ec53b-e284-4d5a-b466-5daf8cbd63f7" (UID: "d89ec53b-e284-4d5a-b466-5daf8cbd63f7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 03 15:44:19.827271 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.827255 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d89ec53b-e284-4d5a-b466-5daf8cbd63f7" (UID: "d89ec53b-e284-4d5a-b466-5daf8cbd63f7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:44:19.925571 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.925535 2532 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istiod-ca-cert\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:44:19.925571 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.925567 2532 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-workload-socket\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:44:19.925571 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.925576 2532 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-workload-certs\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:44:19.925811 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.925588 2532 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-envoy\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:44:19.925811 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.925596 2532 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-data\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:44:19.925811 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.925607 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99v4w\" (UniqueName: \"kubernetes.io/projected/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-kube-api-access-99v4w\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:44:19.925811 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.925615 2532 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-token\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:44:19.925811 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.925623 2532 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-istio-podinfo\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:44:19.925811 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:19.925631 2532 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d89ec53b-e284-4d5a-b466-5daf8cbd63f7-credential-socket\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:44:20.383207 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:20.383170 2532 generic.go:356] "Generic (PLEG): container finished" podID="d89ec53b-e284-4d5a-b466-5daf8cbd63f7" containerID="f0f979b5051a1f188b4d04166293d281499141e05504067e8b6241d2e0b5f13e" exitCode=0 Jul 03 15:44:20.383413 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:20.383231 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" Jul 03 15:44:20.383413 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:20.383263 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" event={"ID":"d89ec53b-e284-4d5a-b466-5daf8cbd63f7","Type":"ContainerDied","Data":"f0f979b5051a1f188b4d04166293d281499141e05504067e8b6241d2e0b5f13e"} Jul 03 15:44:20.383413 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:20.383323 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p" event={"ID":"d89ec53b-e284-4d5a-b466-5daf8cbd63f7","Type":"ContainerDied","Data":"39ee4476175953c88e9a198a698888cd6a7475ce2a101cf31f8b9a9f96de2b34"} Jul 03 15:44:20.383413 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:20.383345 2532 scope.go:117] "RemoveContainer" containerID="f0f979b5051a1f188b4d04166293d281499141e05504067e8b6241d2e0b5f13e" Jul 03 15:44:20.392377 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:20.392338 2532 scope.go:117] "RemoveContainer" containerID="0b21c9d6d1d7b052fd29260bd7cc91459221ae0a325d926eb240068f8b05af61" Jul 03 15:44:20.400488 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:20.400449 2532 scope.go:117] "RemoveContainer" containerID="f0f979b5051a1f188b4d04166293d281499141e05504067e8b6241d2e0b5f13e" Jul 03 15:44:20.400945 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:44:20.400860 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0f979b5051a1f188b4d04166293d281499141e05504067e8b6241d2e0b5f13e\": container with ID starting with f0f979b5051a1f188b4d04166293d281499141e05504067e8b6241d2e0b5f13e not found: ID does not exist" containerID="f0f979b5051a1f188b4d04166293d281499141e05504067e8b6241d2e0b5f13e" Jul 03 15:44:20.401081 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:20.400927 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0f979b5051a1f188b4d04166293d281499141e05504067e8b6241d2e0b5f13e"} err="failed to get container status \"f0f979b5051a1f188b4d04166293d281499141e05504067e8b6241d2e0b5f13e\": rpc error: code = NotFound desc = could not find container \"f0f979b5051a1f188b4d04166293d281499141e05504067e8b6241d2e0b5f13e\": container with ID starting with f0f979b5051a1f188b4d04166293d281499141e05504067e8b6241d2e0b5f13e not found: ID does not exist" Jul 03 15:44:20.401081 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:20.400961 2532 scope.go:117] "RemoveContainer" containerID="0b21c9d6d1d7b052fd29260bd7cc91459221ae0a325d926eb240068f8b05af61" Jul 03 15:44:20.401264 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:44:20.401241 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b21c9d6d1d7b052fd29260bd7cc91459221ae0a325d926eb240068f8b05af61\": container with ID starting with 0b21c9d6d1d7b052fd29260bd7cc91459221ae0a325d926eb240068f8b05af61 not found: ID does not exist" containerID="0b21c9d6d1d7b052fd29260bd7cc91459221ae0a325d926eb240068f8b05af61" Jul 03 15:44:20.401327 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:20.401270 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b21c9d6d1d7b052fd29260bd7cc91459221ae0a325d926eb240068f8b05af61"} err="failed to get container status \"0b21c9d6d1d7b052fd29260bd7cc91459221ae0a325d926eb240068f8b05af61\": rpc error: code = NotFound desc = could not find container \"0b21c9d6d1d7b052fd29260bd7cc91459221ae0a325d926eb240068f8b05af61\": container with ID starting with 0b21c9d6d1d7b052fd29260bd7cc91459221ae0a325d926eb240068f8b05af61 not found: ID does not exist" Jul 03 15:44:20.403211 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:20.403188 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p"] Jul 03 15:44:20.411203 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:20.411182 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-37d20861-openshift-default-748c688c87-nct2p"] Jul 03 15:44:22.017564 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:22.017529 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d89ec53b-e284-4d5a-b466-5daf8cbd63f7" path="/var/lib/kubelet/pods/d89ec53b-e284-4d5a-b466-5daf8cbd63f7/volumes" Jul 03 15:44:24.055405 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:24.055290 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:44:24.122709 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:24.122674 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:44:24.778111 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:24.778044 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:44:30.562738 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:30.562702 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:44:30.632790 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:30.632752 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:44:30.728517 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:30.728475 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:44:30.828022 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:30.827982 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:44:31.511676 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:31.511644 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:44:41.301522 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:41.301488 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:44:41.656522 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:44:41.656490 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:02.669060 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:02.669022 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:04.822294 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:04.822253 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:08.553383 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:08.553341 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:08.633278 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:08.633237 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:08.912448 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:08.912418 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:09.208254 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.208175 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z"] Jul 03 15:45:09.208731 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.208694 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d89ec53b-e284-4d5a-b466-5daf8cbd63f7" containerName="istio-proxy" Jul 03 15:45:09.208731 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.208715 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="d89ec53b-e284-4d5a-b466-5daf8cbd63f7" containerName="istio-proxy" Jul 03 15:45:09.208731 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.208728 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38514223-4db3-4377-817c-e7243961de08" containerName="main" Jul 03 15:45:09.208948 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.208737 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="38514223-4db3-4377-817c-e7243961de08" containerName="main" Jul 03 15:45:09.208948 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.208764 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d89ec53b-e284-4d5a-b466-5daf8cbd63f7" containerName="istio-proxy" Jul 03 15:45:09.208948 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.208774 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="d89ec53b-e284-4d5a-b466-5daf8cbd63f7" containerName="istio-proxy" Jul 03 15:45:09.209117 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.209008 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="d89ec53b-e284-4d5a-b466-5daf8cbd63f7" containerName="istio-proxy" Jul 03 15:45:09.209117 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.209025 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="38514223-4db3-4377-817c-e7243961de08" containerName="main" Jul 03 15:45:09.212250 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.212234 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.215462 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.215441 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-33bce5-openshift-default-dockercfg-bccqx\"" Jul 03 15:45:09.223495 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.223473 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z"] Jul 03 15:45:09.244287 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.244259 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:09.262284 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.262255 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-workload-certs\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.262450 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.262305 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-workload-socket\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.262450 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.262325 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-token\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.262450 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.262393 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26cc54cc-0706-4012-afb0-1c06dda70d18-istiod-ca-cert\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.262627 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.262456 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ppw6\" (UniqueName: \"kubernetes.io/projected/26cc54cc-0706-4012-afb0-1c06dda70d18-kube-api-access-2ppw6\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.262627 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.262491 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-data\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.262627 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.262528 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-envoy\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.262627 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.262565 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-credential-socket\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.262779 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.262634 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-podinfo\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.363734 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.363699 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-workload-certs\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.363939 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.363752 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-workload-socket\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.363939 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.363772 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-token\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.363939 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.363787 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26cc54cc-0706-4012-afb0-1c06dda70d18-istiod-ca-cert\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.363939 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.363818 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ppw6\" (UniqueName: \"kubernetes.io/projected/26cc54cc-0706-4012-afb0-1c06dda70d18-kube-api-access-2ppw6\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.363939 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.363838 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-data\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.363939 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.363861 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-envoy\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.364256 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.364068 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-credential-socket\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.364256 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.364171 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-workload-certs\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.364256 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.364174 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-podinfo\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.364256 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.364211 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-workload-socket\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.364457 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.364435 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-data\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.364551 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.364461 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-credential-socket\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.364652 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.364636 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26cc54cc-0706-4012-afb0-1c06dda70d18-istiod-ca-cert\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.366247 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.366229 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-envoy\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.366520 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.366502 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-podinfo\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.381693 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.381669 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ppw6\" (UniqueName: \"kubernetes.io/projected/26cc54cc-0706-4012-afb0-1c06dda70d18-kube-api-access-2ppw6\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.384263 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.384242 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-token\") pod \"e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.522930 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.522840 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:09.560009 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.559966 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:09.697553 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.697523 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z"] Jul 03 15:45:09.699762 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:45:09.699733 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26cc54cc_0706_4012_afb0_1c06dda70d18.slice/crio-aa54fb18ff7c29ddb80143b78de773c50472ceab4f640af912bab3d7e62c1288 WatchSource:0}: Error finding container aa54fb18ff7c29ddb80143b78de773c50472ceab4f640af912bab3d7e62c1288: Status 404 returned error can't find the container with id aa54fb18ff7c29ddb80143b78de773c50472ceab4f640af912bab3d7e62c1288 Jul 03 15:45:09.701843 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.701794 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:45:09.701940 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.701875 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:45:09.701940 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:09.701903 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:45:10.644154 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:10.644114 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" event={"ID":"26cc54cc-0706-4012-afb0-1c06dda70d18","Type":"ContainerStarted","Data":"647cb4645ee419c7bccfd7f349792ff9149aa2f242ce0476c1b4a37a080eb404"} Jul 03 15:45:10.644664 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:10.644177 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" event={"ID":"26cc54cc-0706-4012-afb0-1c06dda70d18","Type":"ContainerStarted","Data":"aa54fb18ff7c29ddb80143b78de773c50472ceab4f640af912bab3d7e62c1288"} Jul 03 15:45:10.669356 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:10.669302 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" podStartSLOduration=1.669287106 podStartE2EDuration="1.669287106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:45:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:45:10.666883787 +0000 UTC m=+1929.249907617" watchObservedRunningTime="2026-07-03 15:45:10.669287106 +0000 UTC m=+1929.252310934" Jul 03 15:45:11.523967 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:11.523933 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:11.528854 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:11.528830 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:11.649448 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:11.649414 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:11.650490 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:11.650468 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:12.702156 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:12.702123 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:12.800757 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:12.800718 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:12.901412 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:12.901341 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:13.316749 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:13.316711 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:13.416401 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:13.416351 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:13.517319 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:13.517274 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:17.233005 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:17.232966 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:17.544700 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:17.544610 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:17.901896 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:17.901867 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g"] Jul 03 15:45:17.902329 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:17.902316 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="d89ec53b-e284-4d5a-b466-5daf8cbd63f7" containerName="istio-proxy" Jul 03 15:45:17.905877 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:17.905855 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:17.908504 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:17.908482 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-59ce5a-openshift-default-dockercfg-b74q2\"" Jul 03 15:45:17.918349 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:17.918323 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g"] Jul 03 15:45:17.929554 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:17.929515 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:17.941711 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:17.941665 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-workload-socket\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:17.941835 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:17.941730 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62n6d\" (UniqueName: \"kubernetes.io/projected/70eee59f-d932-4d9a-8f86-77a211d3709a-kube-api-access-62n6d\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:17.941835 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:17.941759 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-credential-socket\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:17.941835 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:17.941786 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70eee59f-d932-4d9a-8f86-77a211d3709a-istiod-ca-cert\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:17.941974 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:17.941852 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-workload-certs\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:17.941974 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:17.941888 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-envoy\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:17.941974 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:17.941921 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-data\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:17.941974 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:17.941940 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-podinfo\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:17.942119 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:17.942068 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-token\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:18.043403 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.043355 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-token\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:18.043607 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.043417 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-workload-socket\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:18.043607 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.043450 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62n6d\" (UniqueName: \"kubernetes.io/projected/70eee59f-d932-4d9a-8f86-77a211d3709a-kube-api-access-62n6d\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:18.043607 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.043470 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-credential-socket\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:18.043607 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.043502 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70eee59f-d932-4d9a-8f86-77a211d3709a-istiod-ca-cert\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:18.043607 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.043538 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-workload-certs\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:18.043607 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.043587 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-envoy\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:18.044277 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.043629 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-data\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:18.044277 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.043652 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-podinfo\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:18.044277 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.044066 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-workload-socket\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:18.044277 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.044105 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-workload-certs\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:18.044277 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.044138 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-data\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:18.044560 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.044409 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-credential-socket\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:18.044765 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.044738 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70eee59f-d932-4d9a-8f86-77a211d3709a-istiod-ca-cert\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:18.047259 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.047235 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-podinfo\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:18.047482 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.047461 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-envoy\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:18.055884 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.055856 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-token\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:18.056039 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.056019 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62n6d\" (UniqueName: \"kubernetes.io/projected/70eee59f-d932-4d9a-8f86-77a211d3709a-kube-api-access-62n6d\") pod \"e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:18.217743 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.217640 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:18.362540 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.362512 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g"] Jul 03 15:45:18.364540 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:45:18.364504 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70eee59f_d932_4d9a_8f86_77a211d3709a.slice/crio-13508782c982b9710d18725b66b9c3b81c18742e594df5304f2ee7aa51a9e501 WatchSource:0}: Error finding container 13508782c982b9710d18725b66b9c3b81c18742e594df5304f2ee7aa51a9e501: Status 404 returned error can't find the container with id 13508782c982b9710d18725b66b9c3b81c18742e594df5304f2ee7aa51a9e501 Jul 03 15:45:18.366726 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.366694 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:45:18.366817 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.366768 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:45:18.366817 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.366799 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:45:18.484207 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.484035 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:18.610741 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.610701 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:45:18.685737 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.685701 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" event={"ID":"70eee59f-d932-4d9a-8f86-77a211d3709a","Type":"ContainerStarted","Data":"c92085a7d955003de9d2979de54291e25a3150c584d144562eba3c66277811ae"} Jul 03 15:45:18.685947 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.685768 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" event={"ID":"70eee59f-d932-4d9a-8f86-77a211d3709a","Type":"ContainerStarted","Data":"13508782c982b9710d18725b66b9c3b81c18742e594df5304f2ee7aa51a9e501"} Jul 03 15:45:18.720978 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:18.720918 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" podStartSLOduration=1.7208966220000002 podStartE2EDuration="1.720896622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:45:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:45:18.719674716 +0000 UTC m=+1937.302698558" watchObservedRunningTime="2026-07-03 15:45:18.720896622 +0000 UTC m=+1937.303920451" Jul 03 15:45:19.217878 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:19.217840 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:19.222976 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:19.222952 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:19.690916 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:19.690887 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:19.691895 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:19.691877 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:21.806575 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:21.806543 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:21.905934 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:21.905903 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:21.989148 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:21.989109 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:22.124246 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:22.124207 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:22.419436 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:22.419287 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:22.518352 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:22.518310 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:26.278220 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:26.278188 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:27.002931 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:27.002857 2532 patch_prober.go:28] interesting pod/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": read tcp 10.132.0.2:37236->10.132.0.57:15021: read: connection reset by peer" start-of-body= Jul 03 15:45:27.003119 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:27.002932 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" podUID="26cc54cc-0706-4012-afb0-1c06dda70d18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": read tcp 10.132.0.2:37236->10.132.0.57:15021: read: connection reset by peer" Jul 03 15:45:27.730085 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:27.730052 2532 generic.go:356] "Generic (PLEG): container finished" podID="26cc54cc-0706-4012-afb0-1c06dda70d18" containerID="647cb4645ee419c7bccfd7f349792ff9149aa2f242ce0476c1b4a37a080eb404" exitCode=0 Jul 03 15:45:27.730550 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:27.730113 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" event={"ID":"26cc54cc-0706-4012-afb0-1c06dda70d18","Type":"ContainerDied","Data":"647cb4645ee419c7bccfd7f349792ff9149aa2f242ce0476c1b4a37a080eb404"} Jul 03 15:45:27.730550 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:27.730547 2532 scope.go:117] "RemoveContainer" containerID="647cb4645ee419c7bccfd7f349792ff9149aa2f242ce0476c1b4a37a080eb404" Jul 03 15:45:27.731543 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:27.731505 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:45:27.731647 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:27.731574 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:45:27.731647 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:27.731606 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:45:28.737761 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:28.737710 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" event={"ID":"26cc54cc-0706-4012-afb0-1c06dda70d18","Type":"ContainerStarted","Data":"fba74833965efadc612f3bbf7fe886f53db2abd3a45fba21d50df4f66c3fee9e"} Jul 03 15:45:29.523597 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:29.523556 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:29.523859 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:29.523837 2532 patch_prober.go:28] interesting pod/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 03 15:45:29.523937 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:29.523884 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" podUID="26cc54cc-0706-4012-afb0-1c06dda70d18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 03 15:45:30.524044 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:30.524005 2532 patch_prober.go:28] interesting pod/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 03 15:45:30.524428 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:30.524059 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" podUID="26cc54cc-0706-4012-afb0-1c06dda70d18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 03 15:45:31.524178 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:31.524140 2532 patch_prober.go:28] interesting pod/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 03 15:45:31.524624 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:31.524200 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" podUID="26cc54cc-0706-4012-afb0-1c06dda70d18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 03 15:45:32.523919 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:32.523880 2532 patch_prober.go:28] interesting pod/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 03 15:45:32.524124 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:32.523945 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" podUID="26cc54cc-0706-4012-afb0-1c06dda70d18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 03 15:45:33.407422 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:33.407380 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:45:33.526714 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:33.526656 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:33.527056 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:33.527034 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:33.527860 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:33.527832 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:45:34.692079 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:34.692041 2532 patch_prober.go:28] interesting pod/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 03 15:45:34.692585 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:34.692107 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" podUID="70eee59f-d932-4d9a-8f86-77a211d3709a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 03 15:45:34.780793 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:34.780759 2532 generic.go:356] "Generic (PLEG): container finished" podID="70eee59f-d932-4d9a-8f86-77a211d3709a" containerID="c92085a7d955003de9d2979de54291e25a3150c584d144562eba3c66277811ae" exitCode=0 Jul 03 15:45:34.780958 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:34.780840 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" event={"ID":"70eee59f-d932-4d9a-8f86-77a211d3709a","Type":"ContainerDied","Data":"c92085a7d955003de9d2979de54291e25a3150c584d144562eba3c66277811ae"} Jul 03 15:45:34.781358 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:34.781328 2532 scope.go:117] "RemoveContainer" containerID="c92085a7d955003de9d2979de54291e25a3150c584d144562eba3c66277811ae" Jul 03 15:45:34.782363 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:34.782331 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:45:34.782484 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:34.782419 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:45:34.782484 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:34.782450 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:45:34.920688 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:34.920636 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:35.020690 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:35.020582 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:35.789683 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:35.789650 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" event={"ID":"70eee59f-d932-4d9a-8f86-77a211d3709a","Type":"ContainerStarted","Data":"4c43ae77b23e3618c161424c88364ca1c2758bdd7d0edd267bbd39cfd0708dd9"} Jul 03 15:45:36.218380 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:36.218340 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:36.218599 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:36.218578 2532 patch_prober.go:28] interesting pod/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 03 15:45:36.218648 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:36.218635 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" podUID="70eee59f-d932-4d9a-8f86-77a211d3709a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 03 15:45:37.218260 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:37.218222 2532 patch_prober.go:28] interesting pod/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 03 15:45:37.218682 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:37.218293 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" podUID="70eee59f-d932-4d9a-8f86-77a211d3709a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 03 15:45:38.218631 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:38.218591 2532 patch_prober.go:28] interesting pod/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 03 15:45:38.219112 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:38.218656 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" podUID="70eee59f-d932-4d9a-8f86-77a211d3709a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 03 15:45:39.218606 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:39.218561 2532 patch_prober.go:28] interesting pod/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 03 15:45:39.218802 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:39.218641 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" podUID="70eee59f-d932-4d9a-8f86-77a211d3709a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 03 15:45:40.222420 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:40.222387 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:40.222888 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:40.222709 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:40.223330 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:40.223311 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:45:44.097219 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:44.097181 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:44.199655 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:44.199619 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:47.392979 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:47.392943 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:45:50.701097 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:45:50.701059 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:46:06.148695 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:46:06.148647 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:46:20.931659 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:46:20.931622 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:46:25.201209 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:46:25.201171 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:46:38.508567 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:46:38.508533 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:46:40.831055 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:46:40.831015 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:46:41.810387 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:46:41.810340 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:46:41.975116 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:46:41.975087 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:46:42.365007 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:46:42.364963 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:46:42.462592 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:46:42.462555 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:46:42.564803 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:46:42.564759 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:46:42.689754 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:46:42.689656 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:46:47.448149 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:46:47.448119 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:46:53.651004 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:46:53.650962 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:47:24.222625 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:24.222537 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:24.503259 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:24.503173 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z"] Jul 03 15:47:24.503465 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:24.503414 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" podUID="26cc54cc-0706-4012-afb0-1c06dda70d18" containerName="istio-proxy" containerID="cri-o://fba74833965efadc612f3bbf7fe886f53db2abd3a45fba21d50df4f66c3fee9e" gracePeriod=30 Jul 03 15:47:24.528492 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:24.528458 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:24.750045 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:24.750017 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:24.947751 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:24.947709 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:25.338535 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:25.338504 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:25.440059 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:25.440027 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:25.540247 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:25.540205 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:25.653441 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:25.653295 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:28.606569 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:28.606534 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:47:29.752325 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.752294 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:47:29.787346 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.787263 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-workload-certs\") pod \"26cc54cc-0706-4012-afb0-1c06dda70d18\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " Jul 03 15:47:29.787346 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.787322 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-credential-socket\") pod \"26cc54cc-0706-4012-afb0-1c06dda70d18\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " Jul 03 15:47:29.787582 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.787350 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-envoy\") pod \"26cc54cc-0706-4012-afb0-1c06dda70d18\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " Jul 03 15:47:29.787582 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.787388 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-podinfo\") pod \"26cc54cc-0706-4012-afb0-1c06dda70d18\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " Jul 03 15:47:29.787582 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.787452 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-token\") pod \"26cc54cc-0706-4012-afb0-1c06dda70d18\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " Jul 03 15:47:29.787582 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.787480 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ppw6\" (UniqueName: \"kubernetes.io/projected/26cc54cc-0706-4012-afb0-1c06dda70d18-kube-api-access-2ppw6\") pod \"26cc54cc-0706-4012-afb0-1c06dda70d18\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " Jul 03 15:47:29.787582 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.787518 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26cc54cc-0706-4012-afb0-1c06dda70d18-istiod-ca-cert\") pod \"26cc54cc-0706-4012-afb0-1c06dda70d18\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " Jul 03 15:47:29.787582 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.787576 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-workload-socket\") pod \"26cc54cc-0706-4012-afb0-1c06dda70d18\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " Jul 03 15:47:29.787913 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.787554 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "26cc54cc-0706-4012-afb0-1c06dda70d18" (UID: "26cc54cc-0706-4012-afb0-1c06dda70d18"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:47:29.787913 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.787603 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-data\") pod \"26cc54cc-0706-4012-afb0-1c06dda70d18\" (UID: \"26cc54cc-0706-4012-afb0-1c06dda70d18\") " Jul 03 15:47:29.787913 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.787606 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "26cc54cc-0706-4012-afb0-1c06dda70d18" (UID: "26cc54cc-0706-4012-afb0-1c06dda70d18"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:47:29.787913 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.787820 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "26cc54cc-0706-4012-afb0-1c06dda70d18" (UID: "26cc54cc-0706-4012-afb0-1c06dda70d18"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:47:29.787913 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.787895 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26cc54cc-0706-4012-afb0-1c06dda70d18-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "26cc54cc-0706-4012-afb0-1c06dda70d18" (UID: "26cc54cc-0706-4012-afb0-1c06dda70d18"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:47:29.787913 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.787911 2532 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-workload-socket\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:47:29.788240 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.787929 2532 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-workload-certs\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:47:29.788240 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.787943 2532 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-credential-socket\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:47:29.788984 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.788943 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-data" (OuterVolumeSpecName: "istio-data") pod "26cc54cc-0706-4012-afb0-1c06dda70d18" (UID: "26cc54cc-0706-4012-afb0-1c06dda70d18"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:47:29.789888 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.789850 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-token" (OuterVolumeSpecName: "istio-token") pod "26cc54cc-0706-4012-afb0-1c06dda70d18" (UID: "26cc54cc-0706-4012-afb0-1c06dda70d18"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:47:29.790300 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.790268 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "26cc54cc-0706-4012-afb0-1c06dda70d18" (UID: "26cc54cc-0706-4012-afb0-1c06dda70d18"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 03 15:47:29.790300 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.790287 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26cc54cc-0706-4012-afb0-1c06dda70d18-kube-api-access-2ppw6" (OuterVolumeSpecName: "kube-api-access-2ppw6") pod "26cc54cc-0706-4012-afb0-1c06dda70d18" (UID: "26cc54cc-0706-4012-afb0-1c06dda70d18"). InnerVolumeSpecName "kube-api-access-2ppw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:47:29.790559 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.790348 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "26cc54cc-0706-4012-afb0-1c06dda70d18" (UID: "26cc54cc-0706-4012-afb0-1c06dda70d18"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:47:29.889229 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.889191 2532 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-envoy\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:47:29.889229 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.889223 2532 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-podinfo\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:47:29.889229 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.889232 2532 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-token\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:47:29.889500 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.889241 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ppw6\" (UniqueName: \"kubernetes.io/projected/26cc54cc-0706-4012-afb0-1c06dda70d18-kube-api-access-2ppw6\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:47:29.889500 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.889249 2532 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26cc54cc-0706-4012-afb0-1c06dda70d18-istiod-ca-cert\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:47:29.889500 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:29.889257 2532 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26cc54cc-0706-4012-afb0-1c06dda70d18-istio-data\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:47:30.393445 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:30.393414 2532 generic.go:356] "Generic (PLEG): container finished" podID="26cc54cc-0706-4012-afb0-1c06dda70d18" containerID="fba74833965efadc612f3bbf7fe886f53db2abd3a45fba21d50df4f66c3fee9e" exitCode=0 Jul 03 15:47:30.393630 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:30.393473 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" Jul 03 15:47:30.393630 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:30.393505 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" event={"ID":"26cc54cc-0706-4012-afb0-1c06dda70d18","Type":"ContainerDied","Data":"fba74833965efadc612f3bbf7fe886f53db2abd3a45fba21d50df4f66c3fee9e"} Jul 03 15:47:30.393630 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:30.393566 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z" event={"ID":"26cc54cc-0706-4012-afb0-1c06dda70d18","Type":"ContainerDied","Data":"aa54fb18ff7c29ddb80143b78de773c50472ceab4f640af912bab3d7e62c1288"} Jul 03 15:47:30.393630 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:30.393597 2532 scope.go:117] "RemoveContainer" containerID="fba74833965efadc612f3bbf7fe886f53db2abd3a45fba21d50df4f66c3fee9e" Jul 03 15:47:30.402564 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:30.402543 2532 scope.go:117] "RemoveContainer" containerID="647cb4645ee419c7bccfd7f349792ff9149aa2f242ce0476c1b4a37a080eb404" Jul 03 15:47:30.410326 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:30.410309 2532 scope.go:117] "RemoveContainer" containerID="fba74833965efadc612f3bbf7fe886f53db2abd3a45fba21d50df4f66c3fee9e" Jul 03 15:47:30.410589 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:47:30.410571 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fba74833965efadc612f3bbf7fe886f53db2abd3a45fba21d50df4f66c3fee9e\": container with ID starting with fba74833965efadc612f3bbf7fe886f53db2abd3a45fba21d50df4f66c3fee9e not found: ID does not exist" containerID="fba74833965efadc612f3bbf7fe886f53db2abd3a45fba21d50df4f66c3fee9e" Jul 03 15:47:30.410634 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:30.410597 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fba74833965efadc612f3bbf7fe886f53db2abd3a45fba21d50df4f66c3fee9e"} err="failed to get container status \"fba74833965efadc612f3bbf7fe886f53db2abd3a45fba21d50df4f66c3fee9e\": rpc error: code = NotFound desc = could not find container \"fba74833965efadc612f3bbf7fe886f53db2abd3a45fba21d50df4f66c3fee9e\": container with ID starting with fba74833965efadc612f3bbf7fe886f53db2abd3a45fba21d50df4f66c3fee9e not found: ID does not exist" Jul 03 15:47:30.410634 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:30.410613 2532 scope.go:117] "RemoveContainer" containerID="647cb4645ee419c7bccfd7f349792ff9149aa2f242ce0476c1b4a37a080eb404" Jul 03 15:47:30.410815 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:47:30.410796 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"647cb4645ee419c7bccfd7f349792ff9149aa2f242ce0476c1b4a37a080eb404\": container with ID starting with 647cb4645ee419c7bccfd7f349792ff9149aa2f242ce0476c1b4a37a080eb404 not found: ID does not exist" containerID="647cb4645ee419c7bccfd7f349792ff9149aa2f242ce0476c1b4a37a080eb404" Jul 03 15:47:30.410873 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:30.410824 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"647cb4645ee419c7bccfd7f349792ff9149aa2f242ce0476c1b4a37a080eb404"} err="failed to get container status \"647cb4645ee419c7bccfd7f349792ff9149aa2f242ce0476c1b4a37a080eb404\": rpc error: code = NotFound desc = could not find container \"647cb4645ee419c7bccfd7f349792ff9149aa2f242ce0476c1b4a37a080eb404\": container with ID starting with 647cb4645ee419c7bccfd7f349792ff9149aa2f242ce0476c1b4a37a080eb404 not found: ID does not exist" Jul 03 15:47:30.415386 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:30.415348 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z"] Jul 03 15:47:30.417069 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:30.417049 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-33bce5-openshift-default-756576d86c-xbq8z"] Jul 03 15:47:31.126386 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:31.126333 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:31.699974 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:31.699926 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:31.770046 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:31.770012 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:31.943629 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:31.943596 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g"] Jul 03 15:47:31.943873 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:31.943844 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" podUID="70eee59f-d932-4d9a-8f86-77a211d3709a" containerName="istio-proxy" containerID="cri-o://4c43ae77b23e3618c161424c88364ca1c2758bdd7d0edd267bbd39cfd0708dd9" gracePeriod=30 Jul 03 15:47:31.960782 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:31.960697 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:32.017057 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:32.017023 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26cc54cc-0706-4012-afb0-1c06dda70d18" path="/var/lib/kubelet/pods/26cc54cc-0706-4012-afb0-1c06dda70d18/volumes" Jul 03 15:47:32.188934 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:32.188902 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:32.532774 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:32.532737 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:32.844777 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:32.844747 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78"] Jul 03 15:47:32.845123 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:32.845112 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26cc54cc-0706-4012-afb0-1c06dda70d18" containerName="istio-proxy" Jul 03 15:47:32.845174 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:32.845125 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="26cc54cc-0706-4012-afb0-1c06dda70d18" containerName="istio-proxy" Jul 03 15:47:32.845174 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:32.845145 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26cc54cc-0706-4012-afb0-1c06dda70d18" containerName="istio-proxy" Jul 03 15:47:32.845174 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:32.845151 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="26cc54cc-0706-4012-afb0-1c06dda70d18" containerName="istio-proxy" Jul 03 15:47:32.845279 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:32.845212 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="26cc54cc-0706-4012-afb0-1c06dda70d18" containerName="istio-proxy" Jul 03 15:47:32.853868 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:32.853692 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:32.856606 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:32.856584 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-354253-openshift-default-dockercfg-fzx29\"" Jul 03 15:47:32.861936 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:32.861505 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78"] Jul 03 15:47:32.878041 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:32.878011 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:32.918296 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:32.918265 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgjbw\" (UniqueName: \"kubernetes.io/projected/d8828193-32e3-4d11-8cca-6a1294158b6f-kube-api-access-fgjbw\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:32.918470 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:32.918304 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-workload-socket\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:32.918470 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:32.918321 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-credential-socket\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:32.918470 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:32.918398 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-data\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:32.918470 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:32.918425 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-token\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:32.918470 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:32.918442 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-workload-certs\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:32.918470 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:32.918468 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-podinfo\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:32.918692 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:32.918493 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-envoy\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:32.918692 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:32.918529 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8828193-32e3-4d11-8cca-6a1294158b6f-istiod-ca-cert\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:33.018949 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.018902 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgjbw\" (UniqueName: \"kubernetes.io/projected/d8828193-32e3-4d11-8cca-6a1294158b6f-kube-api-access-fgjbw\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:33.018949 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.018949 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-workload-socket\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:33.019224 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.018974 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-credential-socket\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:33.019224 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.019011 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-data\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:33.019224 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.019048 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-token\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:33.019224 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.019075 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-workload-certs\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:33.019224 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.019115 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-podinfo\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:33.019224 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.019150 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-envoy\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:33.019224 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.019191 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8828193-32e3-4d11-8cca-6a1294158b6f-istiod-ca-cert\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:33.019641 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.019489 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-workload-socket\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:33.019641 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.019539 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-data\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:33.019641 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.019572 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-credential-socket\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:33.019810 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.019646 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-workload-certs\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:33.019946 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.019928 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8828193-32e3-4d11-8cca-6a1294158b6f-istiod-ca-cert\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:33.021606 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.021584 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-envoy\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:33.022095 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.022074 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-podinfo\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:33.031053 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.031026 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-token\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:33.031262 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.031243 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgjbw\" (UniqueName: \"kubernetes.io/projected/d8828193-32e3-4d11-8cca-6a1294158b6f-kube-api-access-fgjbw\") pod \"e2e-api-a-354253-openshift-default-745744d679-nfr78\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:33.140024 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.139933 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:33.166842 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.166811 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:33.315979 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.315944 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78"] Jul 03 15:47:33.318673 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:47:33.318645 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8828193_32e3_4d11_8cca_6a1294158b6f.slice/crio-a6779a09e863c6440e3cf9a7c83af783eeb186e698ac3e43ac821ec9f4fd1d9b WatchSource:0}: Error finding container a6779a09e863c6440e3cf9a7c83af783eeb186e698ac3e43ac821ec9f4fd1d9b: Status 404 returned error can't find the container with id a6779a09e863c6440e3cf9a7c83af783eeb186e698ac3e43ac821ec9f4fd1d9b Jul 03 15:47:33.320903 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.320870 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:47:33.321005 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.320974 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:47:33.321074 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.321019 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:47:33.412156 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.412076 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" event={"ID":"d8828193-32e3-4d11-8cca-6a1294158b6f","Type":"ContainerStarted","Data":"f369c6e9369dbb3873cf5ba7fe9917bfffa6fe17fbb825cfe7de445a890d1b3c"} Jul 03 15:47:33.412156 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.412140 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" event={"ID":"d8828193-32e3-4d11-8cca-6a1294158b6f","Type":"ContainerStarted","Data":"a6779a09e863c6440e3cf9a7c83af783eeb186e698ac3e43ac821ec9f4fd1d9b"} Jul 03 15:47:33.435831 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:33.435772 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" podStartSLOduration=1.435757305 podStartE2EDuration="1.435757305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:47:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:47:33.435124069 +0000 UTC m=+2072.018147903" watchObservedRunningTime="2026-07-03 15:47:33.435757305 +0000 UTC m=+2072.018781134" Jul 03 15:47:34.167950 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:34.167913 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:34.172813 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:34.172784 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:34.417335 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:34.417305 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:34.418397 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:34.418314 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:35.478636 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:35.478604 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:35.580720 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:35.580686 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:35.688228 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:35.688171 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:35.803166 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:35.803064 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:36.164270 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:36.164231 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:36.265663 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:36.265627 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:36.329174 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:36.329133 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:37.203627 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.203572 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:47:37.259386 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.259344 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62n6d\" (UniqueName: \"kubernetes.io/projected/70eee59f-d932-4d9a-8f86-77a211d3709a-kube-api-access-62n6d\") pod \"70eee59f-d932-4d9a-8f86-77a211d3709a\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " Jul 03 15:47:37.259542 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.259420 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-envoy\") pod \"70eee59f-d932-4d9a-8f86-77a211d3709a\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " Jul 03 15:47:37.259542 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.259453 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-data\") pod \"70eee59f-d932-4d9a-8f86-77a211d3709a\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " Jul 03 15:47:37.259542 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.259490 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-credential-socket\") pod \"70eee59f-d932-4d9a-8f86-77a211d3709a\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " Jul 03 15:47:37.259542 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.259529 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-workload-certs\") pod \"70eee59f-d932-4d9a-8f86-77a211d3709a\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " Jul 03 15:47:37.259740 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.259577 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-workload-socket\") pod \"70eee59f-d932-4d9a-8f86-77a211d3709a\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " Jul 03 15:47:37.259740 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.259605 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70eee59f-d932-4d9a-8f86-77a211d3709a-istiod-ca-cert\") pod \"70eee59f-d932-4d9a-8f86-77a211d3709a\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " Jul 03 15:47:37.259740 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.259670 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-podinfo\") pod \"70eee59f-d932-4d9a-8f86-77a211d3709a\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " Jul 03 15:47:37.259883 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.259860 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "70eee59f-d932-4d9a-8f86-77a211d3709a" (UID: "70eee59f-d932-4d9a-8f86-77a211d3709a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:47:37.259946 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.259895 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "70eee59f-d932-4d9a-8f86-77a211d3709a" (UID: "70eee59f-d932-4d9a-8f86-77a211d3709a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:47:37.259946 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.259900 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "70eee59f-d932-4d9a-8f86-77a211d3709a" (UID: "70eee59f-d932-4d9a-8f86-77a211d3709a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:47:37.260058 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.260035 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70eee59f-d932-4d9a-8f86-77a211d3709a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "70eee59f-d932-4d9a-8f86-77a211d3709a" (UID: "70eee59f-d932-4d9a-8f86-77a211d3709a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:47:37.260222 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.260143 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-token\") pod \"70eee59f-d932-4d9a-8f86-77a211d3709a\" (UID: \"70eee59f-d932-4d9a-8f86-77a211d3709a\") " Jul 03 15:47:37.260304 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.260282 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-data" (OuterVolumeSpecName: "istio-data") pod "70eee59f-d932-4d9a-8f86-77a211d3709a" (UID: "70eee59f-d932-4d9a-8f86-77a211d3709a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:47:37.260653 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.260626 2532 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-data\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:47:37.260653 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.260655 2532 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-credential-socket\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:47:37.260847 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.260671 2532 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-workload-certs\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:47:37.260847 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.260685 2532 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-workload-socket\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:47:37.260847 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.260698 2532 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70eee59f-d932-4d9a-8f86-77a211d3709a-istiod-ca-cert\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:47:37.261796 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.261768 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "70eee59f-d932-4d9a-8f86-77a211d3709a" (UID: "70eee59f-d932-4d9a-8f86-77a211d3709a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:47:37.261932 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.261895 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70eee59f-d932-4d9a-8f86-77a211d3709a-kube-api-access-62n6d" (OuterVolumeSpecName: "kube-api-access-62n6d") pod "70eee59f-d932-4d9a-8f86-77a211d3709a" (UID: "70eee59f-d932-4d9a-8f86-77a211d3709a"). InnerVolumeSpecName "kube-api-access-62n6d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:47:37.262148 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.262127 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "70eee59f-d932-4d9a-8f86-77a211d3709a" (UID: "70eee59f-d932-4d9a-8f86-77a211d3709a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 03 15:47:37.262282 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.262262 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-token" (OuterVolumeSpecName: "istio-token") pod "70eee59f-d932-4d9a-8f86-77a211d3709a" (UID: "70eee59f-d932-4d9a-8f86-77a211d3709a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:47:37.362103 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.362069 2532 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-token\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:47:37.362103 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.362102 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62n6d\" (UniqueName: \"kubernetes.io/projected/70eee59f-d932-4d9a-8f86-77a211d3709a-kube-api-access-62n6d\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:47:37.362103 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.362111 2532 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-envoy\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:47:37.362311 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.362120 2532 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70eee59f-d932-4d9a-8f86-77a211d3709a-istio-podinfo\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:47:37.436981 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.436950 2532 generic.go:356] "Generic (PLEG): container finished" podID="70eee59f-d932-4d9a-8f86-77a211d3709a" containerID="4c43ae77b23e3618c161424c88364ca1c2758bdd7d0edd267bbd39cfd0708dd9" exitCode=0 Jul 03 15:47:37.437147 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.437000 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" event={"ID":"70eee59f-d932-4d9a-8f86-77a211d3709a","Type":"ContainerDied","Data":"4c43ae77b23e3618c161424c88364ca1c2758bdd7d0edd267bbd39cfd0708dd9"} Jul 03 15:47:37.437147 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.437037 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" event={"ID":"70eee59f-d932-4d9a-8f86-77a211d3709a","Type":"ContainerDied","Data":"13508782c982b9710d18725b66b9c3b81c18742e594df5304f2ee7aa51a9e501"} Jul 03 15:47:37.437147 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.437058 2532 scope.go:117] "RemoveContainer" containerID="4c43ae77b23e3618c161424c88364ca1c2758bdd7d0edd267bbd39cfd0708dd9" Jul 03 15:47:37.437147 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.436999 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g" Jul 03 15:47:37.448400 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.448354 2532 scope.go:117] "RemoveContainer" containerID="c92085a7d955003de9d2979de54291e25a3150c584d144562eba3c66277811ae" Jul 03 15:47:37.456270 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.456244 2532 scope.go:117] "RemoveContainer" containerID="4c43ae77b23e3618c161424c88364ca1c2758bdd7d0edd267bbd39cfd0708dd9" Jul 03 15:47:37.456520 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:47:37.456499 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c43ae77b23e3618c161424c88364ca1c2758bdd7d0edd267bbd39cfd0708dd9\": container with ID starting with 4c43ae77b23e3618c161424c88364ca1c2758bdd7d0edd267bbd39cfd0708dd9 not found: ID does not exist" containerID="4c43ae77b23e3618c161424c88364ca1c2758bdd7d0edd267bbd39cfd0708dd9" Jul 03 15:47:37.456608 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.456532 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c43ae77b23e3618c161424c88364ca1c2758bdd7d0edd267bbd39cfd0708dd9"} err="failed to get container status \"4c43ae77b23e3618c161424c88364ca1c2758bdd7d0edd267bbd39cfd0708dd9\": rpc error: code = NotFound desc = could not find container \"4c43ae77b23e3618c161424c88364ca1c2758bdd7d0edd267bbd39cfd0708dd9\": container with ID starting with 4c43ae77b23e3618c161424c88364ca1c2758bdd7d0edd267bbd39cfd0708dd9 not found: ID does not exist" Jul 03 15:47:37.456608 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.456558 2532 scope.go:117] "RemoveContainer" containerID="c92085a7d955003de9d2979de54291e25a3150c584d144562eba3c66277811ae" Jul 03 15:47:37.456810 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:47:37.456793 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c92085a7d955003de9d2979de54291e25a3150c584d144562eba3c66277811ae\": container with ID starting with c92085a7d955003de9d2979de54291e25a3150c584d144562eba3c66277811ae not found: ID does not exist" containerID="c92085a7d955003de9d2979de54291e25a3150c584d144562eba3c66277811ae" Jul 03 15:47:37.456863 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.456816 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c92085a7d955003de9d2979de54291e25a3150c584d144562eba3c66277811ae"} err="failed to get container status \"c92085a7d955003de9d2979de54291e25a3150c584d144562eba3c66277811ae\": rpc error: code = NotFound desc = could not find container \"c92085a7d955003de9d2979de54291e25a3150c584d144562eba3c66277811ae\": container with ID starting with c92085a7d955003de9d2979de54291e25a3150c584d144562eba3c66277811ae not found: ID does not exist" Jul 03 15:47:37.463728 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.463702 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g"] Jul 03 15:47:37.471118 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:37.471096 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-59ce5a-openshift-default-574b479655-wtg9g"] Jul 03 15:47:38.017331 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:38.017292 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70eee59f-d932-4d9a-8f86-77a211d3709a" path="/var/lib/kubelet/pods/70eee59f-d932-4d9a-8f86-77a211d3709a/volumes" Jul 03 15:47:38.726233 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:38.726199 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:39.988207 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:39.988169 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:40.497845 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.497800 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:40.787000 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.786911 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55"] Jul 03 15:47:40.787344 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.787328 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70eee59f-d932-4d9a-8f86-77a211d3709a" containerName="istio-proxy" Jul 03 15:47:40.787344 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.787343 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="70eee59f-d932-4d9a-8f86-77a211d3709a" containerName="istio-proxy" Jul 03 15:47:40.787529 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.787435 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="70eee59f-d932-4d9a-8f86-77a211d3709a" containerName="istio-proxy" Jul 03 15:47:40.787529 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.787443 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="26cc54cc-0706-4012-afb0-1c06dda70d18" containerName="istio-proxy" Jul 03 15:47:40.790433 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.790414 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.793489 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.793468 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-959db1-openshift-default-dockercfg-4czcj\"" Jul 03 15:47:40.804539 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.804517 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55"] Jul 03 15:47:40.823004 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.822981 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:40.896750 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.896717 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1093792f-5819-4d22-b33e-4f8255507acb-istio-token\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.896921 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.896767 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-credential-socket\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.896921 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.896827 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-istio-data\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.896921 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.896885 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-workload-socket\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.896921 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.896910 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-workload-certs\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.897121 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.896988 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1093792f-5819-4d22-b33e-4f8255507acb-istio-podinfo\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.897121 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.897013 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1093792f-5819-4d22-b33e-4f8255507acb-istiod-ca-cert\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.897121 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.897033 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-istio-envoy\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.897121 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.897080 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x42g5\" (UniqueName: \"kubernetes.io/projected/1093792f-5819-4d22-b33e-4f8255507acb-kube-api-access-x42g5\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.997601 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.997566 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1093792f-5819-4d22-b33e-4f8255507acb-istio-token\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.997601 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.997608 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-credential-socket\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.998126 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.997625 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-istio-data\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.998126 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.997670 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-workload-socket\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.998126 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.997700 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-workload-certs\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.998126 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.997862 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1093792f-5819-4d22-b33e-4f8255507acb-istio-podinfo\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.998126 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.997896 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1093792f-5819-4d22-b33e-4f8255507acb-istiod-ca-cert\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.998126 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.997927 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-istio-envoy\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.998126 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.997969 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x42g5\" (UniqueName: \"kubernetes.io/projected/1093792f-5819-4d22-b33e-4f8255507acb-kube-api-access-x42g5\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.998126 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.998045 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-credential-socket\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.998126 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.998083 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-workload-certs\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.998126 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.998119 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-istio-data\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.998598 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.998144 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-workload-socket\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:40.998636 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:40.998606 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1093792f-5819-4d22-b33e-4f8255507acb-istiod-ca-cert\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:41.000285 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:41.000268 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-istio-envoy\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:41.000449 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:41.000431 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1093792f-5819-4d22-b33e-4f8255507acb-istio-podinfo\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:41.009279 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:41.009254 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1093792f-5819-4d22-b33e-4f8255507acb-istio-token\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:41.009614 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:41.009591 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x42g5\" (UniqueName: \"kubernetes.io/projected/1093792f-5819-4d22-b33e-4f8255507acb-kube-api-access-x42g5\") pod \"e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:41.101579 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:41.101542 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:41.244624 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:41.244584 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55"] Jul 03 15:47:41.245888 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:47:41.245863 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1093792f_5819_4d22_b33e_4f8255507acb.slice/crio-045f0d886fe51db8d0b90d22ae73d22fc19ba4e44ac7a62a01b1372089db1b8e WatchSource:0}: Error finding container 045f0d886fe51db8d0b90d22ae73d22fc19ba4e44ac7a62a01b1372089db1b8e: Status 404 returned error can't find the container with id 045f0d886fe51db8d0b90d22ae73d22fc19ba4e44ac7a62a01b1372089db1b8e Jul 03 15:47:41.248144 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:41.248105 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:47:41.248227 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:41.248187 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:47:41.248264 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:41.248233 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:47:41.383109 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:41.383011 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:41.462061 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:41.462026 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" event={"ID":"1093792f-5819-4d22-b33e-4f8255507acb","Type":"ContainerStarted","Data":"81794e7db3305aa1933eaf24f0fae8ccf2d003a4ba58fe4867aab7b15e0a8377"} Jul 03 15:47:41.462243 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:41.462084 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" event={"ID":"1093792f-5819-4d22-b33e-4f8255507acb","Type":"ContainerStarted","Data":"045f0d886fe51db8d0b90d22ae73d22fc19ba4e44ac7a62a01b1372089db1b8e"} Jul 03 15:47:41.487598 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:41.487542 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" podStartSLOduration=1.487523848 podStartE2EDuration="1.487523848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:47:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:47:41.485602334 +0000 UTC m=+2080.068626164" watchObservedRunningTime="2026-07-03 15:47:41.487523848 +0000 UTC m=+2080.070547676" Jul 03 15:47:42.101709 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:42.101677 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:42.106437 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:42.106412 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:42.466885 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:42.466794 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:42.467960 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:42.467939 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:47:42.526149 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:42.526113 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:47:43.555475 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:43.555436 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:43.663970 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:43.663935 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:43.752342 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:43.752304 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:44.104504 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:44.104469 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:44.207583 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:44.207541 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:48.044769 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:48.044681 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:50.459586 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:50.459545 2532 patch_prober.go:28] interesting pod/e2e-api-a-354253-openshift-default-745744d679-nfr78 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 03 15:47:50.465859 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:50.459626 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" podUID="d8828193-32e3-4d11-8cca-6a1294158b6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 03 15:47:51.518024 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:51.517990 2532 generic.go:356] "Generic (PLEG): container finished" podID="d8828193-32e3-4d11-8cca-6a1294158b6f" containerID="f369c6e9369dbb3873cf5ba7fe9917bfffa6fe17fbb825cfe7de445a890d1b3c" exitCode=0 Jul 03 15:47:51.518434 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:51.518043 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" event={"ID":"d8828193-32e3-4d11-8cca-6a1294158b6f","Type":"ContainerDied","Data":"f369c6e9369dbb3873cf5ba7fe9917bfffa6fe17fbb825cfe7de445a890d1b3c"} Jul 03 15:47:51.518434 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:51.518404 2532 scope.go:117] "RemoveContainer" containerID="f369c6e9369dbb3873cf5ba7fe9917bfffa6fe17fbb825cfe7de445a890d1b3c" Jul 03 15:47:51.519423 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:51.519391 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:47:51.519531 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:51.519485 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:47:51.519596 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:51.519541 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:47:52.524817 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:52.524783 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" event={"ID":"d8828193-32e3-4d11-8cca-6a1294158b6f","Type":"ContainerStarted","Data":"216f4ed905b238cfa85ca47e7ede2569f01766aa3232655a8ba5e14d89461014"} Jul 03 15:47:53.168174 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:53.168137 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:53.168585 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:53.168492 2532 patch_prober.go:28] interesting pod/e2e-api-a-354253-openshift-default-745744d679-nfr78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 03 15:47:53.168778 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:53.168754 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" podUID="d8828193-32e3-4d11-8cca-6a1294158b6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 03 15:47:54.167444 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:54.167407 2532 patch_prober.go:28] interesting pod/e2e-api-a-354253-openshift-default-745744d679-nfr78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 03 15:47:54.168030 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:54.167998 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" podUID="d8828193-32e3-4d11-8cca-6a1294158b6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 03 15:47:55.167921 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:55.167879 2532 patch_prober.go:28] interesting pod/e2e-api-a-354253-openshift-default-745744d679-nfr78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 03 15:47:55.168587 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:55.168550 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" podUID="d8828193-32e3-4d11-8cca-6a1294158b6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 03 15:47:56.168080 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:56.167582 2532 patch_prober.go:28] interesting pod/e2e-api-a-354253-openshift-default-745744d679-nfr78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 03 15:47:56.168080 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:56.167670 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" podUID="d8828193-32e3-4d11-8cca-6a1294158b6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 03 15:47:56.202005 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:56.201971 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:56.586162 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:56.586129 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:56.680570 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:56.680538 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:56.860818 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:56.860730 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:47:57.171898 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:57.171817 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:57.172424 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:57.172404 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:57.173180 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:57.173155 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:47:57.407824 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:57.407790 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:47:58.508533 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:58.508493 2532 patch_prober.go:28] interesting pod/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 03 15:47:58.508930 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:58.508576 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" podUID="1093792f-5819-4d22-b33e-4f8255507acb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 03 15:47:59.566887 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:59.566780 2532 generic.go:356] "Generic (PLEG): container finished" podID="1093792f-5819-4d22-b33e-4f8255507acb" containerID="81794e7db3305aa1933eaf24f0fae8ccf2d003a4ba58fe4867aab7b15e0a8377" exitCode=0 Jul 03 15:47:59.566887 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:59.566853 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" event={"ID":"1093792f-5819-4d22-b33e-4f8255507acb","Type":"ContainerDied","Data":"81794e7db3305aa1933eaf24f0fae8ccf2d003a4ba58fe4867aab7b15e0a8377"} Jul 03 15:47:59.567502 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:59.567406 2532 scope.go:117] "RemoveContainer" containerID="81794e7db3305aa1933eaf24f0fae8ccf2d003a4ba58fe4867aab7b15e0a8377" Jul 03 15:47:59.568429 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:59.568402 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:47:59.568508 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:59.568468 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:47:59.568508 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:47:59.568500 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:48:00.574636 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:00.574604 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" event={"ID":"1093792f-5819-4d22-b33e-4f8255507acb","Type":"ContainerStarted","Data":"013bf35cadccc3d81f6fb355595c5d44d5102aed49334c4ff95e806de8676074"} Jul 03 15:48:01.104234 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:01.104192 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:48:01.104500 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:01.104470 2532 patch_prober.go:28] interesting pod/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 03 15:48:01.104590 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:01.104531 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" podUID="1093792f-5819-4d22-b33e-4f8255507acb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 03 15:48:02.078246 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:02.078213 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/1.log" Jul 03 15:48:02.080242 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:02.080220 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/1.log" Jul 03 15:48:02.081590 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:02.081561 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5hcn_df460999-eb58-4575-91fc-8130653c6f5b/ovn-acl-logging/0.log" Jul 03 15:48:02.083491 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:02.083470 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5hcn_df460999-eb58-4575-91fc-8130653c6f5b/ovn-acl-logging/0.log" Jul 03 15:48:02.102122 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:02.102092 2532 patch_prober.go:28] interesting pod/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 03 15:48:02.102224 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:02.102155 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" podUID="1093792f-5819-4d22-b33e-4f8255507acb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 03 15:48:02.710137 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:02.710099 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:02.811639 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:02.811588 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:03.051455 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:03.051123 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:03.061786 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:03.060601 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78"] Jul 03 15:48:03.061786 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:03.060831 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" podUID="d8828193-32e3-4d11-8cca-6a1294158b6f" containerName="istio-proxy" containerID="cri-o://216f4ed905b238cfa85ca47e7ede2569f01766aa3232655a8ba5e14d89461014" gracePeriod=30 Jul 03 15:48:03.102672 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:03.102632 2532 patch_prober.go:28] interesting pod/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 03 15:48:03.103117 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:03.102692 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" podUID="1093792f-5819-4d22-b33e-4f8255507acb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 03 15:48:03.219109 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:03.219072 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:03.397507 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:03.397468 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:03.792845 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:03.792750 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:03.897027 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:03.896968 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:03.991616 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:03.991577 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:04.102111 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:04.102060 2532 patch_prober.go:28] interesting pod/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 03 15:48:04.102279 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:04.102111 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" podUID="1093792f-5819-4d22-b33e-4f8255507acb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 03 15:48:04.102754 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:04.102727 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:05.105791 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:05.105757 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:48:05.106185 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:05.106049 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:48:05.106874 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:05.106855 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:48:08.311057 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.311024 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:48:08.359484 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.359390 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8828193-32e3-4d11-8cca-6a1294158b6f-istiod-ca-cert\") pod \"d8828193-32e3-4d11-8cca-6a1294158b6f\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " Jul 03 15:48:08.359484 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.359441 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-data\") pod \"d8828193-32e3-4d11-8cca-6a1294158b6f\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " Jul 03 15:48:08.359709 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.359489 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgjbw\" (UniqueName: \"kubernetes.io/projected/d8828193-32e3-4d11-8cca-6a1294158b6f-kube-api-access-fgjbw\") pod \"d8828193-32e3-4d11-8cca-6a1294158b6f\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " Jul 03 15:48:08.359709 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.359526 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-workload-socket\") pod \"d8828193-32e3-4d11-8cca-6a1294158b6f\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " Jul 03 15:48:08.359709 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.359552 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-envoy\") pod \"d8828193-32e3-4d11-8cca-6a1294158b6f\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " Jul 03 15:48:08.359709 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.359576 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-token\") pod \"d8828193-32e3-4d11-8cca-6a1294158b6f\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " Jul 03 15:48:08.359923 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.359853 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8828193-32e3-4d11-8cca-6a1294158b6f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d8828193-32e3-4d11-8cca-6a1294158b6f" (UID: "d8828193-32e3-4d11-8cca-6a1294158b6f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:48:08.360480 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.360130 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-credential-socket\") pod \"d8828193-32e3-4d11-8cca-6a1294158b6f\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " Jul 03 15:48:08.360480 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.360169 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d8828193-32e3-4d11-8cca-6a1294158b6f" (UID: "d8828193-32e3-4d11-8cca-6a1294158b6f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:48:08.360480 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.360193 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d8828193-32e3-4d11-8cca-6a1294158b6f" (UID: "d8828193-32e3-4d11-8cca-6a1294158b6f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:48:08.360480 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.360207 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-workload-certs\") pod \"d8828193-32e3-4d11-8cca-6a1294158b6f\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " Jul 03 15:48:08.360480 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.360302 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-podinfo\") pod \"d8828193-32e3-4d11-8cca-6a1294158b6f\" (UID: \"d8828193-32e3-4d11-8cca-6a1294158b6f\") " Jul 03 15:48:08.360480 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.360328 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-data" (OuterVolumeSpecName: "istio-data") pod "d8828193-32e3-4d11-8cca-6a1294158b6f" (UID: "d8828193-32e3-4d11-8cca-6a1294158b6f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:48:08.360888 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.360689 2532 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8828193-32e3-4d11-8cca-6a1294158b6f-istiod-ca-cert\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:48:08.360888 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.360711 2532 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-data\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:48:08.360888 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.360725 2532 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-workload-socket\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:48:08.360888 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.360739 2532 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-credential-socket\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:48:08.361099 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.360928 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d8828193-32e3-4d11-8cca-6a1294158b6f" (UID: "d8828193-32e3-4d11-8cca-6a1294158b6f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:48:08.362622 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.362596 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d8828193-32e3-4d11-8cca-6a1294158b6f" (UID: "d8828193-32e3-4d11-8cca-6a1294158b6f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:48:08.363850 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.363820 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8828193-32e3-4d11-8cca-6a1294158b6f-kube-api-access-fgjbw" (OuterVolumeSpecName: "kube-api-access-fgjbw") pod "d8828193-32e3-4d11-8cca-6a1294158b6f" (UID: "d8828193-32e3-4d11-8cca-6a1294158b6f"). InnerVolumeSpecName "kube-api-access-fgjbw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:48:08.364019 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.363996 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d8828193-32e3-4d11-8cca-6a1294158b6f" (UID: "d8828193-32e3-4d11-8cca-6a1294158b6f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 03 15:48:08.364122 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.364106 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-token" (OuterVolumeSpecName: "istio-token") pod "d8828193-32e3-4d11-8cca-6a1294158b6f" (UID: "d8828193-32e3-4d11-8cca-6a1294158b6f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:48:08.404351 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.404312 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:48:08.462072 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.462030 2532 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-workload-certs\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:48:08.462072 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.462067 2532 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-podinfo\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:48:08.462283 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.462080 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgjbw\" (UniqueName: \"kubernetes.io/projected/d8828193-32e3-4d11-8cca-6a1294158b6f-kube-api-access-fgjbw\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:48:08.462283 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.462094 2532 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-envoy\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:48:08.462283 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.462106 2532 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8828193-32e3-4d11-8cca-6a1294158b6f-istio-token\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:48:08.617327 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.617234 2532 generic.go:356] "Generic (PLEG): container finished" podID="d8828193-32e3-4d11-8cca-6a1294158b6f" containerID="216f4ed905b238cfa85ca47e7ede2569f01766aa3232655a8ba5e14d89461014" exitCode=0 Jul 03 15:48:08.617327 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.617285 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" Jul 03 15:48:08.617327 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.617317 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" event={"ID":"d8828193-32e3-4d11-8cca-6a1294158b6f","Type":"ContainerDied","Data":"216f4ed905b238cfa85ca47e7ede2569f01766aa3232655a8ba5e14d89461014"} Jul 03 15:48:08.617644 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.617381 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78" event={"ID":"d8828193-32e3-4d11-8cca-6a1294158b6f","Type":"ContainerDied","Data":"a6779a09e863c6440e3cf9a7c83af783eeb186e698ac3e43ac821ec9f4fd1d9b"} Jul 03 15:48:08.617644 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.617398 2532 scope.go:117] "RemoveContainer" containerID="216f4ed905b238cfa85ca47e7ede2569f01766aa3232655a8ba5e14d89461014" Jul 03 15:48:08.626978 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.626962 2532 scope.go:117] "RemoveContainer" containerID="f369c6e9369dbb3873cf5ba7fe9917bfffa6fe17fbb825cfe7de445a890d1b3c" Jul 03 15:48:08.634887 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.634870 2532 scope.go:117] "RemoveContainer" containerID="216f4ed905b238cfa85ca47e7ede2569f01766aa3232655a8ba5e14d89461014" Jul 03 15:48:08.635137 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:48:08.635121 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"216f4ed905b238cfa85ca47e7ede2569f01766aa3232655a8ba5e14d89461014\": container with ID starting with 216f4ed905b238cfa85ca47e7ede2569f01766aa3232655a8ba5e14d89461014 not found: ID does not exist" containerID="216f4ed905b238cfa85ca47e7ede2569f01766aa3232655a8ba5e14d89461014" Jul 03 15:48:08.635188 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.635144 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"216f4ed905b238cfa85ca47e7ede2569f01766aa3232655a8ba5e14d89461014"} err="failed to get container status \"216f4ed905b238cfa85ca47e7ede2569f01766aa3232655a8ba5e14d89461014\": rpc error: code = NotFound desc = could not find container \"216f4ed905b238cfa85ca47e7ede2569f01766aa3232655a8ba5e14d89461014\": container with ID starting with 216f4ed905b238cfa85ca47e7ede2569f01766aa3232655a8ba5e14d89461014 not found: ID does not exist" Jul 03 15:48:08.635188 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.635158 2532 scope.go:117] "RemoveContainer" containerID="f369c6e9369dbb3873cf5ba7fe9917bfffa6fe17fbb825cfe7de445a890d1b3c" Jul 03 15:48:08.635411 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:48:08.635386 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f369c6e9369dbb3873cf5ba7fe9917bfffa6fe17fbb825cfe7de445a890d1b3c\": container with ID starting with f369c6e9369dbb3873cf5ba7fe9917bfffa6fe17fbb825cfe7de445a890d1b3c not found: ID does not exist" containerID="f369c6e9369dbb3873cf5ba7fe9917bfffa6fe17fbb825cfe7de445a890d1b3c" Jul 03 15:48:08.635461 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.635420 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f369c6e9369dbb3873cf5ba7fe9917bfffa6fe17fbb825cfe7de445a890d1b3c"} err="failed to get container status \"f369c6e9369dbb3873cf5ba7fe9917bfffa6fe17fbb825cfe7de445a890d1b3c\": rpc error: code = NotFound desc = could not find container \"f369c6e9369dbb3873cf5ba7fe9917bfffa6fe17fbb825cfe7de445a890d1b3c\": container with ID starting with f369c6e9369dbb3873cf5ba7fe9917bfffa6fe17fbb825cfe7de445a890d1b3c not found: ID does not exist" Jul 03 15:48:08.640983 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.640965 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78"] Jul 03 15:48:08.645892 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:08.645873 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-354253-openshift-default-745744d679-nfr78"] Jul 03 15:48:09.942250 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:09.942187 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:10.019067 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:10.019036 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8828193-32e3-4d11-8cca-6a1294158b6f" path="/var/lib/kubelet/pods/d8828193-32e3-4d11-8cca-6a1294158b6f/volumes" Jul 03 15:48:10.040127 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:10.040090 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:10.183786 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:10.183748 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55"] Jul 03 15:48:10.184015 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:10.183985 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" podUID="1093792f-5819-4d22-b33e-4f8255507acb" containerName="istio-proxy" containerID="cri-o://013bf35cadccc3d81f6fb355595c5d44d5102aed49334c4ff95e806de8676074" gracePeriod=30 Jul 03 15:48:10.220095 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:10.220013 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:10.450171 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:10.450130 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:10.813010 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:10.812977 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:11.092030 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.091998 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd"] Jul 03 15:48:11.092434 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.092398 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8828193-32e3-4d11-8cca-6a1294158b6f" containerName="istio-proxy" Jul 03 15:48:11.092434 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.092411 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8828193-32e3-4d11-8cca-6a1294158b6f" containerName="istio-proxy" Jul 03 15:48:11.092434 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.092434 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70eee59f-d932-4d9a-8f86-77a211d3709a" containerName="istio-proxy" Jul 03 15:48:11.092560 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.092439 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="70eee59f-d932-4d9a-8f86-77a211d3709a" containerName="istio-proxy" Jul 03 15:48:11.092560 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.092507 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="70eee59f-d932-4d9a-8f86-77a211d3709a" containerName="istio-proxy" Jul 03 15:48:11.092560 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.092515 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8828193-32e3-4d11-8cca-6a1294158b6f" containerName="istio-proxy" Jul 03 15:48:11.095322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.095307 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.098128 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.098111 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-3703d4-openshift-default-dockercfg-qt22d\"" Jul 03 15:48:11.110876 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.110851 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd"] Jul 03 15:48:11.122434 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.122398 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:11.185169 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.185129 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-envoy\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.185169 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.185173 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-data\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.185455 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.185203 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-podinfo\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.185455 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.185314 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7slp\" (UniqueName: \"kubernetes.io/projected/67cdadf5-c8e8-4995-9de1-dd11631981e2-kube-api-access-s7slp\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.185455 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.185419 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-credential-socket\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.185455 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.185451 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-token\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.185671 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.185501 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-workload-socket\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.185671 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.185525 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-workload-certs\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.185671 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.185583 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67cdadf5-c8e8-4995-9de1-dd11631981e2-istiod-ca-cert\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.272986 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.272950 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:11.286116 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.286089 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-credential-socket\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.286241 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.286120 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-token\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.286241 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.286141 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-workload-socket\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.286241 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.286157 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-workload-certs\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.286241 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.286209 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67cdadf5-c8e8-4995-9de1-dd11631981e2-istiod-ca-cert\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.286472 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.286249 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-envoy\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.286472 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.286281 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-data\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.286472 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.286319 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-podinfo\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.286472 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.286416 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7slp\" (UniqueName: \"kubernetes.io/projected/67cdadf5-c8e8-4995-9de1-dd11631981e2-kube-api-access-s7slp\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.286687 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.286591 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-credential-socket\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.286741 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.286715 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-workload-certs\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.286795 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.286744 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-workload-socket\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.286857 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.286836 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-data\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.287201 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.287114 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67cdadf5-c8e8-4995-9de1-dd11631981e2-istiod-ca-cert\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.288732 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.288711 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-envoy\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.289154 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.289133 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-podinfo\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.300828 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.300800 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-token\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.300950 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.300887 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7slp\" (UniqueName: \"kubernetes.io/projected/67cdadf5-c8e8-4995-9de1-dd11631981e2-kube-api-access-s7slp\") pod \"e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.405516 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.405427 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:11.544988 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.544961 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd"] Jul 03 15:48:11.547229 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:48:11.547198 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67cdadf5_c8e8_4995_9de1_dd11631981e2.slice/crio-ab0f67531063446a53089d55e2bf07247e08bccb54b7e8dd42f42471b893ab86 WatchSource:0}: Error finding container ab0f67531063446a53089d55e2bf07247e08bccb54b7e8dd42f42471b893ab86: Status 404 returned error can't find the container with id ab0f67531063446a53089d55e2bf07247e08bccb54b7e8dd42f42471b893ab86 Jul 03 15:48:11.549326 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.549292 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:48:11.549430 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.549356 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:48:11.549430 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.549420 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:48:11.642891 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.642850 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" event={"ID":"67cdadf5-c8e8-4995-9de1-dd11631981e2","Type":"ContainerStarted","Data":"b44b103bbe15aafb461b1422869af452bd4da185447611011bd344cab548c848"} Jul 03 15:48:11.643104 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.642920 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" event={"ID":"67cdadf5-c8e8-4995-9de1-dd11631981e2","Type":"ContainerStarted","Data":"ab0f67531063446a53089d55e2bf07247e08bccb54b7e8dd42f42471b893ab86"} Jul 03 15:48:11.664068 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:11.663967 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" podStartSLOduration=0.663950083 podStartE2EDuration="663.950083ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:48:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:48:11.663069284 +0000 UTC m=+2110.246093118" watchObservedRunningTime="2026-07-03 15:48:11.663950083 +0000 UTC m=+2110.246973919" Jul 03 15:48:12.406139 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:12.406097 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:12.411274 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:12.411247 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:12.647766 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:12.647733 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:12.648876 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:12.648854 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:13.782231 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:13.782202 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:13.883502 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:13.883456 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:14.037979 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:14.037887 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:14.471214 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:14.471182 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:14.569950 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:14.569913 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:15.450674 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.450605 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:48:15.521704 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.521671 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1093792f-5819-4d22-b33e-4f8255507acb-istiod-ca-cert\") pod \"1093792f-5819-4d22-b33e-4f8255507acb\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " Jul 03 15:48:15.521891 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.521728 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-workload-certs\") pod \"1093792f-5819-4d22-b33e-4f8255507acb\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " Jul 03 15:48:15.521891 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.521752 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x42g5\" (UniqueName: \"kubernetes.io/projected/1093792f-5819-4d22-b33e-4f8255507acb-kube-api-access-x42g5\") pod \"1093792f-5819-4d22-b33e-4f8255507acb\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " Jul 03 15:48:15.521891 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.521777 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1093792f-5819-4d22-b33e-4f8255507acb-istio-podinfo\") pod \"1093792f-5819-4d22-b33e-4f8255507acb\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " Jul 03 15:48:15.521891 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.521856 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1093792f-5819-4d22-b33e-4f8255507acb-istio-token\") pod \"1093792f-5819-4d22-b33e-4f8255507acb\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " Jul 03 15:48:15.521891 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.521879 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-workload-socket\") pod \"1093792f-5819-4d22-b33e-4f8255507acb\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " Jul 03 15:48:15.522155 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.521905 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-istio-envoy\") pod \"1093792f-5819-4d22-b33e-4f8255507acb\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " Jul 03 15:48:15.522155 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.521957 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-istio-data\") pod \"1093792f-5819-4d22-b33e-4f8255507acb\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " Jul 03 15:48:15.522155 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.522027 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1093792f-5819-4d22-b33e-4f8255507acb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1093792f-5819-4d22-b33e-4f8255507acb" (UID: "1093792f-5819-4d22-b33e-4f8255507acb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:48:15.522155 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.522042 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1093792f-5819-4d22-b33e-4f8255507acb" (UID: "1093792f-5819-4d22-b33e-4f8255507acb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:48:15.522392 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.522183 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1093792f-5819-4d22-b33e-4f8255507acb" (UID: "1093792f-5819-4d22-b33e-4f8255507acb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:48:15.522392 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.522325 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-credential-socket\") pod \"1093792f-5819-4d22-b33e-4f8255507acb\" (UID: \"1093792f-5819-4d22-b33e-4f8255507acb\") " Jul 03 15:48:15.522585 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.522558 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1093792f-5819-4d22-b33e-4f8255507acb" (UID: "1093792f-5819-4d22-b33e-4f8255507acb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:48:15.522825 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.522693 2532 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-workload-socket\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:48:15.522825 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.522710 2532 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-credential-socket\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:48:15.522825 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.522719 2532 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1093792f-5819-4d22-b33e-4f8255507acb-istiod-ca-cert\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:48:15.522825 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.522727 2532 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-workload-certs\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:48:15.523187 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.523060 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-istio-data" (OuterVolumeSpecName: "istio-data") pod "1093792f-5819-4d22-b33e-4f8255507acb" (UID: "1093792f-5819-4d22-b33e-4f8255507acb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:48:15.524256 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.524231 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1093792f-5819-4d22-b33e-4f8255507acb" (UID: "1093792f-5819-4d22-b33e-4f8255507acb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:48:15.524354 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.524257 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1093792f-5819-4d22-b33e-4f8255507acb-istio-token" (OuterVolumeSpecName: "istio-token") pod "1093792f-5819-4d22-b33e-4f8255507acb" (UID: "1093792f-5819-4d22-b33e-4f8255507acb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:48:15.524505 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.524483 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1093792f-5819-4d22-b33e-4f8255507acb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1093792f-5819-4d22-b33e-4f8255507acb" (UID: "1093792f-5819-4d22-b33e-4f8255507acb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 03 15:48:15.524593 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.524584 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1093792f-5819-4d22-b33e-4f8255507acb-kube-api-access-x42g5" (OuterVolumeSpecName: "kube-api-access-x42g5") pod "1093792f-5819-4d22-b33e-4f8255507acb" (UID: "1093792f-5819-4d22-b33e-4f8255507acb"). InnerVolumeSpecName "kube-api-access-x42g5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:48:15.623815 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.623766 2532 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1093792f-5819-4d22-b33e-4f8255507acb-istio-token\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:48:15.623815 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.623811 2532 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-istio-envoy\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:48:15.623815 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.623821 2532 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1093792f-5819-4d22-b33e-4f8255507acb-istio-data\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:48:15.623815 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.623831 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x42g5\" (UniqueName: \"kubernetes.io/projected/1093792f-5819-4d22-b33e-4f8255507acb-kube-api-access-x42g5\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:48:15.624092 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.623841 2532 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1093792f-5819-4d22-b33e-4f8255507acb-istio-podinfo\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:48:15.666428 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.666394 2532 generic.go:356] "Generic (PLEG): container finished" podID="1093792f-5819-4d22-b33e-4f8255507acb" containerID="013bf35cadccc3d81f6fb355595c5d44d5102aed49334c4ff95e806de8676074" exitCode=0 Jul 03 15:48:15.666605 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.666474 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" Jul 03 15:48:15.666605 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.666486 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" event={"ID":"1093792f-5819-4d22-b33e-4f8255507acb","Type":"ContainerDied","Data":"013bf35cadccc3d81f6fb355595c5d44d5102aed49334c4ff95e806de8676074"} Jul 03 15:48:15.666605 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.666556 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55" event={"ID":"1093792f-5819-4d22-b33e-4f8255507acb","Type":"ContainerDied","Data":"045f0d886fe51db8d0b90d22ae73d22fc19ba4e44ac7a62a01b1372089db1b8e"} Jul 03 15:48:15.666605 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.666579 2532 scope.go:117] "RemoveContainer" containerID="013bf35cadccc3d81f6fb355595c5d44d5102aed49334c4ff95e806de8676074" Jul 03 15:48:15.676354 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.676332 2532 scope.go:117] "RemoveContainer" containerID="81794e7db3305aa1933eaf24f0fae8ccf2d003a4ba58fe4867aab7b15e0a8377" Jul 03 15:48:15.685764 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.685746 2532 scope.go:117] "RemoveContainer" containerID="013bf35cadccc3d81f6fb355595c5d44d5102aed49334c4ff95e806de8676074" Jul 03 15:48:15.686036 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:48:15.686017 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"013bf35cadccc3d81f6fb355595c5d44d5102aed49334c4ff95e806de8676074\": container with ID starting with 013bf35cadccc3d81f6fb355595c5d44d5102aed49334c4ff95e806de8676074 not found: ID does not exist" containerID="013bf35cadccc3d81f6fb355595c5d44d5102aed49334c4ff95e806de8676074" Jul 03 15:48:15.686103 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.686046 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"013bf35cadccc3d81f6fb355595c5d44d5102aed49334c4ff95e806de8676074"} err="failed to get container status \"013bf35cadccc3d81f6fb355595c5d44d5102aed49334c4ff95e806de8676074\": rpc error: code = NotFound desc = could not find container \"013bf35cadccc3d81f6fb355595c5d44d5102aed49334c4ff95e806de8676074\": container with ID starting with 013bf35cadccc3d81f6fb355595c5d44d5102aed49334c4ff95e806de8676074 not found: ID does not exist" Jul 03 15:48:15.686103 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.686062 2532 scope.go:117] "RemoveContainer" containerID="81794e7db3305aa1933eaf24f0fae8ccf2d003a4ba58fe4867aab7b15e0a8377" Jul 03 15:48:15.686332 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:48:15.686314 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81794e7db3305aa1933eaf24f0fae8ccf2d003a4ba58fe4867aab7b15e0a8377\": container with ID starting with 81794e7db3305aa1933eaf24f0fae8ccf2d003a4ba58fe4867aab7b15e0a8377 not found: ID does not exist" containerID="81794e7db3305aa1933eaf24f0fae8ccf2d003a4ba58fe4867aab7b15e0a8377" Jul 03 15:48:15.686414 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.686339 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81794e7db3305aa1933eaf24f0fae8ccf2d003a4ba58fe4867aab7b15e0a8377"} err="failed to get container status \"81794e7db3305aa1933eaf24f0fae8ccf2d003a4ba58fe4867aab7b15e0a8377\": rpc error: code = NotFound desc = could not find container \"81794e7db3305aa1933eaf24f0fae8ccf2d003a4ba58fe4867aab7b15e0a8377\": container with ID starting with 81794e7db3305aa1933eaf24f0fae8ccf2d003a4ba58fe4867aab7b15e0a8377 not found: ID does not exist" Jul 03 15:48:15.690098 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.690077 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55"] Jul 03 15:48:15.696678 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:15.696656 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-959db1-openshift-default-5b454c56bf-5lz55"] Jul 03 15:48:16.017287 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:16.017257 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1093792f-5819-4d22-b33e-4f8255507acb" path="/var/lib/kubelet/pods/1093792f-5819-4d22-b33e-4f8255507acb/volumes" Jul 03 15:48:19.115144 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:19.115105 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:48:23.226148 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.226105 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:23.556593 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.556487 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:23.836935 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.836901 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5"] Jul 03 15:48:23.837293 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.837280 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1093792f-5819-4d22-b33e-4f8255507acb" containerName="istio-proxy" Jul 03 15:48:23.837340 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.837295 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="1093792f-5819-4d22-b33e-4f8255507acb" containerName="istio-proxy" Jul 03 15:48:23.837340 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.837314 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8828193-32e3-4d11-8cca-6a1294158b6f" containerName="istio-proxy" Jul 03 15:48:23.837340 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.837319 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8828193-32e3-4d11-8cca-6a1294158b6f" containerName="istio-proxy" Jul 03 15:48:23.837340 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.837329 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1093792f-5819-4d22-b33e-4f8255507acb" containerName="istio-proxy" Jul 03 15:48:23.837340 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.837334 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="1093792f-5819-4d22-b33e-4f8255507acb" containerName="istio-proxy" Jul 03 15:48:23.837591 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.837447 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8828193-32e3-4d11-8cca-6a1294158b6f" containerName="istio-proxy" Jul 03 15:48:23.837591 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.837465 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="1093792f-5819-4d22-b33e-4f8255507acb" containerName="istio-proxy" Jul 03 15:48:23.837591 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.837474 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="1093792f-5819-4d22-b33e-4f8255507acb" containerName="istio-proxy" Jul 03 15:48:23.867416 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.866573 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5"] Jul 03 15:48:23.867416 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.866701 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:23.869788 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.869753 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-31658c-openshift-default-dockercfg-cnglb\"" Jul 03 15:48:23.872186 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.872155 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:23.897614 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.897582 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvznw\" (UniqueName: \"kubernetes.io/projected/0d139d4e-08e3-4657-ae74-78af8b6bc30f-kube-api-access-vvznw\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:23.897734 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.897626 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istiod-ca-cert\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:23.897734 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.897665 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-credential-socket\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:23.897734 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.897707 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-podinfo\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:23.897882 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.897751 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-data\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:23.897882 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.897786 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-workload-certs\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:23.897882 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.897804 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-token\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:23.897882 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.897873 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-workload-socket\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:23.898032 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.897903 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-envoy\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:23.998986 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.998949 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-envoy\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:23.999160 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.999000 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvznw\" (UniqueName: \"kubernetes.io/projected/0d139d4e-08e3-4657-ae74-78af8b6bc30f-kube-api-access-vvznw\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:23.999160 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.999029 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istiod-ca-cert\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:23.999160 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.999050 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-credential-socket\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:23.999160 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.999084 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-podinfo\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:23.999160 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.999103 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-data\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:23.999160 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.999125 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-workload-certs\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:23.999160 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.999149 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-token\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:23.999517 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.999179 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-workload-socket\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:23.999707 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.999597 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-workload-certs\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:23.999707 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.999621 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-workload-socket\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:23.999837 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.999728 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-credential-socket\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:23.999837 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:23.999778 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-data\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:24.000089 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:24.000068 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istiod-ca-cert\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:24.001615 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:24.001592 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-envoy\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:24.001728 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:24.001708 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-podinfo\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:24.009455 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:24.009434 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvznw\" (UniqueName: \"kubernetes.io/projected/0d139d4e-08e3-4657-ae74-78af8b6bc30f-kube-api-access-vvznw\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:24.010959 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:24.010938 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-token\") pod \"e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:24.153507 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:24.153472 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:24.180230 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:24.180200 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:24.331690 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:24.331664 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5"] Jul 03 15:48:24.333951 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:48:24.333917 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d139d4e_08e3_4657_ae74_78af8b6bc30f.slice/crio-d4fbd6df55b36c60d0c609b0d16b379944d03b9d0feb23af22bec27fe1aa4434 WatchSource:0}: Error finding container d4fbd6df55b36c60d0c609b0d16b379944d03b9d0feb23af22bec27fe1aa4434: Status 404 returned error can't find the container with id d4fbd6df55b36c60d0c609b0d16b379944d03b9d0feb23af22bec27fe1aa4434 Jul 03 15:48:24.336199 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:24.336162 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:48:24.336271 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:24.336232 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:48:24.336271 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:24.336262 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:48:24.715965 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:24.715863 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" event={"ID":"0d139d4e-08e3-4657-ae74-78af8b6bc30f","Type":"ContainerStarted","Data":"befe2019e27275deb07cb893fb62b0d909e088f4c1fdbca497a23c250e367ecb"} Jul 03 15:48:24.715965 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:24.715939 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" event={"ID":"0d139d4e-08e3-4657-ae74-78af8b6bc30f","Type":"ContainerStarted","Data":"d4fbd6df55b36c60d0c609b0d16b379944d03b9d0feb23af22bec27fe1aa4434"} Jul 03 15:48:24.740675 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:24.738079 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" podStartSLOduration=1.738057037 podStartE2EDuration="1.738057037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:48:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:48:24.737407675 +0000 UTC m=+2123.320431513" watchObservedRunningTime="2026-07-03 15:48:24.738057037 +0000 UTC m=+2123.321080870" Jul 03 15:48:25.180741 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:25.180692 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:25.185967 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:25.185940 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:25.721384 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:25.721332 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:25.729665 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:25.728642 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:26.875440 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:26.875390 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:26.969798 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:26.969755 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:27.096485 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:27.096448 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:27.540140 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:27.540017 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:27.637098 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:27.637066 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:27.649958 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:27.649925 2532 patch_prober.go:28] interesting pod/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 03 15:48:27.650133 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:27.649986 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" podUID="67cdadf5-c8e8-4995-9de1-dd11631981e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 03 15:48:27.733669 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:27.733639 2532 generic.go:356] "Generic (PLEG): container finished" podID="67cdadf5-c8e8-4995-9de1-dd11631981e2" containerID="b44b103bbe15aafb461b1422869af452bd4da185447611011bd344cab548c848" exitCode=0 Jul 03 15:48:27.733851 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:27.733711 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" event={"ID":"67cdadf5-c8e8-4995-9de1-dd11631981e2","Type":"ContainerDied","Data":"b44b103bbe15aafb461b1422869af452bd4da185447611011bd344cab548c848"} Jul 03 15:48:27.734257 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:27.734242 2532 scope.go:117] "RemoveContainer" containerID="b44b103bbe15aafb461b1422869af452bd4da185447611011bd344cab548c848" Jul 03 15:48:27.735210 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:27.735182 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:48:27.735278 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:27.735247 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:48:27.735343 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:27.735279 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:48:27.740549 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:27.740513 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:28.742323 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:28.742285 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" event={"ID":"67cdadf5-c8e8-4995-9de1-dd11631981e2","Type":"ContainerStarted","Data":"f32f3ca0fc517ad60f8fa872c962f8e573dcf14c4d931578892ce8b5d5a60461"} Jul 03 15:48:29.405877 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:29.405836 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:29.406088 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:29.406067 2532 patch_prober.go:28] interesting pod/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 03 15:48:29.406169 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:29.406136 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" podUID="67cdadf5-c8e8-4995-9de1-dd11631981e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 03 15:48:30.406444 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:30.406361 2532 patch_prober.go:28] interesting pod/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 03 15:48:30.406811 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:30.406474 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" podUID="67cdadf5-c8e8-4995-9de1-dd11631981e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 03 15:48:30.725161 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:30.725070 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:48:31.287854 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:31.287818 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:31.406241 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:31.406197 2532 patch_prober.go:28] interesting pod/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 03 15:48:31.406494 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:31.406472 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" podUID="67cdadf5-c8e8-4995-9de1-dd11631981e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 03 15:48:32.406131 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:32.406099 2532 patch_prober.go:28] interesting pod/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 03 15:48:32.406305 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:32.406166 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" podUID="67cdadf5-c8e8-4995-9de1-dd11631981e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 03 15:48:33.410709 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:33.410676 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:33.411101 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:33.411078 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:33.411834 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:33.411811 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:48:35.213490 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:35.213451 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:35.314435 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:35.314404 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:38.134879 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:38.134826 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:39.809800 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:39.809766 2532 generic.go:356] "Generic (PLEG): container finished" podID="0d139d4e-08e3-4657-ae74-78af8b6bc30f" containerID="befe2019e27275deb07cb893fb62b0d909e088f4c1fdbca497a23c250e367ecb" exitCode=0 Jul 03 15:48:39.810237 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:39.809845 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" event={"ID":"0d139d4e-08e3-4657-ae74-78af8b6bc30f","Type":"ContainerDied","Data":"befe2019e27275deb07cb893fb62b0d909e088f4c1fdbca497a23c250e367ecb"} Jul 03 15:48:39.810297 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:39.810280 2532 scope.go:117] "RemoveContainer" containerID="befe2019e27275deb07cb893fb62b0d909e088f4c1fdbca497a23c250e367ecb" Jul 03 15:48:39.811379 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:39.811336 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:48:39.811442 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:39.811427 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:48:39.811490 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:39.811481 2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 03 15:48:40.721963 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:40.721929 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:40.816682 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:40.816643 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" event={"ID":"0d139d4e-08e3-4657-ae74-78af8b6bc30f","Type":"ContainerStarted","Data":"ff22a270e3ed591c1b8f55b694fee8db19be94eba0d97f3c98c5e0b55813a9fb"} Jul 03 15:48:41.181475 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:41.181435 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:41.182750 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:41.182727 2532 patch_prober.go:28] interesting pod/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 03 15:48:41.182883 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:41.182807 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" podUID="0d139d4e-08e3-4657-ae74-78af8b6bc30f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 03 15:48:42.181498 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:42.181461 2532 patch_prober.go:28] interesting pod/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 03 15:48:42.181902 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:42.181515 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" podUID="0d139d4e-08e3-4657-ae74-78af8b6bc30f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 03 15:48:43.181418 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:43.181358 2532 patch_prober.go:28] interesting pod/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 03 15:48:43.181596 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:43.181439 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" podUID="0d139d4e-08e3-4657-ae74-78af8b6bc30f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 03 15:48:44.181716 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:44.181672 2532 patch_prober.go:28] interesting pod/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 03 15:48:44.182339 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:44.181737 2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" podUID="0d139d4e-08e3-4657-ae74-78af8b6bc30f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 03 15:48:45.185689 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:45.185661 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:45.186102 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:45.185950 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:45.186704 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:45.186686 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:48:48.437876 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:48.437843 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:48.529006 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:48.528969 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:48:49.562117 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:48:49.562083 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:49:17.103863 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:49:17.103815 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:49:20.605542 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:49:20.605506 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:49:37.704856 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:49:37.704818 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:49:50.410112 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:49:50.410079 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:50:07.511129 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:50:07.511096 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:50:24.813725 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:50:24.813649 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:50:41.394827 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:50:41.394790 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:50:49.153234 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:50:49.153197 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:50:55.203542 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:50:55.203508 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:51:12.002325 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:12.002285 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:51:17.149380 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:17.149331 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:51:18.096296 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:18.096258 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:51:28.912014 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:28.911976 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz"] Jul 03 15:51:28.917535 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:28.917505 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:51:28.917705 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:28.917622 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:28.920455 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:28.920434 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3703d4\"/\"openshift-service-ca.crt\"" Jul 03 15:51:28.921615 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:28.921595 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3703d4\"/\"default-dockercfg-tcx7m\"" Jul 03 15:51:28.921724 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:28.921659 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3703d4\"/\"kube-root-ca.crt\"" Jul 03 15:51:28.921724 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:28.921664 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3703d4\"/\"sub-test-model-3703d4-kserve-self-signed-certs\"" Jul 03 15:51:28.930314 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:28.930284 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz"] Jul 03 15:51:28.958086 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:28.958057 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:51:29.020773 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.020736 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-home\") pod \"sub-test-model-3703d4-kserve-79c456b5d9-w46pz\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:29.020773 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.020777 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-model-cache\") pod \"sub-test-model-3703d4-kserve-79c456b5d9-w46pz\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:29.020998 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.020853 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-tmp-dir\") pod \"sub-test-model-3703d4-kserve-79c456b5d9-w46pz\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:29.020998 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.020880 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-tls-certs\") pod \"sub-test-model-3703d4-kserve-79c456b5d9-w46pz\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:29.020998 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.020896 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6svm\" (UniqueName: \"kubernetes.io/projected/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-kube-api-access-f6svm\") pod \"sub-test-model-3703d4-kserve-79c456b5d9-w46pz\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:29.020998 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.020914 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-dshm\") pod \"sub-test-model-3703d4-kserve-79c456b5d9-w46pz\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:29.121870 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.121825 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-tmp-dir\") pod \"sub-test-model-3703d4-kserve-79c456b5d9-w46pz\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:29.121870 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.121879 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-tls-certs\") pod \"sub-test-model-3703d4-kserve-79c456b5d9-w46pz\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:29.122097 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.121898 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6svm\" (UniqueName: \"kubernetes.io/projected/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-kube-api-access-f6svm\") pod \"sub-test-model-3703d4-kserve-79c456b5d9-w46pz\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:29.122097 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.121925 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-dshm\") pod \"sub-test-model-3703d4-kserve-79c456b5d9-w46pz\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:29.122097 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.121979 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-home\") pod \"sub-test-model-3703d4-kserve-79c456b5d9-w46pz\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:29.122097 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.122007 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-model-cache\") pod \"sub-test-model-3703d4-kserve-79c456b5d9-w46pz\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:29.122316 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.122293 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-tmp-dir\") pod \"sub-test-model-3703d4-kserve-79c456b5d9-w46pz\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:29.122412 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.122344 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-home\") pod \"sub-test-model-3703d4-kserve-79c456b5d9-w46pz\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:29.122490 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.122473 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-model-cache\") pod \"sub-test-model-3703d4-kserve-79c456b5d9-w46pz\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:29.124323 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.124297 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-dshm\") pod \"sub-test-model-3703d4-kserve-79c456b5d9-w46pz\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:29.124555 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.124535 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-tls-certs\") pod \"sub-test-model-3703d4-kserve-79c456b5d9-w46pz\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:29.131133 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.131111 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6svm\" (UniqueName: \"kubernetes.io/projected/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-kube-api-access-f6svm\") pod \"sub-test-model-3703d4-kserve-79c456b5d9-w46pz\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:29.229120 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.229031 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:29.376594 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.376567 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz"] Jul 03 15:51:29.378639 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:51:29.378609 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bbb6fc0_1a0e_4efe_a164_6063c5da3ed2.slice/crio-5f5e5fb67a2e755621af4812ea9e2aa2c1d3a120b12791e83111ff228df7f37b WatchSource:0}: Error finding container 5f5e5fb67a2e755621af4812ea9e2aa2c1d3a120b12791e83111ff228df7f37b: Status 404 returned error can't find the container with id 5f5e5fb67a2e755621af4812ea9e2aa2c1d3a120b12791e83111ff228df7f37b Jul 03 15:51:29.687196 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.687158 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" event={"ID":"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2","Type":"ContainerStarted","Data":"c98c91fbd3de79467d02086de729f280af931b00b4a88ec930922309ca6a3537"} Jul 03 15:51:29.687433 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.687204 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" event={"ID":"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2","Type":"ContainerStarted","Data":"5f5e5fb67a2e755621af4812ea9e2aa2c1d3a120b12791e83111ff228df7f37b"} Jul 03 15:51:29.711569 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:29.711501 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" podStartSLOduration=1.71148524 podStartE2EDuration="1.71148524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:51:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:51:29.710216972 +0000 UTC m=+2308.293240802" watchObservedRunningTime="2026-07-03 15:51:29.71148524 +0000 UTC m=+2308.294509069" Jul 03 15:51:39.230184 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:39.230144 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:39.230641 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:39.230337 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:39.243264 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:39.243235 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:39.747858 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:39.747831 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:51:39.991174 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:39.991139 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:51:52.591181 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:52.591147 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:51:57.097014 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:51:57.096970 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:52:20.308915 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:20.308879 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:52:34.521743 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:34.521689 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz"] Jul 03 15:52:34.552409 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:34.552357 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:52:35.516679 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:35.516648 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:52:38.599920 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:38.599884 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:52:45.536497 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:45.536459 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:52:49.498658 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:49.498619 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:52:49.544815 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:49.544745 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" podUID="9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2" containerName="main" containerID="cri-o://c98c91fbd3de79467d02086de729f280af931b00b4a88ec930922309ca6a3537" gracePeriod=45 Jul 03 15:52:49.807500 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:49.807461 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:52:49.881064 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:49.881030 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-tmp-dir\") pod \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " Jul 03 15:52:49.881233 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:49.881081 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-home\") pod \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " Jul 03 15:52:49.881233 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:49.881115 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-tls-certs\") pod \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " Jul 03 15:52:49.881233 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:49.881139 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-dshm\") pod \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " Jul 03 15:52:49.881233 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:49.881188 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-model-cache\") pod \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " Jul 03 15:52:49.881444 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:49.881253 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6svm\" (UniqueName: \"kubernetes.io/projected/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-kube-api-access-f6svm\") pod \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\" (UID: \"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2\") " Jul 03 15:52:49.881444 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:49.881298 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2" (UID: "9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:52:49.881557 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:49.881481 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-home" (OuterVolumeSpecName: "home") pod "9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2" (UID: "9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:52:49.881557 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:49.881516 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-model-cache" (OuterVolumeSpecName: "model-cache") pod "9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2" (UID: "9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:52:49.881669 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:49.881588 2532 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-home\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:52:49.881669 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:49.881602 2532 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-model-cache\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:52:49.881669 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:49.881612 2532 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-tmp-dir\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:52:49.883643 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:49.883616 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2" (UID: "9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 15:52:49.883745 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:49.883635 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-kube-api-access-f6svm" (OuterVolumeSpecName: "kube-api-access-f6svm") pod "9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2" (UID: "9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2"). InnerVolumeSpecName "kube-api-access-f6svm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:52:49.883745 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:49.883677 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-dshm" (OuterVolumeSpecName: "dshm") pod "9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2" (UID: "9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:52:49.982822 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:49.982790 2532 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-tls-certs\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:52:49.982822 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:49.982819 2532 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-dshm\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:52:49.982822 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:49.982828 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6svm\" (UniqueName: \"kubernetes.io/projected/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2-kube-api-access-f6svm\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:52:50.105516 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:50.105474 2532 generic.go:356] "Generic (PLEG): container finished" podID="9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2" containerID="c98c91fbd3de79467d02086de729f280af931b00b4a88ec930922309ca6a3537" exitCode=0 Jul 03 15:52:50.105516 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:50.105516 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" Jul 03 15:52:50.105770 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:50.105561 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" event={"ID":"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2","Type":"ContainerDied","Data":"c98c91fbd3de79467d02086de729f280af931b00b4a88ec930922309ca6a3537"} Jul 03 15:52:50.105770 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:50.105609 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" event={"ID":"9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2","Type":"ContainerDied","Data":"5f5e5fb67a2e755621af4812ea9e2aa2c1d3a120b12791e83111ff228df7f37b"} Jul 03 15:52:50.105770 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:50.105626 2532 scope.go:117] "RemoveContainer" containerID="c98c91fbd3de79467d02086de729f280af931b00b4a88ec930922309ca6a3537" Jul 03 15:52:50.114614 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:50.114580 2532 scope.go:117] "RemoveContainer" containerID="c98c91fbd3de79467d02086de729f280af931b00b4a88ec930922309ca6a3537" Jul 03 15:52:50.114910 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:52:50.114887 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c98c91fbd3de79467d02086de729f280af931b00b4a88ec930922309ca6a3537\": container with ID starting with c98c91fbd3de79467d02086de729f280af931b00b4a88ec930922309ca6a3537 not found: ID does not exist" containerID="c98c91fbd3de79467d02086de729f280af931b00b4a88ec930922309ca6a3537" Jul 03 15:52:50.114977 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:50.114917 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c98c91fbd3de79467d02086de729f280af931b00b4a88ec930922309ca6a3537"} err="failed to get container status \"c98c91fbd3de79467d02086de729f280af931b00b4a88ec930922309ca6a3537\": rpc error: code = NotFound desc = could not find container \"c98c91fbd3de79467d02086de729f280af931b00b4a88ec930922309ca6a3537\": container with ID starting with c98c91fbd3de79467d02086de729f280af931b00b4a88ec930922309ca6a3537 not found: ID does not exist" Jul 03 15:52:50.122246 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:50.122221 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz"] Jul 03 15:52:50.125427 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:50.125404 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz"] Jul 03 15:52:52.017832 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:52.017787 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2" path="/var/lib/kubelet/pods/9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2/volumes" Jul 03 15:52:54.737234 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:54.737186 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-3703d4/sub-test-model-3703d4-kserve-79c456b5d9-w46pz" podUID="9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Jul 03 15:52:57.308457 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:57.308420 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:52:57.406595 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:52:57.406555 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:53:02.110823 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:53:02.110785 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/1.log" Jul 03 15:53:02.116742 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:53:02.116715 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/1.log" Jul 03 15:53:02.116946 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:53:02.116932 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5hcn_df460999-eb58-4575-91fc-8130653c6f5b/ovn-acl-logging/0.log" Jul 03 15:53:02.119842 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:53:02.119823 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5hcn_df460999-eb58-4575-91fc-8130653c6f5b/ovn-acl-logging/0.log" Jul 03 15:53:35.933931 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:53:35.933896 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:53:36.032405 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:53:36.032356 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:53:41.327179 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:53:41.327140 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:53:46.096875 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:53:46.096843 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:53:49.458501 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:53:49.458467 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:53:49.559801 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:53:49.559746 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:53:58.737439 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:53:58.737394 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:54:00.100352 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:54:00.100314 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:54:14.905595 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:54:14.905556 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:54:20.246945 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:54:20.246910 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:54:21.599643 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:54:21.599602 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:54:22.139790 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:54:22.139752 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:54:22.579663 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:54:22.579626 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:54:22.676955 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:54:22.676922 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:54:22.776960 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:54:22.776925 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:54:22.880643 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:54:22.880545 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:54:26.528604 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:54:26.528573 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:54:26.579664 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:54:26.579631 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:54:27.649394 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:54:27.649346 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:54:30.199287 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:54:30.199255 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:55:04.399512 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:04.399431 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:55:04.644495 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:04.644462 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd"] Jul 03 15:55:04.644735 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:04.644702 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" podUID="67cdadf5-c8e8-4995-9de1-dd11631981e2" containerName="istio-proxy" containerID="cri-o://f32f3ca0fc517ad60f8fa872c962f8e573dcf14c4d931578892ce8b5d5a60461" gracePeriod=30 Jul 03 15:55:04.665391 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:04.665304 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:55:04.914991 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:04.914946 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:55:05.101014 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:05.100959 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:55:05.507318 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:05.507236 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:55:05.612358 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:05.612331 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:55:05.714499 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:05.714460 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:55:05.863892 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:05.863861 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:55:09.003934 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.003891 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fp4ww"] Jul 03 15:55:09.821590 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.821553 2532 generic.go:356] "Generic (PLEG): container finished" podID="67cdadf5-c8e8-4995-9de1-dd11631981e2" containerID="f32f3ca0fc517ad60f8fa872c962f8e573dcf14c4d931578892ce8b5d5a60461" exitCode=0 Jul 03 15:55:09.821775 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.821585 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" event={"ID":"67cdadf5-c8e8-4995-9de1-dd11631981e2","Type":"ContainerDied","Data":"f32f3ca0fc517ad60f8fa872c962f8e573dcf14c4d931578892ce8b5d5a60461"} Jul 03 15:55:09.821775 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.821668 2532 scope.go:117] "RemoveContainer" containerID="b44b103bbe15aafb461b1422869af452bd4da185447611011bd344cab548c848" Jul 03 15:55:09.911628 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.911562 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:55:09.976678 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.976650 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-workload-certs\") pod \"67cdadf5-c8e8-4995-9de1-dd11631981e2\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " Jul 03 15:55:09.976832 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.976693 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-workload-socket\") pod \"67cdadf5-c8e8-4995-9de1-dd11631981e2\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " Jul 03 15:55:09.976832 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.976724 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-token\") pod \"67cdadf5-c8e8-4995-9de1-dd11631981e2\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " Jul 03 15:55:09.976832 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.976755 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67cdadf5-c8e8-4995-9de1-dd11631981e2-istiod-ca-cert\") pod \"67cdadf5-c8e8-4995-9de1-dd11631981e2\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " Jul 03 15:55:09.976832 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.976788 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-envoy\") pod \"67cdadf5-c8e8-4995-9de1-dd11631981e2\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " Jul 03 15:55:09.976832 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.976822 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7slp\" (UniqueName: \"kubernetes.io/projected/67cdadf5-c8e8-4995-9de1-dd11631981e2-kube-api-access-s7slp\") pod \"67cdadf5-c8e8-4995-9de1-dd11631981e2\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " Jul 03 15:55:09.977063 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.976970 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "67cdadf5-c8e8-4995-9de1-dd11631981e2" (UID: "67cdadf5-c8e8-4995-9de1-dd11631981e2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:55:09.977063 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.976982 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-credential-socket\") pod \"67cdadf5-c8e8-4995-9de1-dd11631981e2\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " Jul 03 15:55:09.977063 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.977042 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-data\") pod \"67cdadf5-c8e8-4995-9de1-dd11631981e2\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " Jul 03 15:55:09.977214 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.977101 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-podinfo\") pod \"67cdadf5-c8e8-4995-9de1-dd11631981e2\" (UID: \"67cdadf5-c8e8-4995-9de1-dd11631981e2\") " Jul 03 15:55:09.977214 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.976986 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "67cdadf5-c8e8-4995-9de1-dd11631981e2" (UID: "67cdadf5-c8e8-4995-9de1-dd11631981e2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:55:09.977214 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.977128 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "67cdadf5-c8e8-4995-9de1-dd11631981e2" (UID: "67cdadf5-c8e8-4995-9de1-dd11631981e2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:55:09.977430 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.977400 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67cdadf5-c8e8-4995-9de1-dd11631981e2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "67cdadf5-c8e8-4995-9de1-dd11631981e2" (UID: "67cdadf5-c8e8-4995-9de1-dd11631981e2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:55:09.977704 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.977465 2532 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-workload-certs\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:55:09.977704 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.977487 2532 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-workload-socket\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:55:09.977704 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.977501 2532 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-credential-socket\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:55:09.977926 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.977894 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-data" (OuterVolumeSpecName: "istio-data") pod "67cdadf5-c8e8-4995-9de1-dd11631981e2" (UID: "67cdadf5-c8e8-4995-9de1-dd11631981e2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:55:09.979211 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.979182 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "67cdadf5-c8e8-4995-9de1-dd11631981e2" (UID: "67cdadf5-c8e8-4995-9de1-dd11631981e2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:55:09.979310 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.979260 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67cdadf5-c8e8-4995-9de1-dd11631981e2-kube-api-access-s7slp" (OuterVolumeSpecName: "kube-api-access-s7slp") pod "67cdadf5-c8e8-4995-9de1-dd11631981e2" (UID: "67cdadf5-c8e8-4995-9de1-dd11631981e2"). InnerVolumeSpecName "kube-api-access-s7slp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:55:09.979707 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.979686 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "67cdadf5-c8e8-4995-9de1-dd11631981e2" (UID: "67cdadf5-c8e8-4995-9de1-dd11631981e2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 03 15:55:09.979758 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:09.979704 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-token" (OuterVolumeSpecName: "istio-token") pod "67cdadf5-c8e8-4995-9de1-dd11631981e2" (UID: "67cdadf5-c8e8-4995-9de1-dd11631981e2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:55:10.078146 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:10.078109 2532 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-data\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:55:10.078146 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:10.078142 2532 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-podinfo\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:55:10.078604 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:10.078156 2532 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-token\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:55:10.078604 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:10.078170 2532 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67cdadf5-c8e8-4995-9de1-dd11631981e2-istiod-ca-cert\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:55:10.078604 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:10.078182 2532 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67cdadf5-c8e8-4995-9de1-dd11631981e2-istio-envoy\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:55:10.078604 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:10.078193 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7slp\" (UniqueName: \"kubernetes.io/projected/67cdadf5-c8e8-4995-9de1-dd11631981e2-kube-api-access-s7slp\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:55:10.828937 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:10.828905 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" Jul 03 15:55:10.829123 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:10.828954 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd" event={"ID":"67cdadf5-c8e8-4995-9de1-dd11631981e2","Type":"ContainerDied","Data":"ab0f67531063446a53089d55e2bf07247e08bccb54b7e8dd42f42471b893ab86"} Jul 03 15:55:10.829123 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:10.829005 2532 scope.go:117] "RemoveContainer" containerID="f32f3ca0fc517ad60f8fa872c962f8e573dcf14c4d931578892ce8b5d5a60461" Jul 03 15:55:10.854578 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:10.854553 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd"] Jul 03 15:55:10.858898 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:10.858877 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-3703d4-openshift-default-659b9b4c95-8cxsd"] Jul 03 15:55:11.669040 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:11.669002 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:55:11.812791 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:11.812758 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:55:11.912773 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:11.912742 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:55:12.018025 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:12.017948 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67cdadf5-c8e8-4995-9de1-dd11631981e2" path="/var/lib/kubelet/pods/67cdadf5-c8e8-4995-9de1-dd11631981e2/volumes" Jul 03 15:55:12.051292 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:12.051256 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5"] Jul 03 15:55:12.051573 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:12.051547 2532 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" podUID="0d139d4e-08e3-4657-ae74-78af8b6bc30f" containerName="istio-proxy" containerID="cri-o://ff22a270e3ed591c1b8f55b694fee8db19be94eba0d97f3c98c5e0b55813a9fb" gracePeriod=30 Jul 03 15:55:12.066495 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:12.066452 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:55:12.308059 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:12.307924 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:55:15.188290 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:15.188255 2532 patch_prober.go:28] interesting pod/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 03 15:55:15.188790 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:15.188317 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" podUID="0d139d4e-08e3-4657-ae74-78af8b6bc30f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 03 15:55:17.314471 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.314409 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:55:17.440827 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.440801 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istiod-ca-cert\") pod \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " Jul 03 15:55:17.441013 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.440836 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-data\") pod \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " Jul 03 15:55:17.441013 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.440869 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-podinfo\") pod \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " Jul 03 15:55:17.441013 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.440901 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-workload-socket\") pod \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " Jul 03 15:55:17.441013 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.440931 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-envoy\") pod \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " Jul 03 15:55:17.441013 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.440951 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-credential-socket\") pod \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " Jul 03 15:55:17.441013 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.440987 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-workload-certs\") pod \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " Jul 03 15:55:17.441338 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.441019 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-token\") pod \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " Jul 03 15:55:17.441338 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.441084 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvznw\" (UniqueName: \"kubernetes.io/projected/0d139d4e-08e3-4657-ae74-78af8b6bc30f-kube-api-access-vvznw\") pod \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\" (UID: \"0d139d4e-08e3-4657-ae74-78af8b6bc30f\") " Jul 03 15:55:17.441465 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.441382 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0d139d4e-08e3-4657-ae74-78af8b6bc30f" (UID: "0d139d4e-08e3-4657-ae74-78af8b6bc30f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:55:17.441465 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.441393 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0d139d4e-08e3-4657-ae74-78af8b6bc30f" (UID: "0d139d4e-08e3-4657-ae74-78af8b6bc30f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 15:55:17.442124 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.442085 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0d139d4e-08e3-4657-ae74-78af8b6bc30f" (UID: "0d139d4e-08e3-4657-ae74-78af8b6bc30f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:55:17.442322 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.442281 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0d139d4e-08e3-4657-ae74-78af8b6bc30f" (UID: "0d139d4e-08e3-4657-ae74-78af8b6bc30f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:55:17.442481 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.442431 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-data" (OuterVolumeSpecName: "istio-data") pod "0d139d4e-08e3-4657-ae74-78af8b6bc30f" (UID: "0d139d4e-08e3-4657-ae74-78af8b6bc30f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:55:17.443589 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.443554 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-token" (OuterVolumeSpecName: "istio-token") pod "0d139d4e-08e3-4657-ae74-78af8b6bc30f" (UID: "0d139d4e-08e3-4657-ae74-78af8b6bc30f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:55:17.443859 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.443838 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0d139d4e-08e3-4657-ae74-78af8b6bc30f" (UID: "0d139d4e-08e3-4657-ae74-78af8b6bc30f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 15:55:17.444093 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.444075 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d139d4e-08e3-4657-ae74-78af8b6bc30f-kube-api-access-vvznw" (OuterVolumeSpecName: "kube-api-access-vvznw") pod "0d139d4e-08e3-4657-ae74-78af8b6bc30f" (UID: "0d139d4e-08e3-4657-ae74-78af8b6bc30f"). InnerVolumeSpecName "kube-api-access-vvznw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 15:55:17.444147 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.444121 2532 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0d139d4e-08e3-4657-ae74-78af8b6bc30f" (UID: "0d139d4e-08e3-4657-ae74-78af8b6bc30f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 03 15:55:17.480624 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.480598 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lbx65_dc903bff-bf1d-4ffc-ab4b-413e1ff847a5/manager/0.log" Jul 03 15:55:17.542565 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.542539 2532 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-token\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:55:17.542565 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.542563 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvznw\" (UniqueName: \"kubernetes.io/projected/0d139d4e-08e3-4657-ae74-78af8b6bc30f-kube-api-access-vvznw\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:55:17.542736 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.542578 2532 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istiod-ca-cert\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:55:17.542736 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.542591 2532 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-data\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:55:17.542736 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.542602 2532 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-podinfo\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:55:17.542736 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.542613 2532 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-workload-socket\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:55:17.542736 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.542625 2532 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-istio-envoy\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:55:17.542736 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.542637 2532 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-credential-socket\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:55:17.542736 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.542649 2532 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d139d4e-08e3-4657-ae74-78af8b6bc30f-workload-certs\") on node \"ip-10-0-142-176.ec2.internal\" DevicePath \"\"" Jul 03 15:55:17.600150 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.600127 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-l4vc5_40aecff7-c519-485e-85c3-aa2106577b99/manager/0.log" Jul 03 15:55:17.867218 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.867127 2532 generic.go:356] "Generic (PLEG): container finished" podID="0d139d4e-08e3-4657-ae74-78af8b6bc30f" containerID="ff22a270e3ed591c1b8f55b694fee8db19be94eba0d97f3c98c5e0b55813a9fb" exitCode=0 Jul 03 15:55:17.867218 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.867176 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" Jul 03 15:55:17.867218 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.867205 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" event={"ID":"0d139d4e-08e3-4657-ae74-78af8b6bc30f","Type":"ContainerDied","Data":"ff22a270e3ed591c1b8f55b694fee8db19be94eba0d97f3c98c5e0b55813a9fb"} Jul 03 15:55:17.867484 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.867259 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5" event={"ID":"0d139d4e-08e3-4657-ae74-78af8b6bc30f","Type":"ContainerDied","Data":"d4fbd6df55b36c60d0c609b0d16b379944d03b9d0feb23af22bec27fe1aa4434"} Jul 03 15:55:17.867484 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.867284 2532 scope.go:117] "RemoveContainer" containerID="ff22a270e3ed591c1b8f55b694fee8db19be94eba0d97f3c98c5e0b55813a9fb" Jul 03 15:55:17.877345 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.877326 2532 scope.go:117] "RemoveContainer" containerID="befe2019e27275deb07cb893fb62b0d909e088f4c1fdbca497a23c250e367ecb" Jul 03 15:55:17.888123 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.888103 2532 scope.go:117] "RemoveContainer" containerID="ff22a270e3ed591c1b8f55b694fee8db19be94eba0d97f3c98c5e0b55813a9fb" Jul 03 15:55:17.888448 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:55:17.888428 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff22a270e3ed591c1b8f55b694fee8db19be94eba0d97f3c98c5e0b55813a9fb\": container with ID starting with ff22a270e3ed591c1b8f55b694fee8db19be94eba0d97f3c98c5e0b55813a9fb not found: ID does not exist" containerID="ff22a270e3ed591c1b8f55b694fee8db19be94eba0d97f3c98c5e0b55813a9fb" Jul 03 15:55:17.888501 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.888458 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff22a270e3ed591c1b8f55b694fee8db19be94eba0d97f3c98c5e0b55813a9fb"} err="failed to get container status \"ff22a270e3ed591c1b8f55b694fee8db19be94eba0d97f3c98c5e0b55813a9fb\": rpc error: code = NotFound desc = could not find container \"ff22a270e3ed591c1b8f55b694fee8db19be94eba0d97f3c98c5e0b55813a9fb\": container with ID starting with ff22a270e3ed591c1b8f55b694fee8db19be94eba0d97f3c98c5e0b55813a9fb not found: ID does not exist" Jul 03 15:55:17.888501 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.888475 2532 scope.go:117] "RemoveContainer" containerID="befe2019e27275deb07cb893fb62b0d909e088f4c1fdbca497a23c250e367ecb" Jul 03 15:55:17.888733 ip-10-0-142-176 kubenswrapper[2532]: E0703 15:55:17.888717 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"befe2019e27275deb07cb893fb62b0d909e088f4c1fdbca497a23c250e367ecb\": container with ID starting with befe2019e27275deb07cb893fb62b0d909e088f4c1fdbca497a23c250e367ecb not found: ID does not exist" containerID="befe2019e27275deb07cb893fb62b0d909e088f4c1fdbca497a23c250e367ecb" Jul 03 15:55:17.888792 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.888736 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"befe2019e27275deb07cb893fb62b0d909e088f4c1fdbca497a23c250e367ecb"} err="failed to get container status \"befe2019e27275deb07cb893fb62b0d909e088f4c1fdbca497a23c250e367ecb\": rpc error: code = NotFound desc = could not find container \"befe2019e27275deb07cb893fb62b0d909e088f4c1fdbca497a23c250e367ecb\": container with ID starting with befe2019e27275deb07cb893fb62b0d909e088f4c1fdbca497a23c250e367ecb not found: ID does not exist" Jul 03 15:55:17.889144 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.889127 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5"] Jul 03 15:55:17.894583 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:17.894559 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-31658c-openshift-default-6776f4796c-8cwv5"] Jul 03 15:55:18.017581 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:18.017547 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d139d4e-08e3-4657-ae74-78af8b6bc30f" path="/var/lib/kubelet/pods/0d139d4e-08e3-4657-ae74-78af8b6bc30f/volumes" Jul 03 15:55:18.211528 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:18.211444 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-j9wqv_0ffed699-1e91-4b84-bdbc-ba0522db6921/server/0.log" Jul 03 15:55:18.707153 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:18.707127 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b59fc499-ltlvk_566ec0d5-d122-4ddc-97ed-28f769563ed2/copy-manifests/0.log" Jul 03 15:55:18.713556 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:18.713537 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b59fc499-ltlvk_566ec0d5-d122-4ddc-97ed-28f769563ed2/manager/0.log" Jul 03 15:55:20.243874 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:20.243840 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-twxr6_2112a5da-f5aa-499a-9e04-18e9591ffecf/manager/0.log" Jul 03 15:55:20.363353 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:20.363326 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-n2rm2_4d9386b1-89b2-4919-974c-18c9721dfd35/manager/0.log" Jul 03 15:55:20.473720 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:20.473694 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-5q82r_6feba469-332f-4e04-b026-35df37bc51d7/kuadrant-console-plugin/0.log" Jul 03 15:55:20.595792 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:20.595763 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tkhj8_4a19be4a-33c5-47da-a95a-d2f302ada4f6/registry-server/0.log" Jul 03 15:55:20.713861 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:20.713833 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-4jrs6_5b9d1f2b-ceaa-495f-9681-c925c22bfc44/manager/0.log" Jul 03 15:55:20.837953 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:20.837927 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-fp4ww_a20b67b9-8e5e-4984-b17b-215797565d70/limitador/0.log" Jul 03 15:55:20.955860 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:20.955779 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cqzsl_fd0e5e48-462b-4bd7-8d65-0fd969b8cf64/manager/0.log" Jul 03 15:55:21.672072 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:21.672041 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9d497994-bssgs_36ad7435-8983-428c-8ee1-4ec96914f6a7/kube-auth-proxy/0.log" Jul 03 15:55:21.795112 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:21.795078 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-lpvh6_4c33415d-a4bf-4a55-b755-0507d510f68c/istio-proxy/1.log" Jul 03 15:55:22.164380 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:22.164339 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bc6b7cdc9-l5w6c_3ea73c27-fbc5-4237-a642-c38f09af95a0/router/0.log" Jul 03 15:55:23.109009 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:23.108984 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-64tr6_dede305e-5f97-494b-8006-12ec145445c8/main/0.log" Jul 03 15:55:27.213701 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:27.213660 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:55:27.323960 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:27.323928 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" limit=1024 Jul 03 15:55:29.743751 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:29.743718 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9df89_37843d47-7c15-44ce-b3af-54b536ace36f/global-pull-secret-syncer/0.log" Jul 03 15:55:29.866144 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:29.866113 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nl55n_c8200bbb-db4c-4118-b9b6-451401a16fd0/konnectivity-agent/0.log" Jul 03 15:55:30.023596 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:30.023510 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-176.ec2.internal_3555bbdadd92d8671a620ff24c1e02e8/haproxy/0.log" Jul 03 15:55:35.501643 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:35.501610 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-twxr6_2112a5da-f5aa-499a-9e04-18e9591ffecf/manager/0.log" Jul 03 15:55:35.522603 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:35.522569 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-n2rm2_4d9386b1-89b2-4919-974c-18c9721dfd35/manager/0.log" Jul 03 15:55:35.544396 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:35.544347 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-5q82r_6feba469-332f-4e04-b026-35df37bc51d7/kuadrant-console-plugin/0.log" Jul 03 15:55:35.581874 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:35.581844 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tkhj8_4a19be4a-33c5-47da-a95a-d2f302ada4f6/registry-server/0.log" Jul 03 15:55:35.666626 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:35.666601 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-4jrs6_5b9d1f2b-ceaa-495f-9681-c925c22bfc44/manager/0.log" Jul 03 15:55:35.690542 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:35.690516 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-fp4ww_a20b67b9-8e5e-4984-b17b-215797565d70/limitador/0.log" Jul 03 15:55:35.752357 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:35.752268 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cqzsl_fd0e5e48-462b-4bd7-8d65-0fd969b8cf64/manager/0.log" Jul 03 15:55:37.569689 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:37.569657 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-x8ftb_531cd3e1-eb3e-4443-b988-209c350ae15c/cluster-monitoring-operator/0.log" Jul 03 15:55:37.692985 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:37.692955 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5frvz_6a63b9f0-c361-495b-9dac-9cc82b071f4a/node-exporter/0.log" Jul 03 15:55:37.709995 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:37.709975 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5frvz_6a63b9f0-c361-495b-9dac-9cc82b071f4a/kube-rbac-proxy/0.log" Jul 03 15:55:37.730614 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:37.730587 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5frvz_6a63b9f0-c361-495b-9dac-9cc82b071f4a/init-textfile/0.log" Jul 03 15:55:39.497241 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:39.497212 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-fdnfh_396f2c56-4cfc-410d-836b-bb5d474c2140/networking-console-plugin/0.log" Jul 03 15:55:40.107208 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.107178 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/1.log" Jul 03 15:55:40.110920 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.110898 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-srbsr_00b62b2c-dffe-4879-98e6-41c8ba914d63/console-operator/2.log" Jul 03 15:55:40.165402 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.165095 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz"] Jul 03 15:55:40.171213 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.166039 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2" containerName="main" Jul 03 15:55:40.171213 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.166062 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2" containerName="main" Jul 03 15:55:40.171213 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.166091 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67cdadf5-c8e8-4995-9de1-dd11631981e2" containerName="istio-proxy" Jul 03 15:55:40.171213 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.166100 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="67cdadf5-c8e8-4995-9de1-dd11631981e2" containerName="istio-proxy" Jul 03 15:55:40.171213 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.166119 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d139d4e-08e3-4657-ae74-78af8b6bc30f" containerName="istio-proxy" Jul 03 15:55:40.171213 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.166128 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d139d4e-08e3-4657-ae74-78af8b6bc30f" containerName="istio-proxy" Jul 03 15:55:40.171213 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.166164 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d139d4e-08e3-4657-ae74-78af8b6bc30f" containerName="istio-proxy" Jul 03 15:55:40.171213 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.166173 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d139d4e-08e3-4657-ae74-78af8b6bc30f" containerName="istio-proxy" Jul 03 15:55:40.171213 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.166362 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="67cdadf5-c8e8-4995-9de1-dd11631981e2" containerName="istio-proxy" Jul 03 15:55:40.171213 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.166395 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d139d4e-08e3-4657-ae74-78af8b6bc30f" containerName="istio-proxy" Jul 03 15:55:40.171213 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.166413 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="67cdadf5-c8e8-4995-9de1-dd11631981e2" containerName="istio-proxy" Jul 03 15:55:40.171213 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.166422 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d139d4e-08e3-4657-ae74-78af8b6bc30f" containerName="istio-proxy" Jul 03 15:55:40.171213 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.166440 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bbb6fc0-1a0e-4efe-a164-6063c5da3ed2" containerName="main" Jul 03 15:55:40.171213 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.170446 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz" Jul 03 15:55:40.173344 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.173321 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2795n\"/\"openshift-service-ca.crt\"" Jul 03 15:55:40.174496 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.174472 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2795n\"/\"kube-root-ca.crt\"" Jul 03 15:55:40.174597 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.174493 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2795n\"/\"default-dockercfg-t2c96\"" Jul 03 15:55:40.180119 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.180096 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz"] Jul 03 15:55:40.231066 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.231034 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5-proc\") pod \"perf-node-gather-daemonset-5v8kz\" (UID: \"2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz" Jul 03 15:55:40.231206 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.231128 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kff6x\" (UniqueName: \"kubernetes.io/projected/2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5-kube-api-access-kff6x\") pod \"perf-node-gather-daemonset-5v8kz\" (UID: \"2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz" Jul 03 15:55:40.231206 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.231162 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5-sys\") pod \"perf-node-gather-daemonset-5v8kz\" (UID: \"2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz" Jul 03 15:55:40.231206 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.231200 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5-podres\") pod \"perf-node-gather-daemonset-5v8kz\" (UID: \"2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz" Jul 03 15:55:40.231409 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.231260 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5-lib-modules\") pod \"perf-node-gather-daemonset-5v8kz\" (UID: \"2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz" Jul 03 15:55:40.331784 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.331749 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5-podres\") pod \"perf-node-gather-daemonset-5v8kz\" (UID: \"2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz" Jul 03 15:55:40.331949 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.331793 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5-lib-modules\") pod \"perf-node-gather-daemonset-5v8kz\" (UID: \"2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz" Jul 03 15:55:40.331949 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.331839 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5-proc\") pod \"perf-node-gather-daemonset-5v8kz\" (UID: \"2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz" Jul 03 15:55:40.331949 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.331903 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5-podres\") pod \"perf-node-gather-daemonset-5v8kz\" (UID: \"2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz" Jul 03 15:55:40.331949 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.331909 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kff6x\" (UniqueName: \"kubernetes.io/projected/2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5-kube-api-access-kff6x\") pod \"perf-node-gather-daemonset-5v8kz\" (UID: \"2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz" Jul 03 15:55:40.332146 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.331963 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5-proc\") pod \"perf-node-gather-daemonset-5v8kz\" (UID: \"2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz" Jul 03 15:55:40.332146 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.331975 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5-lib-modules\") pod \"perf-node-gather-daemonset-5v8kz\" (UID: \"2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz" Jul 03 15:55:40.332146 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.332024 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5-sys\") pod \"perf-node-gather-daemonset-5v8kz\" (UID: \"2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz" Jul 03 15:55:40.332146 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.332072 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5-sys\") pod \"perf-node-gather-daemonset-5v8kz\" (UID: \"2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz" Jul 03 15:55:40.340453 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.340425 2532 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kff6x\" (UniqueName: \"kubernetes.io/projected/2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5-kube-api-access-kff6x\") pod \"perf-node-gather-daemonset-5v8kz\" (UID: \"2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz" Jul 03 15:55:40.482416 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.482315 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz" Jul 03 15:55:40.620002 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.619978 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz"] Jul 03 15:55:40.622581 ip-10-0-142-176 kubenswrapper[2532]: W0703 15:55:40.622556 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2cf02ee6_e02b_4e61_b020_ee0ffb8c11b5.slice/crio-c6a92b8cf99d0a478454f83ec92fa68be59c3b4208ba68ad83b32beb3ab4f4b1 WatchSource:0}: Error finding container c6a92b8cf99d0a478454f83ec92fa68be59c3b4208ba68ad83b32beb3ab4f4b1: Status 404 returned error can't find the container with id c6a92b8cf99d0a478454f83ec92fa68be59c3b4208ba68ad83b32beb3ab4f4b1 Jul 03 15:55:40.700729 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.700704 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86c687b48f-5qhjk_6cdfa343-81c5-4671-b66d-c16fcdebf6ca/console/0.log" Jul 03 15:55:40.989948 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.989904 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz" event={"ID":"2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5","Type":"ContainerStarted","Data":"b58c20849498a63fae4b9b80723518ac3b3044230e582625e33b316f5ea4d7ce"} Jul 03 15:55:40.990114 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.989964 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz" event={"ID":"2cf02ee6-e02b-4e61-b020-ee0ffb8c11b5","Type":"ContainerStarted","Data":"c6a92b8cf99d0a478454f83ec92fa68be59c3b4208ba68ad83b32beb3ab4f4b1"} Jul 03 15:55:40.990114 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:40.990044 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz" Jul 03 15:55:41.032831 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:41.032732 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz" podStartSLOduration=1.032712565 podStartE2EDuration="1.032712565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:55:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:55:41.032486387 +0000 UTC m=+2559.615510197" watchObservedRunningTime="2026-07-03 15:55:41.032712565 +0000 UTC m=+2559.615736395" Jul 03 15:55:41.367505 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:41.367473 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-st29z_c0f2ef42-f6dd-4604-99dd-9a5292e6c645/volume-data-source-validator/0.log" Jul 03 15:55:42.391685 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:42.391656 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5wr4p_d825134a-e7de-4199-a8db-36d954270785/dns/0.log" Jul 03 15:55:42.407285 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:42.407267 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5wr4p_d825134a-e7de-4199-a8db-36d954270785/kube-rbac-proxy/0.log" Jul 03 15:55:42.508282 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:42.508256 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rpqwz_f2d8e1ee-2726-48a1-a016-01e11e8f02bf/dns-node-resolver/0.log" Jul 03 15:55:43.034195 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:43.034165 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7pwdd_c481e3d5-ae74-4023-9633-aaeb93addb3a/node-ca/0.log" Jul 03 15:55:44.195437 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:44.195410 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9d497994-bssgs_36ad7435-8983-428c-8ee1-4ec96914f6a7/kube-auth-proxy/0.log" Jul 03 15:55:44.219078 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:44.219049 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-lpvh6_4c33415d-a4bf-4a55-b755-0507d510f68c/istio-proxy/0.log" Jul 03 15:55:44.247987 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:44.247965 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-lpvh6_4c33415d-a4bf-4a55-b755-0507d510f68c/istio-proxy/1.log" Jul 03 15:55:44.384519 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:44.384490 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bc6b7cdc9-l5w6c_3ea73c27-fbc5-4237-a642-c38f09af95a0/router/0.log" Jul 03 15:55:45.019466 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:45.019434 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d5frg_33cb2d20-c735-4eb3-827e-e3aad2ae24bb/serve-healthcheck-canary/0.log" Jul 03 15:55:45.493309 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:45.493274 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-vfv7v_1cd66668-0c47-4f2a-9997-20b41987392c/insights-operator/0.log" Jul 03 15:55:45.494024 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:45.494006 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-vfv7v_1cd66668-0c47-4f2a-9997-20b41987392c/insights-operator/1.log" Jul 03 15:55:45.510940 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:45.510917 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hc69x_9c966052-a70c-4977-8439-4adbf4f2e71c/kube-rbac-proxy/0.log" Jul 03 15:55:45.528050 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:45.528022 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hc69x_9c966052-a70c-4977-8439-4adbf4f2e71c/exporter/0.log" Jul 03 15:55:45.545521 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:45.545497 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hc69x_9c966052-a70c-4977-8439-4adbf4f2e71c/extractor/0.log" Jul 03 15:55:47.005608 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:47.005581 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2795n/perf-node-gather-daemonset-5v8kz" Jul 03 15:55:47.771878 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:47.771851 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lbx65_dc903bff-bf1d-4ffc-ab4b-413e1ff847a5/manager/0.log" Jul 03 15:55:47.886440 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:47.886405 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-l4vc5_40aecff7-c519-485e-85c3-aa2106577b99/manager/0.log" Jul 03 15:55:48.143726 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:48.143701 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-j9wqv_0ffed699-1e91-4b84-bdbc-ba0522db6921/server/0.log" Jul 03 15:55:48.436678 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:48.436579 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b59fc499-ltlvk_566ec0d5-d122-4ddc-97ed-28f769563ed2/manager/0.log" Jul 03 15:55:48.452841 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:48.452814 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b59fc499-ltlvk_566ec0d5-d122-4ddc-97ed-28f769563ed2/copy-manifests/0.log" Jul 03 15:55:50.710250 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:50.710225 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9d497994-bssgs_36ad7435-8983-428c-8ee1-4ec96914f6a7/kube-auth-proxy/0.log" Jul 03 15:55:50.730190 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:50.730164 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-lpvh6_4c33415d-a4bf-4a55-b755-0507d510f68c/istio-proxy/0.log" Jul 03 15:55:50.758002 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:50.757981 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-lpvh6_4c33415d-a4bf-4a55-b755-0507d510f68c/istio-proxy/1.log" Jul 03 15:55:50.872446 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:50.872421 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bc6b7cdc9-l5w6c_3ea73c27-fbc5-4237-a642-c38f09af95a0/router/0.log" Jul 03 15:55:52.339108 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:52.339081 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9d497994-bssgs_36ad7435-8983-428c-8ee1-4ec96914f6a7/kube-auth-proxy/0.log" Jul 03 15:55:52.357428 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:52.357397 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-lpvh6_4c33415d-a4bf-4a55-b755-0507d510f68c/istio-proxy/0.log" Jul 03 15:55:52.388382 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:52.388337 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-lpvh6_4c33415d-a4bf-4a55-b755-0507d510f68c/istio-proxy/1.log" Jul 03 15:55:52.500967 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:52.500938 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bc6b7cdc9-l5w6c_3ea73c27-fbc5-4237-a642-c38f09af95a0/router/0.log" Jul 03 15:55:54.902161 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:54.902133 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-99glx_51963809-27dc-4f46-bb10-953fe9401ca0/migrator/0.log" Jul 03 15:55:54.922970 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:54.922943 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-99glx_51963809-27dc-4f46-bb10-953fe9401ca0/graceful-termination/0.log" Jul 03 15:55:55.250550 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:55.250463 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-jxkx5_25da0080-177d-4f5e-a476-ca1bd2066ca0/kube-storage-version-migrator-operator/1.log" Jul 03 15:55:55.251347 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:55.251329 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-jxkx5_25da0080-177d-4f5e-a476-ca1bd2066ca0/kube-storage-version-migrator-operator/0.log" Jul 03 15:55:56.194101 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:56.194072 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grc4q_e41e9a11-9c6a-42d2-b73f-45707d71798b/kube-multus-additional-cni-plugins/0.log" Jul 03 15:55:56.211677 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:56.211653 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grc4q_e41e9a11-9c6a-42d2-b73f-45707d71798b/egress-router-binary-copy/0.log" Jul 03 15:55:56.231929 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:56.231911 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grc4q_e41e9a11-9c6a-42d2-b73f-45707d71798b/cni-plugins/0.log" Jul 03 15:55:56.248770 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:56.248750 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grc4q_e41e9a11-9c6a-42d2-b73f-45707d71798b/bond-cni-plugin/0.log" Jul 03 15:55:56.265256 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:56.265234 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grc4q_e41e9a11-9c6a-42d2-b73f-45707d71798b/routeoverride-cni/0.log" Jul 03 15:55:56.284899 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:56.284880 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grc4q_e41e9a11-9c6a-42d2-b73f-45707d71798b/whereabouts-cni-bincopy/0.log" Jul 03 15:55:56.301666 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:56.301650 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grc4q_e41e9a11-9c6a-42d2-b73f-45707d71798b/whereabouts-cni/0.log" Jul 03 15:55:56.613493 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:56.613461 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lnx8q_a8e7b01d-06ca-45f9-9516-e6e059981672/kube-multus/0.log" Jul 03 15:55:56.662614 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:56.662592 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-chpm2_a9e3ec89-82d9-45ae-a945-4318350c2074/network-metrics-daemon/0.log" Jul 03 15:55:56.679522 ip-10-0-142-176 kubenswrapper[2532]: I0703 15:55:56.679495 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-chpm2_a9e3ec89-82d9-45ae-a945-4318350c2074/kube-rbac-proxy/0.log"