Jul 02 19:49:06.585729 ip-10-0-137-196 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 02 19:49:06.585741 ip-10-0-137-196 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 02 19:49:06.585750 ip-10-0-137-196 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 02 19:49:06.586053 ip-10-0-137-196 systemd[1]: Failed to start Kubernetes Kubelet. Jul 02 19:49:16.706260 ip-10-0-137-196 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 02 19:49:16.706276 ip-10-0-137-196 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 0ae61ecc277448328d2465dcd25550c0 -- Jul 02 19:50:49.958088 ip-10-0-137-196 systemd[1]: Starting Kubernetes Kubelet... Jul 02 19:50:50.526715 ip-10-0-137-196 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 19:50:50.526715 ip-10-0-137-196 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 19:50:50.526715 ip-10-0-137-196 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 19:50:50.526715 ip-10-0-137-196 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 19:50:50.526715 ip-10-0-137-196 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 19:50:50.526715 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.381498 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 19:50:50.526715 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388525 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:50:50.526715 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388535 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:50:50.526715 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388539 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:50:50.526715 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388543 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:50:50.526715 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388547 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:50:50.526715 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388550 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:50:50.526715 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388552 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:50:50.526715 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388555 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:50:50.459157 ip-10-0-137-196 systemd[1]: Started Kubernetes Kubelet. Jul 02 19:50:50.539103 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388558 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:50:50.539103 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388561 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:50:50.539103 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388563 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:50:50.539103 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388566 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:50:50.539103 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388569 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:50:50.539103 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388571 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:50:50.539103 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388574 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:50:50.539103 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388576 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:50:50.539103 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388579 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:50:50.539103 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388584 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:50:50.539103 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388587 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:50:50.539103 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388590 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:50:50.539103 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388592 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:50:50.539103 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388595 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:50:50.539103 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388598 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:50:50.539103 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388600 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:50:50.539103 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388603 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:50:50.539103 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388606 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:50:50.539103 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388608 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:50:50.541086 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388611 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:50:50.541086 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388613 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:50:50.541086 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388616 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:50:50.541086 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388619 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:50:50.541086 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388621 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:50:50.541086 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388623 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:50:50.541086 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388626 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:50:50.541086 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388628 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:50:50.541086 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388631 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:50:50.541086 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388633 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:50:50.541086 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388636 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:50:50.541086 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388639 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:50:50.541086 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388641 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:50:50.541086 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388644 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:50:50.541086 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388646 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:50:50.541086 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388648 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:50:50.541086 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388652 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:50:50.541086 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388654 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:50:50.541086 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388657 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:50:50.541086 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388661 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:50:50.543295 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388665 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:50:50.543295 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388667 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:50:50.543295 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388670 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:50:50.543295 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388674 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:50:50.543295 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388678 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:50:50.543295 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388681 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:50:50.543295 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388683 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:50:50.543295 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388686 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:50:50.543295 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388689 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:50:50.543295 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388692 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:50:50.543295 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388695 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:50:50.543295 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388698 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:50:50.543295 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388701 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:50:50.543295 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388703 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:50:50.543295 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388706 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:50:50.543295 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388708 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:50:50.543295 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388710 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:50:50.543295 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388713 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:50:50.543295 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388715 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:50:50.543295 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388717 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:50:50.545071 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388721 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:50:50.545071 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388724 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:50:50.545071 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388727 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:50:50.545071 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388731 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:50:50.545071 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388733 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:50:50.545071 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388736 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:50:50.545071 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388738 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:50:50.545071 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388741 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:50:50.545071 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388743 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:50:50.545071 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388745 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:50:50.545071 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388748 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:50:50.545071 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388750 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:50:50.545071 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388753 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:50:50.545071 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388756 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:50:50.545071 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388758 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:50:50.545071 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388762 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:50:50.545071 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388765 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:50:50.545071 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388768 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:50:50.545071 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388771 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:50:50.545071 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388773 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:50:50.547167 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388776 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:50:50.547167 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388778 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:50:50.547167 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388781 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:50:50.547167 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388783 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:50:50.547167 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388786 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:50:50.547167 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388788 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:50:50.547167 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388790 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:50:50.547167 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388793 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:50:50.547167 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388795 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:50:50.547167 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388798 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:50:50.547167 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388800 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:50:50.547167 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.388803 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:50:50.547167 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389499 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:50:50.547167 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389507 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:50:50.547167 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389510 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:50:50.547167 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389513 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:50:50.547167 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389517 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:50:50.547167 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389522 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:50:50.547167 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389525 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:50:50.547167 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389528 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:50:50.556136 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389530 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:50:50.556136 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389533 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:50:50.556136 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389535 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:50:50.556136 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389538 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:50:50.556136 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389541 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:50:50.556136 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389543 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:50:50.556136 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389546 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:50:50.556136 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389549 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:50:50.556136 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389551 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:50:50.556136 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389554 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:50:50.556136 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389556 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:50:50.556136 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389559 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:50:50.556136 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389562 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:50:50.556136 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389564 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:50:50.556136 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389567 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:50:50.556136 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389569 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:50:50.556136 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389572 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:50:50.556136 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389574 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:50:50.556136 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389576 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:50:50.556136 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389579 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:50:50.558998 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389581 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:50:50.558998 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389584 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:50:50.558998 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389586 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:50:50.558998 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389589 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:50:50.558998 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389591 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:50:50.558998 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389594 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:50:50.558998 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389597 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:50:50.558998 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389600 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:50:50.558998 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389603 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:50:50.558998 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389605 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:50:50.558998 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389607 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:50:50.558998 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389610 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:50:50.558998 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389613 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:50:50.558998 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389615 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:50:50.558998 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389618 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:50:50.558998 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389620 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:50:50.558998 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389623 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:50:50.558998 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389625 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:50:50.558998 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389628 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:50:50.558998 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389631 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:50:50.705571 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389633 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:50:50.705571 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389636 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:50:50.705571 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389639 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:50:50.705571 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389642 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:50:50.705571 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389645 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:50:50.705571 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389647 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:50:50.705571 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389650 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:50:50.705571 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389652 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:50:50.705571 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389655 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:50:50.705571 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389657 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:50:50.705571 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389660 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:50:50.705571 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389663 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:50:50.705571 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389666 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:50:50.705571 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389668 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:50:50.705571 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389671 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:50:50.705571 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389674 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:50:50.705571 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389677 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:50:50.705571 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389679 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:50:50.705571 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389682 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:50:50.706530 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389686 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:50:50.706530 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389691 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:50:50.706530 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389694 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:50:50.706530 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389698 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:50:50.706530 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389701 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:50:50.706530 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389704 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:50:50.706530 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389707 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:50:50.706530 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389709 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:50:50.706530 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389714 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:50:50.706530 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389717 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:50:50.706530 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389720 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:50:50.706530 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389723 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:50:50.706530 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389725 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:50:50.706530 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389730 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:50:50.706530 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389732 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:50:50.706530 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389735 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:50:50.706530 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389737 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:50:50.706530 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389740 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:50:50.706530 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389743 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:50:50.707151 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389745 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:50:50.707151 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389748 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:50:50.707151 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389750 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:50:50.707151 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389753 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:50:50.707151 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389755 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:50:50.707151 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389758 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:50:50.707151 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389760 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:50:50.707151 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389762 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:50:50.707151 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389765 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:50:50.707151 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389768 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:50:50.707151 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389770 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:50:50.707151 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389772 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:50:50.707151 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.389775 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:50:50.707151 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390162 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:50:50.707151 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390178 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:50:50.707151 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390182 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:50:50.707151 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390187 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:50:50.707151 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390190 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:50:50.707151 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390193 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:50:50.707151 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390196 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:50:50.708162 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390199 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:50:50.708162 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390201 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:50:50.708162 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390204 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:50:50.708162 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390206 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:50:50.708162 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390209 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:50:50.708162 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390212 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:50:50.708162 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390214 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:50:50.708162 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390217 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:50:50.708162 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390219 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:50:50.708162 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390222 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:50:50.708162 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390224 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:50:50.708162 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390228 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:50:50.708162 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390231 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:50:50.708162 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390234 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:50:50.708162 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390237 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:50:50.708162 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390240 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:50:50.708162 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390242 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:50:50.708162 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390245 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:50:50.708162 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390248 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:50:50.708745 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390251 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:50:50.708745 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390253 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:50:50.708745 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390256 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:50:50.708745 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390258 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:50:50.708745 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390260 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:50:50.708745 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390264 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:50:50.708745 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390267 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:50:50.708745 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390270 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:50:50.708745 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390274 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:50:50.708745 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390278 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:50:50.708745 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390280 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:50:50.708745 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390283 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:50:50.708745 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390285 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:50:50.708745 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390288 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:50:50.708745 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390291 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:50:50.708745 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390293 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:50:50.708745 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390295 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:50:50.708745 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390298 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:50:50.708745 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390300 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:50:50.708745 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390302 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:50:50.709549 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390305 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:50:50.709549 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390308 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:50:50.709549 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390310 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:50:50.709549 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390313 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:50:50.709549 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390315 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:50:50.709549 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390317 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:50:50.709549 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390320 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:50:50.709549 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390322 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:50:50.709549 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390325 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:50:50.709549 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390327 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:50:50.709549 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390329 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:50:50.709549 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390332 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:50:50.709549 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390334 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:50:50.709549 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390337 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:50:50.709549 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390339 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:50:50.709549 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390341 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:50:50.709549 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390344 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:50:50.709549 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390346 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:50:50.709549 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390348 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:50:50.709549 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390351 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:50:50.710141 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390354 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:50:50.710141 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390358 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:50:50.710141 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390361 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:50:50.710141 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390364 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:50:50.710141 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390366 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:50:50.710141 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390369 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:50:50.710141 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390371 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:50:50.710141 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390373 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:50:50.710141 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390376 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:50:50.710141 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390378 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:50:50.710141 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390381 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:50:50.710141 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390383 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:50:50.710141 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390386 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:50:50.710141 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390389 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:50:50.710141 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390391 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:50:50.710141 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390393 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:50:50.710141 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390396 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:50:50.710141 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390398 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:50:50.710141 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390401 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:50:50.710670 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390403 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:50:50.710670 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390405 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:50:50.710670 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390408 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:50:50.710670 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390410 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:50:50.710670 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390412 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:50:50.710670 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390415 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:50:50.710670 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390417 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:50:50.710670 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390419 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:50:50.710670 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390422 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:50:50.710670 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390424 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:50:50.710670 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390428 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:50:50.710670 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390431 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:50:50.710670 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390434 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:50:50.710670 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.390437 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:50:50.710670 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390505 2560 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 19:50:50.710670 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390511 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 19:50:50.710670 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390518 2560 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 19:50:50.710670 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390522 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 19:50:50.710670 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390526 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 19:50:50.710670 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390529 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 19:50:50.710670 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390533 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390537 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390540 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390543 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390546 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390550 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390552 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390557 2560 flags.go:64] FLAG: --cgroup-root="" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390559 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390562 2560 flags.go:64] FLAG: --client-ca-file="" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390565 2560 flags.go:64] FLAG: --cloud-provider="external" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390567 2560 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390572 2560 flags.go:64] FLAG: --cluster-domain="" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390574 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390577 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390580 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390583 2560 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390586 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390589 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390592 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390595 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390598 2560 flags.go:64] FLAG: --contention-profiling="false" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390601 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390604 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 19:50:50.711283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390607 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390611 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390616 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390619 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390621 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390624 2560 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390627 2560 flags.go:64] FLAG: --enable-server="true" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390629 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390633 2560 flags.go:64] FLAG: --event-burst="100" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390636 2560 flags.go:64] FLAG: --event-qps="50" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390639 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390641 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390644 2560 flags.go:64] FLAG: --eviction-hard="" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390648 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390650 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390653 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390657 2560 flags.go:64] FLAG: --eviction-soft="" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390660 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390662 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390665 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390668 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390671 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390673 2560 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390676 2560 flags.go:64] FLAG: --feature-gates="" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390680 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 19:50:50.711935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390682 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390685 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390688 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390691 2560 flags.go:64] FLAG: --healthz-port="10248" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390694 2560 flags.go:64] FLAG: --help="false" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390696 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-137-196.ec2.internal" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390699 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390702 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390706 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390710 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390714 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390716 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390719 2560 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390722 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390724 2560 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390727 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390730 2560 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390732 2560 flags.go:64] FLAG: --kube-reserved="" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390735 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390738 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390741 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390743 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390746 2560 flags.go:64] FLAG: --lock-file="" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390749 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 19:50:50.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390752 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390755 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390760 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390762 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390765 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390768 2560 flags.go:64] FLAG: --logging-format="text" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390770 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390773 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390776 2560 flags.go:64] FLAG: --manifest-url="" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390779 2560 flags.go:64] FLAG: --manifest-url-header="" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390783 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390786 2560 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390789 2560 flags.go:64] FLAG: --max-pods="110" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390792 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390795 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390797 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390801 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390805 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390808 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390811 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390817 2560 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390820 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390823 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 19:50:50.713286 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390826 2560 flags.go:64] FLAG: --pod-cidr="" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390828 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390834 2560 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390864 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390867 2560 flags.go:64] FLAG: --pods-per-core="0" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390870 2560 flags.go:64] FLAG: --port="10250" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390873 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390876 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09e5150298c4d711e" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390879 2560 flags.go:64] FLAG: --qos-reserved="" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390882 2560 flags.go:64] FLAG: --read-only-port="10255" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390885 2560 flags.go:64] FLAG: --register-node="true" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390888 2560 flags.go:64] FLAG: --register-with-taints="" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390892 2560 flags.go:64] FLAG: --registry-burst="10" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390894 2560 flags.go:64] FLAG: --registry-qps="5" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390897 2560 flags.go:64] FLAG: --reserved-cpus="" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390900 2560 flags.go:64] FLAG: --reserved-memory="" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390903 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390906 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390909 2560 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390911 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390914 2560 flags.go:64] FLAG: --runonce="false" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390917 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390920 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390922 2560 flags.go:64] FLAG: --seccomp-default="false" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390925 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 19:50:50.714181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390929 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390932 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390936 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390939 2560 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390942 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390945 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390947 2560 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390950 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390953 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390955 2560 flags.go:64] FLAG: --system-cgroups="" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390958 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390963 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390966 2560 flags.go:64] FLAG: --tls-cert-file="" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390968 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390972 2560 flags.go:64] FLAG: --tls-min-version="" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390975 2560 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390978 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390980 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390984 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390987 2560 flags.go:64] FLAG: --v="2" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390990 2560 flags.go:64] FLAG: --version="false" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390994 2560 flags.go:64] FLAG: --vmodule="" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.390998 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.391001 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391106 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:50:50.714879 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391111 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:50:50.880418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391113 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:50:50.880418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391116 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:50:50.880418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391118 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:50:50.880418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391130 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:50:50.880418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391132 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:50:50.880418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391135 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:50:50.880418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391140 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:50:50.880418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391143 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:50:50.880418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391147 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:50:50.880418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391150 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:50:50.880418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391153 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:50:50.880418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391156 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:50:50.880418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391159 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:50:50.880418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391161 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:50:50.880418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391164 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:50:50.880418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391167 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:50:50.880418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391169 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:50:50.880418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391172 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:50:50.880418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391174 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:50:50.881184 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391177 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:50:50.881184 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391180 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:50:50.881184 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391182 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:50:50.881184 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391185 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:50:50.881184 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391187 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:50:50.881184 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391190 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:50:50.881184 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391193 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:50:50.881184 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391196 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:50:50.881184 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391198 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:50:50.881184 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391200 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:50:50.881184 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391203 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:50:50.881184 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391206 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:50:50.881184 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391208 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:50:50.881184 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391211 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:50:50.881184 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391213 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:50:50.881184 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391216 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:50:50.881184 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391228 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:50:50.881184 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391231 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:50:50.881184 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391233 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:50:50.881184 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391237 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:50:50.881774 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391240 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:50:50.881774 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391245 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:50:50.881774 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391248 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:50:50.881774 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391252 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:50:50.881774 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391255 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:50:50.881774 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391258 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:50:50.881774 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391260 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:50:50.881774 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391263 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:50:50.881774 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391266 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:50:50.881774 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391270 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:50:50.881774 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391273 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:50:50.881774 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391277 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:50:50.881774 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391280 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:50:50.881774 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391282 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:50:50.881774 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391285 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:50:50.881774 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391288 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:50:50.881774 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391290 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:50:50.881774 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391293 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:50:50.881774 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391295 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:50:50.882357 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391298 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:50:50.882357 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391301 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:50:50.882357 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391305 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:50:50.882357 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391308 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:50:50.882357 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391311 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:50:50.882357 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391313 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:50:50.882357 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391316 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:50:50.882357 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391318 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:50:50.882357 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391321 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:50:50.882357 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391323 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:50:50.882357 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391326 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:50:50.882357 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391328 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:50:50.882357 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391332 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:50:50.882357 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391335 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:50:50.882357 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391339 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:50:50.882357 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391341 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:50:50.882357 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391344 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:50:50.882357 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391346 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:50:50.882357 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391349 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:50:50.882357 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391351 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:50:50.882899 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391354 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:50:50.882899 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391356 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:50:50.882899 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391359 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:50:50.882899 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391361 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:50:50.882899 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391364 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:50:50.882899 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391366 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:50:50.882899 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391369 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:50:50.882899 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391371 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:50:50.882899 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391373 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:50:50.882899 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391376 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:50:50.882899 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391379 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:50:50.882899 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391381 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:50:50.882899 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391383 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:50:50.882899 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391386 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:50:50.882899 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391389 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:50:50.882899 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391391 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:50:50.882899 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391394 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:50:50.882899 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391396 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:50:50.882899 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.391399 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:50:50.883478 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.391404 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 19:50:50.883478 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.397636 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 19:50:50.883478 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.397649 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 19:50:50.883478 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.397667 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 19:50:50.883478 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.397672 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 19:50:50.883478 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397730 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:50:50.883478 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397734 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:50:50.883478 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397738 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:50:50.883478 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397742 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:50:50.883478 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397745 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:50:50.883478 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397748 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:50:50.883478 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397751 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:50:50.883478 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397753 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:50:50.883478 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397756 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:50:50.883478 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397759 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:50:50.883901 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397761 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:50:50.883901 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397764 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:50:50.883901 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397766 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:50:50.883901 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397769 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:50:50.883901 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397772 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:50:50.883901 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397775 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:50:50.883901 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397779 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:50:50.883901 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397782 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:50:50.883901 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397785 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:50:50.883901 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397788 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:50:50.883901 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397791 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:50:50.883901 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397795 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:50:50.883901 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397797 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:50:50.883901 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397800 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:50:50.883901 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397802 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:50:50.883901 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397805 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:50:50.883901 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397807 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:50:50.883901 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397810 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:50:50.883901 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397812 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:50:50.884418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397815 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:50:50.884418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397817 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:50:50.884418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397820 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:50:50.884418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397824 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:50:50.884418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397826 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:50:50.884418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397829 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:50:50.884418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397834 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:50:50.884418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397850 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:50:50.884418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397853 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:50:50.884418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397855 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:50:50.884418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397858 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:50:50.884418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397861 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:50:50.884418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397863 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:50:50.884418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397866 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:50:50.884418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397868 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:50:50.884418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397871 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:50:50.884418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397874 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:50:50.884418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397876 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:50:50.884418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397878 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:50:50.884418 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397881 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:50:50.884929 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397883 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:50:50.884929 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397887 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:50:50.884929 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397890 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:50:50.884929 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397893 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:50:50.884929 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397896 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:50:50.884929 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397899 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:50:50.884929 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397902 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:50:50.884929 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397905 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:50:50.884929 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397908 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:50:50.884929 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397911 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:50:50.884929 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397913 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:50:50.884929 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397916 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:50:50.884929 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397918 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:50:50.884929 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397921 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:50:50.884929 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397923 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:50:50.884929 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397927 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:50:50.884929 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397930 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:50:50.884929 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397932 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:50:50.884929 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397936 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:50:50.885481 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397939 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:50:50.885481 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397941 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:50:50.885481 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397944 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:50:50.885481 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397946 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:50:50.885481 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397949 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:50:50.885481 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397951 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:50:50.885481 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397954 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:50:50.885481 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397957 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:50:50.885481 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397960 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:50:50.885481 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397962 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:50:50.885481 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397965 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:50:50.885481 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397967 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:50:50.885481 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397970 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:50:50.885481 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397972 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:50:50.885481 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397975 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:50:50.885481 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397977 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:50:50.885481 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397980 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:50:50.885481 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397982 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:50:50.885481 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397985 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:50:50.885481 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397988 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:50:50.886017 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397990 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:50:50.886017 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397993 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:50:50.886017 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397996 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:50:50.886017 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.397998 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:50:50.886017 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398001 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:50:50.886017 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398003 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:50:50.886017 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398005 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:50:50.886017 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398008 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:50:50.886017 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398013 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:50:50.886017 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398017 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:50:50.886017 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398019 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:50:50.886017 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.398025 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 19:50:50.886017 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398126 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:50:50.886017 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398130 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:50:50.886416 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398134 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:50:50.886416 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398138 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:50:50.886416 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398141 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:50:50.886416 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398144 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:50:50.886416 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398147 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:50:50.886416 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398150 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:50:50.886416 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398153 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:50:50.886416 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398155 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:50:50.886416 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398158 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:50:50.886416 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398160 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:50:50.886416 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398163 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:50:50.886416 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398165 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:50:50.886416 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398169 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:50:50.886416 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398173 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:50:50.886416 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398175 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:50:50.886416 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398178 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:50:50.886416 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398180 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:50:50.886416 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398183 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:50:50.886416 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398186 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:50:50.886928 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398188 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:50:50.886928 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398191 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:50:50.886928 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398193 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:50:50.886928 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398196 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:50:50.886928 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398198 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:50:50.886928 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398200 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:50:50.886928 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398203 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:50:50.886928 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398206 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:50:50.886928 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398209 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:50:50.886928 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398211 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:50:50.886928 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398213 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:50:50.886928 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398217 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:50:50.886928 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398220 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:50:50.886928 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398222 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:50:50.886928 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398225 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:50:50.886928 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398227 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:50:50.886928 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398230 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:50:50.886928 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398232 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:50:50.886928 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398235 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:50:50.886928 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398237 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:50:50.887464 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398239 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:50:50.887464 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398242 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:50:50.887464 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398245 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:50:50.887464 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398247 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:50:50.887464 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398249 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:50:50.887464 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398252 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:50:50.887464 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398255 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:50:50.887464 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398257 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:50:50.887464 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398260 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:50:50.887464 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398262 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:50:50.887464 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398265 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:50:50.887464 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398267 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:50:50.887464 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398270 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:50:50.887464 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398272 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:50:50.887464 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398275 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:50:50.887464 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398277 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:50:50.887464 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398279 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:50:50.887464 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398282 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:50:50.887464 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398284 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:50:50.887967 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398288 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:50:50.887967 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398291 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:50:50.887967 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398293 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:50:50.887967 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398296 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:50:50.887967 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398299 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:50:50.887967 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398302 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:50:50.887967 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398304 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:50:50.887967 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398307 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:50:50.887967 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398309 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:50:50.887967 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398312 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:50:50.887967 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398314 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:50:50.887967 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398317 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:50:50.887967 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398319 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:50:50.887967 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398322 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:50:50.887967 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398324 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:50:50.887967 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398327 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:50:50.887967 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398329 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:50:50.887967 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398332 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:50:50.887967 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398334 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:50:50.887967 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398337 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:50:50.888503 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398339 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:50:50.888503 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398341 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:50:50.888503 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398344 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:50:50.888503 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398346 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:50:50.888503 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398349 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:50:50.888503 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398351 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:50:50.888503 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398354 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:50:50.888503 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398357 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:50:50.888503 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398359 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:50:50.888503 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398362 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:50:50.888503 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398364 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:50:50.888503 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398366 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:50:50.888503 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398370 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:50:50.888503 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398372 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:50:50.888503 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398375 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:50:50.888503 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398378 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:50:50.888503 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398384 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:50:50.888503 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398386 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:50:50.888503 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:50.398389 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:50:50.889052 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.398394 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 19:50:50.889052 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.398480 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 19:50:50.889052 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.400390 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 19:50:50.889052 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.401905 2560 server.go:1019] "Starting client certificate rotation" Jul 02 19:50:50.889052 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.401997 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 19:50:50.889052 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.402662 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 19:50:50.889052 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.404561 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 19:50:50.889052 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.407280 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 19:50:50.889052 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.422608 2560 log.go:25] "Validated CRI v1 runtime API" Jul 02 19:50:50.889052 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.425428 2560 log.go:25] "Validated CRI v1 image API" Jul 02 19:50:50.889052 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.429611 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 19:50:50.889052 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.432263 2560 fs.go:135] Filesystem UUIDs: map[771715eb-f690-4e76-8a0c-088eb7665d47:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c7edbc1f-6e6b-4bfe-81c5-ff72326479e4:/dev/nvme0n1p4] Jul 02 19:50:50.889414 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.432283 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 19:50:50.889414 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.435800 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 19:50:50.889576 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.437677 2560 manager.go:216] Machine: {Timestamp:2026-07-02 19:50:50.436282496 +0000 UTC m=+0.355296290 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3260665 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f3a4cc8bc2c73cc53d99d21ce5cd2 SystemUUID:ec2f3a4c-c8bc-2c73-cc53-d99d21ce5cd2 BootID:0ae61ecc-2774-4832-8d24-65dcd25550c0 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5f:c7:24:eb:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5f:c7:24:eb:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:71:00:c9:53:f3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 19:50:50.889576 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.437765 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 19:50:50.889576 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.437832 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 19:50:50.889576 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.441130 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 19:50:50.889576 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.441153 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-196.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 19:50:50.889576 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.441852 2560 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 19:50:50.889576 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.441861 2560 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 19:50:50.889576 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.441872 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 19:50:50.889576 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.442476 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 19:50:50.889576 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.443752 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 19:50:50.889576 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.446746 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 02 19:50:50.889576 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.446866 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 19:50:50.889576 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.446893 2560 kubelet.go:486] "Attempting to sync node with API server" Jul 02 19:50:50.889576 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.446902 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 19:50:50.889576 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.446913 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 19:50:50.889576 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.446921 2560 kubelet.go:398] "Adding apiserver pod source" Jul 02 19:50:50.889576 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.446931 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 19:50:50.889576 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.447226 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.447241 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.449310 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.451770 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.451811 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.453960 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.454001 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.454013 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.454023 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.454036 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.454046 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.454058 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.454066 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.454077 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.454085 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.454098 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.454107 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.455411 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.455423 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.458326 2560 server.go:1268] "Started kubelet" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.458423 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.458404 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.458468 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.460095 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.460586 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-196.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:50.461343 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:50.461375 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-196.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.461738 2560 server.go:310] "Adding debug handlers to kubelet server" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:50.463892 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:50.464072 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-196.ec2.internal.18be90ed17539ec4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-196.ec2.internal,UID:ip-10-0-137-196.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-196.ec2.internal,},FirstTimestamp:2026-07-02 19:50:50.4583001 +0000 UTC m=+0.377313894,LastTimestamp:2026-07-02 19:50:50.4583001 +0000 UTC m=+0.377313894,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-196.ec2.internal,}" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.467461 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.467466 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:50.467582 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-196.ec2.internal\" not found" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.468040 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.468041 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.468062 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.468132 2560 reconstruct.go:97] "Volume reconstruction finished" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.468142 2560 reconciler.go:29] "Reconciler: start to sync state" Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.468320 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.468330 2560 factory.go:55] Registering systemd factory Jul 02 19:50:50.890397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.468336 2560 factory.go:223] Registration of the systemd container factory successfully Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.468513 2560 factory.go:153] Registering CRI-O factory Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.468523 2560 factory.go:223] Registration of the crio container factory successfully Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.468540 2560 factory.go:103] Registering Raw factory Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.468549 2560 manager.go:1196] Started watching for new ooms in manager Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.469033 2560 manager.go:349] Starting recovery of all containers Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.475318 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:50.481160 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-196.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:50.481432 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.482693 2560 manager.go:354] Recovery completed Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.487094 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.489079 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-196.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.489104 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-196.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.489114 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-196.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.489562 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.489568 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.489571 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.489587 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.490265 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-196.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.490287 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-196.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.490295 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-196.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.490697 2560 policy_none.go:49] "None policy: Start" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.490713 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.490728 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.491854 2560 policy_none.go:47] "Start" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.493811 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8zf78" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:50.500005 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-196.ec2.internal.18be90ed19297768 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-196.ec2.internal,UID:ip-10-0-137-196.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-196.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-196.ec2.internal,},FirstTimestamp:2026-07-02 19:50:50.489091944 +0000 UTC m=+0.408105738,LastTimestamp:2026-07-02 19:50:50.489091944 +0000 UTC m=+0.408105738,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-196.ec2.internal,}" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.503083 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8zf78" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:50.568529 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-196.ec2.internal\" not found" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.577799 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.577831 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.577863 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:50.577894 2560 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.580150 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.580442 2560 manager.go:337] "Starting Device Plugin manager" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:50.580473 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.580482 2560 server.go:87] "Starting device plugin registration server" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.580725 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.580736 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.580925 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.580992 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 19:50:50.891448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.581001 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:50.581449 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:50.581499 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-196.ec2.internal\" not found" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.678722 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-196.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-196.ec2.internal"] Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.678799 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.679780 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-196.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.679816 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-196.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.679827 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-196.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.680925 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.681276 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.681407 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-196.ec2.internal" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.681435 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.681631 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-196.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.681677 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-196.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.681693 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-196.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.681714 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-196.ec2.internal" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.682089 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-196.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.682101 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-196.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.682111 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-196.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.682120 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-196.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.682124 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-196.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.682136 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-196.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.683756 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-196.ec2.internal" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.683774 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.684515 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-196.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.684536 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-196.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.684549 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-196.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:50.687429 2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-196.ec2.internal\" not found" node="ip-10-0-137-196.ec2.internal" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.688316 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-196.ec2.internal" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:50.688338 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-196.ec2.internal\": node \"ip-10-0-137-196.ec2.internal\" not found" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:50.716772 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-196.ec2.internal\" not found" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:50.717544 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-196.ec2.internal\" not found" node="ip-10-0-137-196.ec2.internal" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:50.722597 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-196.ec2.internal\" not found" node="ip-10-0-137-196.ec2.internal" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.770097 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eb88cfb9bd7b5f4fc805a9e795cccc20-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-196.ec2.internal\" (UID: \"eb88cfb9bd7b5f4fc805a9e795cccc20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-196.ec2.internal" Jul 02 19:50:51.083583 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.770138 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb88cfb9bd7b5f4fc805a9e795cccc20-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-196.ec2.internal\" (UID: \"eb88cfb9bd7b5f4fc805a9e795cccc20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-196.ec2.internal" Jul 02 19:50:51.085217 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.770160 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/06a5819e677929f2d6af4dd60c5f15f3-config\") pod \"kube-apiserver-proxy-ip-10-0-137-196.ec2.internal\" (UID: \"06a5819e677929f2d6af4dd60c5f15f3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-196.ec2.internal" Jul 02 19:50:51.085217 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:50.816964 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-196.ec2.internal\" not found" Jul 02 19:50:51.085217 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.870713 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/06a5819e677929f2d6af4dd60c5f15f3-config\") pod \"kube-apiserver-proxy-ip-10-0-137-196.ec2.internal\" (UID: \"06a5819e677929f2d6af4dd60c5f15f3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-196.ec2.internal" Jul 02 19:50:51.085217 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.870747 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eb88cfb9bd7b5f4fc805a9e795cccc20-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-196.ec2.internal\" (UID: \"eb88cfb9bd7b5f4fc805a9e795cccc20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-196.ec2.internal" Jul 02 19:50:51.085217 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.870774 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb88cfb9bd7b5f4fc805a9e795cccc20-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-196.ec2.internal\" (UID: \"eb88cfb9bd7b5f4fc805a9e795cccc20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-196.ec2.internal" Jul 02 19:50:51.085217 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.870714 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/06a5819e677929f2d6af4dd60c5f15f3-config\") pod \"kube-apiserver-proxy-ip-10-0-137-196.ec2.internal\" (UID: \"06a5819e677929f2d6af4dd60c5f15f3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-196.ec2.internal" Jul 02 19:50:51.085217 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.870811 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb88cfb9bd7b5f4fc805a9e795cccc20-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-196.ec2.internal\" (UID: \"eb88cfb9bd7b5f4fc805a9e795cccc20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-196.ec2.internal" Jul 02 19:50:51.085217 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:50.870863 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eb88cfb9bd7b5f4fc805a9e795cccc20-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-196.ec2.internal\" (UID: \"eb88cfb9bd7b5f4fc805a9e795cccc20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-196.ec2.internal" Jul 02 19:50:51.085217 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:50.917957 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-196.ec2.internal\" not found" Jul 02 19:50:51.085217 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:51.018554 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-196.ec2.internal\" not found" Jul 02 19:50:51.085217 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.021698 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-196.ec2.internal" Jul 02 19:50:51.085217 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.026970 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-196.ec2.internal" Jul 02 19:50:51.274268 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:51.119190 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-196.ec2.internal\" not found" Jul 02 19:50:51.274268 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:51.219619 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-196.ec2.internal\" not found" Jul 02 19:50:51.461646 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:51.320106 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-196.ec2.internal\" not found" Jul 02 19:50:51.461646 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.368209 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:50:51.461646 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.383769 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:50:51.461646 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.401600 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 19:50:51.461646 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.401700 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 19:50:51.461646 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.401735 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 19:50:51.461646 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.401756 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 19:50:51.461646 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.447537 2560 apiserver.go:52] "Watching apiserver" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.467965 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-196.ec2.internal" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.467979 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.471194 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.471464 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-dfxtn","openshift-multus/multus-9cdpm","openshift-multus/multus-additional-cni-plugins-mzt7w","openshift-multus/network-metrics-daemon-2vmw6","openshift-network-operator/iptables-alerter-fqc55","openshift-ovn-kubernetes/ovnkube-node-tkp7w","kube-system/konnectivity-agent-xztw7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d","openshift-cluster-node-tuning-operator/tuned-dpgbk","openshift-dns/node-resolver-8wwq6","openshift-network-diagnostics/network-check-target-rm2bw","kube-system/global-pull-secret-syncer-94lwh"] Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.472990 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dfxtn" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.474084 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.475299 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.475615 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gspwc\"" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.475744 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.475788 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.475976 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.476538 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:51.476624 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vmw6" podUID="fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.476954 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2k4tn\"" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.477138 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.477257 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.479153 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.479463 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.479667 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.479810 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.479943 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mxl6d\"" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.480128 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fqc55" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.480163 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xztw7" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.480163 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.480999 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.482179 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.483951 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vhlnz\"" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.483964 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.483994 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.483994 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.484181 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.484215 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.484350 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 19:50:53.004116 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.484360 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.484895 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.484898 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.484974 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.485010 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-np9vf\"" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.485011 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.485053 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.485414 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.485498 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.485522 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qsq7c\"" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.485558 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rqrf7\"" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.485688 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.486225 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.486289 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5l9v8\"" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.486341 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.486823 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.486910 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-196.ec2.internal" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.488634 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8wwq6" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.490960 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:51.491038 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rm2bw" podUID="20f53232-067d-4d46-a0ea-720e1e961f4b" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.491107 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.491110 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.491187 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sk9ql\"" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.492084 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-196.ec2.internal"] Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.492139 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:51.492175 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-94lwh" podUID="271b6a48-768b-4a1f-b7d2-3e9c120a2f55" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.496905 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.496955 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-196.ec2.internal"] Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.505393 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 19:45:51 +0000 UTC" deadline="2028-04-02 05:42:43.724592288 +0000 UTC" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.505422 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15345h51m52.219172478s" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.522360 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kk9th" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.531149 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kk9th" Jul 02 19:50:53.005817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.568729 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 19:50:53.006745 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574480 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-multus-socket-dir-parent\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.006745 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574500 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-host-run-netns\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.006745 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574515 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw6lb\" (UniqueName: \"kubernetes.io/projected/72996a08-b83d-4d1b-99c6-780e15c6722a-kube-api-access-sw6lb\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.006745 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574532 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l986w\" (UniqueName: \"kubernetes.io/projected/086783f9-069b-45d2-ad74-a0195631cfe2-kube-api-access-l986w\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.006745 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574552 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret\") pod \"global-pull-secret-syncer-94lwh\" (UID: \"271b6a48-768b-4a1f-b7d2-3e9c120a2f55\") " pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:50:53.006745 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574565 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-os-release\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.006745 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574601 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-host-var-lib-cni-bin\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.006745 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574630 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c284b6aa-c1c4-4c3e-941f-ce7fbb7f8b67-konnectivity-ca\") pod \"konnectivity-agent-xztw7\" (UID: \"c284b6aa-c1c4-4c3e-941f-ce7fbb7f8b67\") " pod="kube-system/konnectivity-agent-xztw7" Jul 02 19:50:53.006745 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574654 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.006745 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574678 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a5a25f3-df5e-4f11-9697-3d27824d62e2-host-slash\") pod \"iptables-alerter-fqc55\" (UID: \"3a5a25f3-df5e-4f11-9697-3d27824d62e2\") " pod="openshift-network-operator/iptables-alerter-fqc55" Jul 02 19:50:53.006745 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574699 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8c0c3b5-e729-46f6-b927-ecd72af8af02-hosts-file\") pod \"node-resolver-8wwq6\" (UID: \"e8c0c3b5-e729-46f6-b927-ecd72af8af02\") " pod="openshift-dns/node-resolver-8wwq6" Jul 02 19:50:53.006745 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574729 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-multus-cni-dir\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.006745 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574753 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-host-run-netns\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.006745 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574770 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-systemd-units\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.006745 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574790 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-run-ovn\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.006745 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574804 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-log-socket\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.007305 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574823 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab35148e-bbd4-42ef-af7e-69a39287eac1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6zq7d\" (UID: \"ab35148e-bbd4-42ef-af7e-69a39287eac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.007305 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574870 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-etc-sysctl-d\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.007305 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574894 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-host\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.007305 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574918 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-hostroot\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.007305 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574939 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/72996a08-b83d-4d1b-99c6-780e15c6722a-env-overrides\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.007305 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574962 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xdqb\" (UniqueName: \"kubernetes.io/projected/ab35148e-bbd4-42ef-af7e-69a39287eac1-kube-api-access-9xdqb\") pod \"aws-ebs-csi-driver-node-6zq7d\" (UID: \"ab35148e-bbd4-42ef-af7e-69a39287eac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.007305 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.574977 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-system-cni-dir\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.007305 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575003 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.007305 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575024 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3a5a25f3-df5e-4f11-9697-3d27824d62e2-iptables-alerter-script\") pod \"iptables-alerter-fqc55\" (UID: \"3a5a25f3-df5e-4f11-9697-3d27824d62e2\") " pod="openshift-network-operator/iptables-alerter-fqc55" Jul 02 19:50:53.007305 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575037 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-dbus\") pod \"global-pull-secret-syncer-94lwh\" (UID: \"271b6a48-768b-4a1f-b7d2-3e9c120a2f55\") " pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:50:53.007305 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575056 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.007305 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575071 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-etc-modprobe-d\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.007305 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575097 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-var-lib-kubelet\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.007305 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575113 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-cnibin\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.007305 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575141 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.007305 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575162 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-etc-kubernetes\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.008091 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575184 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-var-lib-openvswitch\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.008091 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575203 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-lib-modules\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.008091 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575237 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8c0c3b5-e729-46f6-b927-ecd72af8af02-tmp-dir\") pod \"node-resolver-8wwq6\" (UID: \"e8c0c3b5-e729-46f6-b927-ecd72af8af02\") " pod="openshift-dns/node-resolver-8wwq6" Jul 02 19:50:53.008091 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575251 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-etc-openvswitch\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.008091 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575267 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-system-cni-dir\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.008091 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575285 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-host-run-k8s-cni-cncf-io\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.008091 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575304 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ad299c1f-ba3d-4088-bd88-84536a843b3d-multus-daemon-config\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.008091 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575318 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-host-cni-bin\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.008091 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575330 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab35148e-bbd4-42ef-af7e-69a39287eac1-socket-dir\") pod \"aws-ebs-csi-driver-node-6zq7d\" (UID: \"ab35148e-bbd4-42ef-af7e-69a39287eac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.008091 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575349 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-etc-systemd\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.008091 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575370 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d454a862-97f9-4763-960f-cd1aaf123df4-host\") pod \"node-ca-dfxtn\" (UID: \"d454a862-97f9-4763-960f-cd1aaf123df4\") " pod="openshift-image-registry/node-ca-dfxtn" Jul 02 19:50:53.008091 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575389 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.008091 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575404 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-run-systemd\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.008091 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575417 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/72996a08-b83d-4d1b-99c6-780e15c6722a-ovnkube-script-lib\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.008091 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575429 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-etc-sysctl-conf\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.008091 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575452 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-sys\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.008091 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575469 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/086783f9-069b-45d2-ad74-a0195631cfe2-etc-tuned\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.008843 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575491 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8gg8\" (UniqueName: \"kubernetes.io/projected/d454a862-97f9-4763-960f-cd1aaf123df4-kube-api-access-l8gg8\") pod \"node-ca-dfxtn\" (UID: \"d454a862-97f9-4763-960f-cd1aaf123df4\") " pod="openshift-image-registry/node-ca-dfxtn" Jul 02 19:50:53.008843 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575521 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztjf5\" (UniqueName: \"kubernetes.io/projected/e8c0c3b5-e729-46f6-b927-ecd72af8af02-kube-api-access-ztjf5\") pod \"node-resolver-8wwq6\" (UID: \"e8c0c3b5-e729-46f6-b927-ecd72af8af02\") " pod="openshift-dns/node-resolver-8wwq6" Jul 02 19:50:53.008843 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575540 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-host-var-lib-cni-multus\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.008843 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575552 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qcjx\" (UniqueName: \"kubernetes.io/projected/ad299c1f-ba3d-4088-bd88-84536a843b3d-kube-api-access-4qcjx\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.008843 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575567 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs\") pod \"network-metrics-daemon-2vmw6\" (UID: \"fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab\") " pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:50:53.008843 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575589 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-cnibin\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.008843 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575614 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-host-run-ovn-kubernetes\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.008843 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575631 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c284b6aa-c1c4-4c3e-941f-ce7fbb7f8b67-agent-certs\") pod \"konnectivity-agent-xztw7\" (UID: \"c284b6aa-c1c4-4c3e-941f-ce7fbb7f8b67\") " pod="kube-system/konnectivity-agent-xztw7" Jul 02 19:50:53.008843 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575662 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-host-slash\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.008843 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575692 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-node-log\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.008843 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575707 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab35148e-bbd4-42ef-af7e-69a39287eac1-registration-dir\") pod \"aws-ebs-csi-driver-node-6zq7d\" (UID: \"ab35148e-bbd4-42ef-af7e-69a39287eac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.008843 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575733 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/086783f9-069b-45d2-ad74-a0195631cfe2-tmp\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.008843 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575751 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad299c1f-ba3d-4088-bd88-84536a843b3d-cni-binary-copy\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.008843 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575770 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7j2x\" (UniqueName: \"kubernetes.io/projected/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-kube-api-access-w7j2x\") pod \"network-metrics-daemon-2vmw6\" (UID: \"fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab\") " pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:50:53.008843 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575783 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-host-cni-netd\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.008843 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575797 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/72996a08-b83d-4d1b-99c6-780e15c6722a-ovnkube-config\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.009363 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575816 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab35148e-bbd4-42ef-af7e-69a39287eac1-device-dir\") pod \"aws-ebs-csi-driver-node-6zq7d\" (UID: \"ab35148e-bbd4-42ef-af7e-69a39287eac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.009363 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575854 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-host-kubelet\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.009363 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575881 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab35148e-bbd4-42ef-af7e-69a39287eac1-sys-fs\") pod \"aws-ebs-csi-driver-node-6zq7d\" (UID: \"ab35148e-bbd4-42ef-af7e-69a39287eac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.009363 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575895 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-etc-sysconfig\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.009363 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575908 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf5tp\" (UniqueName: \"kubernetes.io/projected/3a5a25f3-df5e-4f11-9697-3d27824d62e2-kube-api-access-nf5tp\") pod \"iptables-alerter-fqc55\" (UID: \"3a5a25f3-df5e-4f11-9697-3d27824d62e2\") " pod="openshift-network-operator/iptables-alerter-fqc55" Jul 02 19:50:53.009363 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575921 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-kubelet-config\") pod \"global-pull-secret-syncer-94lwh\" (UID: \"271b6a48-768b-4a1f-b7d2-3e9c120a2f55\") " pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:50:53.009363 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575934 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-host-var-lib-kubelet\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.009363 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575948 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-host-run-multus-certs\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.009363 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575960 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab35148e-bbd4-42ef-af7e-69a39287eac1-etc-selinux\") pod \"aws-ebs-csi-driver-node-6zq7d\" (UID: \"ab35148e-bbd4-42ef-af7e-69a39287eac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.009363 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575975 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-etc-kubernetes\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.009363 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.575989 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpbnp\" (UniqueName: \"kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp\") pod \"network-check-target-rm2bw\" (UID: \"20f53232-067d-4d46-a0ea-720e1e961f4b\") " pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:50:53.009363 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.576004 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-multus-conf-dir\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.009363 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.576021 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-run-openvswitch\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.009363 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.576035 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/72996a08-b83d-4d1b-99c6-780e15c6722a-ovn-node-metrics-cert\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.009363 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.576047 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-run\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.009363 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.576059 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d454a862-97f9-4763-960f-cd1aaf123df4-serviceca\") pod \"node-ca-dfxtn\" (UID: \"d454a862-97f9-4763-960f-cd1aaf123df4\") " pod="openshift-image-registry/node-ca-dfxtn" Jul 02 19:50:53.009904 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.576072 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-os-release\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.009904 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:51.576085 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwmtv\" (UniqueName: \"kubernetes.io/projected/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-kube-api-access-jwmtv\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.152575 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026421 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-run-ovn\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.152575 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026446 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-log-socket\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.152575 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026463 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab35148e-bbd4-42ef-af7e-69a39287eac1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6zq7d\" (UID: \"ab35148e-bbd4-42ef-af7e-69a39287eac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.152575 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026492 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-etc-sysctl-d\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.152575 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026514 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-host\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.152575 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026527 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-log-socket\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.152575 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026554 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-hostroot\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.152575 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026566 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-run-ovn\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.152575 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026572 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/72996a08-b83d-4d1b-99c6-780e15c6722a-env-overrides\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.152575 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026607 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-etc-sysctl-d\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.152575 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026616 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-host\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.152575 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026568 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab35148e-bbd4-42ef-af7e-69a39287eac1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6zq7d\" (UID: \"ab35148e-bbd4-42ef-af7e-69a39287eac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.152575 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026618 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-hostroot\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.152575 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026642 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xdqb\" (UniqueName: \"kubernetes.io/projected/ab35148e-bbd4-42ef-af7e-69a39287eac1-kube-api-access-9xdqb\") pod \"aws-ebs-csi-driver-node-6zq7d\" (UID: \"ab35148e-bbd4-42ef-af7e-69a39287eac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.152575 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026674 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-system-cni-dir\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.152575 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026699 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.152575 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026727 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3a5a25f3-df5e-4f11-9697-3d27824d62e2-iptables-alerter-script\") pod \"iptables-alerter-fqc55\" (UID: \"3a5a25f3-df5e-4f11-9697-3d27824d62e2\") " pod="openshift-network-operator/iptables-alerter-fqc55" Jul 02 19:50:53.154323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026735 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-system-cni-dir\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.154323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026750 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-dbus\") pod \"global-pull-secret-syncer-94lwh\" (UID: \"271b6a48-768b-4a1f-b7d2-3e9c120a2f55\") " pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:50:53.154323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026796 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.154323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026824 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-etc-modprobe-d\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.154323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026853 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-var-lib-kubelet\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.154323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026877 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-cnibin\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.154323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026880 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.154323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026899 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-dbus\") pod \"global-pull-secret-syncer-94lwh\" (UID: \"271b6a48-768b-4a1f-b7d2-3e9c120a2f55\") " pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:50:53.154323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026908 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-var-lib-kubelet\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.154323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026909 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.154323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026916 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-cnibin\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.154323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026932 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.154323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.026989 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-etc-modprobe-d\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.154323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027011 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-etc-kubernetes\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.154323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027040 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/72996a08-b83d-4d1b-99c6-780e15c6722a-env-overrides\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.154323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027058 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-var-lib-openvswitch\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.154323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027082 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-etc-kubernetes\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.155297 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027084 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-lib-modules\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.155297 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027106 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8c0c3b5-e729-46f6-b927-ecd72af8af02-tmp-dir\") pod \"node-resolver-8wwq6\" (UID: \"e8c0c3b5-e729-46f6-b927-ecd72af8af02\") " pod="openshift-dns/node-resolver-8wwq6" Jul 02 19:50:53.155297 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027121 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-etc-openvswitch\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.155297 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027115 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-var-lib-openvswitch\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.155297 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027138 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-system-cni-dir\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.155297 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027159 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-host-run-k8s-cni-cncf-io\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.155297 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027166 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-lib-modules\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.155297 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027175 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ad299c1f-ba3d-4088-bd88-84536a843b3d-multus-daemon-config\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.155297 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027215 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-etc-openvswitch\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.155297 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027219 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-system-cni-dir\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.155297 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027244 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-host-cni-bin\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.155297 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027263 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-host-run-k8s-cni-cncf-io\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.155297 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027284 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab35148e-bbd4-42ef-af7e-69a39287eac1-socket-dir\") pod \"aws-ebs-csi-driver-node-6zq7d\" (UID: \"ab35148e-bbd4-42ef-af7e-69a39287eac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.155297 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027305 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-host-cni-bin\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.155297 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027307 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-etc-systemd\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.155297 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027359 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-etc-systemd\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.155297 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027374 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d454a862-97f9-4763-960f-cd1aaf123df4-host\") pod \"node-ca-dfxtn\" (UID: \"d454a862-97f9-4763-960f-cd1aaf123df4\") " pod="openshift-image-registry/node-ca-dfxtn" Jul 02 19:50:53.155297 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027401 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.156197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027426 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-run-systemd\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.156197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027430 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d454a862-97f9-4763-960f-cd1aaf123df4-host\") pod \"node-ca-dfxtn\" (UID: \"d454a862-97f9-4763-960f-cd1aaf123df4\") " pod="openshift-image-registry/node-ca-dfxtn" Jul 02 19:50:53.156197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027429 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8c0c3b5-e729-46f6-b927-ecd72af8af02-tmp-dir\") pod \"node-resolver-8wwq6\" (UID: \"e8c0c3b5-e729-46f6-b927-ecd72af8af02\") " pod="openshift-dns/node-resolver-8wwq6" Jul 02 19:50:53.156197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027449 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/72996a08-b83d-4d1b-99c6-780e15c6722a-ovnkube-script-lib\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.156197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027474 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-etc-sysctl-conf\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.156197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027507 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-run-systemd\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.156197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027516 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.156197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027535 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-sys\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.156197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027557 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/086783f9-069b-45d2-ad74-a0195631cfe2-etc-tuned\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.156197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027566 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-etc-sysctl-conf\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.156197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027572 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3a5a25f3-df5e-4f11-9697-3d27824d62e2-iptables-alerter-script\") pod \"iptables-alerter-fqc55\" (UID: \"3a5a25f3-df5e-4f11-9697-3d27824d62e2\") " pod="openshift-network-operator/iptables-alerter-fqc55" Jul 02 19:50:53.156197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027400 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab35148e-bbd4-42ef-af7e-69a39287eac1-socket-dir\") pod \"aws-ebs-csi-driver-node-6zq7d\" (UID: \"ab35148e-bbd4-42ef-af7e-69a39287eac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.156197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027581 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8gg8\" (UniqueName: \"kubernetes.io/projected/d454a862-97f9-4763-960f-cd1aaf123df4-kube-api-access-l8gg8\") pod \"node-ca-dfxtn\" (UID: \"d454a862-97f9-4763-960f-cd1aaf123df4\") " pod="openshift-image-registry/node-ca-dfxtn" Jul 02 19:50:53.156197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027621 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztjf5\" (UniqueName: \"kubernetes.io/projected/e8c0c3b5-e729-46f6-b927-ecd72af8af02-kube-api-access-ztjf5\") pod \"node-resolver-8wwq6\" (UID: \"e8c0c3b5-e729-46f6-b927-ecd72af8af02\") " pod="openshift-dns/node-resolver-8wwq6" Jul 02 19:50:53.156197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027625 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-sys\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.156197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027663 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-host-var-lib-cni-multus\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.156197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027707 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qcjx\" (UniqueName: \"kubernetes.io/projected/ad299c1f-ba3d-4088-bd88-84536a843b3d-kube-api-access-4qcjx\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.156197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027730 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs\") pod \"network-metrics-daemon-2vmw6\" (UID: \"fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab\") " pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:50:53.157236 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027755 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-cnibin\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.157236 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027780 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-host-run-ovn-kubernetes\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.157236 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027803 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c284b6aa-c1c4-4c3e-941f-ce7fbb7f8b67-agent-certs\") pod \"konnectivity-agent-xztw7\" (UID: \"c284b6aa-c1c4-4c3e-941f-ce7fbb7f8b67\") " pod="kube-system/konnectivity-agent-xztw7" Jul 02 19:50:53.157236 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027825 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-host-slash\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.157236 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027847 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-node-log\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.157236 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027871 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab35148e-bbd4-42ef-af7e-69a39287eac1-registration-dir\") pod \"aws-ebs-csi-driver-node-6zq7d\" (UID: \"ab35148e-bbd4-42ef-af7e-69a39287eac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.157236 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027897 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/086783f9-069b-45d2-ad74-a0195631cfe2-tmp\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.157236 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027926 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad299c1f-ba3d-4088-bd88-84536a843b3d-cni-binary-copy\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.157236 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027926 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ad299c1f-ba3d-4088-bd88-84536a843b3d-multus-daemon-config\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.157236 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027941 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-host-run-ovn-kubernetes\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.157236 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027730 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-host-var-lib-cni-multus\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.157236 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028004 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/72996a08-b83d-4d1b-99c6-780e15c6722a-ovnkube-script-lib\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.157236 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027996 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-host-slash\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.157236 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027950 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7j2x\" (UniqueName: \"kubernetes.io/projected/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-kube-api-access-w7j2x\") pod \"network-metrics-daemon-2vmw6\" (UID: \"fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab\") " pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:50:53.157236 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:53.028069 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:50:53.157236 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028094 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-host-cni-netd\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.157236 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028044 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-cnibin\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.340854 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:53.028137 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs podName:fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab nodeName:}" failed. No retries permitted until 2026-07-02 19:50:53.528108167 +0000 UTC m=+2.097712215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs") pod "network-metrics-daemon-2vmw6" (UID: "fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:50:53.340854 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.027868 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 19:50:53.340854 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028159 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/72996a08-b83d-4d1b-99c6-780e15c6722a-ovnkube-config\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.340854 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028137 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-host-cni-netd\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.340854 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028182 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab35148e-bbd4-42ef-af7e-69a39287eac1-device-dir\") pod \"aws-ebs-csi-driver-node-6zq7d\" (UID: \"ab35148e-bbd4-42ef-af7e-69a39287eac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.340854 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028198 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-host-kubelet\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.340854 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028212 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab35148e-bbd4-42ef-af7e-69a39287eac1-sys-fs\") pod \"aws-ebs-csi-driver-node-6zq7d\" (UID: \"ab35148e-bbd4-42ef-af7e-69a39287eac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.340854 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028226 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-etc-sysconfig\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.340854 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028267 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf5tp\" (UniqueName: \"kubernetes.io/projected/3a5a25f3-df5e-4f11-9697-3d27824d62e2-kube-api-access-nf5tp\") pod \"iptables-alerter-fqc55\" (UID: \"3a5a25f3-df5e-4f11-9697-3d27824d62e2\") " pod="openshift-network-operator/iptables-alerter-fqc55" Jul 02 19:50:53.340854 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028162 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-node-log\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.340854 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028179 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab35148e-bbd4-42ef-af7e-69a39287eac1-registration-dir\") pod \"aws-ebs-csi-driver-node-6zq7d\" (UID: \"ab35148e-bbd4-42ef-af7e-69a39287eac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.340854 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028292 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.340854 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028317 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-host-kubelet\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.340854 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028334 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-kubelet-config\") pod \"global-pull-secret-syncer-94lwh\" (UID: \"271b6a48-768b-4a1f-b7d2-3e9c120a2f55\") " pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:50:53.340854 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028343 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab35148e-bbd4-42ef-af7e-69a39287eac1-device-dir\") pod \"aws-ebs-csi-driver-node-6zq7d\" (UID: \"ab35148e-bbd4-42ef-af7e-69a39287eac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.340854 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028360 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-host-var-lib-kubelet\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.340854 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028363 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab35148e-bbd4-42ef-af7e-69a39287eac1-sys-fs\") pod \"aws-ebs-csi-driver-node-6zq7d\" (UID: \"ab35148e-bbd4-42ef-af7e-69a39287eac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.343163 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028384 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-host-run-multus-certs\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.343163 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028404 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-kubelet-config\") pod \"global-pull-secret-syncer-94lwh\" (UID: \"271b6a48-768b-4a1f-b7d2-3e9c120a2f55\") " pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:50:53.343163 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028423 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab35148e-bbd4-42ef-af7e-69a39287eac1-etc-selinux\") pod \"aws-ebs-csi-driver-node-6zq7d\" (UID: \"ab35148e-bbd4-42ef-af7e-69a39287eac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.343163 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028458 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-host-run-multus-certs\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.343163 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028467 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-host-var-lib-kubelet\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.343163 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028491 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-etc-kubernetes\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.343163 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028519 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpbnp\" (UniqueName: \"kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp\") pod \"network-check-target-rm2bw\" (UID: \"20f53232-067d-4d46-a0ea-720e1e961f4b\") " pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:50:53.343163 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028541 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab35148e-bbd4-42ef-af7e-69a39287eac1-etc-selinux\") pod \"aws-ebs-csi-driver-node-6zq7d\" (UID: \"ab35148e-bbd4-42ef-af7e-69a39287eac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.343163 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028562 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-etc-kubernetes\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.343163 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028588 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-multus-conf-dir\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.343163 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028608 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-run-openvswitch\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.343163 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028629 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/72996a08-b83d-4d1b-99c6-780e15c6722a-ovn-node-metrics-cert\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.343163 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028646 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-run\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.343163 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028665 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d454a862-97f9-4763-960f-cd1aaf123df4-serviceca\") pod \"node-ca-dfxtn\" (UID: \"d454a862-97f9-4763-960f-cd1aaf123df4\") " pod="openshift-image-registry/node-ca-dfxtn" Jul 02 19:50:53.343163 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028685 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-os-release\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.343163 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028705 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwmtv\" (UniqueName: \"kubernetes.io/projected/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-kube-api-access-jwmtv\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.343163 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028726 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-multus-socket-dir-parent\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.344814 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028747 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-host-run-netns\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.344814 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.031184 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-os-release\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.344814 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.031226 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/086783f9-069b-45d2-ad74-a0195631cfe2-etc-tuned\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.344814 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.031231 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-run\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.344814 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.031263 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/086783f9-069b-45d2-ad74-a0195631cfe2-tmp\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.344814 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.031293 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-run-openvswitch\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.344814 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.031324 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-multus-socket-dir-parent\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.344814 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.031366 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-host-run-netns\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.344814 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.031421 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-multus-conf-dir\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.344814 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.032017 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c284b6aa-c1c4-4c3e-941f-ce7fbb7f8b67-agent-certs\") pod \"konnectivity-agent-xztw7\" (UID: \"c284b6aa-c1c4-4c3e-941f-ce7fbb7f8b67\") " pod="kube-system/konnectivity-agent-xztw7" Jul 02 19:50:53.344814 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.032551 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/72996a08-b83d-4d1b-99c6-780e15c6722a-ovn-node-metrics-cert\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.344814 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.028406 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/086783f9-069b-45d2-ad74-a0195631cfe2-etc-sysconfig\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.344814 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.034361 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw6lb\" (UniqueName: \"kubernetes.io/projected/72996a08-b83d-4d1b-99c6-780e15c6722a-kube-api-access-sw6lb\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.344814 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.034387 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l986w\" (UniqueName: \"kubernetes.io/projected/086783f9-069b-45d2-ad74-a0195631cfe2-kube-api-access-l986w\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.344814 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.034762 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret\") pod \"global-pull-secret-syncer-94lwh\" (UID: \"271b6a48-768b-4a1f-b7d2-3e9c120a2f55\") " pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:50:53.344814 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.034792 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-os-release\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.344814 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.034819 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-host-var-lib-cni-bin\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.344814 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.034878 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-host-var-lib-cni-bin\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.345407 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.034886 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-os-release\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.345407 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.034920 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d454a862-97f9-4763-960f-cd1aaf123df4-serviceca\") pod \"node-ca-dfxtn\" (UID: \"d454a862-97f9-4763-960f-cd1aaf123df4\") " pod="openshift-image-registry/node-ca-dfxtn" Jul 02 19:50:53.345407 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:53.034952 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:50:53.345407 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.034983 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c284b6aa-c1c4-4c3e-941f-ce7fbb7f8b67-konnectivity-ca\") pod \"konnectivity-agent-xztw7\" (UID: \"c284b6aa-c1c4-4c3e-941f-ce7fbb7f8b67\") " pod="kube-system/konnectivity-agent-xztw7" Jul 02 19:50:53.345407 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.035003 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.345407 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.035027 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a5a25f3-df5e-4f11-9697-3d27824d62e2-host-slash\") pod \"iptables-alerter-fqc55\" (UID: \"3a5a25f3-df5e-4f11-9697-3d27824d62e2\") " pod="openshift-network-operator/iptables-alerter-fqc55" Jul 02 19:50:53.345407 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.035041 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/72996a08-b83d-4d1b-99c6-780e15c6722a-ovnkube-config\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.345407 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.035065 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a5a25f3-df5e-4f11-9697-3d27824d62e2-host-slash\") pod \"iptables-alerter-fqc55\" (UID: \"3a5a25f3-df5e-4f11-9697-3d27824d62e2\") " pod="openshift-network-operator/iptables-alerter-fqc55" Jul 02 19:50:53.345407 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.035093 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8c0c3b5-e729-46f6-b927-ecd72af8af02-hosts-file\") pod \"node-resolver-8wwq6\" (UID: \"e8c0c3b5-e729-46f6-b927-ecd72af8af02\") " pod="openshift-dns/node-resolver-8wwq6" Jul 02 19:50:53.345407 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.035116 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-multus-cni-dir\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.345407 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.035132 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad299c1f-ba3d-4088-bd88-84536a843b3d-cni-binary-copy\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.345407 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.035139 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-host-run-netns\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.345407 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.035152 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8c0c3b5-e729-46f6-b927-ecd72af8af02-hosts-file\") pod \"node-resolver-8wwq6\" (UID: \"e8c0c3b5-e729-46f6-b927-ecd72af8af02\") " pod="openshift-dns/node-resolver-8wwq6" Jul 02 19:50:53.345407 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.035170 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-systemd-units\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.345407 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.035194 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-host-run-netns\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.345407 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.035194 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad299c1f-ba3d-4088-bd88-84536a843b3d-multus-cni-dir\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.345407 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.035260 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/72996a08-b83d-4d1b-99c6-780e15c6722a-systemd-units\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.345407 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:53.035324 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret podName:271b6a48-768b-4a1f-b7d2-3e9c120a2f55 nodeName:}" failed. No retries permitted until 2026-07-02 19:50:53.535309267 +0000 UTC m=+2.104913323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret") pod "global-pull-secret-syncer-94lwh" (UID: "271b6a48-768b-4a1f-b7d2-3e9c120a2f55") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:50:53.345998 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.035477 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.345998 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.035491 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c284b6aa-c1c4-4c3e-941f-ce7fbb7f8b67-konnectivity-ca\") pod \"konnectivity-agent-xztw7\" (UID: \"c284b6aa-c1c4-4c3e-941f-ce7fbb7f8b67\") " pod="kube-system/konnectivity-agent-xztw7" Jul 02 19:50:53.345998 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:53.040745 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:50:53.345998 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:53.041201 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:50:53.345998 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:53.041218 2560 projected.go:196] Error preparing data for projected volume kube-api-access-kpbnp for pod openshift-network-diagnostics/network-check-target-rm2bw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:50:53.345998 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:53.041295 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp podName:20f53232-067d-4d46-a0ea-720e1e961f4b nodeName:}" failed. No retries permitted until 2026-07-02 19:50:53.541277808 +0000 UTC m=+2.110881876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kpbnp" (UniqueName: "kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp") pod "network-check-target-rm2bw" (UID: "20f53232-067d-4d46-a0ea-720e1e961f4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:50:53.345998 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.042616 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qcjx\" (UniqueName: \"kubernetes.io/projected/ad299c1f-ba3d-4088-bd88-84536a843b3d-kube-api-access-4qcjx\") pod \"multus-9cdpm\" (UID: \"ad299c1f-ba3d-4088-bd88-84536a843b3d\") " pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.345998 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.042719 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw6lb\" (UniqueName: \"kubernetes.io/projected/72996a08-b83d-4d1b-99c6-780e15c6722a-kube-api-access-sw6lb\") pod \"ovnkube-node-tkp7w\" (UID: \"72996a08-b83d-4d1b-99c6-780e15c6722a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.345998 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.043217 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf5tp\" (UniqueName: \"kubernetes.io/projected/3a5a25f3-df5e-4f11-9697-3d27824d62e2-kube-api-access-nf5tp\") pod \"iptables-alerter-fqc55\" (UID: \"3a5a25f3-df5e-4f11-9697-3d27824d62e2\") " pod="openshift-network-operator/iptables-alerter-fqc55" Jul 02 19:50:53.345998 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.043411 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xdqb\" (UniqueName: \"kubernetes.io/projected/ab35148e-bbd4-42ef-af7e-69a39287eac1-kube-api-access-9xdqb\") pod \"aws-ebs-csi-driver-node-6zq7d\" (UID: \"ab35148e-bbd4-42ef-af7e-69a39287eac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.345998 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.043771 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7j2x\" (UniqueName: \"kubernetes.io/projected/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-kube-api-access-w7j2x\") pod \"network-metrics-daemon-2vmw6\" (UID: \"fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab\") " pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:50:53.345998 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.043830 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8gg8\" (UniqueName: \"kubernetes.io/projected/d454a862-97f9-4763-960f-cd1aaf123df4-kube-api-access-l8gg8\") pod \"node-ca-dfxtn\" (UID: \"d454a862-97f9-4763-960f-cd1aaf123df4\") " pod="openshift-image-registry/node-ca-dfxtn" Jul 02 19:50:53.345998 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.044916 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztjf5\" (UniqueName: \"kubernetes.io/projected/e8c0c3b5-e729-46f6-b927-ecd72af8af02-kube-api-access-ztjf5\") pod \"node-resolver-8wwq6\" (UID: \"e8c0c3b5-e729-46f6-b927-ecd72af8af02\") " pod="openshift-dns/node-resolver-8wwq6" Jul 02 19:50:53.345998 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.046416 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwmtv\" (UniqueName: \"kubernetes.io/projected/0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8-kube-api-access-jwmtv\") pod \"multus-additional-cni-plugins-mzt7w\" (UID: \"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8\") " pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.345998 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.048443 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l986w\" (UniqueName: \"kubernetes.io/projected/086783f9-069b-45d2-ad74-a0195631cfe2-kube-api-access-l986w\") pod \"tuned-dpgbk\" (UID: \"086783f9-069b-45d2-ad74-a0195631cfe2\") " pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.345998 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.113377 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:50:53.345998 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.163010 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dfxtn" Jul 02 19:50:53.346723 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:53.170188 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a5819e677929f2d6af4dd60c5f15f3.slice/crio-62dad13518dae34903b8c6e35b48a40bf20ece7f9a1c3984acac116290e4be24 WatchSource:0}: Error finding container 62dad13518dae34903b8c6e35b48a40bf20ece7f9a1c3984acac116290e4be24: Status 404 returned error can't find the container with id 62dad13518dae34903b8c6e35b48a40bf20ece7f9a1c3984acac116290e4be24 Jul 02 19:50:53.346723 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:53.170571 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb88cfb9bd7b5f4fc805a9e795cccc20.slice/crio-515a5f2f99b6ef256deaaa8286c54f6c1d69834925d76fea236ef07e5a62b27c WatchSource:0}: Error finding container 515a5f2f99b6ef256deaaa8286c54f6c1d69834925d76fea236ef07e5a62b27c: Status 404 returned error can't find the container with id 515a5f2f99b6ef256deaaa8286c54f6c1d69834925d76fea236ef07e5a62b27c Jul 02 19:50:53.346723 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:53.175043 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd454a862_97f9_4763_960f_cd1aaf123df4.slice/crio-c015705fb8739a114a44ff1c7883b45fb5ca4f67e3828afe758291961f126f9e WatchSource:0}: Error finding container c015705fb8739a114a44ff1c7883b45fb5ca4f67e3828afe758291961f126f9e: Status 404 returned error can't find the container with id c015705fb8739a114a44ff1c7883b45fb5ca4f67e3828afe758291961f126f9e Jul 02 19:50:53.346723 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.175216 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 19:50:53.346723 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.182629 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9cdpm" Jul 02 19:50:53.346723 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:53.189193 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad299c1f_ba3d_4088_bd88_84536a843b3d.slice/crio-b169fb9b196d825e1eb04f4f1463143f05d713117354ea668e0a9cbbe58655b6 WatchSource:0}: Error finding container b169fb9b196d825e1eb04f4f1463143f05d713117354ea668e0a9cbbe58655b6: Status 404 returned error can't find the container with id b169fb9b196d825e1eb04f4f1463143f05d713117354ea668e0a9cbbe58655b6 Jul 02 19:50:53.346723 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.199378 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mzt7w" Jul 02 19:50:53.346723 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:53.205698 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b85f94d_fc04_42c1_b7aa_5d5cdfd361a8.slice/crio-0300e5d175edeb4944048ecb9d6c7223b2ea356f884babad97b34b5a217fa99e WatchSource:0}: Error finding container 0300e5d175edeb4944048ecb9d6c7223b2ea356f884babad97b34b5a217fa99e: Status 404 returned error can't find the container with id 0300e5d175edeb4944048ecb9d6c7223b2ea356f884babad97b34b5a217fa99e Jul 02 19:50:53.346723 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.221318 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fqc55" Jul 02 19:50:53.346723 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:53.227057 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a5a25f3_df5e_4f11_9697_3d27824d62e2.slice/crio-419907b3d878f27bce411e8f770cfe58ce1e0f4933b915ceb5e5ff09408c31d5 WatchSource:0}: Error finding container 419907b3d878f27bce411e8f770cfe58ce1e0f4933b915ceb5e5ff09408c31d5: Status 404 returned error can't find the container with id 419907b3d878f27bce411e8f770cfe58ce1e0f4933b915ceb5e5ff09408c31d5 Jul 02 19:50:53.346723 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.242109 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xztw7" Jul 02 19:50:53.346723 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.247435 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" Jul 02 19:50:53.346723 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.248635 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:50:53.346723 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:53.249840 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc284b6aa_c1c4_4c3e_941f_ce7fbb7f8b67.slice/crio-20a4265acaceecfb99e8ef594e70487a00ad254e89c4bea5849f23239f89451e WatchSource:0}: Error finding container 20a4265acaceecfb99e8ef594e70487a00ad254e89c4bea5849f23239f89451e: Status 404 returned error can't find the container with id 20a4265acaceecfb99e8ef594e70487a00ad254e89c4bea5849f23239f89451e Jul 02 19:50:53.346723 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:53.254569 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab35148e_bbd4_42ef_af7e_69a39287eac1.slice/crio-52c1ff3e9e4eb63f280ae0e702afdbd09c2735f1df563708e6a5dda4717e9ab0 WatchSource:0}: Error finding container 52c1ff3e9e4eb63f280ae0e702afdbd09c2735f1df563708e6a5dda4717e9ab0: Status 404 returned error can't find the container with id 52c1ff3e9e4eb63f280ae0e702afdbd09c2735f1df563708e6a5dda4717e9ab0 Jul 02 19:50:53.346723 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:53.256645 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72996a08_b83d_4d1b_99c6_780e15c6722a.slice/crio-96711a5ba62470335c7069ac92fbec27e117f33b9ccf62621be7ed9891c51fea WatchSource:0}: Error finding container 96711a5ba62470335c7069ac92fbec27e117f33b9ccf62621be7ed9891c51fea: Status 404 returned error can't find the container with id 96711a5ba62470335c7069ac92fbec27e117f33b9ccf62621be7ed9891c51fea Jul 02 19:50:53.346723 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.277914 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" Jul 02 19:50:53.346723 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.282850 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8wwq6" Jul 02 19:50:53.347516 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:53.284420 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086783f9_069b_45d2_ad74_a0195631cfe2.slice/crio-6d31c9d26fdb0c443c6029f399e1002e7a8ad594a6f51b62b61f74fcc7872329 WatchSource:0}: Error finding container 6d31c9d26fdb0c443c6029f399e1002e7a8ad594a6f51b62b61f74fcc7872329: Status 404 returned error can't find the container with id 6d31c9d26fdb0c443c6029f399e1002e7a8ad594a6f51b62b61f74fcc7872329 Jul 02 19:50:53.347516 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:50:53.289358 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c0c3b5_e729_46f6_b927_ecd72af8af02.slice/crio-99a535d42a940d1bb4afbdd26cb8886234d2ee42a15bfa6e1f8a028b873dd568 WatchSource:0}: Error finding container 99a535d42a940d1bb4afbdd26cb8886234d2ee42a15bfa6e1f8a028b873dd568: Status 404 returned error can't find the container with id 99a535d42a940d1bb4afbdd26cb8886234d2ee42a15bfa6e1f8a028b873dd568 Jul 02 19:50:53.347516 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:53.290822 2560 kuberuntime_manager.go:1459] "Unhandled Error" err="container dns-node-resolver start failed in pod node-resolver-8wwq6_openshift-dns(e8c0c3b5-e729-46f6-b927-ecd72af8af02): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 02 19:50:53.347516 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:53.290851 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-dns/node-resolver-8wwq6" podUID="e8c0c3b5-e729-46f6-b927-ecd72af8af02" Jul 02 19:50:53.662233 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.539319 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret\") pod \"global-pull-secret-syncer-94lwh\" (UID: \"271b6a48-768b-4a1f-b7d2-3e9c120a2f55\") " pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:50:53.662233 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.539361 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs\") pod \"network-metrics-daemon-2vmw6\" (UID: \"fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab\") " pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:50:53.662233 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:53.539445 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:50:53.662233 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:53.539446 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:50:53.662233 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:53.539492 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs podName:fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab nodeName:}" failed. No retries permitted until 2026-07-02 19:50:54.539478514 +0000 UTC m=+3.109082562 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs") pod "network-metrics-daemon-2vmw6" (UID: "fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:50:53.662233 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:53.539505 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret podName:271b6a48-768b-4a1f-b7d2-3e9c120a2f55 nodeName:}" failed. No retries permitted until 2026-07-02 19:50:54.539498728 +0000 UTC m=+3.109102776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret") pod "global-pull-secret-syncer-94lwh" (UID: "271b6a48-768b-4a1f-b7d2-3e9c120a2f55") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:50:53.662233 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.640481 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpbnp\" (UniqueName: \"kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp\") pod \"network-check-target-rm2bw\" (UID: \"20f53232-067d-4d46-a0ea-720e1e961f4b\") " pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:50:53.662233 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:53.640697 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:50:53.662233 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:53.640717 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:50:53.662233 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:53.640729 2560 projected.go:196] Error preparing data for projected volume kube-api-access-kpbnp for pod openshift-network-diagnostics/network-check-target-rm2bw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:50:53.662233 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:53.640785 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp podName:20f53232-067d-4d46-a0ea-720e1e961f4b nodeName:}" failed. No retries permitted until 2026-07-02 19:50:54.640768919 +0000 UTC m=+3.210372987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpbnp" (UniqueName: "kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp") pod "network-check-target-rm2bw" (UID: "20f53232-067d-4d46-a0ea-720e1e961f4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:50:53.891522 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.883635 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 19:45:52 +0000 UTC" deadline="2028-03-04 04:08:29.11930885 +0000 UTC" Jul 02 19:50:53.891522 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.883700 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14648h17m35.235613024s" Jul 02 19:50:53.969564 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.930341 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:50:53.969564 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:53.930459 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vmw6" podUID="fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab" Jul 02 19:50:53.969564 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.943667 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-196.ec2.internal" event={"ID":"06a5819e677929f2d6af4dd60c5f15f3","Type":"ContainerStarted","Data":"62dad13518dae34903b8c6e35b48a40bf20ece7f9a1c3984acac116290e4be24"} Jul 02 19:50:53.969564 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.950070 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fqc55" event={"ID":"3a5a25f3-df5e-4f11-9697-3d27824d62e2","Type":"ContainerStarted","Data":"419907b3d878f27bce411e8f770cfe58ce1e0f4933b915ceb5e5ff09408c31d5"} Jul 02 19:50:53.969564 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.952352 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzt7w" event={"ID":"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8","Type":"ContainerStarted","Data":"0300e5d175edeb4944048ecb9d6c7223b2ea356f884babad97b34b5a217fa99e"} Jul 02 19:50:53.969564 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.967541 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9cdpm" event={"ID":"ad299c1f-ba3d-4088-bd88-84536a843b3d","Type":"ContainerStarted","Data":"b169fb9b196d825e1eb04f4f1463143f05d713117354ea668e0a9cbbe58655b6"} Jul 02 19:50:53.976323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.972870 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-196.ec2.internal" event={"ID":"eb88cfb9bd7b5f4fc805a9e795cccc20","Type":"ContainerStarted","Data":"515a5f2f99b6ef256deaaa8286c54f6c1d69834925d76fea236ef07e5a62b27c"} Jul 02 19:50:53.985127 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.984825 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8wwq6" event={"ID":"e8c0c3b5-e729-46f6-b927-ecd72af8af02","Type":"ContainerStarted","Data":"99a535d42a940d1bb4afbdd26cb8886234d2ee42a15bfa6e1f8a028b873dd568"} Jul 02 19:50:53.993607 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:53.986712 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:28389dd118629aa9d7c2525202f3ad6359afb98b6a3bf7672cb1ecfae2418e23\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-dns/node-resolver-8wwq6" podUID="e8c0c3b5-e729-46f6-b927-ecd72af8af02" Jul 02 19:50:53.993607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.989241 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" event={"ID":"086783f9-069b-45d2-ad74-a0195631cfe2","Type":"ContainerStarted","Data":"6d31c9d26fdb0c443c6029f399e1002e7a8ad594a6f51b62b61f74fcc7872329"} Jul 02 19:50:54.003746 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:53.999071 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" event={"ID":"72996a08-b83d-4d1b-99c6-780e15c6722a","Type":"ContainerStarted","Data":"96711a5ba62470335c7069ac92fbec27e117f33b9ccf62621be7ed9891c51fea"} Jul 02 19:50:54.014527 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:54.005143 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" event={"ID":"ab35148e-bbd4-42ef-af7e-69a39287eac1","Type":"ContainerStarted","Data":"52c1ff3e9e4eb63f280ae0e702afdbd09c2735f1df563708e6a5dda4717e9ab0"} Jul 02 19:50:54.014527 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:54.010108 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xztw7" event={"ID":"c284b6aa-c1c4-4c3e-941f-ce7fbb7f8b67","Type":"ContainerStarted","Data":"20a4265acaceecfb99e8ef594e70487a00ad254e89c4bea5849f23239f89451e"} Jul 02 19:50:54.023695 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:54.022102 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dfxtn" event={"ID":"d454a862-97f9-4763-960f-cd1aaf123df4","Type":"ContainerStarted","Data":"c015705fb8739a114a44ff1c7883b45fb5ca4f67e3828afe758291961f126f9e"} Jul 02 19:50:54.089112 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:54.031751 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:50:54.547757 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:54.547062 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs\") pod \"network-metrics-daemon-2vmw6\" (UID: \"fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab\") " pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:50:54.547757 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:54.547131 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret\") pod \"global-pull-secret-syncer-94lwh\" (UID: \"271b6a48-768b-4a1f-b7d2-3e9c120a2f55\") " pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:50:54.547757 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:54.547267 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:50:54.547757 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:54.547336 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret podName:271b6a48-768b-4a1f-b7d2-3e9c120a2f55 nodeName:}" failed. No retries permitted until 2026-07-02 19:50:56.547317932 +0000 UTC m=+5.116921986 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret") pod "global-pull-secret-syncer-94lwh" (UID: "271b6a48-768b-4a1f-b7d2-3e9c120a2f55") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:50:54.547757 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:54.547401 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:50:54.547757 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:54.547430 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs podName:fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab nodeName:}" failed. No retries permitted until 2026-07-02 19:50:56.547419844 +0000 UTC m=+5.117023895 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs") pod "network-metrics-daemon-2vmw6" (UID: "fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:50:54.548769 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:54.548543 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:50:54.647541 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:54.647488 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpbnp\" (UniqueName: \"kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp\") pod \"network-check-target-rm2bw\" (UID: \"20f53232-067d-4d46-a0ea-720e1e961f4b\") " pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:50:54.647716 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:54.647698 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:50:54.647789 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:54.647722 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:50:54.647846 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:54.647800 2560 projected.go:196] Error preparing data for projected volume kube-api-access-kpbnp for pod openshift-network-diagnostics/network-check-target-rm2bw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:50:54.647893 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:54.647862 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp podName:20f53232-067d-4d46-a0ea-720e1e961f4b nodeName:}" failed. No retries permitted until 2026-07-02 19:50:56.647843767 +0000 UTC m=+5.217447821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpbnp" (UniqueName: "kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp") pod "network-check-target-rm2bw" (UID: "20f53232-067d-4d46-a0ea-720e1e961f4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:50:54.884901 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:54.884420 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 19:45:52 +0000 UTC" deadline="2028-04-16 08:41:02.404394054 +0000 UTC" Jul 02 19:50:54.884901 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:54.884452 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15684h50m7.51994513s" Jul 02 19:50:54.928092 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:54.928056 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:50:54.928242 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:54.928168 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rm2bw" podUID="20f53232-067d-4d46-a0ea-720e1e961f4b" Jul 02 19:50:54.928693 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:54.928560 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:50:54.928693 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:54.928661 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-94lwh" podUID="271b6a48-768b-4a1f-b7d2-3e9c120a2f55" Jul 02 19:50:55.071134 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:55.071106 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:50:55.930985 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:55.929656 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:50:55.930985 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:55.929798 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vmw6" podUID="fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab" Jul 02 19:50:56.565751 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:56.565718 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs\") pod \"network-metrics-daemon-2vmw6\" (UID: \"fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab\") " pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:50:56.566125 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:56.565768 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret\") pod \"global-pull-secret-syncer-94lwh\" (UID: \"271b6a48-768b-4a1f-b7d2-3e9c120a2f55\") " pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:50:56.566125 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:56.565857 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:50:56.566125 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:56.565858 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:50:56.566125 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:56.565903 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret podName:271b6a48-768b-4a1f-b7d2-3e9c120a2f55 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:00.565889556 +0000 UTC m=+9.135493609 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret") pod "global-pull-secret-syncer-94lwh" (UID: "271b6a48-768b-4a1f-b7d2-3e9c120a2f55") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:50:56.566125 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:56.565915 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs podName:fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab nodeName:}" failed. No retries permitted until 2026-07-02 19:51:00.565909149 +0000 UTC m=+9.135513198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs") pod "network-metrics-daemon-2vmw6" (UID: "fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:50:56.666239 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:56.666203 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpbnp\" (UniqueName: \"kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp\") pod \"network-check-target-rm2bw\" (UID: \"20f53232-067d-4d46-a0ea-720e1e961f4b\") " pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:50:56.666422 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:56.666392 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:50:56.666422 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:56.666413 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:50:56.666527 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:56.666425 2560 projected.go:196] Error preparing data for projected volume kube-api-access-kpbnp for pod openshift-network-diagnostics/network-check-target-rm2bw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:50:56.666527 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:56.666475 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp podName:20f53232-067d-4d46-a0ea-720e1e961f4b nodeName:}" failed. No retries permitted until 2026-07-02 19:51:00.666459122 +0000 UTC m=+9.236063183 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpbnp" (UniqueName: "kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp") pod "network-check-target-rm2bw" (UID: "20f53232-067d-4d46-a0ea-720e1e961f4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:50:56.928039 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:56.928007 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:50:56.928287 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:56.928138 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rm2bw" podUID="20f53232-067d-4d46-a0ea-720e1e961f4b" Jul 02 19:50:56.928287 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:56.928189 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:50:56.928429 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:56.928321 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-94lwh" podUID="271b6a48-768b-4a1f-b7d2-3e9c120a2f55" Jul 02 19:50:57.928651 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:57.928619 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:50:57.929148 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:57.928759 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vmw6" podUID="fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab" Jul 02 19:50:58.927807 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:58.927778 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:50:58.927807 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:58.927807 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:50:58.928040 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:58.927893 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rm2bw" podUID="20f53232-067d-4d46-a0ea-720e1e961f4b" Jul 02 19:50:58.928040 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:58.927975 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-94lwh" podUID="271b6a48-768b-4a1f-b7d2-3e9c120a2f55" Jul 02 19:50:59.928233 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:50:59.928205 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:50:59.928693 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:50:59.928370 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vmw6" podUID="fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab" Jul 02 19:51:00.596229 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:00.596004 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs\") pod \"network-metrics-daemon-2vmw6\" (UID: \"fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab\") " pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:51:00.596430 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:00.596168 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:51:00.596430 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:00.596301 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret\") pod \"global-pull-secret-syncer-94lwh\" (UID: \"271b6a48-768b-4a1f-b7d2-3e9c120a2f55\") " pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:51:00.596430 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:00.596364 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs podName:fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab nodeName:}" failed. No retries permitted until 2026-07-02 19:51:08.596341256 +0000 UTC m=+17.165945322 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs") pod "network-metrics-daemon-2vmw6" (UID: "fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:51:00.596430 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:00.596420 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:51:00.596639 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:00.596470 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret podName:271b6a48-768b-4a1f-b7d2-3e9c120a2f55 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:08.5964546 +0000 UTC m=+17.166058652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret") pod "global-pull-secret-syncer-94lwh" (UID: "271b6a48-768b-4a1f-b7d2-3e9c120a2f55") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:51:00.697199 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:00.697164 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpbnp\" (UniqueName: \"kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp\") pod \"network-check-target-rm2bw\" (UID: \"20f53232-067d-4d46-a0ea-720e1e961f4b\") " pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:51:00.697388 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:00.697321 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:51:00.697388 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:00.697342 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:51:00.697388 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:00.697354 2560 projected.go:196] Error preparing data for projected volume kube-api-access-kpbnp for pod openshift-network-diagnostics/network-check-target-rm2bw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:51:00.697520 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:00.697413 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp podName:20f53232-067d-4d46-a0ea-720e1e961f4b nodeName:}" failed. No retries permitted until 2026-07-02 19:51:08.697395698 +0000 UTC m=+17.266999752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpbnp" (UniqueName: "kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp") pod "network-check-target-rm2bw" (UID: "20f53232-067d-4d46-a0ea-720e1e961f4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:51:00.928212 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:00.928111 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:51:00.928212 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:00.928154 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:51:00.928667 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:00.928234 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rm2bw" podUID="20f53232-067d-4d46-a0ea-720e1e961f4b" Jul 02 19:51:00.928667 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:00.928391 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-94lwh" podUID="271b6a48-768b-4a1f-b7d2-3e9c120a2f55" Jul 02 19:51:01.929083 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:01.929051 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:51:01.929479 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:01.929188 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vmw6" podUID="fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab" Jul 02 19:51:02.927636 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:02.927606 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:51:02.927801 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:02.927606 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:51:02.927801 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:02.927702 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rm2bw" podUID="20f53232-067d-4d46-a0ea-720e1e961f4b" Jul 02 19:51:02.927801 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:02.927775 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-94lwh" podUID="271b6a48-768b-4a1f-b7d2-3e9c120a2f55" Jul 02 19:51:03.928100 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:03.928069 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:51:03.928513 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:03.928209 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vmw6" podUID="fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab" Jul 02 19:51:04.928181 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:04.928145 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:51:04.928597 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:04.928145 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:51:04.928597 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:04.928268 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rm2bw" podUID="20f53232-067d-4d46-a0ea-720e1e961f4b" Jul 02 19:51:04.928597 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:04.928356 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-94lwh" podUID="271b6a48-768b-4a1f-b7d2-3e9c120a2f55" Jul 02 19:51:05.928030 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:05.928004 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:51:05.928311 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:05.928243 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vmw6" podUID="fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab" Jul 02 19:51:06.928018 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:06.927989 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:51:06.928164 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:06.928096 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-94lwh" podUID="271b6a48-768b-4a1f-b7d2-3e9c120a2f55" Jul 02 19:51:06.928164 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:06.928153 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:51:06.928288 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:06.928263 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rm2bw" podUID="20f53232-067d-4d46-a0ea-720e1e961f4b" Jul 02 19:51:07.928318 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:07.928285 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:51:07.928689 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:07.928433 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vmw6" podUID="fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab" Jul 02 19:51:08.659235 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:08.659204 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret\") pod \"global-pull-secret-syncer-94lwh\" (UID: \"271b6a48-768b-4a1f-b7d2-3e9c120a2f55\") " pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:51:08.659454 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:08.659273 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs\") pod \"network-metrics-daemon-2vmw6\" (UID: \"fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab\") " pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:51:08.659817 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:08.659798 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:51:08.659897 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:08.659870 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs podName:fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab nodeName:}" failed. No retries permitted until 2026-07-02 19:51:24.659850551 +0000 UTC m=+33.229454611 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs") pod "network-metrics-daemon-2vmw6" (UID: "fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:51:08.659955 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:08.659800 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:51:08.660006 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:08.659960 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret podName:271b6a48-768b-4a1f-b7d2-3e9c120a2f55 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:24.65994556 +0000 UTC m=+33.229549617 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret") pod "global-pull-secret-syncer-94lwh" (UID: "271b6a48-768b-4a1f-b7d2-3e9c120a2f55") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:51:08.760305 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:08.760277 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpbnp\" (UniqueName: \"kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp\") pod \"network-check-target-rm2bw\" (UID: \"20f53232-067d-4d46-a0ea-720e1e961f4b\") " pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:51:08.760454 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:08.760415 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:51:08.760454 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:08.760433 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:51:08.760454 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:08.760443 2560 projected.go:196] Error preparing data for projected volume kube-api-access-kpbnp for pod openshift-network-diagnostics/network-check-target-rm2bw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:51:08.760566 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:08.760486 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp podName:20f53232-067d-4d46-a0ea-720e1e961f4b nodeName:}" failed. No retries permitted until 2026-07-02 19:51:24.760473803 +0000 UTC m=+33.330077854 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpbnp" (UniqueName: "kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp") pod "network-check-target-rm2bw" (UID: "20f53232-067d-4d46-a0ea-720e1e961f4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:51:08.928369 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:08.928285 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:51:08.928369 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:08.928307 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:51:08.928780 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:08.928411 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rm2bw" podUID="20f53232-067d-4d46-a0ea-720e1e961f4b" Jul 02 19:51:08.928780 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:08.928534 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-94lwh" podUID="271b6a48-768b-4a1f-b7d2-3e9c120a2f55" Jul 02 19:51:09.928085 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:09.928048 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:51:09.928273 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:09.928181 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vmw6" podUID="fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab" Jul 02 19:51:10.928221 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:10.928191 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:51:10.928644 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:10.928192 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:51:10.928644 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:10.928330 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rm2bw" podUID="20f53232-067d-4d46-a0ea-720e1e961f4b" Jul 02 19:51:10.928644 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:10.928387 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-94lwh" podUID="271b6a48-768b-4a1f-b7d2-3e9c120a2f55" Jul 02 19:51:11.929075 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:11.929041 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:51:11.929441 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:11.929168 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vmw6" podUID="fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab" Jul 02 19:51:12.928648 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:12.928488 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:51:12.928728 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:12.928529 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:51:12.928770 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:12.928731 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rm2bw" podUID="20f53232-067d-4d46-a0ea-720e1e961f4b" Jul 02 19:51:12.928822 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:12.928799 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-94lwh" podUID="271b6a48-768b-4a1f-b7d2-3e9c120a2f55" Jul 02 19:51:13.069070 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:13.068996 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" event={"ID":"086783f9-069b-45d2-ad74-a0195631cfe2","Type":"ContainerStarted","Data":"e42836184ffa13f07f493c401e02ca0b7070a65c35a3413318c8160a28ca9c20"} Jul 02 19:51:13.071974 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:13.071956 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tkp7w_72996a08-b83d-4d1b-99c6-780e15c6722a/ovn-acl-logging/0.log" Jul 02 19:51:13.072310 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:13.072290 2560 generic.go:356] "Generic (PLEG): container finished" podID="72996a08-b83d-4d1b-99c6-780e15c6722a" containerID="51e6314ba8ab714b0ab3ce2737ea5e1fbb47dc3fed37130f9369240e360a1ca5" exitCode=1 Jul 02 19:51:13.072386 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:13.072365 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" event={"ID":"72996a08-b83d-4d1b-99c6-780e15c6722a","Type":"ContainerStarted","Data":"ea4c87a6671a4b0d669c9ae8de6dacb2ab71f3314f10e0abf53af192906a62cb"} Jul 02 19:51:13.072459 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:13.072444 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" event={"ID":"72996a08-b83d-4d1b-99c6-780e15c6722a","Type":"ContainerStarted","Data":"b6d81c254dc5907138b568abe6bea7ed08e135d3d39644b300a80e6e654bd04b"} Jul 02 19:51:13.072511 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:13.072498 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" event={"ID":"72996a08-b83d-4d1b-99c6-780e15c6722a","Type":"ContainerStarted","Data":"abac75c1a79bf7b6a5b35faec263d5a0e3eb20622cfc43271ec3b803383fde74"} Jul 02 19:51:13.072562 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:13.072550 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" event={"ID":"72996a08-b83d-4d1b-99c6-780e15c6722a","Type":"ContainerStarted","Data":"4ca43cf95e24b38ac28202b4ae2403a41370003d0126fb273f9468872c724a05"} Jul 02 19:51:13.072616 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:13.072604 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" event={"ID":"72996a08-b83d-4d1b-99c6-780e15c6722a","Type":"ContainerDied","Data":"51e6314ba8ab714b0ab3ce2737ea5e1fbb47dc3fed37130f9369240e360a1ca5"} Jul 02 19:51:13.072686 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:13.072657 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" event={"ID":"72996a08-b83d-4d1b-99c6-780e15c6722a","Type":"ContainerStarted","Data":"f0c0e5d9f9ba6c52ae1a01de98ab7c58358efe1b6867a9e5050046fffb867d66"} Jul 02 19:51:13.073838 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:13.073818 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-196.ec2.internal" event={"ID":"06a5819e677929f2d6af4dd60c5f15f3","Type":"ContainerStarted","Data":"ed9d17b813204c3082e2b8613a9d05ad44dac05f4e62bb3b71a4991d66523140"} Jul 02 19:51:13.075162 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:13.075140 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9cdpm" event={"ID":"ad299c1f-ba3d-4088-bd88-84536a843b3d","Type":"ContainerStarted","Data":"c6ca475ed62b2c550f662ea289073419bc603af313d79415ea4bb56bfa2f0350"} Jul 02 19:51:13.104168 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:13.104130 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dpgbk" podStartSLOduration=2.116049601 podStartE2EDuration="21.104118949s" totalImagesPullingTime="18.988069348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:13.089861057 +0000 UTC m=+21.659465155" watchObservedRunningTime="2026-07-02 19:51:13.104118949 +0000 UTC m=+21.673723018" Jul 02 19:51:13.104331 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:13.104310 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-196.ec2.internal" podStartSLOduration=21.104289795 podStartE2EDuration="21.104289795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:13.103852944 +0000 UTC m=+21.673457008" watchObservedRunningTime="2026-07-02 19:51:13.104289795 +0000 UTC m=+21.673893865" Jul 02 19:51:13.927723 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:13.927570 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:51:13.927852 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:13.927797 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vmw6" podUID="fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab" Jul 02 19:51:14.077739 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:14.077667 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8wwq6" event={"ID":"e8c0c3b5-e729-46f6-b927-ecd72af8af02","Type":"ContainerStarted","Data":"d7111ebdea4fe17f7a0a37d9e63fda14fff5f634733d5977b3aa773c0d12568e"} Jul 02 19:51:14.078978 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:14.078954 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" event={"ID":"ab35148e-bbd4-42ef-af7e-69a39287eac1","Type":"ContainerStarted","Data":"628deed654613085516ade2f909930d5b05cb687df4872955aa702de815778c4"} Jul 02 19:51:14.080180 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:14.080157 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xztw7" event={"ID":"c284b6aa-c1c4-4c3e-941f-ce7fbb7f8b67","Type":"ContainerStarted","Data":"372e61a89c953df40232b14c210ec828f27f2e8ee77217cb48514b10e0ea49d9"} Jul 02 19:51:14.081561 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:14.081535 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dfxtn" event={"ID":"d454a862-97f9-4763-960f-cd1aaf123df4","Type":"ContainerStarted","Data":"3e9659c9864bb5c59404424ce3fb0e6e25af85371c35f8de8da19051087d884a"} Jul 02 19:51:14.082832 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:14.082812 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fqc55" event={"ID":"3a5a25f3-df5e-4f11-9697-3d27824d62e2","Type":"ContainerStarted","Data":"07e1bfa12675f2c66c5341762cd2080a22f778a191df002f615214cd30d21b92"} Jul 02 19:51:14.084139 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:14.084120 2560 generic.go:356] "Generic (PLEG): container finished" podID="0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8" containerID="dfced842018fa8a1ac41b6f93641babd4e441a53dea08812ad8d8e4e89989fc8" exitCode=0 Jul 02 19:51:14.084212 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:14.084180 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzt7w" event={"ID":"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8","Type":"ContainerDied","Data":"dfced842018fa8a1ac41b6f93641babd4e441a53dea08812ad8d8e4e89989fc8"} Jul 02 19:51:14.085512 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:14.085446 2560 generic.go:356] "Generic (PLEG): container finished" podID="eb88cfb9bd7b5f4fc805a9e795cccc20" containerID="27b10f71832590a094467c0b93f3c78076812a80c4650879901ee1d27847227a" exitCode=0 Jul 02 19:51:14.085512 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:14.085508 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-196.ec2.internal" event={"ID":"eb88cfb9bd7b5f4fc805a9e795cccc20","Type":"ContainerDied","Data":"27b10f71832590a094467c0b93f3c78076812a80c4650879901ee1d27847227a"} Jul 02 19:51:14.096746 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:14.096714 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9cdpm" podStartSLOduration=2.955683194 podStartE2EDuration="22.096703317s" totalImagesPullingTime="19.141020123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:13.121881017 +0000 UTC m=+21.691485111" watchObservedRunningTime="2026-07-02 19:51:14.096703317 +0000 UTC m=+22.666307388" Jul 02 19:51:14.097197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:14.097178 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8wwq6" podStartSLOduration=22.097171924 podStartE2EDuration="22.097171924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-02 19:51:14.096757332 +0000 UTC m=+22.666361415" watchObservedRunningTime="2026-07-02 19:51:14.097171924 +0000 UTC m=+22.666775993" Jul 02 19:51:14.112147 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:14.112111 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dfxtn" podStartSLOduration=3.01731285 podStartE2EDuration="22.112100237s" totalImagesPullingTime="19.094787387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:14.112052933 +0000 UTC m=+22.681657004" watchObservedRunningTime="2026-07-02 19:51:14.112100237 +0000 UTC m=+22.681704307" Jul 02 19:51:14.167419 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:14.167377 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fqc55" podStartSLOduration=3.123730151 podStartE2EDuration="22.167364017s" totalImagesPullingTime="19.043633866s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:14.166909373 +0000 UTC m=+22.736513444" watchObservedRunningTime="2026-07-02 19:51:14.167364017 +0000 UTC m=+22.736968087" Jul 02 19:51:14.184017 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:14.183987 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xztw7" podStartSLOduration=3.165343743 podStartE2EDuration="22.183976355s" totalImagesPullingTime="19.018632612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:14.183173298 +0000 UTC m=+22.752777369" watchObservedRunningTime="2026-07-02 19:51:14.183976355 +0000 UTC m=+22.753580425" Jul 02 19:51:14.928335 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:14.928303 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:51:14.928623 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:14.928314 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:51:14.928623 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:14.928407 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-94lwh" podUID="271b6a48-768b-4a1f-b7d2-3e9c120a2f55" Jul 02 19:51:14.928623 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:14.928460 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rm2bw" podUID="20f53232-067d-4d46-a0ea-720e1e961f4b" Jul 02 19:51:15.093270 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:15.093210 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-196.ec2.internal" event={"ID":"eb88cfb9bd7b5f4fc805a9e795cccc20","Type":"ContainerStarted","Data":"61adeb799b688932734a8d2db64a3ab154add98c9ebc595b88e394bac0d1f1ce"} Jul 02 19:51:15.116572 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:15.116535 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-196.ec2.internal" podStartSLOduration=23.116521451 podStartE2EDuration="23.116521451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:15.116131273 +0000 UTC m=+23.685735342" watchObservedRunningTime="2026-07-02 19:51:15.116521451 +0000 UTC m=+23.686125520" Jul 02 19:51:15.147496 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:15.147468 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 19:51:15.932062 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:15.931875 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:51:15.932467 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:15.932189 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vmw6" podUID="fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab" Jul 02 19:51:15.942910 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:15.942820 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T19:51:15.147489446Z","UUID":"4fcd5251-27c4-463a-8d7b-260ce1182cdd","Handler":null,"Name":"","Endpoint":""} Jul 02 19:51:15.944397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:15.944376 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 19:51:15.944496 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:15.944419 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 19:51:16.099418 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:16.099392 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tkp7w_72996a08-b83d-4d1b-99c6-780e15c6722a/ovn-acl-logging/0.log" Jul 02 19:51:16.099831 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:16.099785 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" event={"ID":"72996a08-b83d-4d1b-99c6-780e15c6722a","Type":"ContainerStarted","Data":"7bf98cf5f4556162ad70e092a7174a5bc4c9af25e059041dc4cfc166fca1df77"} Jul 02 19:51:16.101747 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:16.101720 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" event={"ID":"ab35148e-bbd4-42ef-af7e-69a39287eac1","Type":"ContainerStarted","Data":"080dd843a5862c688cb45a4cf20cae2fdec894014cd77b8c0f948fbbc0c96af8"} Jul 02 19:51:16.927775 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:16.927748 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:51:16.927929 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:16.927749 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:51:16.927929 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:16.927863 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rm2bw" podUID="20f53232-067d-4d46-a0ea-720e1e961f4b" Jul 02 19:51:16.927929 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:16.927904 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-94lwh" podUID="271b6a48-768b-4a1f-b7d2-3e9c120a2f55" Jul 02 19:51:17.105836 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:17.105803 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" event={"ID":"ab35148e-bbd4-42ef-af7e-69a39287eac1","Type":"ContainerStarted","Data":"48e49aa4fe09b96d271b657dc81a5292605b83fc83e1450dee615b94588f58d9"} Jul 02 19:51:17.126889 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:17.126850 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zq7d" podStartSLOduration=3.538023495 podStartE2EDuration="25.126838416s" totalImagesPullingTime="21.588814921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:17.126334534 +0000 UTC m=+25.695938603" watchObservedRunningTime="2026-07-02 19:51:17.126838416 +0000 UTC m=+25.696442486" Jul 02 19:51:17.750154 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:17.749963 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xztw7" Jul 02 19:51:17.750469 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:17.750453 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xztw7" Jul 02 19:51:17.928099 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:17.928070 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:51:17.928282 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:17.928193 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vmw6" podUID="fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab" Jul 02 19:51:18.111006 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:18.110943 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tkp7w_72996a08-b83d-4d1b-99c6-780e15c6722a/ovn-acl-logging/0.log" Jul 02 19:51:18.111615 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:18.111287 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" event={"ID":"72996a08-b83d-4d1b-99c6-780e15c6722a","Type":"ContainerStarted","Data":"fa27c3b5cc828d360a8b4507f42bb5a5784934d6467773ce59a2f3062f2c75b3"} Jul 02 19:51:18.111615 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:18.111574 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xztw7" Jul 02 19:51:18.111913 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:18.111897 2560 scope.go:117] "RemoveContainer" containerID="51e6314ba8ab714b0ab3ce2737ea5e1fbb47dc3fed37130f9369240e360a1ca5" Jul 02 19:51:18.111993 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:18.111967 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xztw7" Jul 02 19:51:18.928466 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:18.928432 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:51:18.928629 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:18.928441 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:51:18.928629 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:18.928598 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rm2bw" podUID="20f53232-067d-4d46-a0ea-720e1e961f4b" Jul 02 19:51:18.928781 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:18.928679 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-94lwh" podUID="271b6a48-768b-4a1f-b7d2-3e9c120a2f55" Jul 02 19:51:19.118616 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:19.118588 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tkp7w_72996a08-b83d-4d1b-99c6-780e15c6722a/ovn-acl-logging/0.log" Jul 02 19:51:19.119187 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:19.119169 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 02 19:51:19.119292 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:19.119267 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" event={"ID":"72996a08-b83d-4d1b-99c6-780e15c6722a","Type":"ContainerStarted","Data":"f76b68559080b48a12239b17d72b8215694c661b52fb9d62ad79c9c00ffa80a1"} Jul 02 19:51:19.119372 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:19.119358 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:51:19.119421 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:19.119414 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:51:19.134893 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:19.134871 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:51:19.135361 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:19.135345 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:51:19.147572 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:19.147533 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" podStartSLOduration=8.08729265 podStartE2EDuration="27.147519894s" totalImagesPullingTime="19.060227244s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:19.14698733 +0000 UTC m=+27.716591398" watchObservedRunningTime="2026-07-02 19:51:19.147519894 +0000 UTC m=+27.717123963" Jul 02 19:51:19.437739 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:19.437700 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-94lwh"] Jul 02 19:51:19.437920 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:19.437853 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:51:19.437975 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:19.437957 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-94lwh" podUID="271b6a48-768b-4a1f-b7d2-3e9c120a2f55" Jul 02 19:51:19.441788 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:19.441758 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2vmw6"] Jul 02 19:51:19.441917 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:19.441876 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:51:19.442006 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:19.441973 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vmw6" podUID="fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab" Jul 02 19:51:19.444861 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:19.444837 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rm2bw"] Jul 02 19:51:19.444946 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:19.444939 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:51:19.445050 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:19.445024 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rm2bw" podUID="20f53232-067d-4d46-a0ea-720e1e961f4b" Jul 02 19:51:20.120842 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:20.120812 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 02 19:51:20.927984 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:20.927967 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:51:20.928059 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:20.928048 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rm2bw" podUID="20f53232-067d-4d46-a0ea-720e1e961f4b" Jul 02 19:51:20.928107 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:20.928080 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:51:20.928166 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:20.928150 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-94lwh" podUID="271b6a48-768b-4a1f-b7d2-3e9c120a2f55" Jul 02 19:51:20.928208 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:20.928194 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:51:20.928340 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:20.928316 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vmw6" podUID="fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab" Jul 02 19:51:21.124696 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:21.124630 2560 generic.go:356] "Generic (PLEG): container finished" podID="0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8" containerID="06f7b016c90a2af218636b729f50f367ce7ac67790843c702ae8c917681205d6" exitCode=0 Jul 02 19:51:21.125013 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:21.124711 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzt7w" event={"ID":"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8","Type":"ContainerDied","Data":"06f7b016c90a2af218636b729f50f367ce7ac67790843c702ae8c917681205d6"} Jul 02 19:51:21.125013 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:21.124813 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 02 19:51:21.343944 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:21.343922 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:51:22.141501 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:22.141316 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" podUID="72996a08-b83d-4d1b-99c6-780e15c6722a" containerName="ovnkube-controller" probeResult="failure" output="" Jul 02 19:51:22.929208 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:22.929180 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:51:22.929348 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:22.929280 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rm2bw" podUID="20f53232-067d-4d46-a0ea-720e1e961f4b" Jul 02 19:51:22.929348 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:22.929308 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:51:22.929410 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:22.929395 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vmw6" podUID="fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab" Jul 02 19:51:22.929452 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:22.929439 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:51:22.929511 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:22.929495 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-94lwh" podUID="271b6a48-768b-4a1f-b7d2-3e9c120a2f55" Jul 02 19:51:23.130343 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:23.130314 2560 generic.go:356] "Generic (PLEG): container finished" podID="0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8" containerID="2cc34cfd7f0b3d50d83febfc477b2222b72feea5168cfa13c2d436468529307e" exitCode=0 Jul 02 19:51:23.130479 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:23.130372 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzt7w" event={"ID":"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8","Type":"ContainerDied","Data":"2cc34cfd7f0b3d50d83febfc477b2222b72feea5168cfa13c2d436468529307e"} Jul 02 19:51:24.682710 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:24.682687 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs\") pod \"network-metrics-daemon-2vmw6\" (UID: \"fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab\") " pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:51:24.683115 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:24.682735 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret\") pod \"global-pull-secret-syncer-94lwh\" (UID: \"271b6a48-768b-4a1f-b7d2-3e9c120a2f55\") " pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:51:24.683115 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:24.682834 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:51:24.683115 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:24.682870 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:51:24.683115 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:24.682891 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs podName:fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab nodeName:}" failed. No retries permitted until 2026-07-02 19:51:56.682873653 +0000 UTC m=+65.252477716 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs") pod "network-metrics-daemon-2vmw6" (UID: "fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:51:24.683115 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:24.682907 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret podName:271b6a48-768b-4a1f-b7d2-3e9c120a2f55 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:56.68289697 +0000 UTC m=+65.252501019 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret") pod "global-pull-secret-syncer-94lwh" (UID: "271b6a48-768b-4a1f-b7d2-3e9c120a2f55") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:51:24.783515 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:24.783496 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpbnp\" (UniqueName: \"kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp\") pod \"network-check-target-rm2bw\" (UID: \"20f53232-067d-4d46-a0ea-720e1e961f4b\") " pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:51:24.783629 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:24.783622 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:51:24.783675 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:24.783635 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:51:24.783675 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:24.783643 2560 projected.go:196] Error preparing data for projected volume kube-api-access-kpbnp for pod openshift-network-diagnostics/network-check-target-rm2bw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:51:24.783734 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:24.783686 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp podName:20f53232-067d-4d46-a0ea-720e1e961f4b nodeName:}" failed. No retries permitted until 2026-07-02 19:51:56.783671219 +0000 UTC m=+65.353275284 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpbnp" (UniqueName: "kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp") pod "network-check-target-rm2bw" (UID: "20f53232-067d-4d46-a0ea-720e1e961f4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:51:24.928462 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:24.928435 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:51:24.928582 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:24.928514 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:51:24.928582 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:24.928518 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rm2bw" podUID="20f53232-067d-4d46-a0ea-720e1e961f4b" Jul 02 19:51:24.928653 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:24.928598 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-94lwh" podUID="271b6a48-768b-4a1f-b7d2-3e9c120a2f55" Jul 02 19:51:24.928653 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:24.928620 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:51:24.928716 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:24.928672 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vmw6" podUID="fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab" Jul 02 19:51:25.137520 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.137489 2560 generic.go:356] "Generic (PLEG): container finished" podID="0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8" containerID="45202db338ee12b41fb66368a0767578bda29cd049657fd60a7d87cf8315b59b" exitCode=0 Jul 02 19:51:25.137641 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.137548 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzt7w" event={"ID":"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8","Type":"ContainerDied","Data":"45202db338ee12b41fb66368a0767578bda29cd049657fd60a7d87cf8315b59b"} Jul 02 19:51:25.193264 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.193231 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-196.ec2.internal" event="NodeReady" Jul 02 19:51:25.193372 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.193361 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 19:51:25.242845 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.242822 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c7fd89989-hcfn9"] Jul 02 19:51:25.249224 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.249091 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4ttbh"] Jul 02 19:51:25.249335 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.249189 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.254424 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.254404 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 19:51:25.254967 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.254950 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 19:51:25.255325 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.255310 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8j9nr"] Jul 02 19:51:25.255420 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.255408 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4ttbh" Jul 02 19:51:25.256042 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.256017 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qbvl2\"" Jul 02 19:51:25.258584 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.258569 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qnj77\"" Jul 02 19:51:25.258987 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.258971 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 02 19:51:25.259057 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.259042 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:51:25.259189 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.259165 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 02 19:51:25.260837 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.260821 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 19:51:25.261284 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.261265 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-t5vtb"] Jul 02 19:51:25.261368 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.261349 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8j9nr" Jul 02 19:51:25.261449 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.261428 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 19:51:25.264986 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.264958 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 02 19:51:25.265090 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.265048 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rkmn2\"" Jul 02 19:51:25.265179 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.265167 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:51:25.267410 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.267392 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-92lg6"] Jul 02 19:51:25.267506 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.267493 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" Jul 02 19:51:25.275702 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.275668 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 02 19:51:25.276078 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.276059 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-967fv\"" Jul 02 19:51:25.276319 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.276277 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:51:25.276390 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.276338 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 02 19:51:25.276441 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.276401 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 02 19:51:25.280772 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.280748 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-884f959fc-mnsl2"] Jul 02 19:51:25.280998 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.280972 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-92lg6" Jul 02 19:51:25.283596 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.283579 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 02 19:51:25.284310 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.284225 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:51:25.284504 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.284487 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-hvlxw\"" Jul 02 19:51:25.284571 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.284507 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 02 19:51:25.284620 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.284489 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 02 19:51:25.288461 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.288442 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 02 19:51:25.295597 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.295574 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-wg2jz"] Jul 02 19:51:25.295686 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.295671 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:25.299561 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.299541 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 19:51:25.301387 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.299522 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 02 19:51:25.301387 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.300277 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 02 19:51:25.301387 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.300292 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 02 19:51:25.301387 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.300553 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fgzwn\"" Jul 02 19:51:25.301387 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.300736 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 19:51:25.301387 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.300920 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 02 19:51:25.309620 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.309604 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mz68z"] Jul 02 19:51:25.309721 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.309707 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" Jul 02 19:51:25.312573 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.312556 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 02 19:51:25.312653 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.312583 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 19:51:25.312850 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.312830 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 19:51:25.312929 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.312902 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7lgdf\"" Jul 02 19:51:25.313169 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.313154 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 02 19:51:25.321706 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.321689 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw"] Jul 02 19:51:25.321792 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.321779 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mz68z" Jul 02 19:51:25.323108 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.323093 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 02 19:51:25.324526 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.324512 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:51:25.324581 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.324536 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 02 19:51:25.324671 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.324657 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 02 19:51:25.325024 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.325011 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fqxcq\"" Jul 02 19:51:25.325024 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.325018 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 02 19:51:25.335901 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.335887 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-92lg6"] Jul 02 19:51:25.335969 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.335911 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-mrqrw"] Jul 02 19:51:25.336020 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.336007 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw" Jul 02 19:51:25.339278 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.339263 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 02 19:51:25.339342 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.339264 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kc4n8\"" Jul 02 19:51:25.339581 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.339562 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 19:51:25.339658 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.339644 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 19:51:25.341495 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.341421 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 02 19:51:25.350054 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.350038 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sh2cz"] Jul 02 19:51:25.350158 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.350145 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mrqrw" Jul 02 19:51:25.353133 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.353117 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 19:51:25.353133 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.353124 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-c6n6x\"" Jul 02 19:51:25.353434 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.353420 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 19:51:25.364113 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.364097 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c7fd89989-hcfn9"] Jul 02 19:51:25.364188 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.364123 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-85wr2"] Jul 02 19:51:25.364221 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.364190 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sh2cz" Jul 02 19:51:25.366668 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.366653 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-67xbm\"" Jul 02 19:51:25.366732 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.366669 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 19:51:25.366880 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.366867 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 19:51:25.378417 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.378357 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-wg2jz"] Jul 02 19:51:25.378417 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.378380 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mz68z"] Jul 02 19:51:25.378417 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.378394 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-884f959fc-mnsl2"] Jul 02 19:51:25.378417 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.378405 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4ttbh"] Jul 02 19:51:25.378417 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.378420 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw"] Jul 02 19:51:25.378596 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.378462 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-85wr2" Jul 02 19:51:25.378596 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.378500 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-t5vtb"] Jul 02 19:51:25.378596 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.378512 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-mrqrw"] Jul 02 19:51:25.378596 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.378524 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-85wr2"] Jul 02 19:51:25.378596 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.378534 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sh2cz"] Jul 02 19:51:25.378596 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.378548 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8j9nr"] Jul 02 19:51:25.381194 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.381177 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 19:51:25.381497 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.381483 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wlfnm\"" Jul 02 19:51:25.381497 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.381496 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 19:51:25.381701 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.381687 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 19:51:25.389366 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389345 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7a6675d-7af2-4695-ba8a-f6b7985a5521-image-registry-private-configuration\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.389429 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389371 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-certificates\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.389429 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389400 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb5r5\" (UniqueName: \"kubernetes.io/projected/e44c6e9d-8f1b-4e65-9b90-d89047b66f9b-kube-api-access-hb5r5\") pod \"console-operator-68b757fb67-t5vtb\" (UID: \"e44c6e9d-8f1b-4e65-9b90-d89047b66f9b\") " pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" Jul 02 19:51:25.389533 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389426 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08935037-5736-4bbb-abb8-921a6b53ff92-service-ca-bundle\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:25.389533 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389464 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-metrics-certs\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:25.389533 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389484 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e44c6e9d-8f1b-4e65-9b90-d89047b66f9b-serving-cert\") pod \"console-operator-68b757fb67-t5vtb\" (UID: \"e44c6e9d-8f1b-4e65-9b90-d89047b66f9b\") " pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" Jul 02 19:51:25.389533 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389510 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e44c6e9d-8f1b-4e65-9b90-d89047b66f9b-config\") pod \"console-operator-68b757fb67-t5vtb\" (UID: \"e44c6e9d-8f1b-4e65-9b90-d89047b66f9b\") " pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" Jul 02 19:51:25.389533 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389531 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96jt4\" (UniqueName: \"kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-kube-api-access-96jt4\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.389664 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389546 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/108d2c60-1768-434b-81d8-893cdae03a7b-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-92lg6\" (UID: \"108d2c60-1768-434b-81d8-893cdae03a7b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-92lg6" Jul 02 19:51:25.389664 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389569 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/199784ce-eb7c-46c7-a787-697af804e988-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4ttbh\" (UID: \"199784ce-eb7c-46c7-a787-697af804e988\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4ttbh" Jul 02 19:51:25.389664 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389613 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdg8p\" (UniqueName: \"kubernetes.io/projected/08935037-5736-4bbb-abb8-921a6b53ff92-kube-api-access-jdg8p\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:25.389664 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389629 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwfgg\" (UniqueName: \"kubernetes.io/projected/199784ce-eb7c-46c7-a787-697af804e988-kube-api-access-lwfgg\") pod \"cluster-samples-operator-56fcf86bf-4ttbh\" (UID: \"199784ce-eb7c-46c7-a787-697af804e988\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4ttbh" Jul 02 19:51:25.389664 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389646 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7a6675d-7af2-4695-ba8a-f6b7985a5521-trusted-ca\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.389664 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389660 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7a6675d-7af2-4695-ba8a-f6b7985a5521-installation-pull-secrets\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.389817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389701 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e44c6e9d-8f1b-4e65-9b90-d89047b66f9b-trusted-ca\") pod \"console-operator-68b757fb67-t5vtb\" (UID: \"e44c6e9d-8f1b-4e65-9b90-d89047b66f9b\") " pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" Jul 02 19:51:25.389817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389723 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7a6675d-7af2-4695-ba8a-f6b7985a5521-ca-trust-extracted\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.389817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389741 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-bound-sa-token\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.389817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389757 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrf5b\" (UniqueName: \"kubernetes.io/projected/108d2c60-1768-434b-81d8-893cdae03a7b-kube-api-access-jrf5b\") pod \"kube-storage-version-migrator-operator-846bf668f7-92lg6\" (UID: \"108d2c60-1768-434b-81d8-893cdae03a7b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-92lg6" Jul 02 19:51:25.389817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389793 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-default-certificate\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:25.389817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389812 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.389971 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389834 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-stats-auth\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:25.389971 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389864 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/108d2c60-1768-434b-81d8-893cdae03a7b-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-92lg6\" (UID: \"108d2c60-1768-434b-81d8-893cdae03a7b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-92lg6" Jul 02 19:51:25.389971 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.389892 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5249\" (UniqueName: \"kubernetes.io/projected/2f03817d-9515-450a-b96c-9c862eb003d5-kube-api-access-m5249\") pod \"volume-data-source-validator-5d456fdbcd-8j9nr\" (UID: \"2f03817d-9515-450a-b96c-9c862eb003d5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8j9nr" Jul 02 19:51:25.490216 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.490192 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdg8p\" (UniqueName: \"kubernetes.io/projected/08935037-5736-4bbb-abb8-921a6b53ff92-kube-api-access-jdg8p\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:25.490343 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.490218 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7a6675d-7af2-4695-ba8a-f6b7985a5521-installation-pull-secrets\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.490343 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.490241 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfvp9\" (UniqueName: \"kubernetes.io/projected/e4417a85-8a7b-4eb3-bed3-b2aba3d9830a-kube-api-access-tfvp9\") pod \"service-ca-operator-5d46d9ffd4-mz68z\" (UID: \"e4417a85-8a7b-4eb3-bed3-b2aba3d9830a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mz68z" Jul 02 19:51:25.490343 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.490276 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-default-certificate\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:25.490343 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.490299 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/135c70c7-2e29-45cf-8364-d5ebf0614fdb-serving-cert\") pod \"insights-operator-5c847dcfc4-wg2jz\" (UID: \"135c70c7-2e29-45cf-8364-d5ebf0614fdb\") " pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" Jul 02 19:51:25.490343 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.490322 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d890bc7-0743-463a-99c8-9177ee249ef5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d9trw\" (UID: \"0d890bc7-0743-463a-99c8-9177ee249ef5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw" Jul 02 19:51:25.490588 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.490347 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-stats-auth\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:25.490588 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.490368 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/135c70c7-2e29-45cf-8364-d5ebf0614fdb-snapshots\") pod \"insights-operator-5c847dcfc4-wg2jz\" (UID: \"135c70c7-2e29-45cf-8364-d5ebf0614fdb\") " pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" Jul 02 19:51:25.490588 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.490398 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/49b572e5-56d7-4217-96f3-7a19dfd56cda-config-volume\") pod \"dns-default-sh2cz\" (UID: \"49b572e5-56d7-4217-96f3-7a19dfd56cda\") " pod="openshift-dns/dns-default-sh2cz" Jul 02 19:51:25.490588 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.490425 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7a6675d-7af2-4695-ba8a-f6b7985a5521-image-registry-private-configuration\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.490588 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.490447 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-certificates\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.490588 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.490496 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgw7r\" (UniqueName: \"kubernetes.io/projected/ecbab5b4-b257-455f-a7e4-d99e290400e6-kube-api-access-bgw7r\") pod \"network-check-source-989f8b8dc-mrqrw\" (UID: \"ecbab5b4-b257-455f-a7e4-d99e290400e6\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mrqrw" Jul 02 19:51:25.490818 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.490585 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0d890bc7-0743-463a-99c8-9177ee249ef5-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-d9trw\" (UID: \"0d890bc7-0743-463a-99c8-9177ee249ef5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw" Jul 02 19:51:25.490818 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.490675 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49b572e5-56d7-4217-96f3-7a19dfd56cda-tmp-dir\") pod \"dns-default-sh2cz\" (UID: \"49b572e5-56d7-4217-96f3-7a19dfd56cda\") " pod="openshift-dns/dns-default-sh2cz" Jul 02 19:51:25.490818 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.490734 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-metrics-certs\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:25.490818 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.490759 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e44c6e9d-8f1b-4e65-9b90-d89047b66f9b-config\") pod \"console-operator-68b757fb67-t5vtb\" (UID: \"e44c6e9d-8f1b-4e65-9b90-d89047b66f9b\") " pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" Jul 02 19:51:25.490818 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.490799 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96jt4\" (UniqueName: \"kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-kube-api-access-96jt4\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.491035 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.490824 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/108d2c60-1768-434b-81d8-893cdae03a7b-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-92lg6\" (UID: \"108d2c60-1768-434b-81d8-893cdae03a7b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-92lg6" Jul 02 19:51:25.491035 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.490849 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4417a85-8a7b-4eb3-bed3-b2aba3d9830a-config\") pod \"service-ca-operator-5d46d9ffd4-mz68z\" (UID: \"e4417a85-8a7b-4eb3-bed3-b2aba3d9830a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mz68z" Jul 02 19:51:25.491035 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.490896 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e44c6e9d-8f1b-4e65-9b90-d89047b66f9b-trusted-ca\") pod \"console-operator-68b757fb67-t5vtb\" (UID: \"e44c6e9d-8f1b-4e65-9b90-d89047b66f9b\") " pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" Jul 02 19:51:25.491035 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.490937 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7a6675d-7af2-4695-ba8a-f6b7985a5521-ca-trust-extracted\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.491035 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.490963 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29a0dda7-60a5-4f6b-bc15-4fb66164a986-cert\") pod \"ingress-canary-85wr2\" (UID: \"29a0dda7-60a5-4f6b-bc15-4fb66164a986\") " pod="openshift-ingress-canary/ingress-canary-85wr2" Jul 02 19:51:25.491035 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.491009 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7a6675d-7af2-4695-ba8a-f6b7985a5521-trusted-ca\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.491035 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.491035 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/135c70c7-2e29-45cf-8364-d5ebf0614fdb-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-wg2jz\" (UID: \"135c70c7-2e29-45cf-8364-d5ebf0614fdb\") " pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" Jul 02 19:51:25.491303 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.491056 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-certificates\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.491303 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.491059 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ktf4\" (UniqueName: \"kubernetes.io/projected/0d890bc7-0743-463a-99c8-9177ee249ef5-kube-api-access-7ktf4\") pod \"cluster-monitoring-operator-64786d9cbb-d9trw\" (UID: \"0d890bc7-0743-463a-99c8-9177ee249ef5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw" Jul 02 19:51:25.491303 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.491099 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/135c70c7-2e29-45cf-8364-d5ebf0614fdb-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-wg2jz\" (UID: \"135c70c7-2e29-45cf-8364-d5ebf0614fdb\") " pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" Jul 02 19:51:25.491303 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.491125 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-bound-sa-token\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.491303 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.491166 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc2b4\" (UniqueName: \"kubernetes.io/projected/49b572e5-56d7-4217-96f3-7a19dfd56cda-kube-api-access-jc2b4\") pod \"dns-default-sh2cz\" (UID: \"49b572e5-56d7-4217-96f3-7a19dfd56cda\") " pod="openshift-dns/dns-default-sh2cz" Jul 02 19:51:25.491303 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:25.491175 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:51:25.491303 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.491196 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.491303 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:25.491234 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-metrics-certs podName:08935037-5736-4bbb-abb8-921a6b53ff92 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:25.991216788 +0000 UTC m=+34.560820850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-metrics-certs") pod "router-default-884f959fc-mnsl2" (UID: "08935037-5736-4bbb-abb8-921a6b53ff92") : secret "router-metrics-certs-default" not found Jul 02 19:51:25.491303 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.491271 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49b572e5-56d7-4217-96f3-7a19dfd56cda-metrics-tls\") pod \"dns-default-sh2cz\" (UID: \"49b572e5-56d7-4217-96f3-7a19dfd56cda\") " pod="openshift-dns/dns-default-sh2cz" Jul 02 19:51:25.491649 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.491312 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/108d2c60-1768-434b-81d8-893cdae03a7b-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-92lg6\" (UID: \"108d2c60-1768-434b-81d8-893cdae03a7b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-92lg6" Jul 02 19:51:25.491649 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:25.491324 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:51:25.491649 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:25.491335 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c7fd89989-hcfn9: secret "image-registry-tls" not found Jul 02 19:51:25.491649 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.491348 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5249\" (UniqueName: \"kubernetes.io/projected/2f03817d-9515-450a-b96c-9c862eb003d5-kube-api-access-m5249\") pod \"volume-data-source-validator-5d456fdbcd-8j9nr\" (UID: \"2f03817d-9515-450a-b96c-9c862eb003d5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8j9nr" Jul 02 19:51:25.491649 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:25.491393 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls podName:e7a6675d-7af2-4695-ba8a-f6b7985a5521 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:25.991367127 +0000 UTC m=+34.560971182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls") pod "image-registry-7c7fd89989-hcfn9" (UID: "e7a6675d-7af2-4695-ba8a-f6b7985a5521") : secret "image-registry-tls" not found Jul 02 19:51:25.491649 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.491426 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd9k8\" (UniqueName: \"kubernetes.io/projected/135c70c7-2e29-45cf-8364-d5ebf0614fdb-kube-api-access-wd9k8\") pod \"insights-operator-5c847dcfc4-wg2jz\" (UID: \"135c70c7-2e29-45cf-8364-d5ebf0614fdb\") " pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" Jul 02 19:51:25.491649 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.491450 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkw59\" (UniqueName: \"kubernetes.io/projected/29a0dda7-60a5-4f6b-bc15-4fb66164a986-kube-api-access-jkw59\") pod \"ingress-canary-85wr2\" (UID: \"29a0dda7-60a5-4f6b-bc15-4fb66164a986\") " pod="openshift-ingress-canary/ingress-canary-85wr2" Jul 02 19:51:25.491649 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.491498 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb5r5\" (UniqueName: \"kubernetes.io/projected/e44c6e9d-8f1b-4e65-9b90-d89047b66f9b-kube-api-access-hb5r5\") pod \"console-operator-68b757fb67-t5vtb\" (UID: \"e44c6e9d-8f1b-4e65-9b90-d89047b66f9b\") " pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" Jul 02 19:51:25.491649 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.491527 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/135c70c7-2e29-45cf-8364-d5ebf0614fdb-tmp\") pod \"insights-operator-5c847dcfc4-wg2jz\" (UID: \"135c70c7-2e29-45cf-8364-d5ebf0614fdb\") " pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" Jul 02 19:51:25.491649 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.491577 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08935037-5736-4bbb-abb8-921a6b53ff92-service-ca-bundle\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:25.491649 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.491590 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e44c6e9d-8f1b-4e65-9b90-d89047b66f9b-config\") pod \"console-operator-68b757fb67-t5vtb\" (UID: \"e44c6e9d-8f1b-4e65-9b90-d89047b66f9b\") " pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" Jul 02 19:51:25.492145 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.491611 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e44c6e9d-8f1b-4e65-9b90-d89047b66f9b-serving-cert\") pod \"console-operator-68b757fb67-t5vtb\" (UID: \"e44c6e9d-8f1b-4e65-9b90-d89047b66f9b\") " pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" Jul 02 19:51:25.492145 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.491741 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrf5b\" (UniqueName: \"kubernetes.io/projected/108d2c60-1768-434b-81d8-893cdae03a7b-kube-api-access-jrf5b\") pod \"kube-storage-version-migrator-operator-846bf668f7-92lg6\" (UID: \"108d2c60-1768-434b-81d8-893cdae03a7b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-92lg6" Jul 02 19:51:25.492145 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.492051 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/108d2c60-1768-434b-81d8-893cdae03a7b-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-92lg6\" (UID: \"108d2c60-1768-434b-81d8-893cdae03a7b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-92lg6" Jul 02 19:51:25.492326 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:25.492217 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/08935037-5736-4bbb-abb8-921a6b53ff92-service-ca-bundle podName:08935037-5736-4bbb-abb8-921a6b53ff92 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:25.992201295 +0000 UTC m=+34.561805345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/08935037-5736-4bbb-abb8-921a6b53ff92-service-ca-bundle") pod "router-default-884f959fc-mnsl2" (UID: "08935037-5736-4bbb-abb8-921a6b53ff92") : configmap references non-existent config key: service-ca.crt Jul 02 19:51:25.492326 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.492264 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/199784ce-eb7c-46c7-a787-697af804e988-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4ttbh\" (UID: \"199784ce-eb7c-46c7-a787-697af804e988\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4ttbh" Jul 02 19:51:25.492326 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.492301 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwfgg\" (UniqueName: \"kubernetes.io/projected/199784ce-eb7c-46c7-a787-697af804e988-kube-api-access-lwfgg\") pod \"cluster-samples-operator-56fcf86bf-4ttbh\" (UID: \"199784ce-eb7c-46c7-a787-697af804e988\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4ttbh" Jul 02 19:51:25.492484 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.492326 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4417a85-8a7b-4eb3-bed3-b2aba3d9830a-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-mz68z\" (UID: \"e4417a85-8a7b-4eb3-bed3-b2aba3d9830a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mz68z" Jul 02 19:51:25.492484 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.492380 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e44c6e9d-8f1b-4e65-9b90-d89047b66f9b-trusted-ca\") pod \"console-operator-68b757fb67-t5vtb\" (UID: \"e44c6e9d-8f1b-4e65-9b90-d89047b66f9b\") " pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" Jul 02 19:51:25.492484 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:25.492440 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 19:51:25.492484 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:25.492476 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/199784ce-eb7c-46c7-a787-697af804e988-samples-operator-tls podName:199784ce-eb7c-46c7-a787-697af804e988 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:25.992464274 +0000 UTC m=+34.562068324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/199784ce-eb7c-46c7-a787-697af804e988-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-4ttbh" (UID: "199784ce-eb7c-46c7-a787-697af804e988") : secret "samples-operator-tls" not found Jul 02 19:51:25.492693 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.492672 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7a6675d-7af2-4695-ba8a-f6b7985a5521-trusted-ca\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.492743 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.492719 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7a6675d-7af2-4695-ba8a-f6b7985a5521-ca-trust-extracted\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.495039 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.495016 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/108d2c60-1768-434b-81d8-893cdae03a7b-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-92lg6\" (UID: \"108d2c60-1768-434b-81d8-893cdae03a7b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-92lg6" Jul 02 19:51:25.495192 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.495171 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e44c6e9d-8f1b-4e65-9b90-d89047b66f9b-serving-cert\") pod \"console-operator-68b757fb67-t5vtb\" (UID: \"e44c6e9d-8f1b-4e65-9b90-d89047b66f9b\") " pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" Jul 02 19:51:25.495304 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.495198 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-stats-auth\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:25.495304 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.495213 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7a6675d-7af2-4695-ba8a-f6b7985a5521-installation-pull-secrets\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.495304 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.495237 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-default-certificate\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:25.495407 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.495386 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7a6675d-7af2-4695-ba8a-f6b7985a5521-image-registry-private-configuration\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.498119 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.498100 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdg8p\" (UniqueName: \"kubernetes.io/projected/08935037-5736-4bbb-abb8-921a6b53ff92-kube-api-access-jdg8p\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:25.500618 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.500592 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5249\" (UniqueName: \"kubernetes.io/projected/2f03817d-9515-450a-b96c-9c862eb003d5-kube-api-access-m5249\") pod \"volume-data-source-validator-5d456fdbcd-8j9nr\" (UID: \"2f03817d-9515-450a-b96c-9c862eb003d5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8j9nr" Jul 02 19:51:25.501074 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.501052 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrf5b\" (UniqueName: \"kubernetes.io/projected/108d2c60-1768-434b-81d8-893cdae03a7b-kube-api-access-jrf5b\") pod \"kube-storage-version-migrator-operator-846bf668f7-92lg6\" (UID: \"108d2c60-1768-434b-81d8-893cdae03a7b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-92lg6" Jul 02 19:51:25.501367 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.501349 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwfgg\" (UniqueName: \"kubernetes.io/projected/199784ce-eb7c-46c7-a787-697af804e988-kube-api-access-lwfgg\") pod \"cluster-samples-operator-56fcf86bf-4ttbh\" (UID: \"199784ce-eb7c-46c7-a787-697af804e988\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4ttbh" Jul 02 19:51:25.501644 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.501624 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-bound-sa-token\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.501824 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.501808 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96jt4\" (UniqueName: \"kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-kube-api-access-96jt4\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:25.501867 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.501856 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb5r5\" (UniqueName: \"kubernetes.io/projected/e44c6e9d-8f1b-4e65-9b90-d89047b66f9b-kube-api-access-hb5r5\") pod \"console-operator-68b757fb67-t5vtb\" (UID: \"e44c6e9d-8f1b-4e65-9b90-d89047b66f9b\") " pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" Jul 02 19:51:25.572062 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.572040 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8j9nr" Jul 02 19:51:25.579213 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.579191 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" Jul 02 19:51:25.591332 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.591313 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-92lg6" Jul 02 19:51:25.593619 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.593605 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4417a85-8a7b-4eb3-bed3-b2aba3d9830a-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-mz68z\" (UID: \"e4417a85-8a7b-4eb3-bed3-b2aba3d9830a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mz68z" Jul 02 19:51:25.593675 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.593634 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfvp9\" (UniqueName: \"kubernetes.io/projected/e4417a85-8a7b-4eb3-bed3-b2aba3d9830a-kube-api-access-tfvp9\") pod \"service-ca-operator-5d46d9ffd4-mz68z\" (UID: \"e4417a85-8a7b-4eb3-bed3-b2aba3d9830a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mz68z" Jul 02 19:51:25.593675 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.593651 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/135c70c7-2e29-45cf-8364-d5ebf0614fdb-serving-cert\") pod \"insights-operator-5c847dcfc4-wg2jz\" (UID: \"135c70c7-2e29-45cf-8364-d5ebf0614fdb\") " pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" Jul 02 19:51:25.593675 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.593666 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d890bc7-0743-463a-99c8-9177ee249ef5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d9trw\" (UID: \"0d890bc7-0743-463a-99c8-9177ee249ef5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw" Jul 02 19:51:25.593793 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.593682 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/135c70c7-2e29-45cf-8364-d5ebf0614fdb-snapshots\") pod \"insights-operator-5c847dcfc4-wg2jz\" (UID: \"135c70c7-2e29-45cf-8364-d5ebf0614fdb\") " pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" Jul 02 19:51:25.593793 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.593706 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/49b572e5-56d7-4217-96f3-7a19dfd56cda-config-volume\") pod \"dns-default-sh2cz\" (UID: \"49b572e5-56d7-4217-96f3-7a19dfd56cda\") " pod="openshift-dns/dns-default-sh2cz" Jul 02 19:51:25.593793 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.593735 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgw7r\" (UniqueName: \"kubernetes.io/projected/ecbab5b4-b257-455f-a7e4-d99e290400e6-kube-api-access-bgw7r\") pod \"network-check-source-989f8b8dc-mrqrw\" (UID: \"ecbab5b4-b257-455f-a7e4-d99e290400e6\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mrqrw" Jul 02 19:51:25.593793 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.593760 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0d890bc7-0743-463a-99c8-9177ee249ef5-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-d9trw\" (UID: \"0d890bc7-0743-463a-99c8-9177ee249ef5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw" Jul 02 19:51:25.593793 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:25.593777 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:51:25.593793 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.593793 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49b572e5-56d7-4217-96f3-7a19dfd56cda-tmp-dir\") pod \"dns-default-sh2cz\" (UID: \"49b572e5-56d7-4217-96f3-7a19dfd56cda\") " pod="openshift-dns/dns-default-sh2cz" Jul 02 19:51:25.594021 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:25.593839 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d890bc7-0743-463a-99c8-9177ee249ef5-cluster-monitoring-operator-tls podName:0d890bc7-0743-463a-99c8-9177ee249ef5 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:26.093822413 +0000 UTC m=+34.663426462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d890bc7-0743-463a-99c8-9177ee249ef5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-d9trw" (UID: "0d890bc7-0743-463a-99c8-9177ee249ef5") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:51:25.594021 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.593856 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4417a85-8a7b-4eb3-bed3-b2aba3d9830a-config\") pod \"service-ca-operator-5d46d9ffd4-mz68z\" (UID: \"e4417a85-8a7b-4eb3-bed3-b2aba3d9830a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mz68z" Jul 02 19:51:25.594021 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.593882 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29a0dda7-60a5-4f6b-bc15-4fb66164a986-cert\") pod \"ingress-canary-85wr2\" (UID: \"29a0dda7-60a5-4f6b-bc15-4fb66164a986\") " pod="openshift-ingress-canary/ingress-canary-85wr2" Jul 02 19:51:25.594021 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.593914 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/135c70c7-2e29-45cf-8364-d5ebf0614fdb-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-wg2jz\" (UID: \"135c70c7-2e29-45cf-8364-d5ebf0614fdb\") " pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" Jul 02 19:51:25.594021 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.593936 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ktf4\" (UniqueName: \"kubernetes.io/projected/0d890bc7-0743-463a-99c8-9177ee249ef5-kube-api-access-7ktf4\") pod \"cluster-monitoring-operator-64786d9cbb-d9trw\" (UID: \"0d890bc7-0743-463a-99c8-9177ee249ef5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw" Jul 02 19:51:25.594021 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.593960 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/135c70c7-2e29-45cf-8364-d5ebf0614fdb-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-wg2jz\" (UID: \"135c70c7-2e29-45cf-8364-d5ebf0614fdb\") " pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" Jul 02 19:51:25.594021 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.593985 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc2b4\" (UniqueName: \"kubernetes.io/projected/49b572e5-56d7-4217-96f3-7a19dfd56cda-kube-api-access-jc2b4\") pod \"dns-default-sh2cz\" (UID: \"49b572e5-56d7-4217-96f3-7a19dfd56cda\") " pod="openshift-dns/dns-default-sh2cz" Jul 02 19:51:25.594339 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.594028 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49b572e5-56d7-4217-96f3-7a19dfd56cda-metrics-tls\") pod \"dns-default-sh2cz\" (UID: \"49b572e5-56d7-4217-96f3-7a19dfd56cda\") " pod="openshift-dns/dns-default-sh2cz" Jul 02 19:51:25.594339 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:25.594102 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:51:25.594339 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.594115 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49b572e5-56d7-4217-96f3-7a19dfd56cda-tmp-dir\") pod \"dns-default-sh2cz\" (UID: \"49b572e5-56d7-4217-96f3-7a19dfd56cda\") " pod="openshift-dns/dns-default-sh2cz" Jul 02 19:51:25.594339 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:25.594140 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49b572e5-56d7-4217-96f3-7a19dfd56cda-metrics-tls podName:49b572e5-56d7-4217-96f3-7a19dfd56cda nodeName:}" failed. No retries permitted until 2026-07-02 19:51:26.094126824 +0000 UTC m=+34.663730874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/49b572e5-56d7-4217-96f3-7a19dfd56cda-metrics-tls") pod "dns-default-sh2cz" (UID: "49b572e5-56d7-4217-96f3-7a19dfd56cda") : secret "dns-default-metrics-tls" not found Jul 02 19:51:25.594339 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.594292 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/135c70c7-2e29-45cf-8364-d5ebf0614fdb-snapshots\") pod \"insights-operator-5c847dcfc4-wg2jz\" (UID: \"135c70c7-2e29-45cf-8364-d5ebf0614fdb\") " pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" Jul 02 19:51:25.594567 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.594352 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/49b572e5-56d7-4217-96f3-7a19dfd56cda-config-volume\") pod \"dns-default-sh2cz\" (UID: \"49b572e5-56d7-4217-96f3-7a19dfd56cda\") " pod="openshift-dns/dns-default-sh2cz" Jul 02 19:51:25.594864 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.594839 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/135c70c7-2e29-45cf-8364-d5ebf0614fdb-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-wg2jz\" (UID: \"135c70c7-2e29-45cf-8364-d5ebf0614fdb\") " pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" Jul 02 19:51:25.594935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.594886 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4417a85-8a7b-4eb3-bed3-b2aba3d9830a-config\") pod \"service-ca-operator-5d46d9ffd4-mz68z\" (UID: \"e4417a85-8a7b-4eb3-bed3-b2aba3d9830a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mz68z" Jul 02 19:51:25.594935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.594897 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0d890bc7-0743-463a-99c8-9177ee249ef5-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-d9trw\" (UID: \"0d890bc7-0743-463a-99c8-9177ee249ef5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw" Jul 02 19:51:25.594935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.594910 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd9k8\" (UniqueName: \"kubernetes.io/projected/135c70c7-2e29-45cf-8364-d5ebf0614fdb-kube-api-access-wd9k8\") pod \"insights-operator-5c847dcfc4-wg2jz\" (UID: \"135c70c7-2e29-45cf-8364-d5ebf0614fdb\") " pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" Jul 02 19:51:25.595080 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.594940 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkw59\" (UniqueName: \"kubernetes.io/projected/29a0dda7-60a5-4f6b-bc15-4fb66164a986-kube-api-access-jkw59\") pod \"ingress-canary-85wr2\" (UID: \"29a0dda7-60a5-4f6b-bc15-4fb66164a986\") " pod="openshift-ingress-canary/ingress-canary-85wr2" Jul 02 19:51:25.595080 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.594950 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/135c70c7-2e29-45cf-8364-d5ebf0614fdb-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-wg2jz\" (UID: \"135c70c7-2e29-45cf-8364-d5ebf0614fdb\") " pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" Jul 02 19:51:25.595080 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.594984 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/135c70c7-2e29-45cf-8364-d5ebf0614fdb-tmp\") pod \"insights-operator-5c847dcfc4-wg2jz\" (UID: \"135c70c7-2e29-45cf-8364-d5ebf0614fdb\") " pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" Jul 02 19:51:25.595312 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.595289 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/135c70c7-2e29-45cf-8364-d5ebf0614fdb-tmp\") pod \"insights-operator-5c847dcfc4-wg2jz\" (UID: \"135c70c7-2e29-45cf-8364-d5ebf0614fdb\") " pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" Jul 02 19:51:25.596289 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.596236 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/135c70c7-2e29-45cf-8364-d5ebf0614fdb-serving-cert\") pod \"insights-operator-5c847dcfc4-wg2jz\" (UID: \"135c70c7-2e29-45cf-8364-d5ebf0614fdb\") " pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" Jul 02 19:51:25.596370 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.596329 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4417a85-8a7b-4eb3-bed3-b2aba3d9830a-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-mz68z\" (UID: \"e4417a85-8a7b-4eb3-bed3-b2aba3d9830a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mz68z" Jul 02 19:51:25.596702 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.596687 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29a0dda7-60a5-4f6b-bc15-4fb66164a986-cert\") pod \"ingress-canary-85wr2\" (UID: \"29a0dda7-60a5-4f6b-bc15-4fb66164a986\") " pod="openshift-ingress-canary/ingress-canary-85wr2" Jul 02 19:51:25.604204 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.604178 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc2b4\" (UniqueName: \"kubernetes.io/projected/49b572e5-56d7-4217-96f3-7a19dfd56cda-kube-api-access-jc2b4\") pod \"dns-default-sh2cz\" (UID: \"49b572e5-56d7-4217-96f3-7a19dfd56cda\") " pod="openshift-dns/dns-default-sh2cz" Jul 02 19:51:25.604526 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.604502 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfvp9\" (UniqueName: \"kubernetes.io/projected/e4417a85-8a7b-4eb3-bed3-b2aba3d9830a-kube-api-access-tfvp9\") pod \"service-ca-operator-5d46d9ffd4-mz68z\" (UID: \"e4417a85-8a7b-4eb3-bed3-b2aba3d9830a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mz68z" Jul 02 19:51:25.604661 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.604643 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgw7r\" (UniqueName: \"kubernetes.io/projected/ecbab5b4-b257-455f-a7e4-d99e290400e6-kube-api-access-bgw7r\") pod \"network-check-source-989f8b8dc-mrqrw\" (UID: \"ecbab5b4-b257-455f-a7e4-d99e290400e6\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mrqrw" Jul 02 19:51:25.605024 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.604994 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd9k8\" (UniqueName: \"kubernetes.io/projected/135c70c7-2e29-45cf-8364-d5ebf0614fdb-kube-api-access-wd9k8\") pod \"insights-operator-5c847dcfc4-wg2jz\" (UID: \"135c70c7-2e29-45cf-8364-d5ebf0614fdb\") " pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" Jul 02 19:51:25.605153 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.605137 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ktf4\" (UniqueName: \"kubernetes.io/projected/0d890bc7-0743-463a-99c8-9177ee249ef5-kube-api-access-7ktf4\") pod \"cluster-monitoring-operator-64786d9cbb-d9trw\" (UID: \"0d890bc7-0743-463a-99c8-9177ee249ef5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw" Jul 02 19:51:25.605530 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.605511 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkw59\" (UniqueName: \"kubernetes.io/projected/29a0dda7-60a5-4f6b-bc15-4fb66164a986-kube-api-access-jkw59\") pod \"ingress-canary-85wr2\" (UID: \"29a0dda7-60a5-4f6b-bc15-4fb66164a986\") " pod="openshift-ingress-canary/ingress-canary-85wr2" Jul 02 19:51:25.618197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.618178 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" Jul 02 19:51:25.636342 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.636296 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mz68z" Jul 02 19:51:25.657738 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.657681 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mrqrw" Jul 02 19:51:25.685954 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.685923 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-85wr2" Jul 02 19:51:25.822371 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.809031 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8j9nr"] Jul 02 19:51:25.852426 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.852384 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-t5vtb"] Jul 02 19:51:25.884715 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.884652 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mz68z"] Jul 02 19:51:25.900603 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.900577 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-92lg6"] Jul 02 19:51:25.906551 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:51:25.906493 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod108d2c60_1768_434b_81d8_893cdae03a7b.slice/crio-c9b2729fc420b8c27b1e6058a3a12c8f8207acfc3801553943f71f780e73f5e8 WatchSource:0}: Error finding container c9b2729fc420b8c27b1e6058a3a12c8f8207acfc3801553943f71f780e73f5e8: Status 404 returned error can't find the container with id c9b2729fc420b8c27b1e6058a3a12c8f8207acfc3801553943f71f780e73f5e8 Jul 02 19:51:25.933145 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.932857 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-wg2jz"] Jul 02 19:51:25.933145 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.932906 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-mrqrw"] Jul 02 19:51:25.937817 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:51:25.937767 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecbab5b4_b257_455f_a7e4_d99e290400e6.slice/crio-0d00f7c4d59eb810c066d426e722904f26be0f69f01cb735c45f4e871af2b323 WatchSource:0}: Error finding container 0d00f7c4d59eb810c066d426e722904f26be0f69f01cb735c45f4e871af2b323: Status 404 returned error can't find the container with id 0d00f7c4d59eb810c066d426e722904f26be0f69f01cb735c45f4e871af2b323 Jul 02 19:51:25.952795 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:25.952767 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-85wr2"] Jul 02 19:51:25.955334 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:51:25.955309 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29a0dda7_60a5_4f6b_bc15_4fb66164a986.slice/crio-dd8842e112aa4fa3d32077bc93ed76926b38405219cf76847f134bc0f8040cff WatchSource:0}: Error finding container dd8842e112aa4fa3d32077bc93ed76926b38405219cf76847f134bc0f8040cff: Status 404 returned error can't find the container with id dd8842e112aa4fa3d32077bc93ed76926b38405219cf76847f134bc0f8040cff Jul 02 19:51:26.008195 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:26.008164 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/199784ce-eb7c-46c7-a787-697af804e988-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4ttbh\" (UID: \"199784ce-eb7c-46c7-a787-697af804e988\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4ttbh" Jul 02 19:51:26.008318 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:26.008264 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-metrics-certs\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:26.008318 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:26.008299 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 19:51:26.008429 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:26.008326 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:26.008429 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:26.008364 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/199784ce-eb7c-46c7-a787-697af804e988-samples-operator-tls podName:199784ce-eb7c-46c7-a787-697af804e988 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:27.008344546 +0000 UTC m=+35.577948615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/199784ce-eb7c-46c7-a787-697af804e988-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-4ttbh" (UID: "199784ce-eb7c-46c7-a787-697af804e988") : secret "samples-operator-tls" not found Jul 02 19:51:26.008429 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:26.008376 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:51:26.008429 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:26.008414 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-metrics-certs podName:08935037-5736-4bbb-abb8-921a6b53ff92 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:27.008402852 +0000 UTC m=+35.578006912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-metrics-certs") pod "router-default-884f959fc-mnsl2" (UID: "08935037-5736-4bbb-abb8-921a6b53ff92") : secret "router-metrics-certs-default" not found Jul 02 19:51:26.008429 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:26.008424 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:51:26.008633 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:26.008437 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c7fd89989-hcfn9: secret "image-registry-tls" not found Jul 02 19:51:26.008633 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:26.008469 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08935037-5736-4bbb-abb8-921a6b53ff92-service-ca-bundle\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:26.008633 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:26.008483 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls podName:e7a6675d-7af2-4695-ba8a-f6b7985a5521 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:27.008465092 +0000 UTC m=+35.578069164 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls") pod "image-registry-7c7fd89989-hcfn9" (UID: "e7a6675d-7af2-4695-ba8a-f6b7985a5521") : secret "image-registry-tls" not found Jul 02 19:51:26.008633 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:26.008534 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/08935037-5736-4bbb-abb8-921a6b53ff92-service-ca-bundle podName:08935037-5736-4bbb-abb8-921a6b53ff92 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:27.008524936 +0000 UTC m=+35.578128996 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/08935037-5736-4bbb-abb8-921a6b53ff92-service-ca-bundle") pod "router-default-884f959fc-mnsl2" (UID: "08935037-5736-4bbb-abb8-921a6b53ff92") : configmap references non-existent config key: service-ca.crt Jul 02 19:51:26.109015 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:26.108986 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49b572e5-56d7-4217-96f3-7a19dfd56cda-metrics-tls\") pod \"dns-default-sh2cz\" (UID: \"49b572e5-56d7-4217-96f3-7a19dfd56cda\") " pod="openshift-dns/dns-default-sh2cz" Jul 02 19:51:26.109169 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:26.109150 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:51:26.109232 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:26.109205 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d890bc7-0743-463a-99c8-9177ee249ef5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d9trw\" (UID: \"0d890bc7-0743-463a-99c8-9177ee249ef5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw" Jul 02 19:51:26.109232 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:26.109215 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49b572e5-56d7-4217-96f3-7a19dfd56cda-metrics-tls podName:49b572e5-56d7-4217-96f3-7a19dfd56cda nodeName:}" failed. No retries permitted until 2026-07-02 19:51:27.109197014 +0000 UTC m=+35.678801088 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/49b572e5-56d7-4217-96f3-7a19dfd56cda-metrics-tls") pod "dns-default-sh2cz" (UID: "49b572e5-56d7-4217-96f3-7a19dfd56cda") : secret "dns-default-metrics-tls" not found Jul 02 19:51:26.109343 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:26.109333 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:51:26.109400 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:26.109381 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d890bc7-0743-463a-99c8-9177ee249ef5-cluster-monitoring-operator-tls podName:0d890bc7-0743-463a-99c8-9177ee249ef5 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:27.109365321 +0000 UTC m=+35.678969372 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d890bc7-0743-463a-99c8-9177ee249ef5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-d9trw" (UID: "0d890bc7-0743-463a-99c8-9177ee249ef5") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:51:26.141241 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:26.141174 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-85wr2" event={"ID":"29a0dda7-60a5-4f6b-bc15-4fb66164a986","Type":"ContainerStarted","Data":"dd8842e112aa4fa3d32077bc93ed76926b38405219cf76847f134bc0f8040cff"} Jul 02 19:51:26.142264 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:26.142232 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mrqrw" event={"ID":"ecbab5b4-b257-455f-a7e4-d99e290400e6","Type":"ContainerStarted","Data":"0d00f7c4d59eb810c066d426e722904f26be0f69f01cb735c45f4e871af2b323"} Jul 02 19:51:26.143225 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:26.143206 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" event={"ID":"135c70c7-2e29-45cf-8364-d5ebf0614fdb","Type":"ContainerStarted","Data":"63cdb2b9acd53a16ec3e73d86d0a6f11db066596c19ee9ec795df0c24976d034"} Jul 02 19:51:26.144186 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:26.144168 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-92lg6" event={"ID":"108d2c60-1768-434b-81d8-893cdae03a7b","Type":"ContainerStarted","Data":"c9b2729fc420b8c27b1e6058a3a12c8f8207acfc3801553943f71f780e73f5e8"} Jul 02 19:51:26.145241 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:26.145221 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" event={"ID":"e44c6e9d-8f1b-4e65-9b90-d89047b66f9b","Type":"ContainerStarted","Data":"2455c3b724200eac11e42afcbeafc3995d37ce1d989f9f2c03d967a0f93da604"} Jul 02 19:51:26.146262 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:26.146226 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mz68z" event={"ID":"e4417a85-8a7b-4eb3-bed3-b2aba3d9830a","Type":"ContainerStarted","Data":"cd27592b0909e4b45f57b95168e2d8b97e198ed751110f98e0444a76202587f9"} Jul 02 19:51:26.147293 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:26.147275 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8j9nr" event={"ID":"2f03817d-9515-450a-b96c-9c862eb003d5","Type":"ContainerStarted","Data":"b2ed4f575b0ffc39ef5e3fafb179d20f6c88b7dfed245f02c29c7a1984702e49"} Jul 02 19:51:26.929891 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:26.928411 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:51:26.929891 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:26.928843 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:51:26.929891 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:26.929313 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:51:26.935755 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:26.933898 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 19:51:26.935755 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:26.934114 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 19:51:26.936367 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:26.936177 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kmhzg\"" Jul 02 19:51:26.936367 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:26.936304 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkjw9\"" Jul 02 19:51:27.017069 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:27.017032 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:27.017240 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:27.017130 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08935037-5736-4bbb-abb8-921a6b53ff92-service-ca-bundle\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:27.017240 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:27.017165 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/199784ce-eb7c-46c7-a787-697af804e988-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4ttbh\" (UID: \"199784ce-eb7c-46c7-a787-697af804e988\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4ttbh" Jul 02 19:51:27.017381 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:27.017243 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-metrics-certs\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:27.017431 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:27.017405 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:51:27.017484 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:27.017465 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-metrics-certs podName:08935037-5736-4bbb-abb8-921a6b53ff92 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:29.01744665 +0000 UTC m=+37.587050703 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-metrics-certs") pod "router-default-884f959fc-mnsl2" (UID: "08935037-5736-4bbb-abb8-921a6b53ff92") : secret "router-metrics-certs-default" not found Jul 02 19:51:27.017989 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:27.017849 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:51:27.017989 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:27.017867 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c7fd89989-hcfn9: secret "image-registry-tls" not found Jul 02 19:51:27.017989 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:27.017881 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 19:51:27.017989 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:27.017908 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls podName:e7a6675d-7af2-4695-ba8a-f6b7985a5521 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:29.017894637 +0000 UTC m=+37.587498688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls") pod "image-registry-7c7fd89989-hcfn9" (UID: "e7a6675d-7af2-4695-ba8a-f6b7985a5521") : secret "image-registry-tls" not found Jul 02 19:51:27.017989 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:27.017925 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/199784ce-eb7c-46c7-a787-697af804e988-samples-operator-tls podName:199784ce-eb7c-46c7-a787-697af804e988 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:29.017915981 +0000 UTC m=+37.587520029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/199784ce-eb7c-46c7-a787-697af804e988-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-4ttbh" (UID: "199784ce-eb7c-46c7-a787-697af804e988") : secret "samples-operator-tls" not found Jul 02 19:51:27.018338 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:27.017994 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/08935037-5736-4bbb-abb8-921a6b53ff92-service-ca-bundle podName:08935037-5736-4bbb-abb8-921a6b53ff92 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:29.01797091 +0000 UTC m=+37.587574976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/08935037-5736-4bbb-abb8-921a6b53ff92-service-ca-bundle") pod "router-default-884f959fc-mnsl2" (UID: "08935037-5736-4bbb-abb8-921a6b53ff92") : configmap references non-existent config key: service-ca.crt Jul 02 19:51:27.118677 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:27.118643 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49b572e5-56d7-4217-96f3-7a19dfd56cda-metrics-tls\") pod \"dns-default-sh2cz\" (UID: \"49b572e5-56d7-4217-96f3-7a19dfd56cda\") " pod="openshift-dns/dns-default-sh2cz" Jul 02 19:51:27.118864 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:27.118779 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d890bc7-0743-463a-99c8-9177ee249ef5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d9trw\" (UID: \"0d890bc7-0743-463a-99c8-9177ee249ef5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw" Jul 02 19:51:27.118931 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:27.118894 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:51:27.119038 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:27.118955 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d890bc7-0743-463a-99c8-9177ee249ef5-cluster-monitoring-operator-tls podName:0d890bc7-0743-463a-99c8-9177ee249ef5 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:29.118936138 +0000 UTC m=+37.688540189 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d890bc7-0743-463a-99c8-9177ee249ef5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-d9trw" (UID: "0d890bc7-0743-463a-99c8-9177ee249ef5") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:51:27.119826 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:27.119801 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:51:27.119920 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:27.119857 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49b572e5-56d7-4217-96f3-7a19dfd56cda-metrics-tls podName:49b572e5-56d7-4217-96f3-7a19dfd56cda nodeName:}" failed. No retries permitted until 2026-07-02 19:51:29.119841941 +0000 UTC m=+37.689445991 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/49b572e5-56d7-4217-96f3-7a19dfd56cda-metrics-tls") pod "dns-default-sh2cz" (UID: "49b572e5-56d7-4217-96f3-7a19dfd56cda") : secret "dns-default-metrics-tls" not found Jul 02 19:51:29.039199 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:29.038855 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08935037-5736-4bbb-abb8-921a6b53ff92-service-ca-bundle\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:29.039199 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:29.039062 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/08935037-5736-4bbb-abb8-921a6b53ff92-service-ca-bundle podName:08935037-5736-4bbb-abb8-921a6b53ff92 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:33.03904055 +0000 UTC m=+41.608644600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/08935037-5736-4bbb-abb8-921a6b53ff92-service-ca-bundle") pod "router-default-884f959fc-mnsl2" (UID: "08935037-5736-4bbb-abb8-921a6b53ff92") : configmap references non-existent config key: service-ca.crt Jul 02 19:51:29.039199 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:29.039141 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/199784ce-eb7c-46c7-a787-697af804e988-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4ttbh\" (UID: \"199784ce-eb7c-46c7-a787-697af804e988\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4ttbh" Jul 02 19:51:29.039752 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:29.039233 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-metrics-certs\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:29.039752 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:29.039309 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:29.039752 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:29.039468 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 19:51:29.039752 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:29.039523 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/199784ce-eb7c-46c7-a787-697af804e988-samples-operator-tls podName:199784ce-eb7c-46c7-a787-697af804e988 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:33.03950697 +0000 UTC m=+41.609111019 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/199784ce-eb7c-46c7-a787-697af804e988-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-4ttbh" (UID: "199784ce-eb7c-46c7-a787-697af804e988") : secret "samples-operator-tls" not found Jul 02 19:51:29.039752 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:29.039525 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:51:29.039752 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:29.039471 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:51:29.039752 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:29.039546 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c7fd89989-hcfn9: secret "image-registry-tls" not found Jul 02 19:51:29.039752 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:29.039579 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-metrics-certs podName:08935037-5736-4bbb-abb8-921a6b53ff92 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:33.039562596 +0000 UTC m=+41.609166646 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-metrics-certs") pod "router-default-884f959fc-mnsl2" (UID: "08935037-5736-4bbb-abb8-921a6b53ff92") : secret "router-metrics-certs-default" not found Jul 02 19:51:29.039752 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:29.039597 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls podName:e7a6675d-7af2-4695-ba8a-f6b7985a5521 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:33.039587625 +0000 UTC m=+41.609191679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls") pod "image-registry-7c7fd89989-hcfn9" (UID: "e7a6675d-7af2-4695-ba8a-f6b7985a5521") : secret "image-registry-tls" not found Jul 02 19:51:29.140206 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:29.140132 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49b572e5-56d7-4217-96f3-7a19dfd56cda-metrics-tls\") pod \"dns-default-sh2cz\" (UID: \"49b572e5-56d7-4217-96f3-7a19dfd56cda\") " pod="openshift-dns/dns-default-sh2cz" Jul 02 19:51:29.140377 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:29.140288 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:51:29.140377 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:29.140296 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d890bc7-0743-463a-99c8-9177ee249ef5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d9trw\" (UID: \"0d890bc7-0743-463a-99c8-9177ee249ef5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw" Jul 02 19:51:29.140377 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:29.140360 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49b572e5-56d7-4217-96f3-7a19dfd56cda-metrics-tls podName:49b572e5-56d7-4217-96f3-7a19dfd56cda nodeName:}" failed. No retries permitted until 2026-07-02 19:51:33.140339141 +0000 UTC m=+41.709943204 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/49b572e5-56d7-4217-96f3-7a19dfd56cda-metrics-tls") pod "dns-default-sh2cz" (UID: "49b572e5-56d7-4217-96f3-7a19dfd56cda") : secret "dns-default-metrics-tls" not found Jul 02 19:51:29.140517 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:29.140402 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:51:29.140517 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:29.140474 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d890bc7-0743-463a-99c8-9177ee249ef5-cluster-monitoring-operator-tls podName:0d890bc7-0743-463a-99c8-9177ee249ef5 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:33.14045887 +0000 UTC m=+41.710062919 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d890bc7-0743-463a-99c8-9177ee249ef5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-d9trw" (UID: "0d890bc7-0743-463a-99c8-9177ee249ef5") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:51:29.414965 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:29.414899 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-7v7pv"] Jul 02 19:51:29.443052 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:29.442432 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-7v7pv"] Jul 02 19:51:29.443052 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:29.442555 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7v7pv" Jul 02 19:51:29.446003 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:29.445892 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 02 19:51:29.446324 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:29.446168 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 02 19:51:29.446870 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:29.446681 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-l5xpw\"" Jul 02 19:51:29.543933 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:29.543899 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/db3bd1af-2862-434d-b05b-5c05ee2422e1-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-7v7pv\" (UID: \"db3bd1af-2862-434d-b05b-5c05ee2422e1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7v7pv" Jul 02 19:51:29.544101 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:29.543946 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db3bd1af-2862-434d-b05b-5c05ee2422e1-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7v7pv\" (UID: \"db3bd1af-2862-434d-b05b-5c05ee2422e1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7v7pv" Jul 02 19:51:29.645420 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:29.645384 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/db3bd1af-2862-434d-b05b-5c05ee2422e1-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-7v7pv\" (UID: \"db3bd1af-2862-434d-b05b-5c05ee2422e1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7v7pv" Jul 02 19:51:29.645420 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:29.645423 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db3bd1af-2862-434d-b05b-5c05ee2422e1-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7v7pv\" (UID: \"db3bd1af-2862-434d-b05b-5c05ee2422e1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7v7pv" Jul 02 19:51:29.645655 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:29.645572 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:51:29.645655 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:29.645636 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db3bd1af-2862-434d-b05b-5c05ee2422e1-networking-console-plugin-cert podName:db3bd1af-2862-434d-b05b-5c05ee2422e1 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:30.145620792 +0000 UTC m=+38.715224845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/db3bd1af-2862-434d-b05b-5c05ee2422e1-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7v7pv" (UID: "db3bd1af-2862-434d-b05b-5c05ee2422e1") : secret "networking-console-plugin-cert" not found Jul 02 19:51:29.646137 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:29.646108 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/db3bd1af-2862-434d-b05b-5c05ee2422e1-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-7v7pv\" (UID: \"db3bd1af-2862-434d-b05b-5c05ee2422e1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7v7pv" Jul 02 19:51:30.151068 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:30.151035 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db3bd1af-2862-434d-b05b-5c05ee2422e1-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7v7pv\" (UID: \"db3bd1af-2862-434d-b05b-5c05ee2422e1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7v7pv" Jul 02 19:51:30.151418 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:30.151167 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:51:30.151418 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:30.151229 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db3bd1af-2862-434d-b05b-5c05ee2422e1-networking-console-plugin-cert podName:db3bd1af-2862-434d-b05b-5c05ee2422e1 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:31.151212577 +0000 UTC m=+39.720816629 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/db3bd1af-2862-434d-b05b-5c05ee2422e1-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7v7pv" (UID: "db3bd1af-2862-434d-b05b-5c05ee2422e1") : secret "networking-console-plugin-cert" not found Jul 02 19:51:31.160120 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:31.160079 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db3bd1af-2862-434d-b05b-5c05ee2422e1-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7v7pv\" (UID: \"db3bd1af-2862-434d-b05b-5c05ee2422e1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7v7pv" Jul 02 19:51:31.160611 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:31.160269 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:51:31.160611 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:31.160358 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db3bd1af-2862-434d-b05b-5c05ee2422e1-networking-console-plugin-cert podName:db3bd1af-2862-434d-b05b-5c05ee2422e1 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:33.160336512 +0000 UTC m=+41.729940573 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/db3bd1af-2862-434d-b05b-5c05ee2422e1-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7v7pv" (UID: "db3bd1af-2862-434d-b05b-5c05ee2422e1") : secret "networking-console-plugin-cert" not found Jul 02 19:51:33.076697 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:33.076654 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08935037-5736-4bbb-abb8-921a6b53ff92-service-ca-bundle\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:33.077158 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:33.076713 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/199784ce-eb7c-46c7-a787-697af804e988-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4ttbh\" (UID: \"199784ce-eb7c-46c7-a787-697af804e988\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4ttbh" Jul 02 19:51:33.077158 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:33.076786 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/08935037-5736-4bbb-abb8-921a6b53ff92-service-ca-bundle podName:08935037-5736-4bbb-abb8-921a6b53ff92 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:41.076766883 +0000 UTC m=+49.646370955 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/08935037-5736-4bbb-abb8-921a6b53ff92-service-ca-bundle") pod "router-default-884f959fc-mnsl2" (UID: "08935037-5736-4bbb-abb8-921a6b53ff92") : configmap references non-existent config key: service-ca.crt Jul 02 19:51:33.077158 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:33.076834 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-metrics-certs\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:33.077158 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:33.076843 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 19:51:33.077158 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:33.076882 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/199784ce-eb7c-46c7-a787-697af804e988-samples-operator-tls podName:199784ce-eb7c-46c7-a787-697af804e988 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:41.076869701 +0000 UTC m=+49.646473753 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/199784ce-eb7c-46c7-a787-697af804e988-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-4ttbh" (UID: "199784ce-eb7c-46c7-a787-697af804e988") : secret "samples-operator-tls" not found Jul 02 19:51:33.077158 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:33.076899 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:33.077158 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:33.076922 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:51:33.077158 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:33.076955 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-metrics-certs podName:08935037-5736-4bbb-abb8-921a6b53ff92 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:41.076944472 +0000 UTC m=+49.646548533 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-metrics-certs") pod "router-default-884f959fc-mnsl2" (UID: "08935037-5736-4bbb-abb8-921a6b53ff92") : secret "router-metrics-certs-default" not found Jul 02 19:51:33.077158 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:33.076985 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:51:33.077158 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:33.076995 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c7fd89989-hcfn9: secret "image-registry-tls" not found Jul 02 19:51:33.077158 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:33.077018 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls podName:e7a6675d-7af2-4695-ba8a-f6b7985a5521 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:41.077011413 +0000 UTC m=+49.646615462 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls") pod "image-registry-7c7fd89989-hcfn9" (UID: "e7a6675d-7af2-4695-ba8a-f6b7985a5521") : secret "image-registry-tls" not found Jul 02 19:51:33.177969 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:33.177925 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49b572e5-56d7-4217-96f3-7a19dfd56cda-metrics-tls\") pod \"dns-default-sh2cz\" (UID: \"49b572e5-56d7-4217-96f3-7a19dfd56cda\") " pod="openshift-dns/dns-default-sh2cz" Jul 02 19:51:33.178149 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:33.178063 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d890bc7-0743-463a-99c8-9177ee249ef5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d9trw\" (UID: \"0d890bc7-0743-463a-99c8-9177ee249ef5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw" Jul 02 19:51:33.178149 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:33.178074 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:51:33.178149 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:33.178100 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db3bd1af-2862-434d-b05b-5c05ee2422e1-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7v7pv\" (UID: \"db3bd1af-2862-434d-b05b-5c05ee2422e1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7v7pv" Jul 02 19:51:33.178149 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:33.178136 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49b572e5-56d7-4217-96f3-7a19dfd56cda-metrics-tls podName:49b572e5-56d7-4217-96f3-7a19dfd56cda nodeName:}" failed. No retries permitted until 2026-07-02 19:51:41.178120016 +0000 UTC m=+49.747724085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/49b572e5-56d7-4217-96f3-7a19dfd56cda-metrics-tls") pod "dns-default-sh2cz" (UID: "49b572e5-56d7-4217-96f3-7a19dfd56cda") : secret "dns-default-metrics-tls" not found Jul 02 19:51:33.178363 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:33.178206 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:51:33.178363 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:33.178208 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:51:33.178363 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:33.178271 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db3bd1af-2862-434d-b05b-5c05ee2422e1-networking-console-plugin-cert podName:db3bd1af-2862-434d-b05b-5c05ee2422e1 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:37.17824065 +0000 UTC m=+45.747844704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/db3bd1af-2862-434d-b05b-5c05ee2422e1-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7v7pv" (UID: "db3bd1af-2862-434d-b05b-5c05ee2422e1") : secret "networking-console-plugin-cert" not found Jul 02 19:51:33.178363 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:33.178289 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d890bc7-0743-463a-99c8-9177ee249ef5-cluster-monitoring-operator-tls podName:0d890bc7-0743-463a-99c8-9177ee249ef5 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:41.178279837 +0000 UTC m=+49.747883892 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d890bc7-0743-463a-99c8-9177ee249ef5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-d9trw" (UID: "0d890bc7-0743-463a-99c8-9177ee249ef5") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:51:36.185492 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:36.184770 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mz68z" event={"ID":"e4417a85-8a7b-4eb3-bed3-b2aba3d9830a","Type":"ContainerStarted","Data":"5c48e01cc937990b37c80c80db2920044711423019813cf96e17ece6dde6d57d"} Jul 02 19:51:36.187831 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:36.187806 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8j9nr" event={"ID":"2f03817d-9515-450a-b96c-9c862eb003d5","Type":"ContainerStarted","Data":"4bfa794715c41c602a6c4afb6d7a7e79ab5e6a218af464ad5589a17cb6263365"} Jul 02 19:51:36.195440 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:36.195379 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-85wr2" event={"ID":"29a0dda7-60a5-4f6b-bc15-4fb66164a986","Type":"ContainerStarted","Data":"425ea6d8d04056e7ad75a9b5e4efefded4847d2b335d337c5e1fef8d32958b9c"} Jul 02 19:51:36.195656 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:36.195585 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mrqrw" event={"ID":"ecbab5b4-b257-455f-a7e4-d99e290400e6","Type":"ContainerStarted","Data":"6fe6f5c3aad3f7a38aed9da0aae05dd6587e61267978fb0667bc5ffa115e7d2d"} Jul 02 19:51:36.195656 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:36.195626 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" event={"ID":"135c70c7-2e29-45cf-8364-d5ebf0614fdb","Type":"ContainerStarted","Data":"fdd0955c5cf86899931e4a21f6ba04f837b937c5126a8c2453e64d0253bb8a44"} Jul 02 19:51:36.198956 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:36.198936 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzt7w" event={"ID":"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8","Type":"ContainerStarted","Data":"c3fb410530e7b2f52aae900958612b5c15c63b7eae6bbaeb64322e625114d099"} Jul 02 19:51:36.201285 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:36.201266 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-92lg6" event={"ID":"108d2c60-1768-434b-81d8-893cdae03a7b","Type":"ContainerStarted","Data":"51d765ea2d92ddc8be5f6db48a6651cf8985f2f9443eca64c17485ec224e55a6"} Jul 02 19:51:36.203712 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:36.203697 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/0.log" Jul 02 19:51:36.203850 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:36.203834 2560 generic.go:356] "Generic (PLEG): container finished" podID="e44c6e9d-8f1b-4e65-9b90-d89047b66f9b" containerID="4b7fd5fb6d11c07f8343cc990a1d6cf3c0831fbe8a76307b9a7ec15b6098c213" exitCode=255 Jul 02 19:51:36.204188 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:36.204167 2560 scope.go:117] "RemoveContainer" containerID="4b7fd5fb6d11c07f8343cc990a1d6cf3c0831fbe8a76307b9a7ec15b6098c213" Jul 02 19:51:36.205144 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:36.203936 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" event={"ID":"e44c6e9d-8f1b-4e65-9b90-d89047b66f9b","Type":"ContainerDied","Data":"4b7fd5fb6d11c07f8343cc990a1d6cf3c0831fbe8a76307b9a7ec15b6098c213"} Jul 02 19:51:36.205889 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:36.205834 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mz68z" podStartSLOduration=32.270409334 podStartE2EDuration="42.205820576s" totalImagesPullingTime="9.935411242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:36.205480954 +0000 UTC m=+44.775085037" watchObservedRunningTime="2026-07-02 19:51:36.205820576 +0000 UTC m=+44.775424646" Jul 02 19:51:36.228605 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:36.227429 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-92lg6" podStartSLOduration=32.311308407 podStartE2EDuration="42.227410667s" totalImagesPullingTime="9.91610226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:36.226719712 +0000 UTC m=+44.796323783" watchObservedRunningTime="2026-07-02 19:51:36.227410667 +0000 UTC m=+44.797014718" Jul 02 19:51:36.249528 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:36.249470 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" podStartSLOduration=32.427151818 podStartE2EDuration="42.249453396s" totalImagesPullingTime="9.822301578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:36.248472317 +0000 UTC m=+44.818076388" watchObservedRunningTime="2026-07-02 19:51:36.249453396 +0000 UTC m=+44.819057467" Jul 02 19:51:36.337155 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:36.337106 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mrqrw" podStartSLOduration=26.442011909 podStartE2EDuration="36.337085462s" totalImagesPullingTime="9.895073553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:51:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:36.336596699 +0000 UTC m=+44.906200771" watchObservedRunningTime="2026-07-02 19:51:36.337085462 +0000 UTC m=+44.906689534" Jul 02 19:51:36.374474 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:36.374425 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8j9nr" podStartSLOduration=32.473483347 podStartE2EDuration="42.374406372s" totalImagesPullingTime="9.900923025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:36.373414764 +0000 UTC m=+44.943018835" watchObservedRunningTime="2026-07-02 19:51:36.374406372 +0000 UTC m=+44.944010444" Jul 02 19:51:36.374749 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:36.374721 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-85wr2" podStartSLOduration=1.505562813 podStartE2EDuration="11.374711431s" totalImagesPullingTime="9.869148618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:36.355391613 +0000 UTC m=+44.924995683" watchObservedRunningTime="2026-07-02 19:51:36.374711431 +0000 UTC m=+44.944315503" Jul 02 19:51:37.209154 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.209123 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/1.log" Jul 02 19:51:37.209680 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.209664 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/0.log" Jul 02 19:51:37.209757 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.209704 2560 generic.go:356] "Generic (PLEG): container finished" podID="e44c6e9d-8f1b-4e65-9b90-d89047b66f9b" containerID="0c198b6040dd37bdf26f7d5332776984ba05764aadf498d2fae40f9844ff7e3b" exitCode=255 Jul 02 19:51:37.209828 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.209800 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" event={"ID":"e44c6e9d-8f1b-4e65-9b90-d89047b66f9b","Type":"ContainerDied","Data":"0c198b6040dd37bdf26f7d5332776984ba05764aadf498d2fae40f9844ff7e3b"} Jul 02 19:51:37.210082 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.210068 2560 scope.go:117] "RemoveContainer" containerID="4b7fd5fb6d11c07f8343cc990a1d6cf3c0831fbe8a76307b9a7ec15b6098c213" Jul 02 19:51:37.210497 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.210291 2560 scope.go:117] "RemoveContainer" containerID="0c198b6040dd37bdf26f7d5332776984ba05764aadf498d2fae40f9844ff7e3b" Jul 02 19:51:37.210867 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:37.210843 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-t5vtb_openshift-console-operator(e44c6e9d-8f1b-4e65-9b90-d89047b66f9b)\"" pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" podUID="e44c6e9d-8f1b-4e65-9b90-d89047b66f9b" Jul 02 19:51:37.212965 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.212940 2560 generic.go:356] "Generic (PLEG): container finished" podID="0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8" containerID="c3fb410530e7b2f52aae900958612b5c15c63b7eae6bbaeb64322e625114d099" exitCode=0 Jul 02 19:51:37.213075 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.212973 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzt7w" event={"ID":"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8","Type":"ContainerDied","Data":"c3fb410530e7b2f52aae900958612b5c15c63b7eae6bbaeb64322e625114d099"} Jul 02 19:51:37.214191 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.214163 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db3bd1af-2862-434d-b05b-5c05ee2422e1-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7v7pv\" (UID: \"db3bd1af-2862-434d-b05b-5c05ee2422e1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7v7pv" Jul 02 19:51:37.214402 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:37.214379 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:51:37.214492 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:37.214454 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db3bd1af-2862-434d-b05b-5c05ee2422e1-networking-console-plugin-cert podName:db3bd1af-2862-434d-b05b-5c05ee2422e1 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:45.214434186 +0000 UTC m=+53.784038236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/db3bd1af-2862-434d-b05b-5c05ee2422e1-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7v7pv" (UID: "db3bd1af-2862-434d-b05b-5c05ee2422e1") : secret "networking-console-plugin-cert" not found Jul 02 19:51:37.311163 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.310742 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hzrnl"] Jul 02 19:51:37.333362 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.333279 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hzrnl"] Jul 02 19:51:37.333362 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.333357 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:37.335950 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.335933 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 19:51:37.336120 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.335958 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lvrrb\"" Jul 02 19:51:37.336221 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.335968 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 19:51:37.417477 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.417452 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77c937cf-32be-40a0-8950-c53ebd9aa22e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:37.417568 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.417491 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvf67\" (UniqueName: \"kubernetes.io/projected/77c937cf-32be-40a0-8950-c53ebd9aa22e-kube-api-access-kvf67\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:37.417614 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.417577 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77c937cf-32be-40a0-8950-c53ebd9aa22e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:37.417697 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.417675 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/77c937cf-32be-40a0-8950-c53ebd9aa22e-crio-socket\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:37.417768 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.417751 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/77c937cf-32be-40a0-8950-c53ebd9aa22e-data-volume\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:37.518889 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.518822 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/77c937cf-32be-40a0-8950-c53ebd9aa22e-crio-socket\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:37.518889 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.518878 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/77c937cf-32be-40a0-8950-c53ebd9aa22e-data-volume\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:37.519063 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.518971 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77c937cf-32be-40a0-8950-c53ebd9aa22e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:37.519063 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.518992 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvf67\" (UniqueName: \"kubernetes.io/projected/77c937cf-32be-40a0-8950-c53ebd9aa22e-kube-api-access-kvf67\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:37.519063 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.519048 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/77c937cf-32be-40a0-8950-c53ebd9aa22e-crio-socket\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:37.519198 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.519075 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77c937cf-32be-40a0-8950-c53ebd9aa22e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:37.519198 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:37.519123 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 19:51:37.519198 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:37.519169 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:51:37.519198 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:37.519177 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77c937cf-32be-40a0-8950-c53ebd9aa22e-kube-rbac-proxy-cm podName:77c937cf-32be-40a0-8950-c53ebd9aa22e nodeName:}" failed. No retries permitted until 2026-07-02 19:51:38.019158861 +0000 UTC m=+46.588762912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/77c937cf-32be-40a0-8950-c53ebd9aa22e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hzrnl" (UID: "77c937cf-32be-40a0-8950-c53ebd9aa22e") : configmap "kube-rbac-proxy" not found Jul 02 19:51:37.519393 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:37.519203 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77c937cf-32be-40a0-8950-c53ebd9aa22e-insights-runtime-extractor-tls podName:77c937cf-32be-40a0-8950-c53ebd9aa22e nodeName:}" failed. No retries permitted until 2026-07-02 19:51:38.019193116 +0000 UTC m=+46.588797178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77c937cf-32be-40a0-8950-c53ebd9aa22e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hzrnl" (UID: "77c937cf-32be-40a0-8950-c53ebd9aa22e") : secret "insights-runtime-extractor-tls" not found Jul 02 19:51:37.519393 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.519223 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/77c937cf-32be-40a0-8950-c53ebd9aa22e-data-volume\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:37.536634 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:37.536611 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvf67\" (UniqueName: \"kubernetes.io/projected/77c937cf-32be-40a0-8950-c53ebd9aa22e-kube-api-access-kvf67\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:38.023105 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:38.023072 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77c937cf-32be-40a0-8950-c53ebd9aa22e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:38.023287 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:38.023221 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77c937cf-32be-40a0-8950-c53ebd9aa22e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:38.023287 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:38.023234 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:51:38.023381 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:38.023328 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77c937cf-32be-40a0-8950-c53ebd9aa22e-insights-runtime-extractor-tls podName:77c937cf-32be-40a0-8950-c53ebd9aa22e nodeName:}" failed. No retries permitted until 2026-07-02 19:51:39.023306273 +0000 UTC m=+47.592910342 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77c937cf-32be-40a0-8950-c53ebd9aa22e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hzrnl" (UID: "77c937cf-32be-40a0-8950-c53ebd9aa22e") : secret "insights-runtime-extractor-tls" not found Jul 02 19:51:38.023739 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:38.023725 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 19:51:38.023773 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:38.023768 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77c937cf-32be-40a0-8950-c53ebd9aa22e-kube-rbac-proxy-cm podName:77c937cf-32be-40a0-8950-c53ebd9aa22e nodeName:}" failed. No retries permitted until 2026-07-02 19:51:39.023757488 +0000 UTC m=+47.593361541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/77c937cf-32be-40a0-8950-c53ebd9aa22e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hzrnl" (UID: "77c937cf-32be-40a0-8950-c53ebd9aa22e") : configmap "kube-rbac-proxy" not found Jul 02 19:51:38.223029 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:38.222996 2560 generic.go:356] "Generic (PLEG): container finished" podID="0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8" containerID="9f6e8eed5bdabb8f17c10c22844740c6a5adf575ca278d4ac53d24575e66cfe0" exitCode=0 Jul 02 19:51:38.223462 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:38.223074 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzt7w" event={"ID":"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8","Type":"ContainerDied","Data":"9f6e8eed5bdabb8f17c10c22844740c6a5adf575ca278d4ac53d24575e66cfe0"} Jul 02 19:51:38.224760 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:38.224684 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/1.log" Jul 02 19:51:38.224938 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:38.224924 2560 scope.go:117] "RemoveContainer" containerID="0c198b6040dd37bdf26f7d5332776984ba05764aadf498d2fae40f9844ff7e3b" Jul 02 19:51:38.225063 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:38.225046 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-t5vtb_openshift-console-operator(e44c6e9d-8f1b-4e65-9b90-d89047b66f9b)\"" pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" podUID="e44c6e9d-8f1b-4e65-9b90-d89047b66f9b" Jul 02 19:51:39.031163 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:39.031129 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77c937cf-32be-40a0-8950-c53ebd9aa22e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:39.031342 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:39.031206 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77c937cf-32be-40a0-8950-c53ebd9aa22e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:39.031342 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:39.031268 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 19:51:39.031342 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:39.031341 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77c937cf-32be-40a0-8950-c53ebd9aa22e-kube-rbac-proxy-cm podName:77c937cf-32be-40a0-8950-c53ebd9aa22e nodeName:}" failed. No retries permitted until 2026-07-02 19:51:41.031324725 +0000 UTC m=+49.600928775 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/77c937cf-32be-40a0-8950-c53ebd9aa22e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hzrnl" (UID: "77c937cf-32be-40a0-8950-c53ebd9aa22e") : configmap "kube-rbac-proxy" not found Jul 02 19:51:39.031447 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:39.031381 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:51:39.031447 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:39.031444 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77c937cf-32be-40a0-8950-c53ebd9aa22e-insights-runtime-extractor-tls podName:77c937cf-32be-40a0-8950-c53ebd9aa22e nodeName:}" failed. No retries permitted until 2026-07-02 19:51:41.031427628 +0000 UTC m=+49.601031681 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77c937cf-32be-40a0-8950-c53ebd9aa22e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hzrnl" (UID: "77c937cf-32be-40a0-8950-c53ebd9aa22e") : secret "insights-runtime-extractor-tls" not found Jul 02 19:51:39.093159 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:39.093125 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8wwq6_e8c0c3b5-e729-46f6-b927-ecd72af8af02/dns-node-resolver/0.log" Jul 02 19:51:39.232174 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:39.232141 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzt7w" event={"ID":"0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8","Type":"ContainerStarted","Data":"610b49770e3c17cec2c7d49ca0e536b53da5710f09ca2195ce40a6ce829bbe62"} Jul 02 19:51:39.259917 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:39.259874 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mzt7w" podStartSLOduration=8.399098225 podStartE2EDuration="47.259858643s" totalImagesPullingTime="38.860760418s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:39.259617547 +0000 UTC m=+47.829221618" watchObservedRunningTime="2026-07-02 19:51:39.259858643 +0000 UTC m=+47.829462712" Jul 02 19:51:40.291141 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:40.291114 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dfxtn_d454a862-97f9-4763-960f-cd1aaf123df4/node-ca/0.log" Jul 02 19:51:40.892710 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:40.892685 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-85wr2_29a0dda7-60a5-4f6b-bc15-4fb66164a986/serve-healthcheck-canary/0.log" Jul 02 19:51:41.048265 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:41.048208 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77c937cf-32be-40a0-8950-c53ebd9aa22e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:41.048434 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:41.048315 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77c937cf-32be-40a0-8950-c53ebd9aa22e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:41.048516 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:41.048453 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:51:41.048516 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:41.048514 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77c937cf-32be-40a0-8950-c53ebd9aa22e-insights-runtime-extractor-tls podName:77c937cf-32be-40a0-8950-c53ebd9aa22e nodeName:}" failed. No retries permitted until 2026-07-02 19:51:45.048499703 +0000 UTC m=+53.618103751 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77c937cf-32be-40a0-8950-c53ebd9aa22e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hzrnl" (UID: "77c937cf-32be-40a0-8950-c53ebd9aa22e") : secret "insights-runtime-extractor-tls" not found Jul 02 19:51:41.048798 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:41.048776 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77c937cf-32be-40a0-8950-c53ebd9aa22e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:41.149270 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:41.149176 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:41.149388 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:41.149283 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08935037-5736-4bbb-abb8-921a6b53ff92-service-ca-bundle\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:41.149388 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:41.149304 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/199784ce-eb7c-46c7-a787-697af804e988-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4ttbh\" (UID: \"199784ce-eb7c-46c7-a787-697af804e988\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4ttbh" Jul 02 19:51:41.149388 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:41.149336 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:51:41.149388 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:41.149352 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c7fd89989-hcfn9: secret "image-registry-tls" not found Jul 02 19:51:41.149388 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:41.149363 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-metrics-certs\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:41.149545 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:41.149396 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls podName:e7a6675d-7af2-4695-ba8a-f6b7985a5521 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:57.149383204 +0000 UTC m=+65.718987252 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls") pod "image-registry-7c7fd89989-hcfn9" (UID: "e7a6675d-7af2-4695-ba8a-f6b7985a5521") : secret "image-registry-tls" not found Jul 02 19:51:41.149545 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:41.149435 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/08935037-5736-4bbb-abb8-921a6b53ff92-service-ca-bundle podName:08935037-5736-4bbb-abb8-921a6b53ff92 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:57.149420772 +0000 UTC m=+65.719024824 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/08935037-5736-4bbb-abb8-921a6b53ff92-service-ca-bundle") pod "router-default-884f959fc-mnsl2" (UID: "08935037-5736-4bbb-abb8-921a6b53ff92") : configmap references non-existent config key: service-ca.crt Jul 02 19:51:41.149545 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:41.149436 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 19:51:41.149545 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:41.149451 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:51:41.149545 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:41.149482 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/199784ce-eb7c-46c7-a787-697af804e988-samples-operator-tls podName:199784ce-eb7c-46c7-a787-697af804e988 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:57.14947463 +0000 UTC m=+65.719078678 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/199784ce-eb7c-46c7-a787-697af804e988-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-4ttbh" (UID: "199784ce-eb7c-46c7-a787-697af804e988") : secret "samples-operator-tls" not found Jul 02 19:51:41.149545 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:41.149493 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-metrics-certs podName:08935037-5736-4bbb-abb8-921a6b53ff92 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:57.149487611 +0000 UTC m=+65.719091659 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-metrics-certs") pod "router-default-884f959fc-mnsl2" (UID: "08935037-5736-4bbb-abb8-921a6b53ff92") : secret "router-metrics-certs-default" not found Jul 02 19:51:41.250321 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:41.250296 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49b572e5-56d7-4217-96f3-7a19dfd56cda-metrics-tls\") pod \"dns-default-sh2cz\" (UID: \"49b572e5-56d7-4217-96f3-7a19dfd56cda\") " pod="openshift-dns/dns-default-sh2cz" Jul 02 19:51:41.250487 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:41.250398 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d890bc7-0743-463a-99c8-9177ee249ef5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d9trw\" (UID: \"0d890bc7-0743-463a-99c8-9177ee249ef5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw" Jul 02 19:51:41.250487 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:41.250448 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:51:41.250603 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:41.250505 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49b572e5-56d7-4217-96f3-7a19dfd56cda-metrics-tls podName:49b572e5-56d7-4217-96f3-7a19dfd56cda nodeName:}" failed. No retries permitted until 2026-07-02 19:51:57.250488341 +0000 UTC m=+65.820092390 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/49b572e5-56d7-4217-96f3-7a19dfd56cda-metrics-tls") pod "dns-default-sh2cz" (UID: "49b572e5-56d7-4217-96f3-7a19dfd56cda") : secret "dns-default-metrics-tls" not found Jul 02 19:51:41.250603 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:41.250516 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:51:41.250603 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:41.250552 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d890bc7-0743-463a-99c8-9177ee249ef5-cluster-monitoring-operator-tls podName:0d890bc7-0743-463a-99c8-9177ee249ef5 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:57.250539952 +0000 UTC m=+65.820144000 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d890bc7-0743-463a-99c8-9177ee249ef5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-d9trw" (UID: "0d890bc7-0743-463a-99c8-9177ee249ef5") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:51:45.078771 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:45.078734 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77c937cf-32be-40a0-8950-c53ebd9aa22e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:45.079206 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:45.078887 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:51:45.079206 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:45.078950 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77c937cf-32be-40a0-8950-c53ebd9aa22e-insights-runtime-extractor-tls podName:77c937cf-32be-40a0-8950-c53ebd9aa22e nodeName:}" failed. No retries permitted until 2026-07-02 19:51:53.078934482 +0000 UTC m=+61.648538553 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77c937cf-32be-40a0-8950-c53ebd9aa22e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hzrnl" (UID: "77c937cf-32be-40a0-8950-c53ebd9aa22e") : secret "insights-runtime-extractor-tls" not found Jul 02 19:51:45.279930 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:45.279900 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db3bd1af-2862-434d-b05b-5c05ee2422e1-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7v7pv\" (UID: \"db3bd1af-2862-434d-b05b-5c05ee2422e1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7v7pv" Jul 02 19:51:45.280089 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:45.280034 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:51:45.280089 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:45.280088 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db3bd1af-2862-434d-b05b-5c05ee2422e1-networking-console-plugin-cert podName:db3bd1af-2862-434d-b05b-5c05ee2422e1 nodeName:}" failed. No retries permitted until 2026-07-02 19:52:01.280071493 +0000 UTC m=+69.849675561 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/db3bd1af-2862-434d-b05b-5c05ee2422e1-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7v7pv" (UID: "db3bd1af-2862-434d-b05b-5c05ee2422e1") : secret "networking-console-plugin-cert" not found Jul 02 19:51:45.579740 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:45.579708 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" Jul 02 19:51:45.579903 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:45.579760 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" Jul 02 19:51:45.580070 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:45.580058 2560 scope.go:117] "RemoveContainer" containerID="0c198b6040dd37bdf26f7d5332776984ba05764aadf498d2fae40f9844ff7e3b" Jul 02 19:51:45.580213 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:51:45.580193 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-t5vtb_openshift-console-operator(e44c6e9d-8f1b-4e65-9b90-d89047b66f9b)\"" pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" podUID="e44c6e9d-8f1b-4e65-9b90-d89047b66f9b" Jul 02 19:51:52.135437 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:52.135411 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tkp7w" Jul 02 19:51:53.145423 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:53.145386 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77c937cf-32be-40a0-8950-c53ebd9aa22e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:53.147602 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:53.147579 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77c937cf-32be-40a0-8950-c53ebd9aa22e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzrnl\" (UID: \"77c937cf-32be-40a0-8950-c53ebd9aa22e\") " pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:53.264749 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:53.264724 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lvrrb\"" Jul 02 19:51:53.272112 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:53.272090 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hzrnl" Jul 02 19:51:53.390346 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:53.390322 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hzrnl"] Jul 02 19:51:53.392103 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:51:53.392079 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77c937cf_32be_40a0_8950_c53ebd9aa22e.slice/crio-4c4de182b4a198ed9e0426828939e0e3f072c9f24f2c7dba61b6872848ac057f WatchSource:0}: Error finding container 4c4de182b4a198ed9e0426828939e0e3f072c9f24f2c7dba61b6872848ac057f: Status 404 returned error can't find the container with id 4c4de182b4a198ed9e0426828939e0e3f072c9f24f2c7dba61b6872848ac057f Jul 02 19:51:54.277425 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:54.277382 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hzrnl" event={"ID":"77c937cf-32be-40a0-8950-c53ebd9aa22e","Type":"ContainerStarted","Data":"4c4de182b4a198ed9e0426828939e0e3f072c9f24f2c7dba61b6872848ac057f"} Jul 02 19:51:56.777488 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:56.777456 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret\") pod \"global-pull-secret-syncer-94lwh\" (UID: \"271b6a48-768b-4a1f-b7d2-3e9c120a2f55\") " pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:51:56.778011 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:56.777528 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs\") pod \"network-metrics-daemon-2vmw6\" (UID: \"fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab\") " pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:51:56.780402 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:56.780382 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 19:51:56.781392 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:56.781374 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 19:51:56.790035 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:56.790016 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/271b6a48-768b-4a1f-b7d2-3e9c120a2f55-original-pull-secret\") pod \"global-pull-secret-syncer-94lwh\" (UID: \"271b6a48-768b-4a1f-b7d2-3e9c120a2f55\") " pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:51:56.790129 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:56.790094 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab-metrics-certs\") pod \"network-metrics-daemon-2vmw6\" (UID: \"fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab\") " pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:51:56.879041 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:56.879000 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpbnp\" (UniqueName: \"kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp\") pod \"network-check-target-rm2bw\" (UID: \"20f53232-067d-4d46-a0ea-720e1e961f4b\") " pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:51:56.881582 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:56.881557 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpbnp\" (UniqueName: \"kubernetes.io/projected/20f53232-067d-4d46-a0ea-720e1e961f4b-kube-api-access-kpbnp\") pod \"network-check-target-rm2bw\" (UID: \"20f53232-067d-4d46-a0ea-720e1e961f4b\") " pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:51:56.949644 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:56.949617 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kmhzg\"" Jul 02 19:51:56.955843 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:56.955815 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-94lwh" Jul 02 19:51:56.957947 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:56.957926 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:51:56.965754 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:56.965727 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkjw9\"" Jul 02 19:51:56.973916 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:56.973896 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vmw6" Jul 02 19:51:57.132174 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.131689 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-94lwh"] Jul 02 19:51:57.183496 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.183470 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:57.183600 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.183523 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08935037-5736-4bbb-abb8-921a6b53ff92-service-ca-bundle\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:57.183600 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.183543 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/199784ce-eb7c-46c7-a787-697af804e988-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4ttbh\" (UID: \"199784ce-eb7c-46c7-a787-697af804e988\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4ttbh" Jul 02 19:51:57.183665 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.183597 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-metrics-certs\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:57.184115 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.184088 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08935037-5736-4bbb-abb8-921a6b53ff92-service-ca-bundle\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:57.185813 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.185790 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/199784ce-eb7c-46c7-a787-697af804e988-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4ttbh\" (UID: \"199784ce-eb7c-46c7-a787-697af804e988\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4ttbh" Jul 02 19:51:57.186165 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.186149 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08935037-5736-4bbb-abb8-921a6b53ff92-metrics-certs\") pod \"router-default-884f959fc-mnsl2\" (UID: \"08935037-5736-4bbb-abb8-921a6b53ff92\") " pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:57.186208 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.186194 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls\") pod \"image-registry-7c7fd89989-hcfn9\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:57.284661 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.284638 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d890bc7-0743-463a-99c8-9177ee249ef5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d9trw\" (UID: \"0d890bc7-0743-463a-99c8-9177ee249ef5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw" Jul 02 19:51:57.284755 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.284702 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49b572e5-56d7-4217-96f3-7a19dfd56cda-metrics-tls\") pod \"dns-default-sh2cz\" (UID: \"49b572e5-56d7-4217-96f3-7a19dfd56cda\") " pod="openshift-dns/dns-default-sh2cz" Jul 02 19:51:57.286717 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.286644 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d890bc7-0743-463a-99c8-9177ee249ef5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d9trw\" (UID: \"0d890bc7-0743-463a-99c8-9177ee249ef5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw" Jul 02 19:51:57.286717 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.286652 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49b572e5-56d7-4217-96f3-7a19dfd56cda-metrics-tls\") pod \"dns-default-sh2cz\" (UID: \"49b572e5-56d7-4217-96f3-7a19dfd56cda\") " pod="openshift-dns/dns-default-sh2cz" Jul 02 19:51:57.288857 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.288828 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hzrnl" event={"ID":"77c937cf-32be-40a0-8950-c53ebd9aa22e","Type":"ContainerStarted","Data":"13507e3ed99c450dddbd1d0a14a4d66a2b62880e72b8dc841dcd3a7de25592f1"} Jul 02 19:51:57.289840 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.289821 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-94lwh" event={"ID":"271b6a48-768b-4a1f-b7d2-3e9c120a2f55","Type":"ContainerStarted","Data":"bb1130337ed5c6e26d23d23517d6288c05f3c5f700a433afb8014d68c10f6204"} Jul 02 19:51:57.354850 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.354825 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rm2bw"] Jul 02 19:51:57.357074 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.357050 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2vmw6"] Jul 02 19:51:57.358461 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:51:57.358434 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20f53232_067d_4d46_a0ea_720e1e961f4b.slice/crio-5ff0d5ff4c3a5d456091a4998a4bd92c3482feac2131697777466640050d8b00 WatchSource:0}: Error finding container 5ff0d5ff4c3a5d456091a4998a4bd92c3482feac2131697777466640050d8b00: Status 404 returned error can't find the container with id 5ff0d5ff4c3a5d456091a4998a4bd92c3482feac2131697777466640050d8b00 Jul 02 19:51:57.359566 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:51:57.359540 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfddfe8b5_f0e1_4e93_9c8b_c5aee2d814ab.slice/crio-6aac36b97a1e1a2bb8718477eeffbdfe009f409d758c04f73108489d341a0cc1 WatchSource:0}: Error finding container 6aac36b97a1e1a2bb8718477eeffbdfe009f409d758c04f73108489d341a0cc1: Status 404 returned error can't find the container with id 6aac36b97a1e1a2bb8718477eeffbdfe009f409d758c04f73108489d341a0cc1 Jul 02 19:51:57.361779 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.361745 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qbvl2\"" Jul 02 19:51:57.366852 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.366836 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qnj77\"" Jul 02 19:51:57.370177 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.370161 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:57.375239 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.375221 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4ttbh" Jul 02 19:51:57.408747 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.408548 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fgzwn\"" Jul 02 19:51:57.416580 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.416558 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:57.447460 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.447432 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kc4n8\"" Jul 02 19:51:57.455739 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.455501 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw" Jul 02 19:51:57.474731 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.474574 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-67xbm\"" Jul 02 19:51:57.481843 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.481814 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sh2cz" Jul 02 19:51:57.515347 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.512760 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c7fd89989-hcfn9"] Jul 02 19:51:57.534280 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.533933 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4ttbh"] Jul 02 19:51:57.575919 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.575536 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-884f959fc-mnsl2"] Jul 02 19:51:57.579905 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:51:57.579867 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08935037_5736_4bbb_abb8_921a6b53ff92.slice/crio-392307eef32a90a4f526bcb89c2e7437e0f87880f94145d9925848033457e21f WatchSource:0}: Error finding container 392307eef32a90a4f526bcb89c2e7437e0f87880f94145d9925848033457e21f: Status 404 returned error can't find the container with id 392307eef32a90a4f526bcb89c2e7437e0f87880f94145d9925848033457e21f Jul 02 19:51:57.617636 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.617606 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw"] Jul 02 19:51:57.645873 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:57.645848 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sh2cz"] Jul 02 19:51:57.653712 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:51:57.653680 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b572e5_56d7_4217_96f3_7a19dfd56cda.slice/crio-641c6cfe6938143110a10ddd133567376898a2676d2b52a83c7c5318a451e040 WatchSource:0}: Error finding container 641c6cfe6938143110a10ddd133567376898a2676d2b52a83c7c5318a451e040: Status 404 returned error can't find the container with id 641c6cfe6938143110a10ddd133567376898a2676d2b52a83c7c5318a451e040 Jul 02 19:51:58.296616 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:58.296580 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hzrnl" event={"ID":"77c937cf-32be-40a0-8950-c53ebd9aa22e","Type":"ContainerStarted","Data":"dec5566dd0fb05ede8816379aee6adc1ed7bfdc6b254f41b7d4c28730196e14b"} Jul 02 19:51:58.298020 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:58.297982 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2vmw6" event={"ID":"fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab","Type":"ContainerStarted","Data":"6aac36b97a1e1a2bb8718477eeffbdfe009f409d758c04f73108489d341a0cc1"} Jul 02 19:51:58.299320 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:58.299240 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sh2cz" event={"ID":"49b572e5-56d7-4217-96f3-7a19dfd56cda","Type":"ContainerStarted","Data":"641c6cfe6938143110a10ddd133567376898a2676d2b52a83c7c5318a451e040"} Jul 02 19:51:58.300589 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:58.300561 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw" event={"ID":"0d890bc7-0743-463a-99c8-9177ee249ef5","Type":"ContainerStarted","Data":"1f176d33cbb1e4fe97b44e94a5a1791568b5c5b365e2bfc86523f4e0d5cb874b"} Jul 02 19:51:58.302115 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:58.302087 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rm2bw" event={"ID":"20f53232-067d-4d46-a0ea-720e1e961f4b","Type":"ContainerStarted","Data":"b265aaca00680f17b07913f85a5755b48353a15ce09ddd6d44ff6d0c142ace00"} Jul 02 19:51:58.302268 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:58.302137 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rm2bw" event={"ID":"20f53232-067d-4d46-a0ea-720e1e961f4b","Type":"ContainerStarted","Data":"5ff0d5ff4c3a5d456091a4998a4bd92c3482feac2131697777466640050d8b00"} Jul 02 19:51:58.302268 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:58.302186 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:51:58.304041 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:58.304007 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-884f959fc-mnsl2" event={"ID":"08935037-5736-4bbb-abb8-921a6b53ff92","Type":"ContainerStarted","Data":"cce9b38e3684e8e2ed795cfeb27fc9015d68412ebf49d30eabaca4b5287cd9a6"} Jul 02 19:51:58.304158 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:58.304060 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-884f959fc-mnsl2" event={"ID":"08935037-5736-4bbb-abb8-921a6b53ff92","Type":"ContainerStarted","Data":"392307eef32a90a4f526bcb89c2e7437e0f87880f94145d9925848033457e21f"} Jul 02 19:51:58.305297 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:58.305270 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4ttbh" event={"ID":"199784ce-eb7c-46c7-a787-697af804e988","Type":"ContainerStarted","Data":"359340c7765efa59dc8df8f99f54d268fd835e62f43a01845b0ae075decd9bc9"} Jul 02 19:51:58.306675 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:58.306655 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" event={"ID":"e7a6675d-7af2-4695-ba8a-f6b7985a5521","Type":"ContainerStarted","Data":"f99e66c04eec5c02217a8fc469be99cd696aaa9e8b10eeb155da044bc81a6821"} Jul 02 19:51:58.306770 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:58.306686 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" event={"ID":"e7a6675d-7af2-4695-ba8a-f6b7985a5521","Type":"ContainerStarted","Data":"28d97df993c1768e9f9d5b2a99855a61a7a4bac5b1f4429976988298f9790db9"} Jul 02 19:51:58.306829 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:58.306784 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:51:58.317614 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:58.317152 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rm2bw" podStartSLOduration=66.317136091 podStartE2EDuration="1m6.317136091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:50:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:58.316693042 +0000 UTC m=+66.886297114" watchObservedRunningTime="2026-07-02 19:51:58.317136091 +0000 UTC m=+66.886740163" Jul 02 19:51:58.337923 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:58.337525 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-884f959fc-mnsl2" podStartSLOduration=64.337507267 podStartE2EDuration="1m4.337507267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:50:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:58.335921015 +0000 UTC m=+66.905525087" watchObservedRunningTime="2026-07-02 19:51:58.337507267 +0000 UTC m=+66.907111317" Jul 02 19:51:58.357264 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:58.356507 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" podStartSLOduration=66.356494797 podStartE2EDuration="1m6.356494797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:50:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:58.355712968 +0000 UTC m=+66.925317041" watchObservedRunningTime="2026-07-02 19:51:58.356494797 +0000 UTC m=+66.926098867" Jul 02 19:51:58.417407 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:58.417370 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:58.420983 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:58.420465 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:58.927730 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:58.927707 2560 scope.go:117] "RemoveContainer" containerID="0c198b6040dd37bdf26f7d5332776984ba05764aadf498d2fae40f9844ff7e3b" Jul 02 19:51:59.317202 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:59.316418 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2vmw6" event={"ID":"fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab","Type":"ContainerStarted","Data":"3fe1c001dd25c396d7e74d9826989dcb4558bf409d6daccedf5ac4950cfc9ff6"} Jul 02 19:51:59.317202 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:59.316483 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2vmw6" event={"ID":"fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab","Type":"ContainerStarted","Data":"4d3003f00e0813e033484b3316039068ccc65f8d0f32dbcd4b4b153ea5a0c56f"} Jul 02 19:51:59.321284 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:59.320377 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/1.log" Jul 02 19:51:59.321284 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:59.320607 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" event={"ID":"e44c6e9d-8f1b-4e65-9b90-d89047b66f9b","Type":"ContainerStarted","Data":"b80f47053a583cd0ad99f326b1fff625aea20383ec31ddce5b75ed75042458c1"} Jul 02 19:51:59.321284 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:59.321158 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:59.321284 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:59.321194 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" Jul 02 19:51:59.322468 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:59.322448 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-884f959fc-mnsl2" Jul 02 19:51:59.358351 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:59.358303 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2vmw6" podStartSLOduration=65.799932341 podStartE2EDuration="1m7.358285907s" totalImagesPullingTime="1.558353566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:59.337616629 +0000 UTC m=+67.907220700" watchObservedRunningTime="2026-07-02 19:51:59.358285907 +0000 UTC m=+67.927889978" Jul 02 19:51:59.388227 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:59.388181 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" podStartSLOduration=55.425628442 podStartE2EDuration="1m5.388070213s" totalImagesPullingTime="9.962441771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:59.359389084 +0000 UTC m=+67.928993170" watchObservedRunningTime="2026-07-02 19:51:59.388070213 +0000 UTC m=+67.957674285" Jul 02 19:51:59.803822 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:51:59.803678 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-t5vtb" Jul 02 19:52:01.320139 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:01.320097 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db3bd1af-2862-434d-b05b-5c05ee2422e1-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7v7pv\" (UID: \"db3bd1af-2862-434d-b05b-5c05ee2422e1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7v7pv" Jul 02 19:52:01.322853 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:01.322829 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db3bd1af-2862-434d-b05b-5c05ee2422e1-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7v7pv\" (UID: \"db3bd1af-2862-434d-b05b-5c05ee2422e1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7v7pv" Jul 02 19:52:01.558294 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:01.558261 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-l5xpw\"" Jul 02 19:52:01.565745 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:01.565464 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7v7pv" Jul 02 19:52:03.725234 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:03.725210 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-7v7pv"] Jul 02 19:52:03.729283 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:52:03.729213 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb3bd1af_2862_434d_b05b_5c05ee2422e1.slice/crio-3953a8f1da46a23f0930227c60958a8b3545edb2e654c8fce9e64df0edcc2194 WatchSource:0}: Error finding container 3953a8f1da46a23f0930227c60958a8b3545edb2e654c8fce9e64df0edcc2194: Status 404 returned error can't find the container with id 3953a8f1da46a23f0930227c60958a8b3545edb2e654c8fce9e64df0edcc2194 Jul 02 19:52:04.341838 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:04.341807 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7v7pv" event={"ID":"db3bd1af-2862-434d-b05b-5c05ee2422e1","Type":"ContainerStarted","Data":"3953a8f1da46a23f0930227c60958a8b3545edb2e654c8fce9e64df0edcc2194"} Jul 02 19:52:04.343132 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:04.343107 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-94lwh" event={"ID":"271b6a48-768b-4a1f-b7d2-3e9c120a2f55","Type":"ContainerStarted","Data":"d81cb39f57faba2269b6414e1df43c94915140f805d2d0aeb4b20e8ebb1d34b1"} Jul 02 19:52:04.344780 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:04.344757 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4ttbh" event={"ID":"199784ce-eb7c-46c7-a787-697af804e988","Type":"ContainerStarted","Data":"46d3d5f2d61c5961bffa07876acceb28805734c9def8f4e22a992ee7df9945d8"} Jul 02 19:52:04.344881 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:04.344800 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4ttbh" event={"ID":"199784ce-eb7c-46c7-a787-697af804e988","Type":"ContainerStarted","Data":"186ede12418e72d07d66162a8dd03bf1993bc1a2d60e0f23ac9bfbc4a2ee46c7"} Jul 02 19:52:04.346579 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:04.346559 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hzrnl" event={"ID":"77c937cf-32be-40a0-8950-c53ebd9aa22e","Type":"ContainerStarted","Data":"9d47da6b1c89ec743a105233201bc65e209a4e8476c44fb43ccb17c3b2d6588a"} Jul 02 19:52:04.348213 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:04.348193 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sh2cz" event={"ID":"49b572e5-56d7-4217-96f3-7a19dfd56cda","Type":"ContainerStarted","Data":"0f51b41050a6444727f55a2f63fc536c81328e5e9b26652003c09a3918a57727"} Jul 02 19:52:04.348317 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:04.348234 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sh2cz" Jul 02 19:52:04.348317 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:04.348262 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sh2cz" event={"ID":"49b572e5-56d7-4217-96f3-7a19dfd56cda","Type":"ContainerStarted","Data":"533410291d30bd53c474df09aec4e02b5fc7a83e5db72024b82c9c30866d9a56"} Jul 02 19:52:04.349567 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:04.349548 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw" event={"ID":"0d890bc7-0743-463a-99c8-9177ee249ef5","Type":"ContainerStarted","Data":"ceb8a5a91d39b2c8adee73a9bb4381d2b20291847fe75c4b575d1f100a4f9a95"} Jul 02 19:52:04.372238 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:04.372195 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-94lwh" podStartSLOduration=65.865475658 podStartE2EDuration="1m12.372183151s" totalImagesPullingTime="6.506707493s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:04.37097535 +0000 UTC m=+72.940579419" watchObservedRunningTime="2026-07-02 19:52:04.372183151 +0000 UTC m=+72.941787221" Jul 02 19:52:04.404661 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:04.404625 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9trw" podStartSLOduration=64.4563343 podStartE2EDuration="1m10.404614908s" totalImagesPullingTime="5.948280608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:04.403672705 +0000 UTC m=+72.973276766" watchObservedRunningTime="2026-07-02 19:52:04.404614908 +0000 UTC m=+72.974219030" Jul 02 19:52:04.436852 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:04.436806 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hzrnl" podStartSLOduration=17.398936356 podStartE2EDuration="27.436792148s" totalImagesPullingTime="10.037855792s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:51:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:04.436707305 +0000 UTC m=+73.006311376" watchObservedRunningTime="2026-07-02 19:52:04.436792148 +0000 UTC m=+73.006396220" Jul 02 19:52:04.478967 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:04.478926 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sh2cz" podStartSLOduration=33.564708123 podStartE2EDuration="39.478911095s" totalImagesPullingTime="5.914202972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:04.46156888 +0000 UTC m=+73.031172960" watchObservedRunningTime="2026-07-02 19:52:04.478911095 +0000 UTC m=+73.048515166" Jul 02 19:52:04.479711 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:04.479670 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4ttbh" podStartSLOduration=64.497835754 podStartE2EDuration="1m10.479661902s" totalImagesPullingTime="5.981826148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:04.478711803 +0000 UTC m=+73.048315875" watchObservedRunningTime="2026-07-02 19:52:04.479661902 +0000 UTC m=+73.049265975" Jul 02 19:52:06.361089 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:06.361055 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7v7pv" event={"ID":"db3bd1af-2862-434d-b05b-5c05ee2422e1","Type":"ContainerStarted","Data":"41f587cf12c575afb167342f62d4a15c4462de7cebd6025c8893f135ca0c73e8"} Jul 02 19:52:06.378568 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:06.378525 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7v7pv" podStartSLOduration=35.593402465 podStartE2EDuration="37.378510235s" totalImagesPullingTime="1.78510777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:06.377751869 +0000 UTC m=+74.947355939" watchObservedRunningTime="2026-07-02 19:52:06.378510235 +0000 UTC m=+74.948114304" Jul 02 19:52:14.359008 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:14.358980 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sh2cz" Jul 02 19:52:16.685407 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.685375 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b66b457dd-cmlcr"] Jul 02 19:52:16.687498 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.687482 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:16.691361 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.691328 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 19:52:16.691361 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.691351 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-47pv8\"" Jul 02 19:52:16.691554 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.691382 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 19:52:16.691685 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.691664 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 19:52:16.691748 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.691671 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 19:52:16.691748 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.691744 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 19:52:16.691824 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.691750 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 19:52:16.691996 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.691955 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 19:52:16.695956 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.695938 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 02 19:52:16.698361 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.698338 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b66b457dd-cmlcr"] Jul 02 19:52:16.837520 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.837491 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-trusted-ca-bundle\") pod \"console-6b66b457dd-cmlcr\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:16.837658 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.837524 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3907f206-ce81-4b93-b235-4a7b4c2194f4-console-oauth-config\") pod \"console-6b66b457dd-cmlcr\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:16.837658 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.837542 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-oauth-serving-cert\") pod \"console-6b66b457dd-cmlcr\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:16.837658 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.837560 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vxw9\" (UniqueName: \"kubernetes.io/projected/3907f206-ce81-4b93-b235-4a7b4c2194f4-kube-api-access-8vxw9\") pod \"console-6b66b457dd-cmlcr\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:16.837658 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.837621 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3907f206-ce81-4b93-b235-4a7b4c2194f4-console-serving-cert\") pod \"console-6b66b457dd-cmlcr\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:16.837658 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.837647 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-service-ca\") pod \"console-6b66b457dd-cmlcr\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:16.837807 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.837667 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-console-config\") pod \"console-6b66b457dd-cmlcr\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:16.938316 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.938261 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3907f206-ce81-4b93-b235-4a7b4c2194f4-console-serving-cert\") pod \"console-6b66b457dd-cmlcr\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:16.938316 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.938304 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-service-ca\") pod \"console-6b66b457dd-cmlcr\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:16.938483 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.938324 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-console-config\") pod \"console-6b66b457dd-cmlcr\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:16.938483 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.938350 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-trusted-ca-bundle\") pod \"console-6b66b457dd-cmlcr\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:16.938483 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.938371 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3907f206-ce81-4b93-b235-4a7b4c2194f4-console-oauth-config\") pod \"console-6b66b457dd-cmlcr\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:16.938483 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.938391 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-oauth-serving-cert\") pod \"console-6b66b457dd-cmlcr\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:16.938483 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.938409 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vxw9\" (UniqueName: \"kubernetes.io/projected/3907f206-ce81-4b93-b235-4a7b4c2194f4-kube-api-access-8vxw9\") pod \"console-6b66b457dd-cmlcr\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:16.939065 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.939037 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-service-ca\") pod \"console-6b66b457dd-cmlcr\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:16.939158 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.939104 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-console-config\") pod \"console-6b66b457dd-cmlcr\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:16.939158 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.939146 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-oauth-serving-cert\") pod \"console-6b66b457dd-cmlcr\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:16.939270 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.939168 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-trusted-ca-bundle\") pod \"console-6b66b457dd-cmlcr\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:16.940682 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.940655 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3907f206-ce81-4b93-b235-4a7b4c2194f4-console-oauth-config\") pod \"console-6b66b457dd-cmlcr\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:16.940797 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.940778 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3907f206-ce81-4b93-b235-4a7b4c2194f4-console-serving-cert\") pod \"console-6b66b457dd-cmlcr\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:16.947435 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.947416 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vxw9\" (UniqueName: \"kubernetes.io/projected/3907f206-ce81-4b93-b235-4a7b4c2194f4-kube-api-access-8vxw9\") pod \"console-6b66b457dd-cmlcr\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:16.996054 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:16.996034 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:17.121103 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:17.121078 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b66b457dd-cmlcr"] Jul 02 19:52:17.123396 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:52:17.123369 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3907f206_ce81_4b93_b235_4a7b4c2194f4.slice/crio-e0943cc64ab2fad1374766e1868b601c02600ed448a9366ce4586969467dd1e3 WatchSource:0}: Error finding container e0943cc64ab2fad1374766e1868b601c02600ed448a9366ce4586969467dd1e3: Status 404 returned error can't find the container with id e0943cc64ab2fad1374766e1868b601c02600ed448a9366ce4586969467dd1e3 Jul 02 19:52:17.400712 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:17.400685 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b66b457dd-cmlcr" event={"ID":"3907f206-ce81-4b93-b235-4a7b4c2194f4","Type":"ContainerStarted","Data":"e0943cc64ab2fad1374766e1868b601c02600ed448a9366ce4586969467dd1e3"} Jul 02 19:52:19.327389 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:19.327356 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:52:20.418428 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:20.418392 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b66b457dd-cmlcr" event={"ID":"3907f206-ce81-4b93-b235-4a7b4c2194f4","Type":"ContainerStarted","Data":"38548e2a9b0d2da4294b751950100d2086b8d1ea5cbd0687d2c61618db0d581e"} Jul 02 19:52:20.436527 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:20.436484 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b66b457dd-cmlcr" podStartSLOduration=1.845115979 podStartE2EDuration="4.436472258s" totalImagesPullingTime="2.591356279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:52:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:20.435535283 +0000 UTC m=+89.005139353" watchObservedRunningTime="2026-07-02 19:52:20.436472258 +0000 UTC m=+89.006076326" Jul 02 19:52:24.712013 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:24.711986 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c7fd89989-hcfn9"] Jul 02 19:52:26.601048 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.601014 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69"] Jul 02 19:52:26.603938 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.603923 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" Jul 02 19:52:26.608273 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.608235 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-fftz2\"" Jul 02 19:52:26.608273 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.608259 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 02 19:52:26.608457 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.608321 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 19:52:26.608457 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.608338 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 02 19:52:26.608457 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.608321 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 02 19:52:26.617554 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.617521 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5mcb\" (UniqueName: \"kubernetes.io/projected/ef278fe8-7df7-4185-b9f2-4822ee252384-kube-api-access-v5mcb\") pod \"kube-state-metrics-7c9dbb8b7d-fxj69\" (UID: \"ef278fe8-7df7-4185-b9f2-4822ee252384\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" Jul 02 19:52:26.617658 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.617559 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ef278fe8-7df7-4185-b9f2-4822ee252384-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-fxj69\" (UID: \"ef278fe8-7df7-4185-b9f2-4822ee252384\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" Jul 02 19:52:26.617658 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.617615 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef278fe8-7df7-4185-b9f2-4822ee252384-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-fxj69\" (UID: \"ef278fe8-7df7-4185-b9f2-4822ee252384\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" Jul 02 19:52:26.617774 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.617720 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef278fe8-7df7-4185-b9f2-4822ee252384-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-fxj69\" (UID: \"ef278fe8-7df7-4185-b9f2-4822ee252384\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" Jul 02 19:52:26.617774 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.617764 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ef278fe8-7df7-4185-b9f2-4822ee252384-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-fxj69\" (UID: \"ef278fe8-7df7-4185-b9f2-4822ee252384\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" Jul 02 19:52:26.617871 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.617803 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef278fe8-7df7-4185-b9f2-4822ee252384-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-fxj69\" (UID: \"ef278fe8-7df7-4185-b9f2-4822ee252384\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" Jul 02 19:52:26.627883 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.627862 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69"] Jul 02 19:52:26.648069 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.648047 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zk8jp"] Jul 02 19:52:26.650281 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.650267 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.653380 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.653357 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 19:52:26.653380 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.653367 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 19:52:26.653522 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.653360 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2q68n\"" Jul 02 19:52:26.653522 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.653362 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 19:52:26.718781 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.718756 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef278fe8-7df7-4185-b9f2-4822ee252384-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-fxj69\" (UID: \"ef278fe8-7df7-4185-b9f2-4822ee252384\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" Jul 02 19:52:26.718902 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.718789 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9855d8c0-ceb6-4488-9504-25be48d6ca4f-node-exporter-textfile\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.718902 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.718808 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9855d8c0-ceb6-4488-9504-25be48d6ca4f-node-exporter-wtmp\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.719016 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.718909 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9855d8c0-ceb6-4488-9504-25be48d6ca4f-sys\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.719016 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.718928 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9855d8c0-ceb6-4488-9504-25be48d6ca4f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.719016 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.718956 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef278fe8-7df7-4185-b9f2-4822ee252384-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-fxj69\" (UID: \"ef278fe8-7df7-4185-b9f2-4822ee252384\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" Jul 02 19:52:26.719016 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.718976 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9855d8c0-ceb6-4488-9504-25be48d6ca4f-node-exporter-accelerators-collector-config\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.719016 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.718993 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbwhn\" (UniqueName: \"kubernetes.io/projected/9855d8c0-ceb6-4488-9504-25be48d6ca4f-kube-api-access-gbwhn\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.719289 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.719044 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ef278fe8-7df7-4185-b9f2-4822ee252384-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-fxj69\" (UID: \"ef278fe8-7df7-4185-b9f2-4822ee252384\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" Jul 02 19:52:26.719289 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.719088 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9855d8c0-ceb6-4488-9504-25be48d6ca4f-node-exporter-tls\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.719289 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.719111 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef278fe8-7df7-4185-b9f2-4822ee252384-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-fxj69\" (UID: \"ef278fe8-7df7-4185-b9f2-4822ee252384\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" Jul 02 19:52:26.719289 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:52:26.719222 2560 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 02 19:52:26.719289 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.719225 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9855d8c0-ceb6-4488-9504-25be48d6ca4f-root\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.719289 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.719268 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9855d8c0-ceb6-4488-9504-25be48d6ca4f-metrics-client-ca\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.719593 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:52:26.719305 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef278fe8-7df7-4185-b9f2-4822ee252384-kube-state-metrics-tls podName:ef278fe8-7df7-4185-b9f2-4822ee252384 nodeName:}" failed. No retries permitted until 2026-07-02 19:52:27.21928487 +0000 UTC m=+95.788888956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ef278fe8-7df7-4185-b9f2-4822ee252384-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-fxj69" (UID: "ef278fe8-7df7-4185-b9f2-4822ee252384") : secret "kube-state-metrics-tls" not found Jul 02 19:52:26.719593 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.719407 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5mcb\" (UniqueName: \"kubernetes.io/projected/ef278fe8-7df7-4185-b9f2-4822ee252384-kube-api-access-v5mcb\") pod \"kube-state-metrics-7c9dbb8b7d-fxj69\" (UID: \"ef278fe8-7df7-4185-b9f2-4822ee252384\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" Jul 02 19:52:26.719593 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.719434 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ef278fe8-7df7-4185-b9f2-4822ee252384-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-fxj69\" (UID: \"ef278fe8-7df7-4185-b9f2-4822ee252384\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" Jul 02 19:52:26.719593 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.719455 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ef278fe8-7df7-4185-b9f2-4822ee252384-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-fxj69\" (UID: \"ef278fe8-7df7-4185-b9f2-4822ee252384\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" Jul 02 19:52:26.719755 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.719648 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef278fe8-7df7-4185-b9f2-4822ee252384-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-fxj69\" (UID: \"ef278fe8-7df7-4185-b9f2-4822ee252384\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" Jul 02 19:52:26.719949 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.719931 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ef278fe8-7df7-4185-b9f2-4822ee252384-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-fxj69\" (UID: \"ef278fe8-7df7-4185-b9f2-4822ee252384\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" Jul 02 19:52:26.721345 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.721325 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef278fe8-7df7-4185-b9f2-4822ee252384-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-fxj69\" (UID: \"ef278fe8-7df7-4185-b9f2-4822ee252384\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" Jul 02 19:52:26.729536 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.729508 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5mcb\" (UniqueName: \"kubernetes.io/projected/ef278fe8-7df7-4185-b9f2-4822ee252384-kube-api-access-v5mcb\") pod \"kube-state-metrics-7c9dbb8b7d-fxj69\" (UID: \"ef278fe8-7df7-4185-b9f2-4822ee252384\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" Jul 02 19:52:26.820702 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.820668 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9855d8c0-ceb6-4488-9504-25be48d6ca4f-node-exporter-textfile\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.820702 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.820703 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9855d8c0-ceb6-4488-9504-25be48d6ca4f-node-exporter-wtmp\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.820923 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.820729 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9855d8c0-ceb6-4488-9504-25be48d6ca4f-sys\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.820923 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.820787 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9855d8c0-ceb6-4488-9504-25be48d6ca4f-sys\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.820923 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.820819 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9855d8c0-ceb6-4488-9504-25be48d6ca4f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.820923 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.820855 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9855d8c0-ceb6-4488-9504-25be48d6ca4f-node-exporter-wtmp\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.820923 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.820902 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9855d8c0-ceb6-4488-9504-25be48d6ca4f-node-exporter-accelerators-collector-config\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.821164 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.820934 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbwhn\" (UniqueName: \"kubernetes.io/projected/9855d8c0-ceb6-4488-9504-25be48d6ca4f-kube-api-access-gbwhn\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.821164 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.820987 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9855d8c0-ceb6-4488-9504-25be48d6ca4f-node-exporter-tls\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.821164 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.821022 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9855d8c0-ceb6-4488-9504-25be48d6ca4f-node-exporter-textfile\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.821164 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.821030 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9855d8c0-ceb6-4488-9504-25be48d6ca4f-root\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.821164 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.821053 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9855d8c0-ceb6-4488-9504-25be48d6ca4f-metrics-client-ca\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.821164 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.821096 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9855d8c0-ceb6-4488-9504-25be48d6ca4f-root\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.821575 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.821552 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9855d8c0-ceb6-4488-9504-25be48d6ca4f-node-exporter-accelerators-collector-config\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.821650 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.821634 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9855d8c0-ceb6-4488-9504-25be48d6ca4f-metrics-client-ca\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.823270 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.823234 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9855d8c0-ceb6-4488-9504-25be48d6ca4f-node-exporter-tls\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.823309 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.823232 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9855d8c0-ceb6-4488-9504-25be48d6ca4f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.831436 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.831417 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbwhn\" (UniqueName: \"kubernetes.io/projected/9855d8c0-ceb6-4488-9504-25be48d6ca4f-kube-api-access-gbwhn\") pod \"node-exporter-zk8jp\" (UID: \"9855d8c0-ceb6-4488-9504-25be48d6ca4f\") " pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.959526 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.959507 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zk8jp" Jul 02 19:52:26.969460 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:52:26.969439 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9855d8c0_ceb6_4488_9504_25be48d6ca4f.slice/crio-c6941d3131e7fea97236e8151c1c067c2d812ee2f3647e5d306d7a9aefae019a WatchSource:0}: Error finding container c6941d3131e7fea97236e8151c1c067c2d812ee2f3647e5d306d7a9aefae019a: Status 404 returned error can't find the container with id c6941d3131e7fea97236e8151c1c067c2d812ee2f3647e5d306d7a9aefae019a Jul 02 19:52:26.996423 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.996400 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:26.996503 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:26.996461 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:27.001076 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:27.001060 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:27.224355 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:27.224276 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef278fe8-7df7-4185-b9f2-4822ee252384-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-fxj69\" (UID: \"ef278fe8-7df7-4185-b9f2-4822ee252384\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" Jul 02 19:52:27.226562 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:27.226539 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef278fe8-7df7-4185-b9f2-4822ee252384-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-fxj69\" (UID: \"ef278fe8-7df7-4185-b9f2-4822ee252384\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" Jul 02 19:52:27.443013 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:27.442981 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zk8jp" event={"ID":"9855d8c0-ceb6-4488-9504-25be48d6ca4f","Type":"ContainerStarted","Data":"c6941d3131e7fea97236e8151c1c067c2d812ee2f3647e5d306d7a9aefae019a"} Jul 02 19:52:27.446936 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:27.446910 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:52:27.513356 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:27.513287 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" Jul 02 19:52:27.674025 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:27.673862 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69"] Jul 02 19:52:27.676693 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:52:27.676667 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef278fe8_7df7_4185_b9f2_4822ee252384.slice/crio-c5fa23aba58abd12126dc61dcf4e941b0ed9f8db3fe6f6bf005af23f7f175abf WatchSource:0}: Error finding container c5fa23aba58abd12126dc61dcf4e941b0ed9f8db3fe6f6bf005af23f7f175abf: Status 404 returned error can't find the container with id c5fa23aba58abd12126dc61dcf4e941b0ed9f8db3fe6f6bf005af23f7f175abf Jul 02 19:52:28.448543 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:28.448457 2560 generic.go:356] "Generic (PLEG): container finished" podID="9855d8c0-ceb6-4488-9504-25be48d6ca4f" containerID="a8a2bc2e8dbaf21e2fd91d2993dfe72bac2ac3d2bec41b949c620814979cde53" exitCode=0 Jul 02 19:52:28.448703 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:28.448563 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zk8jp" event={"ID":"9855d8c0-ceb6-4488-9504-25be48d6ca4f","Type":"ContainerDied","Data":"a8a2bc2e8dbaf21e2fd91d2993dfe72bac2ac3d2bec41b949c620814979cde53"} Jul 02 19:52:28.450037 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:28.450014 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" event={"ID":"ef278fe8-7df7-4185-b9f2-4822ee252384","Type":"ContainerStarted","Data":"c5fa23aba58abd12126dc61dcf4e941b0ed9f8db3fe6f6bf005af23f7f175abf"} Jul 02 19:52:29.324589 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:29.324554 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rm2bw" Jul 02 19:52:29.455578 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:29.455546 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zk8jp" event={"ID":"9855d8c0-ceb6-4488-9504-25be48d6ca4f","Type":"ContainerStarted","Data":"4387800c5bc1df3c30792ab8551c8f00d530a7663afb6a01f6b9c1c0f27e8ddb"} Jul 02 19:52:29.455717 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:29.455596 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zk8jp" event={"ID":"9855d8c0-ceb6-4488-9504-25be48d6ca4f","Type":"ContainerStarted","Data":"3eb6cd58359a5e94383cb5f8d09bfdb5f4ddc4386ac5ddb1734bb4d038a68a35"} Jul 02 19:52:29.474847 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:29.474801 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zk8jp" podStartSLOduration=2.328786806 podStartE2EDuration="3.47478909s" totalImagesPullingTime="1.08187881s" totalInitContainerRuntime="64.123474ms" isStatefulPod=true podCreationTimestamp="2026-07-02 19:52:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:29.473594426 +0000 UTC m=+98.043198491" watchObservedRunningTime="2026-07-02 19:52:29.47478909 +0000 UTC m=+98.044393161" Jul 02 19:52:30.461972 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:30.461935 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" event={"ID":"ef278fe8-7df7-4185-b9f2-4822ee252384","Type":"ContainerStarted","Data":"d4bbaf4cce529d1390b86d6dc96a223afa8bd55e8b0febca926746031d25b293"} Jul 02 19:52:30.462416 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:30.461993 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" event={"ID":"ef278fe8-7df7-4185-b9f2-4822ee252384","Type":"ContainerStarted","Data":"50693afad7c21967bc8e3b2239d90e3e8cd6c131fe5a00be9e1dc9177bdf4474"} Jul 02 19:52:30.462416 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:30.462017 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" event={"ID":"ef278fe8-7df7-4185-b9f2-4822ee252384","Type":"ContainerStarted","Data":"7640791588bf89f48c7a7adf1dc6d286c5213795bf4c6a3dd9e773c675b454a7"} Jul 02 19:52:30.483197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:30.483151 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fxj69" podStartSLOduration=2.668781057 podStartE2EDuration="4.483135616s" totalImagesPullingTime="1.814354559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:52:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:30.481969739 +0000 UTC m=+99.051573832" watchObservedRunningTime="2026-07-02 19:52:30.483135616 +0000 UTC m=+99.052739736" Jul 02 19:52:42.970046 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:42.970013 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b66b457dd-cmlcr"] Jul 02 19:52:49.735643 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:49.735590 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" podUID="e7a6675d-7af2-4695-ba8a-f6b7985a5521" containerName="registry" containerID="cri-o://f99e66c04eec5c02217a8fc469be99cd696aaa9e8b10eeb155da044bc81a6821" gracePeriod=30 Jul 02 19:52:49.974803 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:49.974777 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:52:50.123972 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.123881 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-certificates\") pod \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " Jul 02 19:52:50.123972 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.123921 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7a6675d-7af2-4695-ba8a-f6b7985a5521-trusted-ca\") pod \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " Jul 02 19:52:50.123972 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.123941 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-bound-sa-token\") pod \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " Jul 02 19:52:50.123972 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.123966 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7a6675d-7af2-4695-ba8a-f6b7985a5521-image-registry-private-configuration\") pod \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " Jul 02 19:52:50.124336 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.124005 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7a6675d-7af2-4695-ba8a-f6b7985a5521-ca-trust-extracted\") pod \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " Jul 02 19:52:50.124336 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.124045 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls\") pod \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " Jul 02 19:52:50.124336 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.124107 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7a6675d-7af2-4695-ba8a-f6b7985a5521-installation-pull-secrets\") pod \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " Jul 02 19:52:50.124336 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.124137 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96jt4\" (UniqueName: \"kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-kube-api-access-96jt4\") pod \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\" (UID: \"e7a6675d-7af2-4695-ba8a-f6b7985a5521\") " Jul 02 19:52:50.124545 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.124404 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7a6675d-7af2-4695-ba8a-f6b7985a5521-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e7a6675d-7af2-4695-ba8a-f6b7985a5521" (UID: "e7a6675d-7af2-4695-ba8a-f6b7985a5521"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:52:50.124648 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.124615 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e7a6675d-7af2-4695-ba8a-f6b7985a5521" (UID: "e7a6675d-7af2-4695-ba8a-f6b7985a5521"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:52:50.126590 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.126555 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7a6675d-7af2-4695-ba8a-f6b7985a5521-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e7a6675d-7af2-4695-ba8a-f6b7985a5521" (UID: "e7a6675d-7af2-4695-ba8a-f6b7985a5521"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:52:50.126590 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.126579 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e7a6675d-7af2-4695-ba8a-f6b7985a5521" (UID: "e7a6675d-7af2-4695-ba8a-f6b7985a5521"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:52:50.126788 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.126734 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e7a6675d-7af2-4695-ba8a-f6b7985a5521" (UID: "e7a6675d-7af2-4695-ba8a-f6b7985a5521"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:52:50.126847 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.126821 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7a6675d-7af2-4695-ba8a-f6b7985a5521-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e7a6675d-7af2-4695-ba8a-f6b7985a5521" (UID: "e7a6675d-7af2-4695-ba8a-f6b7985a5521"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:52:50.126907 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.126889 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-kube-api-access-96jt4" (OuterVolumeSpecName: "kube-api-access-96jt4") pod "e7a6675d-7af2-4695-ba8a-f6b7985a5521" (UID: "e7a6675d-7af2-4695-ba8a-f6b7985a5521"). InnerVolumeSpecName "kube-api-access-96jt4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:52:50.132831 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.132805 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7a6675d-7af2-4695-ba8a-f6b7985a5521-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e7a6675d-7af2-4695-ba8a-f6b7985a5521" (UID: "e7a6675d-7af2-4695-ba8a-f6b7985a5521"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:52:50.225112 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.225077 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-certificates\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:52:50.225112 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.225108 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7a6675d-7af2-4695-ba8a-f6b7985a5521-trusted-ca\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:52:50.225112 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.225118 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-bound-sa-token\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:52:50.225358 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.225127 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7a6675d-7af2-4695-ba8a-f6b7985a5521-image-registry-private-configuration\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:52:50.225358 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.225137 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7a6675d-7af2-4695-ba8a-f6b7985a5521-ca-trust-extracted\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:52:50.225358 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.225145 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-registry-tls\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:52:50.225358 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.225153 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7a6675d-7af2-4695-ba8a-f6b7985a5521-installation-pull-secrets\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:52:50.225358 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.225160 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96jt4\" (UniqueName: \"kubernetes.io/projected/e7a6675d-7af2-4695-ba8a-f6b7985a5521-kube-api-access-96jt4\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:52:50.535819 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.535780 2560 generic.go:356] "Generic (PLEG): container finished" podID="e7a6675d-7af2-4695-ba8a-f6b7985a5521" containerID="f99e66c04eec5c02217a8fc469be99cd696aaa9e8b10eeb155da044bc81a6821" exitCode=0 Jul 02 19:52:50.535819 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.535819 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" event={"ID":"e7a6675d-7af2-4695-ba8a-f6b7985a5521","Type":"ContainerDied","Data":"f99e66c04eec5c02217a8fc469be99cd696aaa9e8b10eeb155da044bc81a6821"} Jul 02 19:52:50.536065 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.535833 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" Jul 02 19:52:50.536065 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.535854 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c7fd89989-hcfn9" event={"ID":"e7a6675d-7af2-4695-ba8a-f6b7985a5521","Type":"ContainerDied","Data":"28d97df993c1768e9f9d5b2a99855a61a7a4bac5b1f4429976988298f9790db9"} Jul 02 19:52:50.536065 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.535874 2560 scope.go:117] "RemoveContainer" containerID="f99e66c04eec5c02217a8fc469be99cd696aaa9e8b10eeb155da044bc81a6821" Jul 02 19:52:50.544208 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.544191 2560 scope.go:117] "RemoveContainer" containerID="f99e66c04eec5c02217a8fc469be99cd696aaa9e8b10eeb155da044bc81a6821" Jul 02 19:52:50.544497 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:52:50.544472 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f99e66c04eec5c02217a8fc469be99cd696aaa9e8b10eeb155da044bc81a6821\": container with ID starting with f99e66c04eec5c02217a8fc469be99cd696aaa9e8b10eeb155da044bc81a6821 not found: ID does not exist" containerID="f99e66c04eec5c02217a8fc469be99cd696aaa9e8b10eeb155da044bc81a6821" Jul 02 19:52:50.544584 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.544503 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f99e66c04eec5c02217a8fc469be99cd696aaa9e8b10eeb155da044bc81a6821"} err="failed to get container status \"f99e66c04eec5c02217a8fc469be99cd696aaa9e8b10eeb155da044bc81a6821\": rpc error: code = NotFound desc = could not find container \"f99e66c04eec5c02217a8fc469be99cd696aaa9e8b10eeb155da044bc81a6821\": container with ID starting with f99e66c04eec5c02217a8fc469be99cd696aaa9e8b10eeb155da044bc81a6821 not found: ID does not exist" Jul 02 19:52:50.556675 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.556654 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c7fd89989-hcfn9"] Jul 02 19:52:50.560106 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:50.560084 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c7fd89989-hcfn9"] Jul 02 19:52:51.933147 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:51.933071 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7a6675d-7af2-4695-ba8a-f6b7985a5521" path="/var/lib/kubelet/pods/e7a6675d-7af2-4695-ba8a-f6b7985a5521/volumes" Jul 02 19:52:52.544692 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:52.544657 2560 generic.go:356] "Generic (PLEG): container finished" podID="e4417a85-8a7b-4eb3-bed3-b2aba3d9830a" containerID="5c48e01cc937990b37c80c80db2920044711423019813cf96e17ece6dde6d57d" exitCode=0 Jul 02 19:52:52.544868 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:52.544738 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mz68z" event={"ID":"e4417a85-8a7b-4eb3-bed3-b2aba3d9830a","Type":"ContainerDied","Data":"5c48e01cc937990b37c80c80db2920044711423019813cf96e17ece6dde6d57d"} Jul 02 19:52:52.545093 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:52.545078 2560 scope.go:117] "RemoveContainer" containerID="5c48e01cc937990b37c80c80db2920044711423019813cf96e17ece6dde6d57d" Jul 02 19:52:53.549946 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:52:53.549912 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mz68z" event={"ID":"e4417a85-8a7b-4eb3-bed3-b2aba3d9830a","Type":"ContainerStarted","Data":"d779fb23593e8b382b4b08133a7f27daf3d925f7db5987dbcc43ec9cc7586dc2"} Jul 02 19:53:02.581107 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:02.581068 2560 generic.go:356] "Generic (PLEG): container finished" podID="108d2c60-1768-434b-81d8-893cdae03a7b" containerID="51d765ea2d92ddc8be5f6db48a6651cf8985f2f9443eca64c17485ec224e55a6" exitCode=0 Jul 02 19:53:02.581616 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:02.581140 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-92lg6" event={"ID":"108d2c60-1768-434b-81d8-893cdae03a7b","Type":"ContainerDied","Data":"51d765ea2d92ddc8be5f6db48a6651cf8985f2f9443eca64c17485ec224e55a6"} Jul 02 19:53:02.581616 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:02.581492 2560 scope.go:117] "RemoveContainer" containerID="51d765ea2d92ddc8be5f6db48a6651cf8985f2f9443eca64c17485ec224e55a6" Jul 02 19:53:02.582648 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:02.582610 2560 generic.go:356] "Generic (PLEG): container finished" podID="135c70c7-2e29-45cf-8364-d5ebf0614fdb" containerID="fdd0955c5cf86899931e4a21f6ba04f837b937c5126a8c2453e64d0253bb8a44" exitCode=0 Jul 02 19:53:02.582750 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:02.582681 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" event={"ID":"135c70c7-2e29-45cf-8364-d5ebf0614fdb","Type":"ContainerDied","Data":"fdd0955c5cf86899931e4a21f6ba04f837b937c5126a8c2453e64d0253bb8a44"} Jul 02 19:53:02.583019 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:02.583005 2560 scope.go:117] "RemoveContainer" containerID="fdd0955c5cf86899931e4a21f6ba04f837b937c5126a8c2453e64d0253bb8a44" Jul 02 19:53:03.587977 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:03.587945 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-wg2jz" event={"ID":"135c70c7-2e29-45cf-8364-d5ebf0614fdb","Type":"ContainerStarted","Data":"6feec4d2094db8443b9e2fb935625119ab5ec1eafbc5489c52f299eaf92ebe11"} Jul 02 19:53:03.594463 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:03.594435 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-92lg6" event={"ID":"108d2c60-1768-434b-81d8-893cdae03a7b","Type":"ContainerStarted","Data":"492825cf21a82e6322874f047847d19e667381a03e28da3efc13d4054874475f"} Jul 02 19:53:07.997108 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:07.997061 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6b66b457dd-cmlcr" podUID="3907f206-ce81-4b93-b235-4a7b4c2194f4" containerName="console" containerID="cri-o://38548e2a9b0d2da4294b751950100d2086b8d1ea5cbd0687d2c61618db0d581e" gracePeriod=15 Jul 02 19:53:08.237050 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.237027 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:53:08.365850 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.365772 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-trusted-ca-bundle\") pod \"3907f206-ce81-4b93-b235-4a7b4c2194f4\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " Jul 02 19:53:08.365850 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.365805 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3907f206-ce81-4b93-b235-4a7b4c2194f4-console-serving-cert\") pod \"3907f206-ce81-4b93-b235-4a7b4c2194f4\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " Jul 02 19:53:08.365850 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.365837 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vxw9\" (UniqueName: \"kubernetes.io/projected/3907f206-ce81-4b93-b235-4a7b4c2194f4-kube-api-access-8vxw9\") pod \"3907f206-ce81-4b93-b235-4a7b4c2194f4\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " Jul 02 19:53:08.366099 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.365860 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-console-config\") pod \"3907f206-ce81-4b93-b235-4a7b4c2194f4\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " Jul 02 19:53:08.366099 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.365887 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-oauth-serving-cert\") pod \"3907f206-ce81-4b93-b235-4a7b4c2194f4\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " Jul 02 19:53:08.366099 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.365919 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-service-ca\") pod \"3907f206-ce81-4b93-b235-4a7b4c2194f4\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " Jul 02 19:53:08.366099 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.365967 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3907f206-ce81-4b93-b235-4a7b4c2194f4-console-oauth-config\") pod \"3907f206-ce81-4b93-b235-4a7b4c2194f4\" (UID: \"3907f206-ce81-4b93-b235-4a7b4c2194f4\") " Jul 02 19:53:08.366336 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.366243 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3907f206-ce81-4b93-b235-4a7b4c2194f4" (UID: "3907f206-ce81-4b93-b235-4a7b4c2194f4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:53:08.366336 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.366313 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-service-ca" (OuterVolumeSpecName: "service-ca") pod "3907f206-ce81-4b93-b235-4a7b4c2194f4" (UID: "3907f206-ce81-4b93-b235-4a7b4c2194f4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:53:08.366463 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.366346 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3907f206-ce81-4b93-b235-4a7b4c2194f4" (UID: "3907f206-ce81-4b93-b235-4a7b4c2194f4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:53:08.366463 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.366354 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-console-config" (OuterVolumeSpecName: "console-config") pod "3907f206-ce81-4b93-b235-4a7b4c2194f4" (UID: "3907f206-ce81-4b93-b235-4a7b4c2194f4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:53:08.368090 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.368068 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3907f206-ce81-4b93-b235-4a7b4c2194f4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3907f206-ce81-4b93-b235-4a7b4c2194f4" (UID: "3907f206-ce81-4b93-b235-4a7b4c2194f4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:53:08.368184 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.368100 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3907f206-ce81-4b93-b235-4a7b4c2194f4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3907f206-ce81-4b93-b235-4a7b4c2194f4" (UID: "3907f206-ce81-4b93-b235-4a7b4c2194f4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:53:08.368227 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.368179 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3907f206-ce81-4b93-b235-4a7b4c2194f4-kube-api-access-8vxw9" (OuterVolumeSpecName: "kube-api-access-8vxw9") pod "3907f206-ce81-4b93-b235-4a7b4c2194f4" (UID: "3907f206-ce81-4b93-b235-4a7b4c2194f4"). InnerVolumeSpecName "kube-api-access-8vxw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:53:08.466836 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.466806 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-trusted-ca-bundle\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:53:08.466836 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.466833 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3907f206-ce81-4b93-b235-4a7b4c2194f4-console-serving-cert\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:53:08.467012 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.466846 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vxw9\" (UniqueName: \"kubernetes.io/projected/3907f206-ce81-4b93-b235-4a7b4c2194f4-kube-api-access-8vxw9\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:53:08.467012 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.466859 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-console-config\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:53:08.467012 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.466870 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-oauth-serving-cert\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:53:08.467012 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.466881 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3907f206-ce81-4b93-b235-4a7b4c2194f4-service-ca\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:53:08.467012 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.466892 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3907f206-ce81-4b93-b235-4a7b4c2194f4-console-oauth-config\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:53:08.613425 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.613395 2560 generic.go:356] "Generic (PLEG): container finished" podID="3907f206-ce81-4b93-b235-4a7b4c2194f4" containerID="38548e2a9b0d2da4294b751950100d2086b8d1ea5cbd0687d2c61618db0d581e" exitCode=0 Jul 02 19:53:08.613552 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.613439 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b66b457dd-cmlcr" Jul 02 19:53:08.613552 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.613481 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b66b457dd-cmlcr" event={"ID":"3907f206-ce81-4b93-b235-4a7b4c2194f4","Type":"ContainerDied","Data":"38548e2a9b0d2da4294b751950100d2086b8d1ea5cbd0687d2c61618db0d581e"} Jul 02 19:53:08.613552 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.613530 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b66b457dd-cmlcr" event={"ID":"3907f206-ce81-4b93-b235-4a7b4c2194f4","Type":"ContainerDied","Data":"e0943cc64ab2fad1374766e1868b601c02600ed448a9366ce4586969467dd1e3"} Jul 02 19:53:08.613655 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.613557 2560 scope.go:117] "RemoveContainer" containerID="38548e2a9b0d2da4294b751950100d2086b8d1ea5cbd0687d2c61618db0d581e" Jul 02 19:53:08.622000 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.621985 2560 scope.go:117] "RemoveContainer" containerID="38548e2a9b0d2da4294b751950100d2086b8d1ea5cbd0687d2c61618db0d581e" Jul 02 19:53:08.622235 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:53:08.622219 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38548e2a9b0d2da4294b751950100d2086b8d1ea5cbd0687d2c61618db0d581e\": container with ID starting with 38548e2a9b0d2da4294b751950100d2086b8d1ea5cbd0687d2c61618db0d581e not found: ID does not exist" containerID="38548e2a9b0d2da4294b751950100d2086b8d1ea5cbd0687d2c61618db0d581e" Jul 02 19:53:08.622304 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.622270 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38548e2a9b0d2da4294b751950100d2086b8d1ea5cbd0687d2c61618db0d581e"} err="failed to get container status \"38548e2a9b0d2da4294b751950100d2086b8d1ea5cbd0687d2c61618db0d581e\": rpc error: code = NotFound desc = could not find container \"38548e2a9b0d2da4294b751950100d2086b8d1ea5cbd0687d2c61618db0d581e\": container with ID starting with 38548e2a9b0d2da4294b751950100d2086b8d1ea5cbd0687d2c61618db0d581e not found: ID does not exist" Jul 02 19:53:08.634821 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.634798 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b66b457dd-cmlcr"] Jul 02 19:53:08.639422 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:08.639397 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b66b457dd-cmlcr"] Jul 02 19:53:09.932525 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:09.932492 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3907f206-ce81-4b93-b235-4a7b4c2194f4" path="/var/lib/kubelet/pods/3907f206-ce81-4b93-b235-4a7b4c2194f4/volumes" Jul 02 19:53:50.875354 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.875273 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8444cc454c-ptjkd"] Jul 02 19:53:50.875815 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.875611 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7a6675d-7af2-4695-ba8a-f6b7985a5521" containerName="registry" Jul 02 19:53:50.875815 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.875625 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7a6675d-7af2-4695-ba8a-f6b7985a5521" containerName="registry" Jul 02 19:53:50.875815 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.875632 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3907f206-ce81-4b93-b235-4a7b4c2194f4" containerName="console" Jul 02 19:53:50.875815 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.875638 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3907f206-ce81-4b93-b235-4a7b4c2194f4" containerName="console" Jul 02 19:53:50.875815 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.875685 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3907f206-ce81-4b93-b235-4a7b4c2194f4" containerName="console" Jul 02 19:53:50.875815 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.875693 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7a6675d-7af2-4695-ba8a-f6b7985a5521" containerName="registry" Jul 02 19:53:50.878842 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.878824 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:50.881660 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.881634 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 02 19:53:50.881784 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.881635 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5x6zs\"" Jul 02 19:53:50.881784 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.881636 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 02 19:53:50.881784 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.881643 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 02 19:53:50.882164 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.882151 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 02 19:53:50.882220 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.882208 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 02 19:53:50.887272 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.887228 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 02 19:53:50.890067 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.890047 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8444cc454c-ptjkd"] Jul 02 19:53:50.956928 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.956897 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fk7d\" (UniqueName: \"kubernetes.io/projected/16da836b-66c6-49a3-a9a0-a309ea5d9f20-kube-api-access-7fk7d\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:50.956928 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.956938 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16da836b-66c6-49a3-a9a0-a309ea5d9f20-metrics-client-ca\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:50.957149 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.956967 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/16da836b-66c6-49a3-a9a0-a309ea5d9f20-secret-telemeter-client\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:50.957149 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.957048 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/16da836b-66c6-49a3-a9a0-a309ea5d9f20-telemeter-client-tls\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:50.957149 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.957092 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16da836b-66c6-49a3-a9a0-a309ea5d9f20-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:50.957149 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.957119 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/16da836b-66c6-49a3-a9a0-a309ea5d9f20-federate-client-tls\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:50.957149 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.957139 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16da836b-66c6-49a3-a9a0-a309ea5d9f20-serving-certs-ca-bundle\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:50.957386 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:50.957171 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16da836b-66c6-49a3-a9a0-a309ea5d9f20-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:51.058429 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:51.058372 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16da836b-66c6-49a3-a9a0-a309ea5d9f20-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:51.058429 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:51.058430 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/16da836b-66c6-49a3-a9a0-a309ea5d9f20-federate-client-tls\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:51.058688 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:51.058453 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16da836b-66c6-49a3-a9a0-a309ea5d9f20-serving-certs-ca-bundle\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:51.058688 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:51.058472 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16da836b-66c6-49a3-a9a0-a309ea5d9f20-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:51.058688 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:51.058492 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fk7d\" (UniqueName: \"kubernetes.io/projected/16da836b-66c6-49a3-a9a0-a309ea5d9f20-kube-api-access-7fk7d\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:51.058688 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:51.058521 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16da836b-66c6-49a3-a9a0-a309ea5d9f20-metrics-client-ca\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:51.058688 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:51.058561 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/16da836b-66c6-49a3-a9a0-a309ea5d9f20-secret-telemeter-client\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:51.058921 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:51.058795 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/16da836b-66c6-49a3-a9a0-a309ea5d9f20-telemeter-client-tls\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:51.059405 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:51.059374 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16da836b-66c6-49a3-a9a0-a309ea5d9f20-metrics-client-ca\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:51.059594 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:51.059418 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16da836b-66c6-49a3-a9a0-a309ea5d9f20-serving-certs-ca-bundle\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:51.059693 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:51.059615 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16da836b-66c6-49a3-a9a0-a309ea5d9f20-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:51.061547 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:51.061517 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16da836b-66c6-49a3-a9a0-a309ea5d9f20-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:51.061638 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:51.061623 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/16da836b-66c6-49a3-a9a0-a309ea5d9f20-secret-telemeter-client\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:51.061706 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:51.061680 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/16da836b-66c6-49a3-a9a0-a309ea5d9f20-federate-client-tls\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:51.061749 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:51.061681 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/16da836b-66c6-49a3-a9a0-a309ea5d9f20-telemeter-client-tls\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:51.066931 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:51.066913 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fk7d\" (UniqueName: \"kubernetes.io/projected/16da836b-66c6-49a3-a9a0-a309ea5d9f20-kube-api-access-7fk7d\") pod \"telemeter-client-8444cc454c-ptjkd\" (UID: \"16da836b-66c6-49a3-a9a0-a309ea5d9f20\") " pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:51.189829 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:51.189750 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" Jul 02 19:53:51.323167 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:51.323138 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8444cc454c-ptjkd"] Jul 02 19:53:51.325195 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:53:51.325170 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16da836b_66c6_49a3_a9a0_a309ea5d9f20.slice/crio-d2ee42936416d35a5f194152454fe328f8c9f71d2317eb4af3a335048d64604d WatchSource:0}: Error finding container d2ee42936416d35a5f194152454fe328f8c9f71d2317eb4af3a335048d64604d: Status 404 returned error can't find the container with id d2ee42936416d35a5f194152454fe328f8c9f71d2317eb4af3a335048d64604d Jul 02 19:53:51.778095 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:51.778055 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" event={"ID":"16da836b-66c6-49a3-a9a0-a309ea5d9f20","Type":"ContainerStarted","Data":"d2ee42936416d35a5f194152454fe328f8c9f71d2317eb4af3a335048d64604d"} Jul 02 19:53:53.786808 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:53.786774 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" event={"ID":"16da836b-66c6-49a3-a9a0-a309ea5d9f20","Type":"ContainerStarted","Data":"c5bd9305bbed1f93e6f83e31533264fa786a1d96b90959c6f6d93bb70211f5f2"} Jul 02 19:53:54.792280 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:54.792188 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" event={"ID":"16da836b-66c6-49a3-a9a0-a309ea5d9f20","Type":"ContainerStarted","Data":"68dcf61d2f2b83b7e46a9bf4f1eb438fff2e58302c3aa1a053f2dbe5c20950c8"} Jul 02 19:53:54.792280 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:54.792258 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" event={"ID":"16da836b-66c6-49a3-a9a0-a309ea5d9f20","Type":"ContainerStarted","Data":"7ea640a661663ef8f685ea5684a0f4c7a4af6c0ba8881533e3f4341dde11d471"} Jul 02 19:53:54.816111 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:54.816064 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8444cc454c-ptjkd" podStartSLOduration=1.6758955420000001 podStartE2EDuration="4.816049752s" totalImagesPullingTime="3.14015421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:53:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:53:54.814035592 +0000 UTC m=+183.383639664" watchObservedRunningTime="2026-07-02 19:53:54.816049752 +0000 UTC m=+183.385653822" Jul 02 19:53:55.594376 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.594346 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7875c6d47-5nwm8"] Jul 02 19:53:55.597574 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.597549 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:55.600022 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.599997 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 19:53:55.601297 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.601273 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-47pv8\"" Jul 02 19:53:55.601399 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.601339 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 19:53:55.601399 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.601372 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 19:53:55.601399 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.601389 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 19:53:55.601556 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.601506 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 19:53:55.601612 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.601582 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 19:53:55.601793 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.601777 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 19:53:55.605947 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.605823 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 02 19:53:55.611325 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.611294 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7875c6d47-5nwm8"] Jul 02 19:53:55.692077 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.692040 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e64f8254-de3e-416c-b782-a16433a58bee-console-oauth-config\") pod \"console-7875c6d47-5nwm8\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:55.692241 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.692087 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j58zs\" (UniqueName: \"kubernetes.io/projected/e64f8254-de3e-416c-b782-a16433a58bee-kube-api-access-j58zs\") pod \"console-7875c6d47-5nwm8\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:55.692241 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.692112 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-service-ca\") pod \"console-7875c6d47-5nwm8\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:55.692241 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.692156 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-trusted-ca-bundle\") pod \"console-7875c6d47-5nwm8\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:55.692241 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.692187 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e64f8254-de3e-416c-b782-a16433a58bee-console-serving-cert\") pod \"console-7875c6d47-5nwm8\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:55.692467 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.692276 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-console-config\") pod \"console-7875c6d47-5nwm8\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:55.692467 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.692314 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-oauth-serving-cert\") pod \"console-7875c6d47-5nwm8\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:55.793306 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.793272 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j58zs\" (UniqueName: \"kubernetes.io/projected/e64f8254-de3e-416c-b782-a16433a58bee-kube-api-access-j58zs\") pod \"console-7875c6d47-5nwm8\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:55.793306 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.793310 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-service-ca\") pod \"console-7875c6d47-5nwm8\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:55.793824 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.793328 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-trusted-ca-bundle\") pod \"console-7875c6d47-5nwm8\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:55.793824 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.793371 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e64f8254-de3e-416c-b782-a16433a58bee-console-serving-cert\") pod \"console-7875c6d47-5nwm8\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:55.793824 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.793418 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-console-config\") pod \"console-7875c6d47-5nwm8\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:55.793824 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.793454 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-oauth-serving-cert\") pod \"console-7875c6d47-5nwm8\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:55.793824 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.793487 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e64f8254-de3e-416c-b782-a16433a58bee-console-oauth-config\") pod \"console-7875c6d47-5nwm8\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:55.794152 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.794068 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-service-ca\") pod \"console-7875c6d47-5nwm8\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:55.794343 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.794320 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-trusted-ca-bundle\") pod \"console-7875c6d47-5nwm8\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:55.794343 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.794337 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-oauth-serving-cert\") pod \"console-7875c6d47-5nwm8\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:55.794477 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.794414 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-console-config\") pod \"console-7875c6d47-5nwm8\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:55.796054 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.796029 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e64f8254-de3e-416c-b782-a16433a58bee-console-oauth-config\") pod \"console-7875c6d47-5nwm8\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:55.796437 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.796420 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e64f8254-de3e-416c-b782-a16433a58bee-console-serving-cert\") pod \"console-7875c6d47-5nwm8\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:55.801289 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.801243 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j58zs\" (UniqueName: \"kubernetes.io/projected/e64f8254-de3e-416c-b782-a16433a58bee-kube-api-access-j58zs\") pod \"console-7875c6d47-5nwm8\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:55.908571 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:55.908506 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:53:56.038199 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:56.038174 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7875c6d47-5nwm8"] Jul 02 19:53:56.040837 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:53:56.040810 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64f8254_de3e_416c_b782_a16433a58bee.slice/crio-e42011b0b94993bf498c88057865a0cc98ca5baa810749341f544dc84c174626 WatchSource:0}: Error finding container e42011b0b94993bf498c88057865a0cc98ca5baa810749341f544dc84c174626: Status 404 returned error can't find the container with id e42011b0b94993bf498c88057865a0cc98ca5baa810749341f544dc84c174626 Jul 02 19:53:56.803498 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:56.803462 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7875c6d47-5nwm8" event={"ID":"e64f8254-de3e-416c-b782-a16433a58bee","Type":"ContainerStarted","Data":"733c2c6ef1cf59d46ee3c8d7b56c841623ab1e7b618f43f32e0f735e90ddd29c"} Jul 02 19:53:56.803875 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:56.803517 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7875c6d47-5nwm8" event={"ID":"e64f8254-de3e-416c-b782-a16433a58bee","Type":"ContainerStarted","Data":"e42011b0b94993bf498c88057865a0cc98ca5baa810749341f544dc84c174626"} Jul 02 19:53:56.821221 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:53:56.821175 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7875c6d47-5nwm8" podStartSLOduration=1.8211617549999999 podStartE2EDuration="1.821161755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:53:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:53:56.820007444 +0000 UTC m=+185.389611539" watchObservedRunningTime="2026-07-02 19:53:56.821161755 +0000 UTC m=+185.390765826" Jul 02 19:54:05.909231 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:54:05.909192 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:54:05.909643 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:54:05.909270 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:54:05.913903 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:54:05.913881 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:54:06.847926 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:54:06.847898 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:55:01.376919 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.376885 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85fc745c94-zql72"] Jul 02 19:55:01.380401 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.380378 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.391538 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.391483 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85fc745c94-zql72"] Jul 02 19:55:01.479178 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.479145 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-console-config\") pod \"console-85fc745c94-zql72\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.479178 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.479179 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjnx5\" (UniqueName: \"kubernetes.io/projected/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-kube-api-access-rjnx5\") pod \"console-85fc745c94-zql72\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.479415 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.479202 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-trusted-ca-bundle\") pod \"console-85fc745c94-zql72\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.479415 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.479279 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-console-oauth-config\") pod \"console-85fc745c94-zql72\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.479415 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.479322 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-oauth-serving-cert\") pod \"console-85fc745c94-zql72\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.479415 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.479352 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-service-ca\") pod \"console-85fc745c94-zql72\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.479415 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.479416 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-console-serving-cert\") pod \"console-85fc745c94-zql72\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.580546 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.580510 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-console-serving-cert\") pod \"console-85fc745c94-zql72\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.580546 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.580551 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-console-config\") pod \"console-85fc745c94-zql72\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.580763 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.580572 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjnx5\" (UniqueName: \"kubernetes.io/projected/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-kube-api-access-rjnx5\") pod \"console-85fc745c94-zql72\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.580763 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.580613 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-trusted-ca-bundle\") pod \"console-85fc745c94-zql72\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.580763 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.580645 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-console-oauth-config\") pod \"console-85fc745c94-zql72\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.580763 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.580663 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-oauth-serving-cert\") pod \"console-85fc745c94-zql72\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.580763 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.580700 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-service-ca\") pod \"console-85fc745c94-zql72\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.581491 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.581460 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-console-config\") pod \"console-85fc745c94-zql72\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.581633 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.581493 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-oauth-serving-cert\") pod \"console-85fc745c94-zql72\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.581633 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.581499 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-service-ca\") pod \"console-85fc745c94-zql72\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.581751 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.581721 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-trusted-ca-bundle\") pod \"console-85fc745c94-zql72\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.583182 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.583156 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-console-serving-cert\") pod \"console-85fc745c94-zql72\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.583309 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.583177 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-console-oauth-config\") pod \"console-85fc745c94-zql72\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.588924 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.588904 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjnx5\" (UniqueName: \"kubernetes.io/projected/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-kube-api-access-rjnx5\") pod \"console-85fc745c94-zql72\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.691769 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.691677 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:01.826710 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:01.826652 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85fc745c94-zql72"] Jul 02 19:55:01.828875 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:55:01.828836 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ec25ee7_5cf7_4760_9912_ac633d8b42c3.slice/crio-97392b42d32f35571dcac943b1ad26ba60a6b0726a8e40302e38f004d08de9bb WatchSource:0}: Error finding container 97392b42d32f35571dcac943b1ad26ba60a6b0726a8e40302e38f004d08de9bb: Status 404 returned error can't find the container with id 97392b42d32f35571dcac943b1ad26ba60a6b0726a8e40302e38f004d08de9bb Jul 02 19:55:02.049511 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:02.049468 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fc745c94-zql72" event={"ID":"8ec25ee7-5cf7-4760-9912-ac633d8b42c3","Type":"ContainerStarted","Data":"e43131cb65c67c8f4048ccb9aaf36a245c3e94617c029f729ea208490f52ad9e"} Jul 02 19:55:02.049720 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:02.049523 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fc745c94-zql72" event={"ID":"8ec25ee7-5cf7-4760-9912-ac633d8b42c3","Type":"ContainerStarted","Data":"97392b42d32f35571dcac943b1ad26ba60a6b0726a8e40302e38f004d08de9bb"} Jul 02 19:55:02.067532 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:02.067469 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85fc745c94-zql72" podStartSLOduration=1.067453901 podStartE2EDuration="1.067453901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:55:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:02.065858652 +0000 UTC m=+250.635462723" watchObservedRunningTime="2026-07-02 19:55:02.067453901 +0000 UTC m=+250.637057971" Jul 02 19:55:11.692358 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:11.692308 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:11.692885 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:11.692381 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:11.697149 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:11.697129 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:12.089511 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:12.089481 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:55:12.138936 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:12.138897 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7875c6d47-5nwm8"] Jul 02 19:55:37.163610 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.163567 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7875c6d47-5nwm8" podUID="e64f8254-de3e-416c-b782-a16433a58bee" containerName="console" containerID="cri-o://733c2c6ef1cf59d46ee3c8d7b56c841623ab1e7b618f43f32e0f735e90ddd29c" gracePeriod=15 Jul 02 19:55:37.406020 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.405990 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:55:37.555573 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.555538 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-console-config\") pod \"e64f8254-de3e-416c-b782-a16433a58bee\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " Jul 02 19:55:37.555755 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.555602 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j58zs\" (UniqueName: \"kubernetes.io/projected/e64f8254-de3e-416c-b782-a16433a58bee-kube-api-access-j58zs\") pod \"e64f8254-de3e-416c-b782-a16433a58bee\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " Jul 02 19:55:37.555755 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.555633 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e64f8254-de3e-416c-b782-a16433a58bee-console-oauth-config\") pod \"e64f8254-de3e-416c-b782-a16433a58bee\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " Jul 02 19:55:37.555755 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.555673 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-trusted-ca-bundle\") pod \"e64f8254-de3e-416c-b782-a16433a58bee\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " Jul 02 19:55:37.555755 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.555701 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e64f8254-de3e-416c-b782-a16433a58bee-console-serving-cert\") pod \"e64f8254-de3e-416c-b782-a16433a58bee\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " Jul 02 19:55:37.555755 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.555718 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-oauth-serving-cert\") pod \"e64f8254-de3e-416c-b782-a16433a58bee\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " Jul 02 19:55:37.555755 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.555742 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-service-ca\") pod \"e64f8254-de3e-416c-b782-a16433a58bee\" (UID: \"e64f8254-de3e-416c-b782-a16433a58bee\") " Jul 02 19:55:37.556282 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.556211 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-service-ca" (OuterVolumeSpecName: "service-ca") pod "e64f8254-de3e-416c-b782-a16433a58bee" (UID: "e64f8254-de3e-416c-b782-a16433a58bee"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:55:37.556282 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.556240 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e64f8254-de3e-416c-b782-a16433a58bee" (UID: "e64f8254-de3e-416c-b782-a16433a58bee"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:55:37.556449 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.556290 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-console-config" (OuterVolumeSpecName: "console-config") pod "e64f8254-de3e-416c-b782-a16433a58bee" (UID: "e64f8254-de3e-416c-b782-a16433a58bee"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:55:37.556449 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.556326 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e64f8254-de3e-416c-b782-a16433a58bee" (UID: "e64f8254-de3e-416c-b782-a16433a58bee"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:55:37.557817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.557792 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e64f8254-de3e-416c-b782-a16433a58bee-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e64f8254-de3e-416c-b782-a16433a58bee" (UID: "e64f8254-de3e-416c-b782-a16433a58bee"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:55:37.557913 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.557836 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e64f8254-de3e-416c-b782-a16433a58bee-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e64f8254-de3e-416c-b782-a16433a58bee" (UID: "e64f8254-de3e-416c-b782-a16433a58bee"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:55:37.557913 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.557843 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e64f8254-de3e-416c-b782-a16433a58bee-kube-api-access-j58zs" (OuterVolumeSpecName: "kube-api-access-j58zs") pod "e64f8254-de3e-416c-b782-a16433a58bee" (UID: "e64f8254-de3e-416c-b782-a16433a58bee"). InnerVolumeSpecName "kube-api-access-j58zs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:55:37.656323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.656286 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-oauth-serving-cert\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:55:37.656323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.656320 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-service-ca\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:55:37.656323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.656329 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-console-config\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:55:37.656546 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.656342 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j58zs\" (UniqueName: \"kubernetes.io/projected/e64f8254-de3e-416c-b782-a16433a58bee-kube-api-access-j58zs\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:55:37.656546 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.656352 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e64f8254-de3e-416c-b782-a16433a58bee-console-oauth-config\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:55:37.656546 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.656360 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e64f8254-de3e-416c-b782-a16433a58bee-trusted-ca-bundle\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:55:37.656546 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:37.656369 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e64f8254-de3e-416c-b782-a16433a58bee-console-serving-cert\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:55:38.186561 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:38.186517 2560 generic.go:356] "Generic (PLEG): container finished" podID="e64f8254-de3e-416c-b782-a16433a58bee" containerID="733c2c6ef1cf59d46ee3c8d7b56c841623ab1e7b618f43f32e0f735e90ddd29c" exitCode=0 Jul 02 19:55:38.186931 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:38.186581 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7875c6d47-5nwm8" event={"ID":"e64f8254-de3e-416c-b782-a16433a58bee","Type":"ContainerDied","Data":"733c2c6ef1cf59d46ee3c8d7b56c841623ab1e7b618f43f32e0f735e90ddd29c"} Jul 02 19:55:38.186931 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:38.186651 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7875c6d47-5nwm8" event={"ID":"e64f8254-de3e-416c-b782-a16433a58bee","Type":"ContainerDied","Data":"e42011b0b94993bf498c88057865a0cc98ca5baa810749341f544dc84c174626"} Jul 02 19:55:38.186931 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:38.186585 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7875c6d47-5nwm8" Jul 02 19:55:38.186931 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:38.186677 2560 scope.go:117] "RemoveContainer" containerID="733c2c6ef1cf59d46ee3c8d7b56c841623ab1e7b618f43f32e0f735e90ddd29c" Jul 02 19:55:38.194784 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:38.194768 2560 scope.go:117] "RemoveContainer" containerID="733c2c6ef1cf59d46ee3c8d7b56c841623ab1e7b618f43f32e0f735e90ddd29c" Jul 02 19:55:38.195022 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:55:38.195006 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"733c2c6ef1cf59d46ee3c8d7b56c841623ab1e7b618f43f32e0f735e90ddd29c\": container with ID starting with 733c2c6ef1cf59d46ee3c8d7b56c841623ab1e7b618f43f32e0f735e90ddd29c not found: ID does not exist" containerID="733c2c6ef1cf59d46ee3c8d7b56c841623ab1e7b618f43f32e0f735e90ddd29c" Jul 02 19:55:38.195098 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:38.195030 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"733c2c6ef1cf59d46ee3c8d7b56c841623ab1e7b618f43f32e0f735e90ddd29c"} err="failed to get container status \"733c2c6ef1cf59d46ee3c8d7b56c841623ab1e7b618f43f32e0f735e90ddd29c\": rpc error: code = NotFound desc = could not find container \"733c2c6ef1cf59d46ee3c8d7b56c841623ab1e7b618f43f32e0f735e90ddd29c\": container with ID starting with 733c2c6ef1cf59d46ee3c8d7b56c841623ab1e7b618f43f32e0f735e90ddd29c not found: ID does not exist" Jul 02 19:55:38.203816 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:38.203796 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7875c6d47-5nwm8"] Jul 02 19:55:38.207856 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:38.207836 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7875c6d47-5nwm8"] Jul 02 19:55:39.932787 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:39.932755 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e64f8254-de3e-416c-b782-a16433a58bee" path="/var/lib/kubelet/pods/e64f8254-de3e-416c-b782-a16433a58bee/volumes" Jul 02 19:55:51.828910 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:51.828885 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/1.log" Jul 02 19:55:51.831850 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:51.831826 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tkp7w_72996a08-b83d-4d1b-99c6-780e15c6722a/ovn-acl-logging/0.log" Jul 02 19:55:51.833217 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:51.833192 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/1.log" Jul 02 19:55:51.836398 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:51.836381 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tkp7w_72996a08-b83d-4d1b-99c6-780e15c6722a/ovn-acl-logging/0.log" Jul 02 19:55:51.839121 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:51.839103 2560 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 19:55:57.912346 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:57.912311 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6"] Jul 02 19:55:57.914536 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:57.912752 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e64f8254-de3e-416c-b782-a16433a58bee" containerName="console" Jul 02 19:55:57.914536 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:57.912771 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e64f8254-de3e-416c-b782-a16433a58bee" containerName="console" Jul 02 19:55:57.914536 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:57.912823 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e64f8254-de3e-416c-b782-a16433a58bee" containerName="console" Jul 02 19:55:57.915823 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:57.915808 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6" Jul 02 19:55:57.918704 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:57.918677 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 19:55:57.918806 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:57.918708 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8929d\"" Jul 02 19:55:57.919935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:57.919919 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 19:55:57.927660 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:57.927640 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6"] Jul 02 19:55:58.016629 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:58.016591 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46bc677f-023e-459e-a1de-2b52a08a299b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6\" (UID: \"46bc677f-023e-459e-a1de-2b52a08a299b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6" Jul 02 19:55:58.016629 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:58.016625 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46bc677f-023e-459e-a1de-2b52a08a299b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6\" (UID: \"46bc677f-023e-459e-a1de-2b52a08a299b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6" Jul 02 19:55:58.016860 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:58.016748 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsmks\" (UniqueName: \"kubernetes.io/projected/46bc677f-023e-459e-a1de-2b52a08a299b-kube-api-access-hsmks\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6\" (UID: \"46bc677f-023e-459e-a1de-2b52a08a299b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6" Jul 02 19:55:58.117132 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:58.117095 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsmks\" (UniqueName: \"kubernetes.io/projected/46bc677f-023e-459e-a1de-2b52a08a299b-kube-api-access-hsmks\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6\" (UID: \"46bc677f-023e-459e-a1de-2b52a08a299b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6" Jul 02 19:55:58.117318 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:58.117143 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46bc677f-023e-459e-a1de-2b52a08a299b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6\" (UID: \"46bc677f-023e-459e-a1de-2b52a08a299b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6" Jul 02 19:55:58.117318 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:58.117164 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46bc677f-023e-459e-a1de-2b52a08a299b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6\" (UID: \"46bc677f-023e-459e-a1de-2b52a08a299b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6" Jul 02 19:55:58.117528 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:58.117509 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46bc677f-023e-459e-a1de-2b52a08a299b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6\" (UID: \"46bc677f-023e-459e-a1de-2b52a08a299b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6" Jul 02 19:55:58.117582 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:58.117552 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46bc677f-023e-459e-a1de-2b52a08a299b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6\" (UID: \"46bc677f-023e-459e-a1de-2b52a08a299b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6" Jul 02 19:55:58.125314 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:58.125296 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsmks\" (UniqueName: \"kubernetes.io/projected/46bc677f-023e-459e-a1de-2b52a08a299b-kube-api-access-hsmks\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6\" (UID: \"46bc677f-023e-459e-a1de-2b52a08a299b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6" Jul 02 19:55:58.224839 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:58.224807 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6" Jul 02 19:55:58.352482 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:58.352458 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6"] Jul 02 19:55:58.354624 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:55:58.354589 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46bc677f_023e_459e_a1de_2b52a08a299b.slice/crio-131056dfff4c475697631a2b29d87e75a1dfdd6a8c07b81e1590b0b01c8a0f9f WatchSource:0}: Error finding container 131056dfff4c475697631a2b29d87e75a1dfdd6a8c07b81e1590b0b01c8a0f9f: Status 404 returned error can't find the container with id 131056dfff4c475697631a2b29d87e75a1dfdd6a8c07b81e1590b0b01c8a0f9f Jul 02 19:55:58.356545 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:58.356527 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 19:55:59.267871 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:55:59.267835 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6" event={"ID":"46bc677f-023e-459e-a1de-2b52a08a299b","Type":"ContainerStarted","Data":"131056dfff4c475697631a2b29d87e75a1dfdd6a8c07b81e1590b0b01c8a0f9f"} Jul 02 19:56:06.298009 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:06.297972 2560 generic.go:356] "Generic (PLEG): container finished" podID="46bc677f-023e-459e-a1de-2b52a08a299b" containerID="729df1f0bfd9c1ff6967815e789875c7f5f30216d50647d94a4286669b1ee678" exitCode=0 Jul 02 19:56:06.298405 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:06.298058 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6" event={"ID":"46bc677f-023e-459e-a1de-2b52a08a299b","Type":"ContainerDied","Data":"729df1f0bfd9c1ff6967815e789875c7f5f30216d50647d94a4286669b1ee678"} Jul 02 19:56:09.315036 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:09.314996 2560 generic.go:356] "Generic (PLEG): container finished" podID="46bc677f-023e-459e-a1de-2b52a08a299b" containerID="9e6c69687cc76ee26c87fc9448acbe54ba21157f6328aeb7e2f0709c1a4bb9c0" exitCode=0 Jul 02 19:56:09.315435 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:09.315085 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6" event={"ID":"46bc677f-023e-459e-a1de-2b52a08a299b","Type":"ContainerDied","Data":"9e6c69687cc76ee26c87fc9448acbe54ba21157f6328aeb7e2f0709c1a4bb9c0"} Jul 02 19:56:18.354434 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:18.354402 2560 generic.go:356] "Generic (PLEG): container finished" podID="46bc677f-023e-459e-a1de-2b52a08a299b" containerID="dbe79d50230426ccd80c57ce9696d763e752db6ea93c0269066e447aca3fd48d" exitCode=0 Jul 02 19:56:18.354780 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:18.354482 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6" event={"ID":"46bc677f-023e-459e-a1de-2b52a08a299b","Type":"ContainerDied","Data":"dbe79d50230426ccd80c57ce9696d763e752db6ea93c0269066e447aca3fd48d"} Jul 02 19:56:19.481222 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:19.481198 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6" Jul 02 19:56:19.585697 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:19.585663 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46bc677f-023e-459e-a1de-2b52a08a299b-util\") pod \"46bc677f-023e-459e-a1de-2b52a08a299b\" (UID: \"46bc677f-023e-459e-a1de-2b52a08a299b\") " Jul 02 19:56:19.585856 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:19.585711 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46bc677f-023e-459e-a1de-2b52a08a299b-bundle\") pod \"46bc677f-023e-459e-a1de-2b52a08a299b\" (UID: \"46bc677f-023e-459e-a1de-2b52a08a299b\") " Jul 02 19:56:19.585856 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:19.585755 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsmks\" (UniqueName: \"kubernetes.io/projected/46bc677f-023e-459e-a1de-2b52a08a299b-kube-api-access-hsmks\") pod \"46bc677f-023e-459e-a1de-2b52a08a299b\" (UID: \"46bc677f-023e-459e-a1de-2b52a08a299b\") " Jul 02 19:56:19.586410 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:19.586376 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46bc677f-023e-459e-a1de-2b52a08a299b-bundle" (OuterVolumeSpecName: "bundle") pod "46bc677f-023e-459e-a1de-2b52a08a299b" (UID: "46bc677f-023e-459e-a1de-2b52a08a299b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:56:19.587940 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:19.587915 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46bc677f-023e-459e-a1de-2b52a08a299b-kube-api-access-hsmks" (OuterVolumeSpecName: "kube-api-access-hsmks") pod "46bc677f-023e-459e-a1de-2b52a08a299b" (UID: "46bc677f-023e-459e-a1de-2b52a08a299b"). InnerVolumeSpecName "kube-api-access-hsmks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:56:19.589728 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:19.589702 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46bc677f-023e-459e-a1de-2b52a08a299b-util" (OuterVolumeSpecName: "util") pod "46bc677f-023e-459e-a1de-2b52a08a299b" (UID: "46bc677f-023e-459e-a1de-2b52a08a299b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:56:19.686428 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:19.686372 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46bc677f-023e-459e-a1de-2b52a08a299b-util\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:56:19.686428 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:19.686395 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46bc677f-023e-459e-a1de-2b52a08a299b-bundle\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:56:19.686428 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:19.686409 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsmks\" (UniqueName: \"kubernetes.io/projected/46bc677f-023e-459e-a1de-2b52a08a299b-kube-api-access-hsmks\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:56:20.364075 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:20.364039 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6" event={"ID":"46bc677f-023e-459e-a1de-2b52a08a299b","Type":"ContainerDied","Data":"131056dfff4c475697631a2b29d87e75a1dfdd6a8c07b81e1590b0b01c8a0f9f"} Jul 02 19:56:20.364260 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:20.364081 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mncd6" Jul 02 19:56:20.364260 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:20.364124 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="131056dfff4c475697631a2b29d87e75a1dfdd6a8c07b81e1590b0b01c8a0f9f" Jul 02 19:56:26.004594 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:26.004563 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc9gq"] Jul 02 19:56:26.005044 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:26.004914 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46bc677f-023e-459e-a1de-2b52a08a299b" containerName="util" Jul 02 19:56:26.005044 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:26.004927 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="46bc677f-023e-459e-a1de-2b52a08a299b" containerName="util" Jul 02 19:56:26.005044 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:26.004934 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46bc677f-023e-459e-a1de-2b52a08a299b" containerName="extract" Jul 02 19:56:26.005044 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:26.004940 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="46bc677f-023e-459e-a1de-2b52a08a299b" containerName="extract" Jul 02 19:56:26.005044 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:26.004959 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46bc677f-023e-459e-a1de-2b52a08a299b" containerName="pull" Jul 02 19:56:26.005044 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:26.004965 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="46bc677f-023e-459e-a1de-2b52a08a299b" containerName="pull" Jul 02 19:56:26.005044 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:26.005012 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="46bc677f-023e-459e-a1de-2b52a08a299b" containerName="extract" Jul 02 19:56:26.008440 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:26.008425 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc9gq" Jul 02 19:56:26.011117 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:26.011089 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 02 19:56:26.011277 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:26.011165 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:56:26.011337 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:26.011285 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-nj7s8\"" Jul 02 19:56:26.024292 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:26.024239 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc9gq"] Jul 02 19:56:26.132197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:26.132153 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx67k\" (UniqueName: \"kubernetes.io/projected/08016930-c13a-4eaa-9e9c-93342e15f67b-kube-api-access-wx67k\") pod \"cert-manager-operator-controller-manager-55c444bf86-rc9gq\" (UID: \"08016930-c13a-4eaa-9e9c-93342e15f67b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc9gq" Jul 02 19:56:26.132397 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:26.132207 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08016930-c13a-4eaa-9e9c-93342e15f67b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rc9gq\" (UID: \"08016930-c13a-4eaa-9e9c-93342e15f67b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc9gq" Jul 02 19:56:26.233462 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:26.233414 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08016930-c13a-4eaa-9e9c-93342e15f67b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rc9gq\" (UID: \"08016930-c13a-4eaa-9e9c-93342e15f67b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc9gq" Jul 02 19:56:26.233645 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:26.233533 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx67k\" (UniqueName: \"kubernetes.io/projected/08016930-c13a-4eaa-9e9c-93342e15f67b-kube-api-access-wx67k\") pod \"cert-manager-operator-controller-manager-55c444bf86-rc9gq\" (UID: \"08016930-c13a-4eaa-9e9c-93342e15f67b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc9gq" Jul 02 19:56:26.233891 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:26.233868 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08016930-c13a-4eaa-9e9c-93342e15f67b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rc9gq\" (UID: \"08016930-c13a-4eaa-9e9c-93342e15f67b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc9gq" Jul 02 19:56:26.245647 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:26.245626 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx67k\" (UniqueName: \"kubernetes.io/projected/08016930-c13a-4eaa-9e9c-93342e15f67b-kube-api-access-wx67k\") pod \"cert-manager-operator-controller-manager-55c444bf86-rc9gq\" (UID: \"08016930-c13a-4eaa-9e9c-93342e15f67b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc9gq" Jul 02 19:56:26.317441 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:26.317356 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc9gq" Jul 02 19:56:26.452558 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:26.452527 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc9gq"] Jul 02 19:56:26.455166 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:56:26.455143 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08016930_c13a_4eaa_9e9c_93342e15f67b.slice/crio-cc1286ab74dacdd2d9dde4fc5d5bd8506a8d8a7188fa971534aecae53985049c WatchSource:0}: Error finding container cc1286ab74dacdd2d9dde4fc5d5bd8506a8d8a7188fa971534aecae53985049c: Status 404 returned error can't find the container with id cc1286ab74dacdd2d9dde4fc5d5bd8506a8d8a7188fa971534aecae53985049c Jul 02 19:56:27.396917 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:27.396883 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc9gq" event={"ID":"08016930-c13a-4eaa-9e9c-93342e15f67b","Type":"ContainerStarted","Data":"cc1286ab74dacdd2d9dde4fc5d5bd8506a8d8a7188fa971534aecae53985049c"} Jul 02 19:56:28.403174 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:28.403118 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc9gq" event={"ID":"08016930-c13a-4eaa-9e9c-93342e15f67b","Type":"ContainerStarted","Data":"9b13a2ddd198309d73e5118ae1b48b4ba687690235d0fe4944399e4c737d0dd2"} Jul 02 19:56:28.434462 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:28.434330 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc9gq" podStartSLOduration=1.732281776 podStartE2EDuration="3.434313456s" totalImagesPullingTime="1.70203168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:56:28.432635179 +0000 UTC m=+337.002239250" watchObservedRunningTime="2026-07-02 19:56:28.434313456 +0000 UTC m=+337.003917526" Jul 02 19:56:29.847962 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:29.847927 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9"] Jul 02 19:56:29.850362 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:29.850345 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9" Jul 02 19:56:29.853271 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:29.853232 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 19:56:29.854200 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:29.854184 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8929d\"" Jul 02 19:56:29.854303 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:29.854185 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 19:56:29.863345 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:29.863324 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9"] Jul 02 19:56:29.967455 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:29.967425 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06124570-cae2-44ef-917f-bc6d546cdf8f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9\" (UID: \"06124570-cae2-44ef-917f-bc6d546cdf8f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9" Jul 02 19:56:29.967618 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:29.967474 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06124570-cae2-44ef-917f-bc6d546cdf8f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9\" (UID: \"06124570-cae2-44ef-917f-bc6d546cdf8f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9" Jul 02 19:56:29.967618 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:29.967553 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dn8q\" (UniqueName: \"kubernetes.io/projected/06124570-cae2-44ef-917f-bc6d546cdf8f-kube-api-access-8dn8q\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9\" (UID: \"06124570-cae2-44ef-917f-bc6d546cdf8f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9" Jul 02 19:56:30.068706 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.068670 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06124570-cae2-44ef-917f-bc6d546cdf8f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9\" (UID: \"06124570-cae2-44ef-917f-bc6d546cdf8f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9" Jul 02 19:56:30.068884 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.068713 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dn8q\" (UniqueName: \"kubernetes.io/projected/06124570-cae2-44ef-917f-bc6d546cdf8f-kube-api-access-8dn8q\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9\" (UID: \"06124570-cae2-44ef-917f-bc6d546cdf8f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9" Jul 02 19:56:30.068884 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.068763 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06124570-cae2-44ef-917f-bc6d546cdf8f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9\" (UID: \"06124570-cae2-44ef-917f-bc6d546cdf8f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9" Jul 02 19:56:30.069062 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.069041 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06124570-cae2-44ef-917f-bc6d546cdf8f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9\" (UID: \"06124570-cae2-44ef-917f-bc6d546cdf8f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9" Jul 02 19:56:30.069128 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.069072 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06124570-cae2-44ef-917f-bc6d546cdf8f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9\" (UID: \"06124570-cae2-44ef-917f-bc6d546cdf8f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9" Jul 02 19:56:30.078740 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.078706 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dn8q\" (UniqueName: \"kubernetes.io/projected/06124570-cae2-44ef-917f-bc6d546cdf8f-kube-api-access-8dn8q\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9\" (UID: \"06124570-cae2-44ef-917f-bc6d546cdf8f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9" Jul 02 19:56:30.159702 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.159631 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9" Jul 02 19:56:30.294824 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.294793 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9"] Jul 02 19:56:30.298176 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:56:30.298132 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06124570_cae2_44ef_917f_bc6d546cdf8f.slice/crio-7cb60ed06d26557b305c0e8835ab8420e2ddabd3b787cf6668d3b4ace53444ea WatchSource:0}: Error finding container 7cb60ed06d26557b305c0e8835ab8420e2ddabd3b787cf6668d3b4ace53444ea: Status 404 returned error can't find the container with id 7cb60ed06d26557b305c0e8835ab8420e2ddabd3b787cf6668d3b4ace53444ea Jul 02 19:56:30.309084 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.309061 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7krp8"] Jul 02 19:56:30.311282 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.311267 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7krp8" Jul 02 19:56:30.314834 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.314815 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 02 19:56:30.315127 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.315113 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 02 19:56:30.315997 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.315982 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-4n8cp\"" Jul 02 19:56:30.327845 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.327825 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7krp8"] Jul 02 19:56:30.371999 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.371975 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj2p5\" (UniqueName: \"kubernetes.io/projected/db44c818-657a-433f-9f4e-44466263300b-kube-api-access-gj2p5\") pod \"cert-manager-webhook-6486ffd997-7krp8\" (UID: \"db44c818-657a-433f-9f4e-44466263300b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7krp8" Jul 02 19:56:30.372083 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.372063 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db44c818-657a-433f-9f4e-44466263300b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7krp8\" (UID: \"db44c818-657a-433f-9f4e-44466263300b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7krp8" Jul 02 19:56:30.414120 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.414039 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9" event={"ID":"06124570-cae2-44ef-917f-bc6d546cdf8f","Type":"ContainerStarted","Data":"cc26dbf9818af1b8930693e60a4ccde5d3a91f8ccdb5297f416d476c318def72"} Jul 02 19:56:30.414120 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.414088 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9" event={"ID":"06124570-cae2-44ef-917f-bc6d546cdf8f","Type":"ContainerStarted","Data":"7cb60ed06d26557b305c0e8835ab8420e2ddabd3b787cf6668d3b4ace53444ea"} Jul 02 19:56:30.473340 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.473316 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db44c818-657a-433f-9f4e-44466263300b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7krp8\" (UID: \"db44c818-657a-433f-9f4e-44466263300b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7krp8" Jul 02 19:56:30.473455 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.473377 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj2p5\" (UniqueName: \"kubernetes.io/projected/db44c818-657a-433f-9f4e-44466263300b-kube-api-access-gj2p5\") pod \"cert-manager-webhook-6486ffd997-7krp8\" (UID: \"db44c818-657a-433f-9f4e-44466263300b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7krp8" Jul 02 19:56:30.482950 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.482922 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db44c818-657a-433f-9f4e-44466263300b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7krp8\" (UID: \"db44c818-657a-433f-9f4e-44466263300b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7krp8" Jul 02 19:56:30.482950 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.482948 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj2p5\" (UniqueName: \"kubernetes.io/projected/db44c818-657a-433f-9f4e-44466263300b-kube-api-access-gj2p5\") pod \"cert-manager-webhook-6486ffd997-7krp8\" (UID: \"db44c818-657a-433f-9f4e-44466263300b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7krp8" Jul 02 19:56:30.661450 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.661411 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7krp8" Jul 02 19:56:30.788031 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:30.787876 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7krp8"] Jul 02 19:56:30.790520 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:56:30.790494 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb44c818_657a_433f_9f4e_44466263300b.slice/crio-15f92214419b39bab80297ced8fcca6177a80c849750b2ca7512e3e81c6893a2 WatchSource:0}: Error finding container 15f92214419b39bab80297ced8fcca6177a80c849750b2ca7512e3e81c6893a2: Status 404 returned error can't find the container with id 15f92214419b39bab80297ced8fcca6177a80c849750b2ca7512e3e81c6893a2 Jul 02 19:56:31.421504 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:31.421417 2560 generic.go:356] "Generic (PLEG): container finished" podID="06124570-cae2-44ef-917f-bc6d546cdf8f" containerID="cc26dbf9818af1b8930693e60a4ccde5d3a91f8ccdb5297f416d476c318def72" exitCode=0 Jul 02 19:56:31.421939 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:31.421512 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9" event={"ID":"06124570-cae2-44ef-917f-bc6d546cdf8f","Type":"ContainerDied","Data":"cc26dbf9818af1b8930693e60a4ccde5d3a91f8ccdb5297f416d476c318def72"} Jul 02 19:56:31.423046 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:31.423016 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7krp8" event={"ID":"db44c818-657a-433f-9f4e-44466263300b","Type":"ContainerStarted","Data":"15f92214419b39bab80297ced8fcca6177a80c849750b2ca7512e3e81c6893a2"} Jul 02 19:56:34.442024 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:34.441944 2560 generic.go:356] "Generic (PLEG): container finished" podID="06124570-cae2-44ef-917f-bc6d546cdf8f" containerID="d14fe18f039428ecae8420aa8601711917c6feec37b1ce8306546fb95a5a09af" exitCode=0 Jul 02 19:56:34.442403 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:34.442035 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9" event={"ID":"06124570-cae2-44ef-917f-bc6d546cdf8f","Type":"ContainerDied","Data":"d14fe18f039428ecae8420aa8601711917c6feec37b1ce8306546fb95a5a09af"} Jul 02 19:56:34.444036 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:34.444002 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7krp8" event={"ID":"db44c818-657a-433f-9f4e-44466263300b","Type":"ContainerStarted","Data":"0e8c738162e5ecfe9dc0393c5cff568ad5445e2c2ab6e8b0a6a891e9fba5e760"} Jul 02 19:56:34.444159 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:34.444132 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7krp8" Jul 02 19:56:34.476005 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:34.475955 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-7krp8" podStartSLOduration=1.290322641 podStartE2EDuration="4.475938243s" totalImagesPullingTime="3.185615602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:56:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:56:34.474165889 +0000 UTC m=+343.043769961" watchObservedRunningTime="2026-07-02 19:56:34.475938243 +0000 UTC m=+343.045542313" Jul 02 19:56:35.450241 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:35.450208 2560 generic.go:356] "Generic (PLEG): container finished" podID="06124570-cae2-44ef-917f-bc6d546cdf8f" containerID="935d040e70cde7a60f1c6cfba1a0acca4cd38f3fd0ffab4a9ca1d5a681e2c1dd" exitCode=0 Jul 02 19:56:35.450642 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:35.450291 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9" event={"ID":"06124570-cae2-44ef-917f-bc6d546cdf8f","Type":"ContainerDied","Data":"935d040e70cde7a60f1c6cfba1a0acca4cd38f3fd0ffab4a9ca1d5a681e2c1dd"} Jul 02 19:56:36.582907 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.582877 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9" Jul 02 19:56:36.678348 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.678306 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-z8pkt"] Jul 02 19:56:36.678628 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.678617 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06124570-cae2-44ef-917f-bc6d546cdf8f" containerName="util" Jul 02 19:56:36.678674 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.678630 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="06124570-cae2-44ef-917f-bc6d546cdf8f" containerName="util" Jul 02 19:56:36.678674 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.678650 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06124570-cae2-44ef-917f-bc6d546cdf8f" containerName="pull" Jul 02 19:56:36.678674 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.678655 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="06124570-cae2-44ef-917f-bc6d546cdf8f" containerName="pull" Jul 02 19:56:36.678674 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.678662 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06124570-cae2-44ef-917f-bc6d546cdf8f" containerName="extract" Jul 02 19:56:36.678674 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.678668 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="06124570-cae2-44ef-917f-bc6d546cdf8f" containerName="extract" Jul 02 19:56:36.678838 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.678725 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="06124570-cae2-44ef-917f-bc6d546cdf8f" containerName="extract" Jul 02 19:56:36.681485 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.681471 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-z8pkt" Jul 02 19:56:36.684066 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.684048 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-8pwmq\"" Jul 02 19:56:36.690817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.690797 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-z8pkt"] Jul 02 19:56:36.730008 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.729953 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dn8q\" (UniqueName: \"kubernetes.io/projected/06124570-cae2-44ef-917f-bc6d546cdf8f-kube-api-access-8dn8q\") pod \"06124570-cae2-44ef-917f-bc6d546cdf8f\" (UID: \"06124570-cae2-44ef-917f-bc6d546cdf8f\") " Jul 02 19:56:36.730109 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.730041 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06124570-cae2-44ef-917f-bc6d546cdf8f-bundle\") pod \"06124570-cae2-44ef-917f-bc6d546cdf8f\" (UID: \"06124570-cae2-44ef-917f-bc6d546cdf8f\") " Jul 02 19:56:36.730109 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.730070 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06124570-cae2-44ef-917f-bc6d546cdf8f-util\") pod \"06124570-cae2-44ef-917f-bc6d546cdf8f\" (UID: \"06124570-cae2-44ef-917f-bc6d546cdf8f\") " Jul 02 19:56:36.730414 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.730393 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06124570-cae2-44ef-917f-bc6d546cdf8f-bundle" (OuterVolumeSpecName: "bundle") pod "06124570-cae2-44ef-917f-bc6d546cdf8f" (UID: "06124570-cae2-44ef-917f-bc6d546cdf8f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:56:36.731979 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.731959 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06124570-cae2-44ef-917f-bc6d546cdf8f-kube-api-access-8dn8q" (OuterVolumeSpecName: "kube-api-access-8dn8q") pod "06124570-cae2-44ef-917f-bc6d546cdf8f" (UID: "06124570-cae2-44ef-917f-bc6d546cdf8f"). InnerVolumeSpecName "kube-api-access-8dn8q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:56:36.734323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.734293 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06124570-cae2-44ef-917f-bc6d546cdf8f-util" (OuterVolumeSpecName: "util") pod "06124570-cae2-44ef-917f-bc6d546cdf8f" (UID: "06124570-cae2-44ef-917f-bc6d546cdf8f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:56:36.830879 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.830851 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m87vb\" (UniqueName: \"kubernetes.io/projected/956e88bb-cbfb-42d4-944e-aee067022382-kube-api-access-m87vb\") pod \"cert-manager-cainjector-559cdd8c87-z8pkt\" (UID: \"956e88bb-cbfb-42d4-944e-aee067022382\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z8pkt" Jul 02 19:56:36.830972 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.830893 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/956e88bb-cbfb-42d4-944e-aee067022382-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-z8pkt\" (UID: \"956e88bb-cbfb-42d4-944e-aee067022382\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z8pkt" Jul 02 19:56:36.830972 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.830927 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dn8q\" (UniqueName: \"kubernetes.io/projected/06124570-cae2-44ef-917f-bc6d546cdf8f-kube-api-access-8dn8q\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:56:36.830972 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.830939 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06124570-cae2-44ef-917f-bc6d546cdf8f-bundle\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:56:36.830972 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.830948 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06124570-cae2-44ef-917f-bc6d546cdf8f-util\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:56:36.931313 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.931273 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m87vb\" (UniqueName: \"kubernetes.io/projected/956e88bb-cbfb-42d4-944e-aee067022382-kube-api-access-m87vb\") pod \"cert-manager-cainjector-559cdd8c87-z8pkt\" (UID: \"956e88bb-cbfb-42d4-944e-aee067022382\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z8pkt" Jul 02 19:56:36.931441 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.931331 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/956e88bb-cbfb-42d4-944e-aee067022382-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-z8pkt\" (UID: \"956e88bb-cbfb-42d4-944e-aee067022382\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z8pkt" Jul 02 19:56:36.940350 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.940328 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/956e88bb-cbfb-42d4-944e-aee067022382-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-z8pkt\" (UID: \"956e88bb-cbfb-42d4-944e-aee067022382\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z8pkt" Jul 02 19:56:36.940513 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.940492 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m87vb\" (UniqueName: \"kubernetes.io/projected/956e88bb-cbfb-42d4-944e-aee067022382-kube-api-access-m87vb\") pod \"cert-manager-cainjector-559cdd8c87-z8pkt\" (UID: \"956e88bb-cbfb-42d4-944e-aee067022382\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z8pkt" Jul 02 19:56:36.990421 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:36.990359 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-z8pkt" Jul 02 19:56:37.118813 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:37.118791 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-z8pkt"] Jul 02 19:56:37.120616 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:56:37.120593 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod956e88bb_cbfb_42d4_944e_aee067022382.slice/crio-1949f96df7cbd135fa4c20d6eb9a8e86829bfc0788bf301dc8b757caa625c234 WatchSource:0}: Error finding container 1949f96df7cbd135fa4c20d6eb9a8e86829bfc0788bf301dc8b757caa625c234: Status 404 returned error can't find the container with id 1949f96df7cbd135fa4c20d6eb9a8e86829bfc0788bf301dc8b757caa625c234 Jul 02 19:56:37.462371 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:37.462343 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9" Jul 02 19:56:37.462543 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:37.462341 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftg8s9" event={"ID":"06124570-cae2-44ef-917f-bc6d546cdf8f","Type":"ContainerDied","Data":"7cb60ed06d26557b305c0e8835ab8420e2ddabd3b787cf6668d3b4ace53444ea"} Jul 02 19:56:37.462543 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:37.462464 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7cb60ed06d26557b305c0e8835ab8420e2ddabd3b787cf6668d3b4ace53444ea" Jul 02 19:56:37.463908 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:37.463880 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-z8pkt" event={"ID":"956e88bb-cbfb-42d4-944e-aee067022382","Type":"ContainerStarted","Data":"9410ae705136bae5ca7500ad8c746aa51bc43f2b0761e4b32ebb950688f5f1fb"} Jul 02 19:56:37.464012 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:37.463920 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-z8pkt" event={"ID":"956e88bb-cbfb-42d4-944e-aee067022382","Type":"ContainerStarted","Data":"1949f96df7cbd135fa4c20d6eb9a8e86829bfc0788bf301dc8b757caa625c234"} Jul 02 19:56:37.479367 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:37.479315 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-z8pkt" podStartSLOduration=1.479297123 podStartE2EDuration="1.479297123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:56:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:56:37.478722639 +0000 UTC m=+346.048326710" watchObservedRunningTime="2026-07-02 19:56:37.479297123 +0000 UTC m=+346.048901194" Jul 02 19:56:40.453300 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:40.453244 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7krp8" Jul 02 19:56:50.912479 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:50.912398 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p"] Jul 02 19:56:50.916003 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:50.915986 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p" Jul 02 19:56:50.918837 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:50.918817 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8929d\"" Jul 02 19:56:50.919148 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:50.919132 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 19:56:50.919912 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:50.919896 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 19:56:50.927330 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:50.927310 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p"] Jul 02 19:56:51.053829 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:51.053790 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsklf\" (UniqueName: \"kubernetes.io/projected/7518773c-63f5-4a68-b824-4d7b45e166a7-kube-api-access-qsklf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p\" (UID: \"7518773c-63f5-4a68-b824-4d7b45e166a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p" Jul 02 19:56:51.053829 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:51.053835 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7518773c-63f5-4a68-b824-4d7b45e166a7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p\" (UID: \"7518773c-63f5-4a68-b824-4d7b45e166a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p" Jul 02 19:56:51.054029 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:51.053858 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7518773c-63f5-4a68-b824-4d7b45e166a7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p\" (UID: \"7518773c-63f5-4a68-b824-4d7b45e166a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p" Jul 02 19:56:51.155061 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:51.155018 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsklf\" (UniqueName: \"kubernetes.io/projected/7518773c-63f5-4a68-b824-4d7b45e166a7-kube-api-access-qsklf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p\" (UID: \"7518773c-63f5-4a68-b824-4d7b45e166a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p" Jul 02 19:56:51.155061 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:51.155067 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7518773c-63f5-4a68-b824-4d7b45e166a7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p\" (UID: \"7518773c-63f5-4a68-b824-4d7b45e166a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p" Jul 02 19:56:51.155299 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:51.155087 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7518773c-63f5-4a68-b824-4d7b45e166a7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p\" (UID: \"7518773c-63f5-4a68-b824-4d7b45e166a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p" Jul 02 19:56:51.155448 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:51.155430 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7518773c-63f5-4a68-b824-4d7b45e166a7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p\" (UID: \"7518773c-63f5-4a68-b824-4d7b45e166a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p" Jul 02 19:56:51.155483 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:51.155460 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7518773c-63f5-4a68-b824-4d7b45e166a7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p\" (UID: \"7518773c-63f5-4a68-b824-4d7b45e166a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p" Jul 02 19:56:51.164403 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:51.164343 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsklf\" (UniqueName: \"kubernetes.io/projected/7518773c-63f5-4a68-b824-4d7b45e166a7-kube-api-access-qsklf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p\" (UID: \"7518773c-63f5-4a68-b824-4d7b45e166a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p" Jul 02 19:56:51.225828 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:51.225798 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p" Jul 02 19:56:51.377355 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:51.377330 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p"] Jul 02 19:56:51.378969 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:56:51.378937 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7518773c_63f5_4a68_b824_4d7b45e166a7.slice/crio-e83223fb71a3a964ec8fb564acde129d72a1c662e3e479ab062ba11e799605c4 WatchSource:0}: Error finding container e83223fb71a3a964ec8fb564acde129d72a1c662e3e479ab062ba11e799605c4: Status 404 returned error can't find the container with id e83223fb71a3a964ec8fb564acde129d72a1c662e3e479ab062ba11e799605c4 Jul 02 19:56:51.528622 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:51.528588 2560 generic.go:356] "Generic (PLEG): container finished" podID="7518773c-63f5-4a68-b824-4d7b45e166a7" containerID="c975096a6131c2b34f485dad912b3117b15e1a9e41be137121a0d0b568c42580" exitCode=0 Jul 02 19:56:51.528778 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:51.528681 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p" event={"ID":"7518773c-63f5-4a68-b824-4d7b45e166a7","Type":"ContainerDied","Data":"c975096a6131c2b34f485dad912b3117b15e1a9e41be137121a0d0b568c42580"} Jul 02 19:56:51.528778 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:51.528735 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p" event={"ID":"7518773c-63f5-4a68-b824-4d7b45e166a7","Type":"ContainerStarted","Data":"e83223fb71a3a964ec8fb564acde129d72a1c662e3e479ab062ba11e799605c4"} Jul 02 19:56:52.534461 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:52.534427 2560 generic.go:356] "Generic (PLEG): container finished" podID="7518773c-63f5-4a68-b824-4d7b45e166a7" containerID="89fad9dc91d40c00160d85b7c08a6f686c71239b4a298fd81b0b7fc91df7a039" exitCode=0 Jul 02 19:56:52.534920 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:52.534516 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p" event={"ID":"7518773c-63f5-4a68-b824-4d7b45e166a7","Type":"ContainerDied","Data":"89fad9dc91d40c00160d85b7c08a6f686c71239b4a298fd81b0b7fc91df7a039"} Jul 02 19:56:53.541211 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:53.541173 2560 generic.go:356] "Generic (PLEG): container finished" podID="7518773c-63f5-4a68-b824-4d7b45e166a7" containerID="b573e63ec51a25661a9e0f9ddba7455c7ca897efaaa3ebc7bdac1deddfbda094" exitCode=0 Jul 02 19:56:53.541607 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:53.541273 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p" event={"ID":"7518773c-63f5-4a68-b824-4d7b45e166a7","Type":"ContainerDied","Data":"b573e63ec51a25661a9e0f9ddba7455c7ca897efaaa3ebc7bdac1deddfbda094"} Jul 02 19:56:54.673507 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:54.673485 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p" Jul 02 19:56:54.785313 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:54.785285 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsklf\" (UniqueName: \"kubernetes.io/projected/7518773c-63f5-4a68-b824-4d7b45e166a7-kube-api-access-qsklf\") pod \"7518773c-63f5-4a68-b824-4d7b45e166a7\" (UID: \"7518773c-63f5-4a68-b824-4d7b45e166a7\") " Jul 02 19:56:54.785503 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:54.785324 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7518773c-63f5-4a68-b824-4d7b45e166a7-util\") pod \"7518773c-63f5-4a68-b824-4d7b45e166a7\" (UID: \"7518773c-63f5-4a68-b824-4d7b45e166a7\") " Jul 02 19:56:54.785503 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:54.785370 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7518773c-63f5-4a68-b824-4d7b45e166a7-bundle\") pod \"7518773c-63f5-4a68-b824-4d7b45e166a7\" (UID: \"7518773c-63f5-4a68-b824-4d7b45e166a7\") " Jul 02 19:56:54.786139 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:54.786112 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7518773c-63f5-4a68-b824-4d7b45e166a7-bundle" (OuterVolumeSpecName: "bundle") pod "7518773c-63f5-4a68-b824-4d7b45e166a7" (UID: "7518773c-63f5-4a68-b824-4d7b45e166a7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:56:54.787623 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:54.787591 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7518773c-63f5-4a68-b824-4d7b45e166a7-kube-api-access-qsklf" (OuterVolumeSpecName: "kube-api-access-qsklf") pod "7518773c-63f5-4a68-b824-4d7b45e166a7" (UID: "7518773c-63f5-4a68-b824-4d7b45e166a7"). InnerVolumeSpecName "kube-api-access-qsklf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:56:54.793312 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:54.793285 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7518773c-63f5-4a68-b824-4d7b45e166a7-util" (OuterVolumeSpecName: "util") pod "7518773c-63f5-4a68-b824-4d7b45e166a7" (UID: "7518773c-63f5-4a68-b824-4d7b45e166a7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:56:54.886008 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:54.885946 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7518773c-63f5-4a68-b824-4d7b45e166a7-bundle\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:56:54.886008 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:54.885969 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsklf\" (UniqueName: \"kubernetes.io/projected/7518773c-63f5-4a68-b824-4d7b45e166a7-kube-api-access-qsklf\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:56:54.886008 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:54.885979 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7518773c-63f5-4a68-b824-4d7b45e166a7-util\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:56:55.551419 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:55.551388 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p" Jul 02 19:56:55.551580 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:55.551415 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gs7p" event={"ID":"7518773c-63f5-4a68-b824-4d7b45e166a7","Type":"ContainerDied","Data":"e83223fb71a3a964ec8fb564acde129d72a1c662e3e479ab062ba11e799605c4"} Jul 02 19:56:55.551580 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:56:55.551463 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e83223fb71a3a964ec8fb564acde129d72a1c662e3e479ab062ba11e799605c4" Jul 02 19:57:03.886030 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:03.885991 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fc9d97d57-k22gg"] Jul 02 19:57:03.886439 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:03.886298 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7518773c-63f5-4a68-b824-4d7b45e166a7" containerName="util" Jul 02 19:57:03.886439 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:03.886309 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7518773c-63f5-4a68-b824-4d7b45e166a7" containerName="util" Jul 02 19:57:03.886439 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:03.886329 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7518773c-63f5-4a68-b824-4d7b45e166a7" containerName="extract" Jul 02 19:57:03.886439 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:03.886336 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7518773c-63f5-4a68-b824-4d7b45e166a7" containerName="extract" Jul 02 19:57:03.886439 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:03.886349 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7518773c-63f5-4a68-b824-4d7b45e166a7" containerName="pull" Jul 02 19:57:03.886439 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:03.886359 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7518773c-63f5-4a68-b824-4d7b45e166a7" containerName="pull" Jul 02 19:57:03.886439 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:03.886432 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7518773c-63f5-4a68-b824-4d7b45e166a7" containerName="extract" Jul 02 19:57:03.888817 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:03.888798 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-k22gg" Jul 02 19:57:03.893474 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:03.893456 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 19:57:03.895400 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:03.895379 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 19:57:03.897603 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:03.897586 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:57:03.902164 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:03.902145 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rs4x8\"" Jul 02 19:57:03.903721 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:03.903704 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 19:57:03.903935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:03.903923 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 19:57:03.937437 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:03.937406 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fc9d97d57-k22gg"] Jul 02 19:57:03.957573 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:03.957547 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e0fc8cea-f218-4790-97d7-eced3beaf967-cert\") pod \"lws-controller-manager-7fc9d97d57-k22gg\" (UID: \"e0fc8cea-f218-4790-97d7-eced3beaf967\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-k22gg" Jul 02 19:57:03.957740 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:03.957586 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4lvt\" (UniqueName: \"kubernetes.io/projected/e0fc8cea-f218-4790-97d7-eced3beaf967-kube-api-access-v4lvt\") pod \"lws-controller-manager-7fc9d97d57-k22gg\" (UID: \"e0fc8cea-f218-4790-97d7-eced3beaf967\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-k22gg" Jul 02 19:57:03.957740 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:03.957627 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e0fc8cea-f218-4790-97d7-eced3beaf967-manager-config\") pod \"lws-controller-manager-7fc9d97d57-k22gg\" (UID: \"e0fc8cea-f218-4790-97d7-eced3beaf967\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-k22gg" Jul 02 19:57:03.957740 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:03.957695 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e0fc8cea-f218-4790-97d7-eced3beaf967-metrics-cert\") pod \"lws-controller-manager-7fc9d97d57-k22gg\" (UID: \"e0fc8cea-f218-4790-97d7-eced3beaf967\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-k22gg" Jul 02 19:57:04.058775 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:04.058737 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e0fc8cea-f218-4790-97d7-eced3beaf967-cert\") pod \"lws-controller-manager-7fc9d97d57-k22gg\" (UID: \"e0fc8cea-f218-4790-97d7-eced3beaf967\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-k22gg" Jul 02 19:57:04.058984 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:04.058794 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4lvt\" (UniqueName: \"kubernetes.io/projected/e0fc8cea-f218-4790-97d7-eced3beaf967-kube-api-access-v4lvt\") pod \"lws-controller-manager-7fc9d97d57-k22gg\" (UID: \"e0fc8cea-f218-4790-97d7-eced3beaf967\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-k22gg" Jul 02 19:57:04.058984 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:04.058844 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e0fc8cea-f218-4790-97d7-eced3beaf967-manager-config\") pod \"lws-controller-manager-7fc9d97d57-k22gg\" (UID: \"e0fc8cea-f218-4790-97d7-eced3beaf967\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-k22gg" Jul 02 19:57:04.059089 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:04.059026 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e0fc8cea-f218-4790-97d7-eced3beaf967-metrics-cert\") pod \"lws-controller-manager-7fc9d97d57-k22gg\" (UID: \"e0fc8cea-f218-4790-97d7-eced3beaf967\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-k22gg" Jul 02 19:57:04.059621 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:04.059595 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e0fc8cea-f218-4790-97d7-eced3beaf967-manager-config\") pod \"lws-controller-manager-7fc9d97d57-k22gg\" (UID: \"e0fc8cea-f218-4790-97d7-eced3beaf967\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-k22gg" Jul 02 19:57:04.061585 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:04.061561 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e0fc8cea-f218-4790-97d7-eced3beaf967-cert\") pod \"lws-controller-manager-7fc9d97d57-k22gg\" (UID: \"e0fc8cea-f218-4790-97d7-eced3beaf967\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-k22gg" Jul 02 19:57:04.061727 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:04.061595 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e0fc8cea-f218-4790-97d7-eced3beaf967-metrics-cert\") pod \"lws-controller-manager-7fc9d97d57-k22gg\" (UID: \"e0fc8cea-f218-4790-97d7-eced3beaf967\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-k22gg" Jul 02 19:57:04.082694 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:04.082662 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4lvt\" (UniqueName: \"kubernetes.io/projected/e0fc8cea-f218-4790-97d7-eced3beaf967-kube-api-access-v4lvt\") pod \"lws-controller-manager-7fc9d97d57-k22gg\" (UID: \"e0fc8cea-f218-4790-97d7-eced3beaf967\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-k22gg" Jul 02 19:57:04.198242 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:04.198155 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-k22gg" Jul 02 19:57:04.361044 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:04.359161 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fc9d97d57-k22gg"] Jul 02 19:57:04.364238 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:57:04.364208 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0fc8cea_f218_4790_97d7_eced3beaf967.slice/crio-bf7da8c810f4922b54aa35211cbf179fb1e652c53006aa9d0de83a3beda7a3a5 WatchSource:0}: Error finding container bf7da8c810f4922b54aa35211cbf179fb1e652c53006aa9d0de83a3beda7a3a5: Status 404 returned error can't find the container with id bf7da8c810f4922b54aa35211cbf179fb1e652c53006aa9d0de83a3beda7a3a5 Jul 02 19:57:04.596460 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:04.596423 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-k22gg" event={"ID":"e0fc8cea-f218-4790-97d7-eced3beaf967","Type":"ContainerStarted","Data":"bf7da8c810f4922b54aa35211cbf179fb1e652c53006aa9d0de83a3beda7a3a5"} Jul 02 19:57:05.941792 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:05.941754 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj"] Jul 02 19:57:05.944799 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:05.944777 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" Jul 02 19:57:05.950144 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:05.950113 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 19:57:05.950315 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:05.950185 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-s6hdw\"" Jul 02 19:57:05.950315 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:05.950184 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 19:57:05.950315 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:05.950214 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 19:57:05.950633 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:05.950613 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 19:57:05.974804 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:05.974771 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e3e80534-78fe-4588-9013-485a405eb04d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj\" (UID: \"e3e80534-78fe-4588-9013-485a405eb04d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" Jul 02 19:57:05.974965 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:05.974811 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzjvx\" (UniqueName: \"kubernetes.io/projected/e3e80534-78fe-4588-9013-485a405eb04d-kube-api-access-vzjvx\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj\" (UID: \"e3e80534-78fe-4588-9013-485a405eb04d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" Jul 02 19:57:05.975023 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:05.974998 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e3e80534-78fe-4588-9013-485a405eb04d-manifests\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj\" (UID: \"e3e80534-78fe-4588-9013-485a405eb04d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" Jul 02 19:57:05.975114 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:05.975090 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3e80534-78fe-4588-9013-485a405eb04d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj\" (UID: \"e3e80534-78fe-4588-9013-485a405eb04d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" Jul 02 19:57:05.975161 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:05.975128 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3e80534-78fe-4588-9013-485a405eb04d-tmp\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj\" (UID: \"e3e80534-78fe-4588-9013-485a405eb04d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" Jul 02 19:57:05.985575 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:05.985542 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj"] Jul 02 19:57:06.076188 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:06.076149 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e3e80534-78fe-4588-9013-485a405eb04d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj\" (UID: \"e3e80534-78fe-4588-9013-485a405eb04d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" Jul 02 19:57:06.076188 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:06.076189 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzjvx\" (UniqueName: \"kubernetes.io/projected/e3e80534-78fe-4588-9013-485a405eb04d-kube-api-access-vzjvx\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj\" (UID: \"e3e80534-78fe-4588-9013-485a405eb04d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" Jul 02 19:57:06.076466 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:06.076219 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e3e80534-78fe-4588-9013-485a405eb04d-manifests\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj\" (UID: \"e3e80534-78fe-4588-9013-485a405eb04d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" Jul 02 19:57:06.076466 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:06.076274 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3e80534-78fe-4588-9013-485a405eb04d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj\" (UID: \"e3e80534-78fe-4588-9013-485a405eb04d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" Jul 02 19:57:06.076466 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:06.076299 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3e80534-78fe-4588-9013-485a405eb04d-tmp\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj\" (UID: \"e3e80534-78fe-4588-9013-485a405eb04d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" Jul 02 19:57:06.076874 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:06.076846 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e3e80534-78fe-4588-9013-485a405eb04d-manifests\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj\" (UID: \"e3e80534-78fe-4588-9013-485a405eb04d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" Jul 02 19:57:06.079269 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:06.079228 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3e80534-78fe-4588-9013-485a405eb04d-tmp\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj\" (UID: \"e3e80534-78fe-4588-9013-485a405eb04d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" Jul 02 19:57:06.079437 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:06.079403 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3e80534-78fe-4588-9013-485a405eb04d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj\" (UID: \"e3e80534-78fe-4588-9013-485a405eb04d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" Jul 02 19:57:06.079510 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:06.079444 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e3e80534-78fe-4588-9013-485a405eb04d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj\" (UID: \"e3e80534-78fe-4588-9013-485a405eb04d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" Jul 02 19:57:06.095662 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:06.095632 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzjvx\" (UniqueName: \"kubernetes.io/projected/e3e80534-78fe-4588-9013-485a405eb04d-kube-api-access-vzjvx\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj\" (UID: \"e3e80534-78fe-4588-9013-485a405eb04d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" Jul 02 19:57:06.258915 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:06.258876 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" Jul 02 19:57:06.557306 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:06.557282 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj"] Jul 02 19:57:06.559409 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:57:06.559383 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3e80534_78fe_4588_9013_485a405eb04d.slice/crio-d5e6376267a95a2e087433fcfb6be934aaa564432860075703ad8adddad83da0 WatchSource:0}: Error finding container d5e6376267a95a2e087433fcfb6be934aaa564432860075703ad8adddad83da0: Status 404 returned error can't find the container with id d5e6376267a95a2e087433fcfb6be934aaa564432860075703ad8adddad83da0 Jul 02 19:57:06.607300 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:06.607265 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-k22gg" event={"ID":"e0fc8cea-f218-4790-97d7-eced3beaf967","Type":"ContainerStarted","Data":"569673c9105af3634731137d6b44c6edce138db9f86e91753da3603cd4b4ddd5"} Jul 02 19:57:06.607469 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:06.607432 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-k22gg" Jul 02 19:57:06.608509 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:06.608487 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" event={"ID":"e3e80534-78fe-4588-9013-485a405eb04d","Type":"ContainerStarted","Data":"d5e6376267a95a2e087433fcfb6be934aaa564432860075703ad8adddad83da0"} Jul 02 19:57:06.625140 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:06.625091 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-k22gg" podStartSLOduration=1.5385736209999998 podStartE2EDuration="3.62507627s" totalImagesPullingTime="2.086502649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:06.624461133 +0000 UTC m=+375.194065204" watchObservedRunningTime="2026-07-02 19:57:06.62507627 +0000 UTC m=+375.194680340" Jul 02 19:57:09.626393 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:09.626303 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" event={"ID":"e3e80534-78fe-4588-9013-485a405eb04d","Type":"ContainerStarted","Data":"08f0681ed2d53f0eaa758604ee38165e97148e011d3038c3399cbd1e7b2f8ceb"} Jul 02 19:57:10.632751 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:10.632668 2560 generic.go:356] "Generic (PLEG): container finished" podID="e3e80534-78fe-4588-9013-485a405eb04d" containerID="08f0681ed2d53f0eaa758604ee38165e97148e011d3038c3399cbd1e7b2f8ceb" exitCode=0 Jul 02 19:57:10.633134 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:10.632762 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" event={"ID":"e3e80534-78fe-4588-9013-485a405eb04d","Type":"ContainerDied","Data":"08f0681ed2d53f0eaa758604ee38165e97148e011d3038c3399cbd1e7b2f8ceb"} Jul 02 19:57:11.639439 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:11.639399 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" event={"ID":"e3e80534-78fe-4588-9013-485a405eb04d","Type":"ContainerStarted","Data":"4f17ed986e7430b470f02919eb08babfae18339405400813a105f681f1ecf298"} Jul 02 19:57:11.639914 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:11.639571 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" Jul 02 19:57:11.667458 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:11.667404 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" podStartSLOduration=2.609408192 podStartE2EDuration="6.66738686s" totalImagesPullingTime="3.048869343s" totalInitContainerRuntime="1.009109325s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:11.665897741 +0000 UTC m=+380.235502114" watchObservedRunningTime="2026-07-02 19:57:11.66738686 +0000 UTC m=+380.236990930" Jul 02 19:57:17.616631 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:17.616605 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-k22gg" Jul 02 19:57:22.646823 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:22.646784 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj" Jul 02 19:57:47.515431 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.515395 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7"] Jul 02 19:57:47.517723 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.517708 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.521635 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.521542 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-qtx98\"" Jul 02 19:57:47.521767 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.521720 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 19:57:47.552393 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.552370 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7"] Jul 02 19:57:47.643795 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.643767 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38f43236-c979-40be-8733-b325081cd474-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.643941 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.643809 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38f43236-c979-40be-8733-b325081cd474-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.643941 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.643828 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38f43236-c979-40be-8733-b325081cd474-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.643941 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.643872 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38f43236-c979-40be-8733-b325081cd474-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.643941 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.643894 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38f43236-c979-40be-8733-b325081cd474-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.644073 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.643963 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38f43236-c979-40be-8733-b325081cd474-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.644073 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.644019 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxb7m\" (UniqueName: \"kubernetes.io/projected/38f43236-c979-40be-8733-b325081cd474-kube-api-access-vxb7m\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.644073 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.644043 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38f43236-c979-40be-8733-b325081cd474-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.644073 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.644061 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38f43236-c979-40be-8733-b325081cd474-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.745067 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.745032 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxb7m\" (UniqueName: \"kubernetes.io/projected/38f43236-c979-40be-8733-b325081cd474-kube-api-access-vxb7m\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.745238 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.745087 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38f43236-c979-40be-8733-b325081cd474-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.745238 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.745122 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38f43236-c979-40be-8733-b325081cd474-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.745238 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.745153 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38f43236-c979-40be-8733-b325081cd474-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.745238 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.745208 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38f43236-c979-40be-8733-b325081cd474-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.745238 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.745237 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38f43236-c979-40be-8733-b325081cd474-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.745541 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.745307 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38f43236-c979-40be-8733-b325081cd474-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.745541 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.745336 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38f43236-c979-40be-8733-b325081cd474-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.745747 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.745724 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38f43236-c979-40be-8733-b325081cd474-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.745844 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.745671 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38f43236-c979-40be-8733-b325081cd474-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.745844 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.745764 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38f43236-c979-40be-8733-b325081cd474-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.745844 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.745801 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38f43236-c979-40be-8733-b325081cd474-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.746003 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.745947 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38f43236-c979-40be-8733-b325081cd474-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.746003 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.745966 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38f43236-c979-40be-8733-b325081cd474-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.747573 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.747550 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38f43236-c979-40be-8733-b325081cd474-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.747694 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.747677 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38f43236-c979-40be-8733-b325081cd474-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.754873 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.754854 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38f43236-c979-40be-8733-b325081cd474-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.756641 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.756624 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxb7m\" (UniqueName: \"kubernetes.io/projected/38f43236-c979-40be-8733-b325081cd474-kube-api-access-vxb7m\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l79f7\" (UID: \"38f43236-c979-40be-8733-b325081cd474\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.828222 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.828167 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:47.975585 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:47.975561 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7"] Jul 02 19:57:47.977769 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:57:47.977740 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38f43236_c979_40be_8733_b325081cd474.slice/crio-4064e231248b56e05149a67766525816cf2da33cb3ad315d9ad4734fbed3d364 WatchSource:0}: Error finding container 4064e231248b56e05149a67766525816cf2da33cb3ad315d9ad4734fbed3d364: Status 404 returned error can't find the container with id 4064e231248b56e05149a67766525816cf2da33cb3ad315d9ad4734fbed3d364 Jul 02 19:57:48.821138 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:48.821100 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" event={"ID":"38f43236-c979-40be-8733-b325081cd474","Type":"ContainerStarted","Data":"4064e231248b56e05149a67766525816cf2da33cb3ad315d9ad4734fbed3d364"} Jul 02 19:57:51.920850 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:51.920811 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 19:57:51.921084 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:51.920886 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 19:57:51.921084 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:51.920918 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 19:57:52.844191 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:52.844153 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" event={"ID":"38f43236-c979-40be-8733-b325081cd474","Type":"ContainerStarted","Data":"fd0b95e6392380d700f2bf690b63682880872cff800923f682c3af41d54b2a7f"} Jul 02 19:57:52.866646 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:52.866603 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" podStartSLOduration=1.926267664 podStartE2EDuration="5.866591398s" totalImagesPullingTime="3.940323734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:52.865388426 +0000 UTC m=+421.434992521" watchObservedRunningTime="2026-07-02 19:57:52.866591398 +0000 UTC m=+421.436195469" Jul 02 19:57:53.828665 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:53.828625 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:53.832729 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:53.832703 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:53.848646 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:53.848615 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:57:53.849283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:57:53.849267 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l79f7" Jul 02 19:58:27.417270 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:27.417168 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2jtvm"] Jul 02 19:58:27.423356 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:27.423333 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2jtvm" Jul 02 19:58:27.434972 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:27.434951 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-h8lwd\"" Jul 02 19:58:27.435990 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:27.435888 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 19:58:27.436104 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:27.435987 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 19:58:27.456290 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:27.456264 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2jtvm"] Jul 02 19:58:27.581401 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:27.581370 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7dss\" (UniqueName: \"kubernetes.io/projected/76039b0d-0910-4f11-8df4-976aac9637af-kube-api-access-h7dss\") pod \"kuadrant-operator-catalog-2jtvm\" (UID: \"76039b0d-0910-4f11-8df4-976aac9637af\") " pod="kuadrant-system/kuadrant-operator-catalog-2jtvm" Jul 02 19:58:27.682061 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:27.681972 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7dss\" (UniqueName: \"kubernetes.io/projected/76039b0d-0910-4f11-8df4-976aac9637af-kube-api-access-h7dss\") pod \"kuadrant-operator-catalog-2jtvm\" (UID: \"76039b0d-0910-4f11-8df4-976aac9637af\") " pod="kuadrant-system/kuadrant-operator-catalog-2jtvm" Jul 02 19:58:27.691757 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:27.691731 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7dss\" (UniqueName: \"kubernetes.io/projected/76039b0d-0910-4f11-8df4-976aac9637af-kube-api-access-h7dss\") pod \"kuadrant-operator-catalog-2jtvm\" (UID: \"76039b0d-0910-4f11-8df4-976aac9637af\") " pod="kuadrant-system/kuadrant-operator-catalog-2jtvm" Jul 02 19:58:27.732759 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:27.732735 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2jtvm" Jul 02 19:58:27.757200 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:27.757178 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2jtvm"] Jul 02 19:58:27.872311 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:27.872290 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2jtvm"] Jul 02 19:58:27.875199 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:58:27.875173 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76039b0d_0910_4f11_8df4_976aac9637af.slice/crio-2477db474833532ed5d83c0fe0660748d3f059e2287ae2089f787722b494be74 WatchSource:0}: Error finding container 2477db474833532ed5d83c0fe0660748d3f059e2287ae2089f787722b494be74: Status 404 returned error can't find the container with id 2477db474833532ed5d83c0fe0660748d3f059e2287ae2089f787722b494be74 Jul 02 19:58:27.968818 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:27.968791 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cwqwb"] Jul 02 19:58:27.971545 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:27.971528 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cwqwb" Jul 02 19:58:27.981452 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:27.981432 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cwqwb"] Jul 02 19:58:28.008485 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:28.008461 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2jtvm" event={"ID":"76039b0d-0910-4f11-8df4-976aac9637af","Type":"ContainerStarted","Data":"2477db474833532ed5d83c0fe0660748d3f059e2287ae2089f787722b494be74"} Jul 02 19:58:28.083974 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:28.083942 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsd9t\" (UniqueName: \"kubernetes.io/projected/243feb22-2f0e-40b1-b169-d7042f369294-kube-api-access-nsd9t\") pod \"kuadrant-operator-catalog-cwqwb\" (UID: \"243feb22-2f0e-40b1-b169-d7042f369294\") " pod="kuadrant-system/kuadrant-operator-catalog-cwqwb" Jul 02 19:58:28.185327 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:28.185291 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsd9t\" (UniqueName: \"kubernetes.io/projected/243feb22-2f0e-40b1-b169-d7042f369294-kube-api-access-nsd9t\") pod \"kuadrant-operator-catalog-cwqwb\" (UID: \"243feb22-2f0e-40b1-b169-d7042f369294\") " pod="kuadrant-system/kuadrant-operator-catalog-cwqwb" Jul 02 19:58:28.194645 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:28.194614 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsd9t\" (UniqueName: \"kubernetes.io/projected/243feb22-2f0e-40b1-b169-d7042f369294-kube-api-access-nsd9t\") pod \"kuadrant-operator-catalog-cwqwb\" (UID: \"243feb22-2f0e-40b1-b169-d7042f369294\") " pod="kuadrant-system/kuadrant-operator-catalog-cwqwb" Jul 02 19:58:28.280724 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:28.280635 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cwqwb" Jul 02 19:58:28.416567 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:28.416537 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cwqwb"] Jul 02 19:58:28.422339 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:58:28.422306 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod243feb22_2f0e_40b1_b169_d7042f369294.slice/crio-685b5fa949bcc66732828fcdf11c1a8ac8027e8469c26b0db813e6d928acf5fe WatchSource:0}: Error finding container 685b5fa949bcc66732828fcdf11c1a8ac8027e8469c26b0db813e6d928acf5fe: Status 404 returned error can't find the container with id 685b5fa949bcc66732828fcdf11c1a8ac8027e8469c26b0db813e6d928acf5fe Jul 02 19:58:29.015318 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:29.015280 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cwqwb" event={"ID":"243feb22-2f0e-40b1-b169-d7042f369294","Type":"ContainerStarted","Data":"685b5fa949bcc66732828fcdf11c1a8ac8027e8469c26b0db813e6d928acf5fe"} Jul 02 19:58:31.026015 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:31.025978 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2jtvm" event={"ID":"76039b0d-0910-4f11-8df4-976aac9637af","Type":"ContainerStarted","Data":"cf738eafe13b335834bda5ef0bd7190477b60f417e5660c678ba87052821d76e"} Jul 02 19:58:31.026518 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:31.026021 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-2jtvm" podUID="76039b0d-0910-4f11-8df4-976aac9637af" containerName="registry-server" containerID="cri-o://cf738eafe13b335834bda5ef0bd7190477b60f417e5660c678ba87052821d76e" gracePeriod=2 Jul 02 19:58:31.027644 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:31.027618 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cwqwb" event={"ID":"243feb22-2f0e-40b1-b169-d7042f369294","Type":"ContainerStarted","Data":"3f161f37b63638341fccded4b7b6ca49d6635d287172ff007cb6565070bfa1bc"} Jul 02 19:58:31.059267 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:31.058279 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2jtvm" podStartSLOduration=1.8511035850000002 podStartE2EDuration="4.058242512s" totalImagesPullingTime="2.207138927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:58:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:58:31.057567161 +0000 UTC m=+459.627171231" watchObservedRunningTime="2026-07-02 19:58:31.058242512 +0000 UTC m=+459.627846586" Jul 02 19:58:31.082941 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:31.082890 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-cwqwb" podStartSLOduration=2.420254959 podStartE2EDuration="4.082876211s" totalImagesPullingTime="1.662621252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:58:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:58:31.080593164 +0000 UTC m=+459.650197254" watchObservedRunningTime="2026-07-02 19:58:31.082876211 +0000 UTC m=+459.652480281" Jul 02 19:58:31.272945 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:31.272922 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2jtvm" Jul 02 19:58:31.415738 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:31.415641 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7dss\" (UniqueName: \"kubernetes.io/projected/76039b0d-0910-4f11-8df4-976aac9637af-kube-api-access-h7dss\") pod \"76039b0d-0910-4f11-8df4-976aac9637af\" (UID: \"76039b0d-0910-4f11-8df4-976aac9637af\") " Jul 02 19:58:31.417828 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:31.417800 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76039b0d-0910-4f11-8df4-976aac9637af-kube-api-access-h7dss" (OuterVolumeSpecName: "kube-api-access-h7dss") pod "76039b0d-0910-4f11-8df4-976aac9637af" (UID: "76039b0d-0910-4f11-8df4-976aac9637af"). InnerVolumeSpecName "kube-api-access-h7dss". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:58:31.516527 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:31.516495 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7dss\" (UniqueName: \"kubernetes.io/projected/76039b0d-0910-4f11-8df4-976aac9637af-kube-api-access-h7dss\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:58:32.033943 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:32.033909 2560 generic.go:356] "Generic (PLEG): container finished" podID="76039b0d-0910-4f11-8df4-976aac9637af" containerID="cf738eafe13b335834bda5ef0bd7190477b60f417e5660c678ba87052821d76e" exitCode=0 Jul 02 19:58:32.034452 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:32.033981 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2jtvm" Jul 02 19:58:32.034452 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:32.033994 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2jtvm" event={"ID":"76039b0d-0910-4f11-8df4-976aac9637af","Type":"ContainerDied","Data":"cf738eafe13b335834bda5ef0bd7190477b60f417e5660c678ba87052821d76e"} Jul 02 19:58:32.034452 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:32.034056 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2jtvm" event={"ID":"76039b0d-0910-4f11-8df4-976aac9637af","Type":"ContainerDied","Data":"2477db474833532ed5d83c0fe0660748d3f059e2287ae2089f787722b494be74"} Jul 02 19:58:32.034452 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:32.034082 2560 scope.go:117] "RemoveContainer" containerID="cf738eafe13b335834bda5ef0bd7190477b60f417e5660c678ba87052821d76e" Jul 02 19:58:32.044519 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:32.044502 2560 scope.go:117] "RemoveContainer" containerID="cf738eafe13b335834bda5ef0bd7190477b60f417e5660c678ba87052821d76e" Jul 02 19:58:32.044727 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:58:32.044708 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf738eafe13b335834bda5ef0bd7190477b60f417e5660c678ba87052821d76e\": container with ID starting with cf738eafe13b335834bda5ef0bd7190477b60f417e5660c678ba87052821d76e not found: ID does not exist" containerID="cf738eafe13b335834bda5ef0bd7190477b60f417e5660c678ba87052821d76e" Jul 02 19:58:32.044824 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:32.044734 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf738eafe13b335834bda5ef0bd7190477b60f417e5660c678ba87052821d76e"} err="failed to get container status \"cf738eafe13b335834bda5ef0bd7190477b60f417e5660c678ba87052821d76e\": rpc error: code = NotFound desc = could not find container \"cf738eafe13b335834bda5ef0bd7190477b60f417e5660c678ba87052821d76e\": container with ID starting with cf738eafe13b335834bda5ef0bd7190477b60f417e5660c678ba87052821d76e not found: ID does not exist" Jul 02 19:58:32.055157 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:32.055138 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2jtvm"] Jul 02 19:58:32.060667 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:32.060648 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2jtvm"] Jul 02 19:58:33.933782 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:33.933748 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76039b0d-0910-4f11-8df4-976aac9637af" path="/var/lib/kubelet/pods/76039b0d-0910-4f11-8df4-976aac9637af/volumes" Jul 02 19:58:38.280795 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:38.280756 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-cwqwb" Jul 02 19:58:38.281197 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:38.280821 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-cwqwb" Jul 02 19:58:38.303777 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:38.303751 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-cwqwb" Jul 02 19:58:39.089089 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:39.089061 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-cwqwb" Jul 02 19:58:43.612844 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:43.612808 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59"] Jul 02 19:58:43.613329 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:43.613311 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76039b0d-0910-4f11-8df4-976aac9637af" containerName="registry-server" Jul 02 19:58:43.613420 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:43.613332 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="76039b0d-0910-4f11-8df4-976aac9637af" containerName="registry-server" Jul 02 19:58:43.613477 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:43.613418 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="76039b0d-0910-4f11-8df4-976aac9637af" containerName="registry-server" Jul 02 19:58:43.617852 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:43.617831 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59" Jul 02 19:58:43.620785 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:43.620764 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6kbnp\"" Jul 02 19:58:43.628019 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:43.627986 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59"] Jul 02 19:58:43.715637 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:43.715603 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b361c4a0-67a4-46f9-9014-f7414d9a56e2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59\" (UID: \"b361c4a0-67a4-46f9-9014-f7414d9a56e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59" Jul 02 19:58:43.715771 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:43.715669 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxd59\" (UniqueName: \"kubernetes.io/projected/b361c4a0-67a4-46f9-9014-f7414d9a56e2-kube-api-access-fxd59\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59\" (UID: \"b361c4a0-67a4-46f9-9014-f7414d9a56e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59" Jul 02 19:58:43.715771 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:43.715738 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b361c4a0-67a4-46f9-9014-f7414d9a56e2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59\" (UID: \"b361c4a0-67a4-46f9-9014-f7414d9a56e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59" Jul 02 19:58:43.816529 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:43.816498 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b361c4a0-67a4-46f9-9014-f7414d9a56e2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59\" (UID: \"b361c4a0-67a4-46f9-9014-f7414d9a56e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59" Jul 02 19:58:43.816665 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:43.816549 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxd59\" (UniqueName: \"kubernetes.io/projected/b361c4a0-67a4-46f9-9014-f7414d9a56e2-kube-api-access-fxd59\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59\" (UID: \"b361c4a0-67a4-46f9-9014-f7414d9a56e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59" Jul 02 19:58:43.816665 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:43.816580 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b361c4a0-67a4-46f9-9014-f7414d9a56e2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59\" (UID: \"b361c4a0-67a4-46f9-9014-f7414d9a56e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59" Jul 02 19:58:43.816923 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:43.816902 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b361c4a0-67a4-46f9-9014-f7414d9a56e2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59\" (UID: \"b361c4a0-67a4-46f9-9014-f7414d9a56e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59" Jul 02 19:58:43.816999 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:43.816911 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b361c4a0-67a4-46f9-9014-f7414d9a56e2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59\" (UID: \"b361c4a0-67a4-46f9-9014-f7414d9a56e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59" Jul 02 19:58:43.825495 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:43.825461 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxd59\" (UniqueName: \"kubernetes.io/projected/b361c4a0-67a4-46f9-9014-f7414d9a56e2-kube-api-access-fxd59\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59\" (UID: \"b361c4a0-67a4-46f9-9014-f7414d9a56e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59" Jul 02 19:58:43.928809 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:43.928742 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59" Jul 02 19:58:44.063142 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.063120 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59"] Jul 02 19:58:44.064921 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:58:44.064898 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb361c4a0_67a4_46f9_9014_f7414d9a56e2.slice/crio-0f28b4d8e6db5761d03b1cf39a620b103162b68aa30d80b369c5c49defee14ed WatchSource:0}: Error finding container 0f28b4d8e6db5761d03b1cf39a620b103162b68aa30d80b369c5c49defee14ed: Status 404 returned error can't find the container with id 0f28b4d8e6db5761d03b1cf39a620b103162b68aa30d80b369c5c49defee14ed Jul 02 19:58:44.090273 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.090231 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59" event={"ID":"b361c4a0-67a4-46f9-9014-f7414d9a56e2","Type":"ContainerStarted","Data":"0f28b4d8e6db5761d03b1cf39a620b103162b68aa30d80b369c5c49defee14ed"} Jul 02 19:58:44.213060 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.213026 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6"] Jul 02 19:58:44.216454 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.216436 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6" Jul 02 19:58:44.226072 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.226051 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6"] Jul 02 19:58:44.321833 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.321805 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjk97\" (UniqueName: \"kubernetes.io/projected/58362ddd-9c5b-4f91-b65f-8555c125901d-kube-api-access-gjk97\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6\" (UID: \"58362ddd-9c5b-4f91-b65f-8555c125901d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6" Jul 02 19:58:44.321947 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.321841 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58362ddd-9c5b-4f91-b65f-8555c125901d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6\" (UID: \"58362ddd-9c5b-4f91-b65f-8555c125901d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6" Jul 02 19:58:44.321947 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.321874 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58362ddd-9c5b-4f91-b65f-8555c125901d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6\" (UID: \"58362ddd-9c5b-4f91-b65f-8555c125901d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6" Jul 02 19:58:44.422783 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.422744 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjk97\" (UniqueName: \"kubernetes.io/projected/58362ddd-9c5b-4f91-b65f-8555c125901d-kube-api-access-gjk97\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6\" (UID: \"58362ddd-9c5b-4f91-b65f-8555c125901d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6" Jul 02 19:58:44.422783 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.422791 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58362ddd-9c5b-4f91-b65f-8555c125901d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6\" (UID: \"58362ddd-9c5b-4f91-b65f-8555c125901d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6" Jul 02 19:58:44.422935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.422825 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58362ddd-9c5b-4f91-b65f-8555c125901d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6\" (UID: \"58362ddd-9c5b-4f91-b65f-8555c125901d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6" Jul 02 19:58:44.423178 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.423164 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58362ddd-9c5b-4f91-b65f-8555c125901d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6\" (UID: \"58362ddd-9c5b-4f91-b65f-8555c125901d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6" Jul 02 19:58:44.423217 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.423188 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58362ddd-9c5b-4f91-b65f-8555c125901d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6\" (UID: \"58362ddd-9c5b-4f91-b65f-8555c125901d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6" Jul 02 19:58:44.432568 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.432547 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjk97\" (UniqueName: \"kubernetes.io/projected/58362ddd-9c5b-4f91-b65f-8555c125901d-kube-api-access-gjk97\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6\" (UID: \"58362ddd-9c5b-4f91-b65f-8555c125901d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6" Jul 02 19:58:44.554380 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.554319 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6" Jul 02 19:58:44.619319 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.619283 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj"] Jul 02 19:58:44.624010 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.623987 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj" Jul 02 19:58:44.631495 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.631129 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj"] Jul 02 19:58:44.688337 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.688307 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6"] Jul 02 19:58:44.691259 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:58:44.691220 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58362ddd_9c5b_4f91_b65f_8555c125901d.slice/crio-ca521e09c31a02e843eec4adf280c9d3fa359bacfad9d080e77f1a05765255cf WatchSource:0}: Error finding container ca521e09c31a02e843eec4adf280c9d3fa359bacfad9d080e77f1a05765255cf: Status 404 returned error can't find the container with id ca521e09c31a02e843eec4adf280c9d3fa359bacfad9d080e77f1a05765255cf Jul 02 19:58:44.724207 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.724184 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddb369e1-f829-489a-b338-b1e1ae8d620c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj\" (UID: \"ddb369e1-f829-489a-b338-b1e1ae8d620c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj" Jul 02 19:58:44.724323 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.724309 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9pws\" (UniqueName: \"kubernetes.io/projected/ddb369e1-f829-489a-b338-b1e1ae8d620c-kube-api-access-n9pws\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj\" (UID: \"ddb369e1-f829-489a-b338-b1e1ae8d620c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj" Jul 02 19:58:44.724388 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.724332 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddb369e1-f829-489a-b338-b1e1ae8d620c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj\" (UID: \"ddb369e1-f829-489a-b338-b1e1ae8d620c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj" Jul 02 19:58:44.825553 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.825493 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9pws\" (UniqueName: \"kubernetes.io/projected/ddb369e1-f829-489a-b338-b1e1ae8d620c-kube-api-access-n9pws\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj\" (UID: \"ddb369e1-f829-489a-b338-b1e1ae8d620c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj" Jul 02 19:58:44.825553 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.825528 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddb369e1-f829-489a-b338-b1e1ae8d620c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj\" (UID: \"ddb369e1-f829-489a-b338-b1e1ae8d620c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj" Jul 02 19:58:44.825694 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.825577 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddb369e1-f829-489a-b338-b1e1ae8d620c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj\" (UID: \"ddb369e1-f829-489a-b338-b1e1ae8d620c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj" Jul 02 19:58:44.825968 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.825949 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddb369e1-f829-489a-b338-b1e1ae8d620c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj\" (UID: \"ddb369e1-f829-489a-b338-b1e1ae8d620c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj" Jul 02 19:58:44.826009 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.825961 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddb369e1-f829-489a-b338-b1e1ae8d620c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj\" (UID: \"ddb369e1-f829-489a-b338-b1e1ae8d620c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj" Jul 02 19:58:44.834481 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.834456 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9pws\" (UniqueName: \"kubernetes.io/projected/ddb369e1-f829-489a-b338-b1e1ae8d620c-kube-api-access-n9pws\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj\" (UID: \"ddb369e1-f829-489a-b338-b1e1ae8d620c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj" Jul 02 19:58:44.933748 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:44.933717 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj" Jul 02 19:58:45.017633 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:45.017607 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q"] Jul 02 19:58:45.023843 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:45.023821 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q" Jul 02 19:58:45.031182 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:45.031161 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q"] Jul 02 19:58:45.070391 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:45.070367 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj"] Jul 02 19:58:45.072033 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:58:45.072004 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddb369e1_f829_489a_b338_b1e1ae8d620c.slice/crio-dc10a3a3f757ea2090c2d22a0dddca8c85c3c448b1f23349a24924e55f538330 WatchSource:0}: Error finding container dc10a3a3f757ea2090c2d22a0dddca8c85c3c448b1f23349a24924e55f538330: Status 404 returned error can't find the container with id dc10a3a3f757ea2090c2d22a0dddca8c85c3c448b1f23349a24924e55f538330 Jul 02 19:58:45.096483 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:45.096461 2560 generic.go:356] "Generic (PLEG): container finished" podID="b361c4a0-67a4-46f9-9014-f7414d9a56e2" containerID="6b431bc18e2e50c89875e10073fa85322aeca8bc95f5ed7b16a6d8d4bc0900ca" exitCode=0 Jul 02 19:58:45.096600 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:45.096533 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59" event={"ID":"b361c4a0-67a4-46f9-9014-f7414d9a56e2","Type":"ContainerDied","Data":"6b431bc18e2e50c89875e10073fa85322aeca8bc95f5ed7b16a6d8d4bc0900ca"} Jul 02 19:58:45.097799 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:45.097769 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj" event={"ID":"ddb369e1-f829-489a-b338-b1e1ae8d620c","Type":"ContainerStarted","Data":"dc10a3a3f757ea2090c2d22a0dddca8c85c3c448b1f23349a24924e55f538330"} Jul 02 19:58:45.099137 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:45.099120 2560 generic.go:356] "Generic (PLEG): container finished" podID="58362ddd-9c5b-4f91-b65f-8555c125901d" containerID="f25ccc081ad4b3cc9a41e742efd8eff16908a0973e360306c32efa0ab8f8a426" exitCode=0 Jul 02 19:58:45.099210 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:45.099155 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6" event={"ID":"58362ddd-9c5b-4f91-b65f-8555c125901d","Type":"ContainerDied","Data":"f25ccc081ad4b3cc9a41e742efd8eff16908a0973e360306c32efa0ab8f8a426"} Jul 02 19:58:45.099210 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:45.099183 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6" event={"ID":"58362ddd-9c5b-4f91-b65f-8555c125901d","Type":"ContainerStarted","Data":"ca521e09c31a02e843eec4adf280c9d3fa359bacfad9d080e77f1a05765255cf"} Jul 02 19:58:45.127897 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:45.127874 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da425dd5-b9eb-4acb-925c-c7d413c71cf0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q\" (UID: \"da425dd5-b9eb-4acb-925c-c7d413c71cf0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q" Jul 02 19:58:45.127991 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:45.127909 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da425dd5-b9eb-4acb-925c-c7d413c71cf0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q\" (UID: \"da425dd5-b9eb-4acb-925c-c7d413c71cf0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q" Jul 02 19:58:45.128085 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:45.128062 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd9gn\" (UniqueName: \"kubernetes.io/projected/da425dd5-b9eb-4acb-925c-c7d413c71cf0-kube-api-access-kd9gn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q\" (UID: \"da425dd5-b9eb-4acb-925c-c7d413c71cf0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q" Jul 02 19:58:45.228845 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:45.228817 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da425dd5-b9eb-4acb-925c-c7d413c71cf0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q\" (UID: \"da425dd5-b9eb-4acb-925c-c7d413c71cf0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q" Jul 02 19:58:45.228990 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:45.228863 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da425dd5-b9eb-4acb-925c-c7d413c71cf0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q\" (UID: \"da425dd5-b9eb-4acb-925c-c7d413c71cf0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q" Jul 02 19:58:45.229097 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:45.229067 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd9gn\" (UniqueName: \"kubernetes.io/projected/da425dd5-b9eb-4acb-925c-c7d413c71cf0-kube-api-access-kd9gn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q\" (UID: \"da425dd5-b9eb-4acb-925c-c7d413c71cf0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q" Jul 02 19:58:45.229237 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:45.229217 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da425dd5-b9eb-4acb-925c-c7d413c71cf0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q\" (UID: \"da425dd5-b9eb-4acb-925c-c7d413c71cf0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q" Jul 02 19:58:45.229318 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:45.229230 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da425dd5-b9eb-4acb-925c-c7d413c71cf0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q\" (UID: \"da425dd5-b9eb-4acb-925c-c7d413c71cf0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q" Jul 02 19:58:45.238446 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:45.238424 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd9gn\" (UniqueName: \"kubernetes.io/projected/da425dd5-b9eb-4acb-925c-c7d413c71cf0-kube-api-access-kd9gn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q\" (UID: \"da425dd5-b9eb-4acb-925c-c7d413c71cf0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q" Jul 02 19:58:45.336883 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:45.336826 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q" Jul 02 19:58:45.482492 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:45.482469 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q"] Jul 02 19:58:45.483876 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:58:45.483849 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda425dd5_b9eb_4acb_925c_c7d413c71cf0.slice/crio-cea0a9fea04b0ad1837637b1ee3c5c023c1649d7da8072ec0021287a45ec2806 WatchSource:0}: Error finding container cea0a9fea04b0ad1837637b1ee3c5c023c1649d7da8072ec0021287a45ec2806: Status 404 returned error can't find the container with id cea0a9fea04b0ad1837637b1ee3c5c023c1649d7da8072ec0021287a45ec2806 Jul 02 19:58:46.105769 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:46.105732 2560 generic.go:356] "Generic (PLEG): container finished" podID="58362ddd-9c5b-4f91-b65f-8555c125901d" containerID="81873365c3b1996e40333791d0623f3ddf5542b3cc993eb555fe733f55c42e2b" exitCode=0 Jul 02 19:58:46.106193 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:46.105826 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6" event={"ID":"58362ddd-9c5b-4f91-b65f-8555c125901d","Type":"ContainerDied","Data":"81873365c3b1996e40333791d0623f3ddf5542b3cc993eb555fe733f55c42e2b"} Jul 02 19:58:46.107672 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:46.107650 2560 generic.go:356] "Generic (PLEG): container finished" podID="b361c4a0-67a4-46f9-9014-f7414d9a56e2" containerID="d027191d5a078c613e8bf8f9713bbd464c117bcb0439847ae959ebe1e42f8d1f" exitCode=0 Jul 02 19:58:46.107777 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:46.107721 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59" event={"ID":"b361c4a0-67a4-46f9-9014-f7414d9a56e2","Type":"ContainerDied","Data":"d027191d5a078c613e8bf8f9713bbd464c117bcb0439847ae959ebe1e42f8d1f"} Jul 02 19:58:46.109360 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:46.109338 2560 generic.go:356] "Generic (PLEG): container finished" podID="da425dd5-b9eb-4acb-925c-c7d413c71cf0" containerID="bbba4fb38a079ca5f99f9d650592c74b137fae21890366748f0ef3eccc1abe69" exitCode=0 Jul 02 19:58:46.109433 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:46.109368 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q" event={"ID":"da425dd5-b9eb-4acb-925c-c7d413c71cf0","Type":"ContainerDied","Data":"bbba4fb38a079ca5f99f9d650592c74b137fae21890366748f0ef3eccc1abe69"} Jul 02 19:58:46.109433 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:46.109404 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q" event={"ID":"da425dd5-b9eb-4acb-925c-c7d413c71cf0","Type":"ContainerStarted","Data":"cea0a9fea04b0ad1837637b1ee3c5c023c1649d7da8072ec0021287a45ec2806"} Jul 02 19:58:46.112986 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:46.111480 2560 generic.go:356] "Generic (PLEG): container finished" podID="ddb369e1-f829-489a-b338-b1e1ae8d620c" containerID="242a3849f937cf602944f3861edae07e090d2bf2005f3e64c910bbbd41dc6343" exitCode=0 Jul 02 19:58:46.112986 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:46.111532 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj" event={"ID":"ddb369e1-f829-489a-b338-b1e1ae8d620c","Type":"ContainerDied","Data":"242a3849f937cf602944f3861edae07e090d2bf2005f3e64c910bbbd41dc6343"} Jul 02 19:58:47.119709 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:47.119684 2560 generic.go:356] "Generic (PLEG): container finished" podID="58362ddd-9c5b-4f91-b65f-8555c125901d" containerID="de1ca35b42fdfcd732027d0874e9da1e3b311c4510d6d275fbf414384126b44c" exitCode=0 Jul 02 19:58:47.120039 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:47.119770 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6" event={"ID":"58362ddd-9c5b-4f91-b65f-8555c125901d","Type":"ContainerDied","Data":"de1ca35b42fdfcd732027d0874e9da1e3b311c4510d6d275fbf414384126b44c"} Jul 02 19:58:47.122013 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:47.121992 2560 generic.go:356] "Generic (PLEG): container finished" podID="b361c4a0-67a4-46f9-9014-f7414d9a56e2" containerID="34edc9aba9757f86cae071155ed6e9cd5fcce1573e299e275f462603773dcd7a" exitCode=0 Jul 02 19:58:47.122098 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:47.122041 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59" event={"ID":"b361c4a0-67a4-46f9-9014-f7414d9a56e2","Type":"ContainerDied","Data":"34edc9aba9757f86cae071155ed6e9cd5fcce1573e299e275f462603773dcd7a"} Jul 02 19:58:48.128749 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.128715 2560 generic.go:356] "Generic (PLEG): container finished" podID="da425dd5-b9eb-4acb-925c-c7d413c71cf0" containerID="6d9d63286abaa7d7381babaae059ffa4bc6f181b4ee2c06a5f88b2110cdc5897" exitCode=0 Jul 02 19:58:48.129192 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.128809 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q" event={"ID":"da425dd5-b9eb-4acb-925c-c7d413c71cf0","Type":"ContainerDied","Data":"6d9d63286abaa7d7381babaae059ffa4bc6f181b4ee2c06a5f88b2110cdc5897"} Jul 02 19:58:48.130609 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.130590 2560 generic.go:356] "Generic (PLEG): container finished" podID="ddb369e1-f829-489a-b338-b1e1ae8d620c" containerID="4419bf90b503f6a2e558086092ee5eddbe7447de570d1ddf2c09cb151148016d" exitCode=0 Jul 02 19:58:48.130690 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.130663 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj" event={"ID":"ddb369e1-f829-489a-b338-b1e1ae8d620c","Type":"ContainerDied","Data":"4419bf90b503f6a2e558086092ee5eddbe7447de570d1ddf2c09cb151148016d"} Jul 02 19:58:48.384531 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.384477 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59" Jul 02 19:58:48.387447 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.387427 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6" Jul 02 19:58:48.559059 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.559027 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjk97\" (UniqueName: \"kubernetes.io/projected/58362ddd-9c5b-4f91-b65f-8555c125901d-kube-api-access-gjk97\") pod \"58362ddd-9c5b-4f91-b65f-8555c125901d\" (UID: \"58362ddd-9c5b-4f91-b65f-8555c125901d\") " Jul 02 19:58:48.559059 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.559063 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxd59\" (UniqueName: \"kubernetes.io/projected/b361c4a0-67a4-46f9-9014-f7414d9a56e2-kube-api-access-fxd59\") pod \"b361c4a0-67a4-46f9-9014-f7414d9a56e2\" (UID: \"b361c4a0-67a4-46f9-9014-f7414d9a56e2\") " Jul 02 19:58:48.559283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.559130 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58362ddd-9c5b-4f91-b65f-8555c125901d-util\") pod \"58362ddd-9c5b-4f91-b65f-8555c125901d\" (UID: \"58362ddd-9c5b-4f91-b65f-8555c125901d\") " Jul 02 19:58:48.559283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.559206 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b361c4a0-67a4-46f9-9014-f7414d9a56e2-bundle\") pod \"b361c4a0-67a4-46f9-9014-f7414d9a56e2\" (UID: \"b361c4a0-67a4-46f9-9014-f7414d9a56e2\") " Jul 02 19:58:48.559283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.559235 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b361c4a0-67a4-46f9-9014-f7414d9a56e2-util\") pod \"b361c4a0-67a4-46f9-9014-f7414d9a56e2\" (UID: \"b361c4a0-67a4-46f9-9014-f7414d9a56e2\") " Jul 02 19:58:48.559283 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.559281 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58362ddd-9c5b-4f91-b65f-8555c125901d-bundle\") pod \"58362ddd-9c5b-4f91-b65f-8555c125901d\" (UID: \"58362ddd-9c5b-4f91-b65f-8555c125901d\") " Jul 02 19:58:48.559790 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.559763 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b361c4a0-67a4-46f9-9014-f7414d9a56e2-bundle" (OuterVolumeSpecName: "bundle") pod "b361c4a0-67a4-46f9-9014-f7414d9a56e2" (UID: "b361c4a0-67a4-46f9-9014-f7414d9a56e2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:58:48.560040 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.560009 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58362ddd-9c5b-4f91-b65f-8555c125901d-bundle" (OuterVolumeSpecName: "bundle") pod "58362ddd-9c5b-4f91-b65f-8555c125901d" (UID: "58362ddd-9c5b-4f91-b65f-8555c125901d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:58:48.561241 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.561213 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b361c4a0-67a4-46f9-9014-f7414d9a56e2-kube-api-access-fxd59" (OuterVolumeSpecName: "kube-api-access-fxd59") pod "b361c4a0-67a4-46f9-9014-f7414d9a56e2" (UID: "b361c4a0-67a4-46f9-9014-f7414d9a56e2"). InnerVolumeSpecName "kube-api-access-fxd59". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:58:48.561241 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.561234 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58362ddd-9c5b-4f91-b65f-8555c125901d-kube-api-access-gjk97" (OuterVolumeSpecName: "kube-api-access-gjk97") pod "58362ddd-9c5b-4f91-b65f-8555c125901d" (UID: "58362ddd-9c5b-4f91-b65f-8555c125901d"). InnerVolumeSpecName "kube-api-access-gjk97". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:58:48.564884 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.564865 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b361c4a0-67a4-46f9-9014-f7414d9a56e2-util" (OuterVolumeSpecName: "util") pod "b361c4a0-67a4-46f9-9014-f7414d9a56e2" (UID: "b361c4a0-67a4-46f9-9014-f7414d9a56e2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:58:48.564884 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.564863 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58362ddd-9c5b-4f91-b65f-8555c125901d-util" (OuterVolumeSpecName: "util") pod "58362ddd-9c5b-4f91-b65f-8555c125901d" (UID: "58362ddd-9c5b-4f91-b65f-8555c125901d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:58:48.660703 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.660654 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b361c4a0-67a4-46f9-9014-f7414d9a56e2-bundle\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:58:48.660703 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.660673 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b361c4a0-67a4-46f9-9014-f7414d9a56e2-util\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:58:48.660703 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.660682 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58362ddd-9c5b-4f91-b65f-8555c125901d-bundle\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:58:48.660703 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.660690 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjk97\" (UniqueName: \"kubernetes.io/projected/58362ddd-9c5b-4f91-b65f-8555c125901d-kube-api-access-gjk97\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:58:48.660864 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.660709 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxd59\" (UniqueName: \"kubernetes.io/projected/b361c4a0-67a4-46f9-9014-f7414d9a56e2-kube-api-access-fxd59\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:58:48.660864 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:48.660717 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58362ddd-9c5b-4f91-b65f-8555c125901d-util\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:58:49.137811 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:49.137783 2560 generic.go:356] "Generic (PLEG): container finished" podID="da425dd5-b9eb-4acb-925c-c7d413c71cf0" containerID="b630cf0dd0a49959cbe7fdb1b569c0444925c47203f449fba62e9bfb22d987a9" exitCode=0 Jul 02 19:58:49.138199 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:49.137857 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q" event={"ID":"da425dd5-b9eb-4acb-925c-c7d413c71cf0","Type":"ContainerDied","Data":"b630cf0dd0a49959cbe7fdb1b569c0444925c47203f449fba62e9bfb22d987a9"} Jul 02 19:58:49.139983 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:49.139961 2560 generic.go:356] "Generic (PLEG): container finished" podID="ddb369e1-f829-489a-b338-b1e1ae8d620c" containerID="e15fd8f41461df6036cc1ab4c7b1dc2ac75b2f5d5400599e54a1d979945c1ab4" exitCode=0 Jul 02 19:58:49.140093 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:49.140025 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj" event={"ID":"ddb369e1-f829-489a-b338-b1e1ae8d620c","Type":"ContainerDied","Data":"e15fd8f41461df6036cc1ab4c7b1dc2ac75b2f5d5400599e54a1d979945c1ab4"} Jul 02 19:58:49.141822 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:49.141804 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6" Jul 02 19:58:49.141909 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:49.141835 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6" event={"ID":"58362ddd-9c5b-4f91-b65f-8555c125901d","Type":"ContainerDied","Data":"ca521e09c31a02e843eec4adf280c9d3fa359bacfad9d080e77f1a05765255cf"} Jul 02 19:58:49.141909 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:49.141874 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca521e09c31a02e843eec4adf280c9d3fa359bacfad9d080e77f1a05765255cf" Jul 02 19:58:49.143821 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:49.143803 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59" event={"ID":"b361c4a0-67a4-46f9-9014-f7414d9a56e2","Type":"ContainerDied","Data":"0f28b4d8e6db5761d03b1cf39a620b103162b68aa30d80b369c5c49defee14ed"} Jul 02 19:58:49.143888 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:49.143835 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f28b4d8e6db5761d03b1cf39a620b103162b68aa30d80b369c5c49defee14ed" Jul 02 19:58:49.143888 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:49.143840 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59" Jul 02 19:58:50.288321 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:50.288291 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj" Jul 02 19:58:50.316960 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:50.316938 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q" Jul 02 19:58:50.477762 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:50.477737 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da425dd5-b9eb-4acb-925c-c7d413c71cf0-util\") pod \"da425dd5-b9eb-4acb-925c-c7d413c71cf0\" (UID: \"da425dd5-b9eb-4acb-925c-c7d413c71cf0\") " Jul 02 19:58:50.477891 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:50.477777 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddb369e1-f829-489a-b338-b1e1ae8d620c-bundle\") pod \"ddb369e1-f829-489a-b338-b1e1ae8d620c\" (UID: \"ddb369e1-f829-489a-b338-b1e1ae8d620c\") " Jul 02 19:58:50.477891 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:50.477796 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kd9gn\" (UniqueName: \"kubernetes.io/projected/da425dd5-b9eb-4acb-925c-c7d413c71cf0-kube-api-access-kd9gn\") pod \"da425dd5-b9eb-4acb-925c-c7d413c71cf0\" (UID: \"da425dd5-b9eb-4acb-925c-c7d413c71cf0\") " Jul 02 19:58:50.477891 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:50.477849 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da425dd5-b9eb-4acb-925c-c7d413c71cf0-bundle\") pod \"da425dd5-b9eb-4acb-925c-c7d413c71cf0\" (UID: \"da425dd5-b9eb-4acb-925c-c7d413c71cf0\") " Jul 02 19:58:50.477891 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:50.477874 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9pws\" (UniqueName: \"kubernetes.io/projected/ddb369e1-f829-489a-b338-b1e1ae8d620c-kube-api-access-n9pws\") pod \"ddb369e1-f829-489a-b338-b1e1ae8d620c\" (UID: \"ddb369e1-f829-489a-b338-b1e1ae8d620c\") " Jul 02 19:58:50.478120 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:50.477924 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddb369e1-f829-489a-b338-b1e1ae8d620c-util\") pod \"ddb369e1-f829-489a-b338-b1e1ae8d620c\" (UID: \"ddb369e1-f829-489a-b338-b1e1ae8d620c\") " Jul 02 19:58:50.478422 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:50.478391 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddb369e1-f829-489a-b338-b1e1ae8d620c-bundle" (OuterVolumeSpecName: "bundle") pod "ddb369e1-f829-489a-b338-b1e1ae8d620c" (UID: "ddb369e1-f829-489a-b338-b1e1ae8d620c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:58:50.478540 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:50.478504 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da425dd5-b9eb-4acb-925c-c7d413c71cf0-bundle" (OuterVolumeSpecName: "bundle") pod "da425dd5-b9eb-4acb-925c-c7d413c71cf0" (UID: "da425dd5-b9eb-4acb-925c-c7d413c71cf0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:58:50.480025 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:50.479995 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da425dd5-b9eb-4acb-925c-c7d413c71cf0-kube-api-access-kd9gn" (OuterVolumeSpecName: "kube-api-access-kd9gn") pod "da425dd5-b9eb-4acb-925c-c7d413c71cf0" (UID: "da425dd5-b9eb-4acb-925c-c7d413c71cf0"). InnerVolumeSpecName "kube-api-access-kd9gn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:58:50.480106 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:50.480076 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddb369e1-f829-489a-b338-b1e1ae8d620c-kube-api-access-n9pws" (OuterVolumeSpecName: "kube-api-access-n9pws") pod "ddb369e1-f829-489a-b338-b1e1ae8d620c" (UID: "ddb369e1-f829-489a-b338-b1e1ae8d620c"). InnerVolumeSpecName "kube-api-access-n9pws". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:58:50.483210 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:50.483190 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da425dd5-b9eb-4acb-925c-c7d413c71cf0-util" (OuterVolumeSpecName: "util") pod "da425dd5-b9eb-4acb-925c-c7d413c71cf0" (UID: "da425dd5-b9eb-4acb-925c-c7d413c71cf0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:58:50.532559 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:50.532529 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddb369e1-f829-489a-b338-b1e1ae8d620c-util" (OuterVolumeSpecName: "util") pod "ddb369e1-f829-489a-b338-b1e1ae8d620c" (UID: "ddb369e1-f829-489a-b338-b1e1ae8d620c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:58:50.579186 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:50.579153 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da425dd5-b9eb-4acb-925c-c7d413c71cf0-bundle\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:58:50.579186 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:50.579187 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9pws\" (UniqueName: \"kubernetes.io/projected/ddb369e1-f829-489a-b338-b1e1ae8d620c-kube-api-access-n9pws\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:58:50.579349 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:50.579203 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddb369e1-f829-489a-b338-b1e1ae8d620c-util\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:58:50.579349 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:50.579214 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da425dd5-b9eb-4acb-925c-c7d413c71cf0-util\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:58:50.579349 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:50.579225 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddb369e1-f829-489a-b338-b1e1ae8d620c-bundle\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:58:50.579349 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:50.579237 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kd9gn\" (UniqueName: \"kubernetes.io/projected/da425dd5-b9eb-4acb-925c-c7d413c71cf0-kube-api-access-kd9gn\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:58:51.155426 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:51.155393 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q" Jul 02 19:58:51.155426 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:51.155418 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q" event={"ID":"da425dd5-b9eb-4acb-925c-c7d413c71cf0","Type":"ContainerDied","Data":"cea0a9fea04b0ad1837637b1ee3c5c023c1649d7da8072ec0021287a45ec2806"} Jul 02 19:58:51.155649 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:51.155470 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cea0a9fea04b0ad1837637b1ee3c5c023c1649d7da8072ec0021287a45ec2806" Jul 02 19:58:51.157399 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:51.157374 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj" Jul 02 19:58:51.157399 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:51.157388 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj" event={"ID":"ddb369e1-f829-489a-b338-b1e1ae8d620c","Type":"ContainerDied","Data":"dc10a3a3f757ea2090c2d22a0dddca8c85c3c448b1f23349a24924e55f538330"} Jul 02 19:58:51.157653 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:51.157422 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc10a3a3f757ea2090c2d22a0dddca8c85c3c448b1f23349a24924e55f538330" Jul 02 19:58:57.107501 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.107468 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-589bf44758-kjjls"] Jul 02 19:58:57.107952 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.107937 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da425dd5-b9eb-4acb-925c-c7d413c71cf0" containerName="util" Jul 02 19:58:57.108014 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.107955 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="da425dd5-b9eb-4acb-925c-c7d413c71cf0" containerName="util" Jul 02 19:58:57.108014 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.107969 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddb369e1-f829-489a-b338-b1e1ae8d620c" containerName="extract" Jul 02 19:58:57.108014 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.107978 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddb369e1-f829-489a-b338-b1e1ae8d620c" containerName="extract" Jul 02 19:58:57.108014 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.107991 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddb369e1-f829-489a-b338-b1e1ae8d620c" containerName="pull" Jul 02 19:58:57.108014 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108002 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddb369e1-f829-489a-b338-b1e1ae8d620c" containerName="pull" Jul 02 19:58:57.108280 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108016 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da425dd5-b9eb-4acb-925c-c7d413c71cf0" containerName="extract" Jul 02 19:58:57.108280 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108024 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="da425dd5-b9eb-4acb-925c-c7d413c71cf0" containerName="extract" Jul 02 19:58:57.108280 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108035 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58362ddd-9c5b-4f91-b65f-8555c125901d" containerName="util" Jul 02 19:58:57.108280 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108043 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="58362ddd-9c5b-4f91-b65f-8555c125901d" containerName="util" Jul 02 19:58:57.108280 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108057 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddb369e1-f829-489a-b338-b1e1ae8d620c" containerName="util" Jul 02 19:58:57.108280 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108065 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddb369e1-f829-489a-b338-b1e1ae8d620c" containerName="util" Jul 02 19:58:57.108280 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108074 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b361c4a0-67a4-46f9-9014-f7414d9a56e2" containerName="util" Jul 02 19:58:57.108280 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108083 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b361c4a0-67a4-46f9-9014-f7414d9a56e2" containerName="util" Jul 02 19:58:57.108280 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108093 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58362ddd-9c5b-4f91-b65f-8555c125901d" containerName="pull" Jul 02 19:58:57.108280 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108101 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="58362ddd-9c5b-4f91-b65f-8555c125901d" containerName="pull" Jul 02 19:58:57.108280 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108111 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58362ddd-9c5b-4f91-b65f-8555c125901d" containerName="extract" Jul 02 19:58:57.108280 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108119 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="58362ddd-9c5b-4f91-b65f-8555c125901d" containerName="extract" Jul 02 19:58:57.108280 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108137 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b361c4a0-67a4-46f9-9014-f7414d9a56e2" containerName="pull" Jul 02 19:58:57.108280 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108146 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b361c4a0-67a4-46f9-9014-f7414d9a56e2" containerName="pull" Jul 02 19:58:57.108280 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108154 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b361c4a0-67a4-46f9-9014-f7414d9a56e2" containerName="extract" Jul 02 19:58:57.108280 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108161 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b361c4a0-67a4-46f9-9014-f7414d9a56e2" containerName="extract" Jul 02 19:58:57.108280 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108181 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da425dd5-b9eb-4acb-925c-c7d413c71cf0" containerName="pull" Jul 02 19:58:57.108280 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108190 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="da425dd5-b9eb-4acb-925c-c7d413c71cf0" containerName="pull" Jul 02 19:58:57.109105 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108296 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddb369e1-f829-489a-b338-b1e1ae8d620c" containerName="extract" Jul 02 19:58:57.109105 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108310 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="58362ddd-9c5b-4f91-b65f-8555c125901d" containerName="extract" Jul 02 19:58:57.109105 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108320 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="da425dd5-b9eb-4acb-925c-c7d413c71cf0" containerName="extract" Jul 02 19:58:57.109105 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.108332 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b361c4a0-67a4-46f9-9014-f7414d9a56e2" containerName="extract" Jul 02 19:58:57.111622 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.111600 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.127013 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.126988 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-589bf44758-kjjls"] Jul 02 19:58:57.128456 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.128434 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/392000fd-fbd2-459d-96e3-c0c5d38ad693-service-ca\") pod \"console-589bf44758-kjjls\" (UID: \"392000fd-fbd2-459d-96e3-c0c5d38ad693\") " pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.128579 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.128466 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr84m\" (UniqueName: \"kubernetes.io/projected/392000fd-fbd2-459d-96e3-c0c5d38ad693-kube-api-access-nr84m\") pod \"console-589bf44758-kjjls\" (UID: \"392000fd-fbd2-459d-96e3-c0c5d38ad693\") " pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.128579 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.128486 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/392000fd-fbd2-459d-96e3-c0c5d38ad693-trusted-ca-bundle\") pod \"console-589bf44758-kjjls\" (UID: \"392000fd-fbd2-459d-96e3-c0c5d38ad693\") " pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.128579 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.128524 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/392000fd-fbd2-459d-96e3-c0c5d38ad693-oauth-serving-cert\") pod \"console-589bf44758-kjjls\" (UID: \"392000fd-fbd2-459d-96e3-c0c5d38ad693\") " pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.128745 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.128582 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/392000fd-fbd2-459d-96e3-c0c5d38ad693-console-serving-cert\") pod \"console-589bf44758-kjjls\" (UID: \"392000fd-fbd2-459d-96e3-c0c5d38ad693\") " pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.128745 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.128639 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/392000fd-fbd2-459d-96e3-c0c5d38ad693-console-config\") pod \"console-589bf44758-kjjls\" (UID: \"392000fd-fbd2-459d-96e3-c0c5d38ad693\") " pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.128745 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.128693 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/392000fd-fbd2-459d-96e3-c0c5d38ad693-console-oauth-config\") pod \"console-589bf44758-kjjls\" (UID: \"392000fd-fbd2-459d-96e3-c0c5d38ad693\") " pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.229373 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.229332 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/392000fd-fbd2-459d-96e3-c0c5d38ad693-trusted-ca-bundle\") pod \"console-589bf44758-kjjls\" (UID: \"392000fd-fbd2-459d-96e3-c0c5d38ad693\") " pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.229542 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.229393 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/392000fd-fbd2-459d-96e3-c0c5d38ad693-oauth-serving-cert\") pod \"console-589bf44758-kjjls\" (UID: \"392000fd-fbd2-459d-96e3-c0c5d38ad693\") " pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.229542 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.229426 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/392000fd-fbd2-459d-96e3-c0c5d38ad693-console-serving-cert\") pod \"console-589bf44758-kjjls\" (UID: \"392000fd-fbd2-459d-96e3-c0c5d38ad693\") " pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.229542 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.229457 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/392000fd-fbd2-459d-96e3-c0c5d38ad693-console-config\") pod \"console-589bf44758-kjjls\" (UID: \"392000fd-fbd2-459d-96e3-c0c5d38ad693\") " pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.229542 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.229502 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/392000fd-fbd2-459d-96e3-c0c5d38ad693-console-oauth-config\") pod \"console-589bf44758-kjjls\" (UID: \"392000fd-fbd2-459d-96e3-c0c5d38ad693\") " pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.229763 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.229562 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/392000fd-fbd2-459d-96e3-c0c5d38ad693-service-ca\") pod \"console-589bf44758-kjjls\" (UID: \"392000fd-fbd2-459d-96e3-c0c5d38ad693\") " pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.229763 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.229595 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr84m\" (UniqueName: \"kubernetes.io/projected/392000fd-fbd2-459d-96e3-c0c5d38ad693-kube-api-access-nr84m\") pod \"console-589bf44758-kjjls\" (UID: \"392000fd-fbd2-459d-96e3-c0c5d38ad693\") " pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.230398 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.230371 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/392000fd-fbd2-459d-96e3-c0c5d38ad693-trusted-ca-bundle\") pod \"console-589bf44758-kjjls\" (UID: \"392000fd-fbd2-459d-96e3-c0c5d38ad693\") " pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.230398 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.230380 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/392000fd-fbd2-459d-96e3-c0c5d38ad693-oauth-serving-cert\") pod \"console-589bf44758-kjjls\" (UID: \"392000fd-fbd2-459d-96e3-c0c5d38ad693\") " pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.230544 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.230380 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/392000fd-fbd2-459d-96e3-c0c5d38ad693-service-ca\") pod \"console-589bf44758-kjjls\" (UID: \"392000fd-fbd2-459d-96e3-c0c5d38ad693\") " pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.230544 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.230383 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/392000fd-fbd2-459d-96e3-c0c5d38ad693-console-config\") pod \"console-589bf44758-kjjls\" (UID: \"392000fd-fbd2-459d-96e3-c0c5d38ad693\") " pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.232040 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.232017 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/392000fd-fbd2-459d-96e3-c0c5d38ad693-console-oauth-config\") pod \"console-589bf44758-kjjls\" (UID: \"392000fd-fbd2-459d-96e3-c0c5d38ad693\") " pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.232091 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.232041 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/392000fd-fbd2-459d-96e3-c0c5d38ad693-console-serving-cert\") pod \"console-589bf44758-kjjls\" (UID: \"392000fd-fbd2-459d-96e3-c0c5d38ad693\") " pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.238482 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.238461 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr84m\" (UniqueName: \"kubernetes.io/projected/392000fd-fbd2-459d-96e3-c0c5d38ad693-kube-api-access-nr84m\") pod \"console-589bf44758-kjjls\" (UID: \"392000fd-fbd2-459d-96e3-c0c5d38ad693\") " pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.420351 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.420277 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:58:57.555206 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:57.555182 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-589bf44758-kjjls"] Jul 02 19:58:57.557447 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:58:57.557418 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod392000fd_fbd2_459d_96e3_c0c5d38ad693.slice/crio-c3449773d3ecef1f5989c9f62842137a3d0639be06c6c5c717558647c5858f02 WatchSource:0}: Error finding container c3449773d3ecef1f5989c9f62842137a3d0639be06c6c5c717558647c5858f02: Status 404 returned error can't find the container with id c3449773d3ecef1f5989c9f62842137a3d0639be06c6c5c717558647c5858f02 Jul 02 19:58:58.193381 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:58.193341 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-589bf44758-kjjls" event={"ID":"392000fd-fbd2-459d-96e3-c0c5d38ad693","Type":"ContainerStarted","Data":"4e2fd4214e5ab7e5d2d79a52327a367ebee4858aac180e2a08c6b05ce4371a05"} Jul 02 19:58:58.193917 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:58.193435 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-589bf44758-kjjls" event={"ID":"392000fd-fbd2-459d-96e3-c0c5d38ad693","Type":"ContainerStarted","Data":"c3449773d3ecef1f5989c9f62842137a3d0639be06c6c5c717558647c5858f02"} Jul 02 19:58:58.220209 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:58:58.220154 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-589bf44758-kjjls" podStartSLOduration=1.220139718 podStartE2EDuration="1.220139718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:58:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:58:58.218461006 +0000 UTC m=+486.788065077" watchObservedRunningTime="2026-07-02 19:58:58.220139718 +0000 UTC m=+486.789743789" Jul 02 19:59:00.047567 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:00.047527 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762"] Jul 02 19:59:00.053039 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:00.053017 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762" Jul 02 19:59:00.056003 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:00.055977 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-ndhzt\"" Jul 02 19:59:00.068161 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:00.068140 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762"] Jul 02 19:59:00.149356 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:00.149322 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhfcg\" (UniqueName: \"kubernetes.io/projected/ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e-kube-api-access-rhfcg\") pod \"limitador-operator-controller-manager-859d7b78bd-bq762\" (UID: \"ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762" Jul 02 19:59:00.250006 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:00.249974 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhfcg\" (UniqueName: \"kubernetes.io/projected/ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e-kube-api-access-rhfcg\") pod \"limitador-operator-controller-manager-859d7b78bd-bq762\" (UID: \"ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762" Jul 02 19:59:00.259402 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:00.259376 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhfcg\" (UniqueName: \"kubernetes.io/projected/ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e-kube-api-access-rhfcg\") pod \"limitador-operator-controller-manager-859d7b78bd-bq762\" (UID: \"ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762" Jul 02 19:59:00.363603 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:00.363507 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762" Jul 02 19:59:00.500932 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:00.500904 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762"] Jul 02 19:59:00.502406 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:59:00.502380 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddf30b81_43b8_43e4_ba4c_53a1b8d2e04e.slice/crio-93335d552c9a7dda255c90a558c7381feadfb3063197a7b165e9cff8ff93dd98 WatchSource:0}: Error finding container 93335d552c9a7dda255c90a558c7381feadfb3063197a7b165e9cff8ff93dd98: Status 404 returned error can't find the container with id 93335d552c9a7dda255c90a558c7381feadfb3063197a7b165e9cff8ff93dd98 Jul 02 19:59:01.211380 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:01.211350 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762" event={"ID":"ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e","Type":"ContainerStarted","Data":"93335d552c9a7dda255c90a558c7381feadfb3063197a7b165e9cff8ff93dd98"} Jul 02 19:59:03.224509 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:03.224475 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762" event={"ID":"ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e","Type":"ContainerStarted","Data":"d30fabee6430b295e99f37c4784681ee992f1867e755b093f16bce18b7cbc96e"} Jul 02 19:59:03.224914 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:03.224579 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762" Jul 02 19:59:03.245760 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:03.245719 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762" podStartSLOduration=1.325552268 podStartE2EDuration="3.245706741s" totalImagesPullingTime="1.920154473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:59:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:03.243626011 +0000 UTC m=+491.813230101" watchObservedRunningTime="2026-07-02 19:59:03.245706741 +0000 UTC m=+491.815310812" Jul 02 19:59:04.114811 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:04.114776 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-b8vch"] Jul 02 19:59:04.120589 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:04.120562 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b8vch" Jul 02 19:59:04.124406 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:04.124388 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5v5pv\"" Jul 02 19:59:04.133195 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:04.133171 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-b8vch"] Jul 02 19:59:04.174995 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:04.174961 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lllx6\" (UniqueName: \"kubernetes.io/projected/c195d448-406c-452f-b4d8-0362aa941eea-kube-api-access-lllx6\") pod \"authorino-operator-75cc8d5cb7-b8vch\" (UID: \"c195d448-406c-452f-b4d8-0362aa941eea\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-b8vch" Jul 02 19:59:04.276133 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:04.276092 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lllx6\" (UniqueName: \"kubernetes.io/projected/c195d448-406c-452f-b4d8-0362aa941eea-kube-api-access-lllx6\") pod \"authorino-operator-75cc8d5cb7-b8vch\" (UID: \"c195d448-406c-452f-b4d8-0362aa941eea\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-b8vch" Jul 02 19:59:04.285860 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:04.285838 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lllx6\" (UniqueName: \"kubernetes.io/projected/c195d448-406c-452f-b4d8-0362aa941eea-kube-api-access-lllx6\") pod \"authorino-operator-75cc8d5cb7-b8vch\" (UID: \"c195d448-406c-452f-b4d8-0362aa941eea\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-b8vch" Jul 02 19:59:04.430345 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:04.430243 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b8vch" Jul 02 19:59:04.589230 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:04.589202 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-b8vch"] Jul 02 19:59:04.590594 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:59:04.590559 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc195d448_406c_452f_b4d8_0362aa941eea.slice/crio-f7d003ab0664d00ada18dee515f949722985171d297dea1841aef65cf9707aab WatchSource:0}: Error finding container f7d003ab0664d00ada18dee515f949722985171d297dea1841aef65cf9707aab: Status 404 returned error can't find the container with id f7d003ab0664d00ada18dee515f949722985171d297dea1841aef65cf9707aab Jul 02 19:59:05.236670 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:05.236637 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b8vch" event={"ID":"c195d448-406c-452f-b4d8-0362aa941eea","Type":"ContainerStarted","Data":"f7d003ab0664d00ada18dee515f949722985171d297dea1841aef65cf9707aab"} Jul 02 19:59:07.251079 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:07.250996 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b8vch" event={"ID":"c195d448-406c-452f-b4d8-0362aa941eea","Type":"ContainerStarted","Data":"eb254942cd086822a45181adfd998df51d7aea098ca250313f7847d869ab8107"} Jul 02 19:59:07.251523 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:07.251133 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b8vch" Jul 02 19:59:07.278720 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:07.278670 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b8vch" podStartSLOduration=0.873145863 podStartE2EDuration="3.27865406s" totalImagesPullingTime="2.405508197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:07.275171538 +0000 UTC m=+495.844775610" watchObservedRunningTime="2026-07-02 19:59:07.27865406 +0000 UTC m=+495.848258131" Jul 02 19:59:07.420778 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:07.420747 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:59:07.420954 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:07.420816 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:59:07.425988 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:07.425965 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:59:08.260211 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:08.260180 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-589bf44758-kjjls" Jul 02 19:59:08.327820 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:08.327771 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85fc745c94-zql72"] Jul 02 19:59:14.232140 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:14.232109 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762" Jul 02 19:59:18.259416 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:18.259391 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b8vch" Jul 02 19:59:29.111735 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.111649 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762"] Jul 02 19:59:29.112242 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.111907 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762" podUID="ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e" containerName="manager" containerID="cri-o://d30fabee6430b295e99f37c4784681ee992f1867e755b093f16bce18b7cbc96e" gracePeriod=2 Jul 02 19:59:29.125893 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.125851 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762"] Jul 02 19:59:29.131670 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:59:29.131625 2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-bq762\": pods \"limitador-operator-controller-manager-859d7b78bd-bq762\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762" Jul 02 19:59:29.147465 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.147439 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vkmm9"] Jul 02 19:59:29.147807 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.147794 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e" containerName="manager" Jul 02 19:59:29.147852 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.147810 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e" containerName="manager" Jul 02 19:59:29.147886 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.147868 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e" containerName="manager" Jul 02 19:59:29.150960 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.150938 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vkmm9" Jul 02 19:59:29.163500 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.163476 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vkmm9"] Jul 02 19:59:29.188681 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:59:29.188648 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bq762\" is forbidden: User \"system:node:ip-10-0-137-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-196.ec2.internal' and this object" podUID="ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762" Jul 02 19:59:29.287798 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.287768 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7drgn\" (UniqueName: \"kubernetes.io/projected/580c85e9-4531-4e5a-a7fa-ad7b91a27b2d-kube-api-access-7drgn\") pod \"limitador-operator-controller-manager-859d7b78bd-vkmm9\" (UID: \"580c85e9-4531-4e5a-a7fa-ad7b91a27b2d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vkmm9" Jul 02 19:59:29.362332 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.362275 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762" Jul 02 19:59:29.364768 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:59:29.364744 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bq762\" is forbidden: User \"system:node:ip-10-0-137-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-196.ec2.internal' and this object" podUID="ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762" Jul 02 19:59:29.364950 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.364929 2560 generic.go:356] "Generic (PLEG): container finished" podID="ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e" containerID="d30fabee6430b295e99f37c4784681ee992f1867e755b093f16bce18b7cbc96e" exitCode=0 Jul 02 19:59:29.364994 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.364958 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762" Jul 02 19:59:29.365027 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.365015 2560 scope.go:117] "RemoveContainer" containerID="d30fabee6430b295e99f37c4784681ee992f1867e755b093f16bce18b7cbc96e" Jul 02 19:59:29.367208 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:59:29.367186 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bq762\" is forbidden: User \"system:node:ip-10-0-137-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-196.ec2.internal' and this object" podUID="ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762" Jul 02 19:59:29.373152 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.373136 2560 scope.go:117] "RemoveContainer" containerID="d30fabee6430b295e99f37c4784681ee992f1867e755b093f16bce18b7cbc96e" Jul 02 19:59:29.373414 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:59:29.373397 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d30fabee6430b295e99f37c4784681ee992f1867e755b093f16bce18b7cbc96e\": container with ID starting with d30fabee6430b295e99f37c4784681ee992f1867e755b093f16bce18b7cbc96e not found: ID does not exist" containerID="d30fabee6430b295e99f37c4784681ee992f1867e755b093f16bce18b7cbc96e" Jul 02 19:59:29.373469 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.373422 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d30fabee6430b295e99f37c4784681ee992f1867e755b093f16bce18b7cbc96e"} err="failed to get container status \"d30fabee6430b295e99f37c4784681ee992f1867e755b093f16bce18b7cbc96e\": rpc error: code = NotFound desc = could not find container \"d30fabee6430b295e99f37c4784681ee992f1867e755b093f16bce18b7cbc96e\": container with ID starting with d30fabee6430b295e99f37c4784681ee992f1867e755b093f16bce18b7cbc96e not found: ID does not exist" Jul 02 19:59:29.388869 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.388847 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7drgn\" (UniqueName: \"kubernetes.io/projected/580c85e9-4531-4e5a-a7fa-ad7b91a27b2d-kube-api-access-7drgn\") pod \"limitador-operator-controller-manager-859d7b78bd-vkmm9\" (UID: \"580c85e9-4531-4e5a-a7fa-ad7b91a27b2d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vkmm9" Jul 02 19:59:29.409112 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.409087 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7drgn\" (UniqueName: \"kubernetes.io/projected/580c85e9-4531-4e5a-a7fa-ad7b91a27b2d-kube-api-access-7drgn\") pod \"limitador-operator-controller-manager-859d7b78bd-vkmm9\" (UID: \"580c85e9-4531-4e5a-a7fa-ad7b91a27b2d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vkmm9" Jul 02 19:59:29.490108 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.490078 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhfcg\" (UniqueName: \"kubernetes.io/projected/ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e-kube-api-access-rhfcg\") pod \"ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e\" (UID: \"ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e\") " Jul 02 19:59:29.491942 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.491923 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e-kube-api-access-rhfcg" (OuterVolumeSpecName: "kube-api-access-rhfcg") pod "ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e" (UID: "ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e"). InnerVolumeSpecName "kube-api-access-rhfcg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:59:29.497137 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.497092 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vkmm9" Jul 02 19:59:29.590871 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.590839 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhfcg\" (UniqueName: \"kubernetes.io/projected/ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e-kube-api-access-rhfcg\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:59:29.633014 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.632988 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vkmm9"] Jul 02 19:59:29.634830 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:59:29.634799 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod580c85e9_4531_4e5a_a7fa_ad7b91a27b2d.slice/crio-005a69b73fb87fc6b79d20a99cd37c1f4b1419dd9b16708b882747630da65a2b WatchSource:0}: Error finding container 005a69b73fb87fc6b79d20a99cd37c1f4b1419dd9b16708b882747630da65a2b: Status 404 returned error can't find the container with id 005a69b73fb87fc6b79d20a99cd37c1f4b1419dd9b16708b882747630da65a2b Jul 02 19:59:29.677295 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:59:29.677265 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bq762\" is forbidden: User \"system:node:ip-10-0-137-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-196.ec2.internal' and this object" podUID="ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bq762" Jul 02 19:59:29.934019 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:29.933948 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e" path="/var/lib/kubelet/pods/ddf30b81-43b8-43e4-ba4c-53a1b8d2e04e/volumes" Jul 02 19:59:30.372069 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:30.372036 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vkmm9" event={"ID":"580c85e9-4531-4e5a-a7fa-ad7b91a27b2d","Type":"ContainerStarted","Data":"356307cc6b0bbd25600450dec335770a09b31af3295ec3d5543ea5ce323b194c"} Jul 02 19:59:30.372802 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:30.372097 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vkmm9" Jul 02 19:59:30.372802 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:30.372119 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vkmm9" event={"ID":"580c85e9-4531-4e5a-a7fa-ad7b91a27b2d","Type":"ContainerStarted","Data":"005a69b73fb87fc6b79d20a99cd37c1f4b1419dd9b16708b882747630da65a2b"} Jul 02 19:59:30.396991 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:30.396947 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vkmm9" podStartSLOduration=1.3969331729999999 podStartE2EDuration="1.396933173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:59:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:30.395973002 +0000 UTC m=+518.965577093" watchObservedRunningTime="2026-07-02 19:59:30.396933173 +0000 UTC m=+518.966537244" Jul 02 19:59:33.350623 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.350567 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-85fc745c94-zql72" podUID="8ec25ee7-5cf7-4760-9912-ac633d8b42c3" containerName="console" containerID="cri-o://e43131cb65c67c8f4048ccb9aaf36a245c3e94617c029f729ea208490f52ad9e" gracePeriod=15 Jul 02 19:59:33.589459 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.589437 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:59:33.724518 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.724493 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-service-ca\") pod \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " Jul 02 19:59:33.724705 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.724536 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-console-serving-cert\") pod \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " Jul 02 19:59:33.724705 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.724579 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-console-config\") pod \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " Jul 02 19:59:33.724705 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.724621 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-console-oauth-config\") pod \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " Jul 02 19:59:33.724705 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.724649 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-oauth-serving-cert\") pod \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " Jul 02 19:59:33.724705 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.724684 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-trusted-ca-bundle\") pod \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " Jul 02 19:59:33.724947 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.724717 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjnx5\" (UniqueName: \"kubernetes.io/projected/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-kube-api-access-rjnx5\") pod \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\" (UID: \"8ec25ee7-5cf7-4760-9912-ac633d8b42c3\") " Jul 02 19:59:33.724947 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.724879 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-service-ca" (OuterVolumeSpecName: "service-ca") pod "8ec25ee7-5cf7-4760-9912-ac633d8b42c3" (UID: "8ec25ee7-5cf7-4760-9912-ac633d8b42c3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:59:33.725051 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.725014 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-console-config" (OuterVolumeSpecName: "console-config") pod "8ec25ee7-5cf7-4760-9912-ac633d8b42c3" (UID: "8ec25ee7-5cf7-4760-9912-ac633d8b42c3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:59:33.725110 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.725094 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8ec25ee7-5cf7-4760-9912-ac633d8b42c3" (UID: "8ec25ee7-5cf7-4760-9912-ac633d8b42c3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:59:33.725166 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.725097 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8ec25ee7-5cf7-4760-9912-ac633d8b42c3" (UID: "8ec25ee7-5cf7-4760-9912-ac633d8b42c3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:59:33.725166 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.725137 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-service-ca\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:59:33.725166 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.725155 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-console-config\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:59:33.726781 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.726758 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8ec25ee7-5cf7-4760-9912-ac633d8b42c3" (UID: "8ec25ee7-5cf7-4760-9912-ac633d8b42c3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:59:33.726863 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.726787 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-kube-api-access-rjnx5" (OuterVolumeSpecName: "kube-api-access-rjnx5") pod "8ec25ee7-5cf7-4760-9912-ac633d8b42c3" (UID: "8ec25ee7-5cf7-4760-9912-ac633d8b42c3"). InnerVolumeSpecName "kube-api-access-rjnx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:59:33.726863 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.726835 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8ec25ee7-5cf7-4760-9912-ac633d8b42c3" (UID: "8ec25ee7-5cf7-4760-9912-ac633d8b42c3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:59:33.825534 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.825493 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-console-oauth-config\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:59:33.825534 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.825528 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-oauth-serving-cert\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:59:33.825534 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.825542 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-trusted-ca-bundle\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:59:33.825732 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.825557 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjnx5\" (UniqueName: \"kubernetes.io/projected/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-kube-api-access-rjnx5\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:59:33.825732 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:33.825570 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ec25ee7-5cf7-4760-9912-ac633d8b42c3-console-serving-cert\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 19:59:34.394856 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:34.394824 2560 generic.go:356] "Generic (PLEG): container finished" podID="8ec25ee7-5cf7-4760-9912-ac633d8b42c3" containerID="e43131cb65c67c8f4048ccb9aaf36a245c3e94617c029f729ea208490f52ad9e" exitCode=0 Jul 02 19:59:34.395277 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:34.394871 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fc745c94-zql72" Jul 02 19:59:34.395277 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:34.394910 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fc745c94-zql72" event={"ID":"8ec25ee7-5cf7-4760-9912-ac633d8b42c3","Type":"ContainerDied","Data":"e43131cb65c67c8f4048ccb9aaf36a245c3e94617c029f729ea208490f52ad9e"} Jul 02 19:59:34.395277 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:34.394954 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fc745c94-zql72" event={"ID":"8ec25ee7-5cf7-4760-9912-ac633d8b42c3","Type":"ContainerDied","Data":"97392b42d32f35571dcac943b1ad26ba60a6b0726a8e40302e38f004d08de9bb"} Jul 02 19:59:34.395277 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:34.394970 2560 scope.go:117] "RemoveContainer" containerID="e43131cb65c67c8f4048ccb9aaf36a245c3e94617c029f729ea208490f52ad9e" Jul 02 19:59:34.403951 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:34.403927 2560 scope.go:117] "RemoveContainer" containerID="e43131cb65c67c8f4048ccb9aaf36a245c3e94617c029f729ea208490f52ad9e" Jul 02 19:59:34.404210 ip-10-0-137-196 kubenswrapper[2560]: E0702 19:59:34.404192 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e43131cb65c67c8f4048ccb9aaf36a245c3e94617c029f729ea208490f52ad9e\": container with ID starting with e43131cb65c67c8f4048ccb9aaf36a245c3e94617c029f729ea208490f52ad9e not found: ID does not exist" containerID="e43131cb65c67c8f4048ccb9aaf36a245c3e94617c029f729ea208490f52ad9e" Jul 02 19:59:34.404279 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:34.404219 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e43131cb65c67c8f4048ccb9aaf36a245c3e94617c029f729ea208490f52ad9e"} err="failed to get container status \"e43131cb65c67c8f4048ccb9aaf36a245c3e94617c029f729ea208490f52ad9e\": rpc error: code = NotFound desc = could not find container \"e43131cb65c67c8f4048ccb9aaf36a245c3e94617c029f729ea208490f52ad9e\": container with ID starting with e43131cb65c67c8f4048ccb9aaf36a245c3e94617c029f729ea208490f52ad9e not found: ID does not exist" Jul 02 19:59:34.428069 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:34.428039 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85fc745c94-zql72"] Jul 02 19:59:34.432561 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:34.432541 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85fc745c94-zql72"] Jul 02 19:59:35.933935 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:35.933898 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ec25ee7-5cf7-4760-9912-ac633d8b42c3" path="/var/lib/kubelet/pods/8ec25ee7-5cf7-4760-9912-ac633d8b42c3/volumes" Jul 02 19:59:41.380208 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:41.380168 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vkmm9" Jul 02 19:59:57.701692 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.701657 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx"] Jul 02 19:59:57.702183 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.702158 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ec25ee7-5cf7-4760-9912-ac633d8b42c3" containerName="console" Jul 02 19:59:57.702315 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.702233 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ec25ee7-5cf7-4760-9912-ac633d8b42c3" containerName="console" Jul 02 19:59:57.702368 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.702353 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ec25ee7-5cf7-4760-9912-ac633d8b42c3" containerName="console" Jul 02 19:59:57.706910 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.706889 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.711575 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.711553 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-vzhvk\"" Jul 02 19:59:57.718858 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.718828 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx"] Jul 02 19:59:57.830088 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.830054 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn6n6\" (UniqueName: \"kubernetes.io/projected/1bdccac3-910b-4dd9-bd76-3557fbd16838-kube-api-access-xn6n6\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.830275 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.830093 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bdccac3-910b-4dd9-bd76-3557fbd16838-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.830275 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.830116 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdccac3-910b-4dd9-bd76-3557fbd16838-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.830275 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.830143 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bdccac3-910b-4dd9-bd76-3557fbd16838-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.830275 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.830165 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdccac3-910b-4dd9-bd76-3557fbd16838-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.830275 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.830223 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bdccac3-910b-4dd9-bd76-3557fbd16838-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.830275 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.830243 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bdccac3-910b-4dd9-bd76-3557fbd16838-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.830489 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.830290 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bdccac3-910b-4dd9-bd76-3557fbd16838-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.830489 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.830314 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bdccac3-910b-4dd9-bd76-3557fbd16838-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.931190 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.931164 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bdccac3-910b-4dd9-bd76-3557fbd16838-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.931190 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.931193 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bdccac3-910b-4dd9-bd76-3557fbd16838-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.931399 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.931218 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bdccac3-910b-4dd9-bd76-3557fbd16838-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.931399 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.931239 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bdccac3-910b-4dd9-bd76-3557fbd16838-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.931399 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.931301 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn6n6\" (UniqueName: \"kubernetes.io/projected/1bdccac3-910b-4dd9-bd76-3557fbd16838-kube-api-access-xn6n6\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.931399 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.931333 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bdccac3-910b-4dd9-bd76-3557fbd16838-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.931598 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.931469 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdccac3-910b-4dd9-bd76-3557fbd16838-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.931598 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.931538 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bdccac3-910b-4dd9-bd76-3557fbd16838-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.931598 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.931569 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdccac3-910b-4dd9-bd76-3557fbd16838-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.931752 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.931599 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bdccac3-910b-4dd9-bd76-3557fbd16838-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.931752 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.931653 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bdccac3-910b-4dd9-bd76-3557fbd16838-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.931940 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.931893 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdccac3-910b-4dd9-bd76-3557fbd16838-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.932065 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.931942 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdccac3-910b-4dd9-bd76-3557fbd16838-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.932065 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.931992 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bdccac3-910b-4dd9-bd76-3557fbd16838-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.933685 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.933663 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bdccac3-910b-4dd9-bd76-3557fbd16838-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.933926 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.933908 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bdccac3-910b-4dd9-bd76-3557fbd16838-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.947880 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.947856 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bdccac3-910b-4dd9-bd76-3557fbd16838-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:57.948352 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:57.948335 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn6n6\" (UniqueName: \"kubernetes.io/projected/1bdccac3-910b-4dd9-bd76-3557fbd16838-kube-api-access-xn6n6\") pod \"maas-default-gateway-openshift-default-56654dcf7-jzkvx\" (UID: \"1bdccac3-910b-4dd9-bd76-3557fbd16838\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:58.017226 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:58.017197 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:58.155958 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:58.155934 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx"] Jul 02 19:59:58.157573 ip-10-0-137-196 kubenswrapper[2560]: W0702 19:59:58.157547 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bdccac3_910b_4dd9_bd76_3557fbd16838.slice/crio-6e30d11bf3f0a020c5398f86dfea5dfbdf7f5bf26567eb7090cb2ea21364d8d7 WatchSource:0}: Error finding container 6e30d11bf3f0a020c5398f86dfea5dfbdf7f5bf26567eb7090cb2ea21364d8d7: Status 404 returned error can't find the container with id 6e30d11bf3f0a020c5398f86dfea5dfbdf7f5bf26567eb7090cb2ea21364d8d7 Jul 02 19:59:58.159587 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:58.159555 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 19:59:58.159712 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:58.159631 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 19:59:58.159712 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:58.159673 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 19:59:58.532180 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:58.532142 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" event={"ID":"1bdccac3-910b-4dd9-bd76-3557fbd16838","Type":"ContainerStarted","Data":"ca803b2b9afb64f0f2326f355ef0b46fcbe6ffc09a0ebc1e5e6343ab8eb58c88"} Jul 02 19:59:58.532366 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:58.532205 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" event={"ID":"1bdccac3-910b-4dd9-bd76-3557fbd16838","Type":"ContainerStarted","Data":"6e30d11bf3f0a020c5398f86dfea5dfbdf7f5bf26567eb7090cb2ea21364d8d7"} Jul 02 19:59:58.558341 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:58.558291 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" podStartSLOduration=1.55827702 podStartE2EDuration="1.55827702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:59:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:58.555960777 +0000 UTC m=+547.125564852" watchObservedRunningTime="2026-07-02 19:59:58.55827702 +0000 UTC m=+547.127881085" Jul 02 19:59:59.017393 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:59.017369 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:59.022105 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:59.022080 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:59.537868 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:59.537841 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 19:59:59.538856 ip-10-0-137-196 kubenswrapper[2560]: I0702 19:59:59.538841 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 20:00:15.638544 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:15.638511 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-s8ccd"] Jul 02 20:00:15.642967 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:15.642949 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-s8ccd" Jul 02 20:00:15.646658 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:15.646639 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lxjhb\"" Jul 02 20:00:15.651206 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:15.651188 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-s8ccd"] Jul 02 20:00:15.676898 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:15.676877 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs8qf\" (UniqueName: \"kubernetes.io/projected/893a9a1d-8fe0-4980-91af-417cb0a2bd00-kube-api-access-vs8qf\") pod \"authorino-58cd955675-s8ccd\" (UID: \"893a9a1d-8fe0-4980-91af-417cb0a2bd00\") " pod="kuadrant-system/authorino-58cd955675-s8ccd" Jul 02 20:00:15.777322 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:15.777288 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs8qf\" (UniqueName: \"kubernetes.io/projected/893a9a1d-8fe0-4980-91af-417cb0a2bd00-kube-api-access-vs8qf\") pod \"authorino-58cd955675-s8ccd\" (UID: \"893a9a1d-8fe0-4980-91af-417cb0a2bd00\") " pod="kuadrant-system/authorino-58cd955675-s8ccd" Jul 02 20:00:15.786432 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:15.786406 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs8qf\" (UniqueName: \"kubernetes.io/projected/893a9a1d-8fe0-4980-91af-417cb0a2bd00-kube-api-access-vs8qf\") pod \"authorino-58cd955675-s8ccd\" (UID: \"893a9a1d-8fe0-4980-91af-417cb0a2bd00\") " pod="kuadrant-system/authorino-58cd955675-s8ccd" Jul 02 20:00:15.828376 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:15.828342 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-fhdxg"] Jul 02 20:00:15.831722 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:15.831704 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fhdxg" Jul 02 20:00:15.840948 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:15.840915 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fhdxg"] Jul 02 20:00:15.878333 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:15.878301 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnxhk\" (UniqueName: \"kubernetes.io/projected/30b5407a-1542-4b8d-a441-5f68a096ef75-kube-api-access-vnxhk\") pod \"authorino-75d556bd77-fhdxg\" (UID: \"30b5407a-1542-4b8d-a441-5f68a096ef75\") " pod="kuadrant-system/authorino-75d556bd77-fhdxg" Jul 02 20:00:15.953914 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:15.953889 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-s8ccd" Jul 02 20:00:15.979122 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:15.979091 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnxhk\" (UniqueName: \"kubernetes.io/projected/30b5407a-1542-4b8d-a441-5f68a096ef75-kube-api-access-vnxhk\") pod \"authorino-75d556bd77-fhdxg\" (UID: \"30b5407a-1542-4b8d-a441-5f68a096ef75\") " pod="kuadrant-system/authorino-75d556bd77-fhdxg" Jul 02 20:00:15.989243 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:15.989220 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnxhk\" (UniqueName: \"kubernetes.io/projected/30b5407a-1542-4b8d-a441-5f68a096ef75-kube-api-access-vnxhk\") pod \"authorino-75d556bd77-fhdxg\" (UID: \"30b5407a-1542-4b8d-a441-5f68a096ef75\") " pod="kuadrant-system/authorino-75d556bd77-fhdxg" Jul 02 20:00:16.093503 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:16.093471 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-s8ccd"] Jul 02 20:00:16.094197 ip-10-0-137-196 kubenswrapper[2560]: W0702 20:00:16.094171 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod893a9a1d_8fe0_4980_91af_417cb0a2bd00.slice/crio-7fc95cf54d9e6dad11db4982b6ba5b5194129eff62461c017e631a2e844c5414 WatchSource:0}: Error finding container 7fc95cf54d9e6dad11db4982b6ba5b5194129eff62461c017e631a2e844c5414: Status 404 returned error can't find the container with id 7fc95cf54d9e6dad11db4982b6ba5b5194129eff62461c017e631a2e844c5414 Jul 02 20:00:16.141858 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:16.141825 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fhdxg" Jul 02 20:00:16.277276 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:16.277232 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fhdxg"] Jul 02 20:00:16.278088 ip-10-0-137-196 kubenswrapper[2560]: W0702 20:00:16.278056 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30b5407a_1542_4b8d_a441_5f68a096ef75.slice/crio-b1ce0fbe6a2a0d592330d59d58cf4f92d0adec1ce349e9eb8bc1c0cf74938210 WatchSource:0}: Error finding container b1ce0fbe6a2a0d592330d59d58cf4f92d0adec1ce349e9eb8bc1c0cf74938210: Status 404 returned error can't find the container with id b1ce0fbe6a2a0d592330d59d58cf4f92d0adec1ce349e9eb8bc1c0cf74938210 Jul 02 20:00:16.632602 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:16.632515 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fhdxg" event={"ID":"30b5407a-1542-4b8d-a441-5f68a096ef75","Type":"ContainerStarted","Data":"b1ce0fbe6a2a0d592330d59d58cf4f92d0adec1ce349e9eb8bc1c0cf74938210"} Jul 02 20:00:16.633669 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:16.633643 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-s8ccd" event={"ID":"893a9a1d-8fe0-4980-91af-417cb0a2bd00","Type":"ContainerStarted","Data":"7fc95cf54d9e6dad11db4982b6ba5b5194129eff62461c017e631a2e844c5414"} Jul 02 20:00:20.662990 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:20.662951 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fhdxg" event={"ID":"30b5407a-1542-4b8d-a441-5f68a096ef75","Type":"ContainerStarted","Data":"64add70dcaccd91e06042b2e0469cfcbcd19ea92e8e972d72ec7d658360774f4"} Jul 02 20:00:20.664353 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:20.664326 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-s8ccd" event={"ID":"893a9a1d-8fe0-4980-91af-417cb0a2bd00","Type":"ContainerStarted","Data":"a665debfd66cf4c7554ab684405a49e498e51de6a219eeb6e0a16b8c1cf055be"} Jul 02 20:00:20.682156 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:20.682109 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-fhdxg" podStartSLOduration=2.211793396 podStartE2EDuration="5.682095936s" totalImagesPullingTime="3.47030254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:00:20.679758018 +0000 UTC m=+569.249362092" watchObservedRunningTime="2026-07-02 20:00:20.682095936 +0000 UTC m=+569.251700007" Jul 02 20:00:20.696265 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:20.696191 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-s8ccd" podStartSLOduration=2.053989979 podStartE2EDuration="5.696164002s" totalImagesPullingTime="3.642174023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:00:20.695959539 +0000 UTC m=+569.265563612" watchObservedRunningTime="2026-07-02 20:00:20.696164002 +0000 UTC m=+569.265768074" Jul 02 20:00:20.732699 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:20.732662 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-s8ccd"] Jul 02 20:00:22.674464 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:22.674423 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-s8ccd" podUID="893a9a1d-8fe0-4980-91af-417cb0a2bd00" containerName="authorino" containerID="cri-o://a665debfd66cf4c7554ab684405a49e498e51de6a219eeb6e0a16b8c1cf055be" gracePeriod=30 Jul 02 20:00:22.946389 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:22.946367 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-s8ccd" Jul 02 20:00:23.043511 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:23.043484 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs8qf\" (UniqueName: \"kubernetes.io/projected/893a9a1d-8fe0-4980-91af-417cb0a2bd00-kube-api-access-vs8qf\") pod \"893a9a1d-8fe0-4980-91af-417cb0a2bd00\" (UID: \"893a9a1d-8fe0-4980-91af-417cb0a2bd00\") " Jul 02 20:00:23.045405 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:23.045384 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/893a9a1d-8fe0-4980-91af-417cb0a2bd00-kube-api-access-vs8qf" (OuterVolumeSpecName: "kube-api-access-vs8qf") pod "893a9a1d-8fe0-4980-91af-417cb0a2bd00" (UID: "893a9a1d-8fe0-4980-91af-417cb0a2bd00"). InnerVolumeSpecName "kube-api-access-vs8qf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:00:23.144577 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:23.144549 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs8qf\" (UniqueName: \"kubernetes.io/projected/893a9a1d-8fe0-4980-91af-417cb0a2bd00-kube-api-access-vs8qf\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:00:23.680773 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:23.680733 2560 generic.go:356] "Generic (PLEG): container finished" podID="893a9a1d-8fe0-4980-91af-417cb0a2bd00" containerID="a665debfd66cf4c7554ab684405a49e498e51de6a219eeb6e0a16b8c1cf055be" exitCode=0 Jul 02 20:00:23.681229 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:23.680779 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-s8ccd" event={"ID":"893a9a1d-8fe0-4980-91af-417cb0a2bd00","Type":"ContainerDied","Data":"a665debfd66cf4c7554ab684405a49e498e51de6a219eeb6e0a16b8c1cf055be"} Jul 02 20:00:23.681229 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:23.680793 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-s8ccd" Jul 02 20:00:23.681229 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:23.680819 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-s8ccd" event={"ID":"893a9a1d-8fe0-4980-91af-417cb0a2bd00","Type":"ContainerDied","Data":"7fc95cf54d9e6dad11db4982b6ba5b5194129eff62461c017e631a2e844c5414"} Jul 02 20:00:23.681229 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:23.680839 2560 scope.go:117] "RemoveContainer" containerID="a665debfd66cf4c7554ab684405a49e498e51de6a219eeb6e0a16b8c1cf055be" Jul 02 20:00:23.689673 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:23.689653 2560 scope.go:117] "RemoveContainer" containerID="a665debfd66cf4c7554ab684405a49e498e51de6a219eeb6e0a16b8c1cf055be" Jul 02 20:00:23.689961 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:00:23.689936 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a665debfd66cf4c7554ab684405a49e498e51de6a219eeb6e0a16b8c1cf055be\": container with ID starting with a665debfd66cf4c7554ab684405a49e498e51de6a219eeb6e0a16b8c1cf055be not found: ID does not exist" containerID="a665debfd66cf4c7554ab684405a49e498e51de6a219eeb6e0a16b8c1cf055be" Jul 02 20:00:23.690040 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:23.689973 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a665debfd66cf4c7554ab684405a49e498e51de6a219eeb6e0a16b8c1cf055be"} err="failed to get container status \"a665debfd66cf4c7554ab684405a49e498e51de6a219eeb6e0a16b8c1cf055be\": rpc error: code = NotFound desc = could not find container \"a665debfd66cf4c7554ab684405a49e498e51de6a219eeb6e0a16b8c1cf055be\": container with ID starting with a665debfd66cf4c7554ab684405a49e498e51de6a219eeb6e0a16b8c1cf055be not found: ID does not exist" Jul 02 20:00:23.704296 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:23.704270 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-s8ccd"] Jul 02 20:00:23.710034 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:23.710012 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-s8ccd"] Jul 02 20:00:23.934028 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:23.933949 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="893a9a1d-8fe0-4980-91af-417cb0a2bd00" path="/var/lib/kubelet/pods/893a9a1d-8fe0-4980-91af-417cb0a2bd00/volumes" Jul 02 20:00:44.140129 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.140094 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dmtlg"] Jul 02 20:00:44.140549 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.140496 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="893a9a1d-8fe0-4980-91af-417cb0a2bd00" containerName="authorino" Jul 02 20:00:44.140549 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.140511 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="893a9a1d-8fe0-4980-91af-417cb0a2bd00" containerName="authorino" Jul 02 20:00:44.140625 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.140584 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="893a9a1d-8fe0-4980-91af-417cb0a2bd00" containerName="authorino" Jul 02 20:00:44.145762 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.145743 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dmtlg" Jul 02 20:00:44.149988 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.149965 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dmtlg"] Jul 02 20:00:44.236006 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.235970 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqpjl\" (UniqueName: \"kubernetes.io/projected/0f19750d-58de-4b9c-b22c-2119542514b1-kube-api-access-pqpjl\") pod \"authorino-5d4b67c446-dmtlg\" (UID: \"0f19750d-58de-4b9c-b22c-2119542514b1\") " pod="kuadrant-system/authorino-5d4b67c446-dmtlg" Jul 02 20:00:44.322020 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.321986 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dmtlg"] Jul 02 20:00:44.322328 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:00:44.322305 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-pqpjl], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-dmtlg" podUID="0f19750d-58de-4b9c-b22c-2119542514b1" Jul 02 20:00:44.337011 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.336986 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqpjl\" (UniqueName: \"kubernetes.io/projected/0f19750d-58de-4b9c-b22c-2119542514b1-kube-api-access-pqpjl\") pod \"authorino-5d4b67c446-dmtlg\" (UID: \"0f19750d-58de-4b9c-b22c-2119542514b1\") " pod="kuadrant-system/authorino-5d4b67c446-dmtlg" Jul 02 20:00:44.350859 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.350837 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqpjl\" (UniqueName: \"kubernetes.io/projected/0f19750d-58de-4b9c-b22c-2119542514b1-kube-api-access-pqpjl\") pod \"authorino-5d4b67c446-dmtlg\" (UID: \"0f19750d-58de-4b9c-b22c-2119542514b1\") " pod="kuadrant-system/authorino-5d4b67c446-dmtlg" Jul 02 20:00:44.356106 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.356080 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-hk27w"] Jul 02 20:00:44.358873 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.358852 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-hk27w" Jul 02 20:00:44.361582 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.361564 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 02 20:00:44.374316 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.374277 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-hk27w"] Jul 02 20:00:44.408855 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.408783 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-hk27w"] Jul 02 20:00:44.409088 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:00:44.409065 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-9hhb7 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-hk27w" podUID="50a78c7c-5aa1-4690-8a49-d2a22834b2de" Jul 02 20:00:44.438613 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.438577 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50a78c7c-5aa1-4690-8a49-d2a22834b2de-tls-cert\") pod \"authorino-76877994-hk27w\" (UID: \"50a78c7c-5aa1-4690-8a49-d2a22834b2de\") " pod="kuadrant-system/authorino-76877994-hk27w" Jul 02 20:00:44.438755 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.438623 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hhb7\" (UniqueName: \"kubernetes.io/projected/50a78c7c-5aa1-4690-8a49-d2a22834b2de-kube-api-access-9hhb7\") pod \"authorino-76877994-hk27w\" (UID: \"50a78c7c-5aa1-4690-8a49-d2a22834b2de\") " pod="kuadrant-system/authorino-76877994-hk27w" Jul 02 20:00:44.440976 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.440954 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-855b5668f6-rqjnd"] Jul 02 20:00:44.443999 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.443985 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-855b5668f6-rqjnd" Jul 02 20:00:44.453240 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.453217 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-855b5668f6-rqjnd"] Jul 02 20:00:44.539342 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.539301 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21e42879-3c87-40dc-9987-951850784aaa-tls-cert\") pod \"authorino-855b5668f6-rqjnd\" (UID: \"21e42879-3c87-40dc-9987-951850784aaa\") " pod="kuadrant-system/authorino-855b5668f6-rqjnd" Jul 02 20:00:44.539342 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.539344 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29b4m\" (UniqueName: \"kubernetes.io/projected/21e42879-3c87-40dc-9987-951850784aaa-kube-api-access-29b4m\") pod \"authorino-855b5668f6-rqjnd\" (UID: \"21e42879-3c87-40dc-9987-951850784aaa\") " pod="kuadrant-system/authorino-855b5668f6-rqjnd" Jul 02 20:00:44.539579 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.539372 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50a78c7c-5aa1-4690-8a49-d2a22834b2de-tls-cert\") pod \"authorino-76877994-hk27w\" (UID: \"50a78c7c-5aa1-4690-8a49-d2a22834b2de\") " pod="kuadrant-system/authorino-76877994-hk27w" Jul 02 20:00:44.539579 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.539406 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hhb7\" (UniqueName: \"kubernetes.io/projected/50a78c7c-5aa1-4690-8a49-d2a22834b2de-kube-api-access-9hhb7\") pod \"authorino-76877994-hk27w\" (UID: \"50a78c7c-5aa1-4690-8a49-d2a22834b2de\") " pod="kuadrant-system/authorino-76877994-hk27w" Jul 02 20:00:44.541822 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.541802 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50a78c7c-5aa1-4690-8a49-d2a22834b2de-tls-cert\") pod \"authorino-76877994-hk27w\" (UID: \"50a78c7c-5aa1-4690-8a49-d2a22834b2de\") " pod="kuadrant-system/authorino-76877994-hk27w" Jul 02 20:00:44.548933 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.548913 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hhb7\" (UniqueName: \"kubernetes.io/projected/50a78c7c-5aa1-4690-8a49-d2a22834b2de-kube-api-access-9hhb7\") pod \"authorino-76877994-hk27w\" (UID: \"50a78c7c-5aa1-4690-8a49-d2a22834b2de\") " pod="kuadrant-system/authorino-76877994-hk27w" Jul 02 20:00:44.640758 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.640723 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21e42879-3c87-40dc-9987-951850784aaa-tls-cert\") pod \"authorino-855b5668f6-rqjnd\" (UID: \"21e42879-3c87-40dc-9987-951850784aaa\") " pod="kuadrant-system/authorino-855b5668f6-rqjnd" Jul 02 20:00:44.640758 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.640761 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29b4m\" (UniqueName: \"kubernetes.io/projected/21e42879-3c87-40dc-9987-951850784aaa-kube-api-access-29b4m\") pod \"authorino-855b5668f6-rqjnd\" (UID: \"21e42879-3c87-40dc-9987-951850784aaa\") " pod="kuadrant-system/authorino-855b5668f6-rqjnd" Jul 02 20:00:44.643133 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.643112 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21e42879-3c87-40dc-9987-951850784aaa-tls-cert\") pod \"authorino-855b5668f6-rqjnd\" (UID: \"21e42879-3c87-40dc-9987-951850784aaa\") " pod="kuadrant-system/authorino-855b5668f6-rqjnd" Jul 02 20:00:44.649785 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.649761 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29b4m\" (UniqueName: \"kubernetes.io/projected/21e42879-3c87-40dc-9987-951850784aaa-kube-api-access-29b4m\") pod \"authorino-855b5668f6-rqjnd\" (UID: \"21e42879-3c87-40dc-9987-951850784aaa\") " pod="kuadrant-system/authorino-855b5668f6-rqjnd" Jul 02 20:00:44.753942 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.753891 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-855b5668f6-rqjnd" Jul 02 20:00:44.794867 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.794842 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dmtlg" Jul 02 20:00:44.795022 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.794842 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-hk27w" Jul 02 20:00:44.801903 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.801878 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dmtlg" Jul 02 20:00:44.806531 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.806504 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-hk27w" Jul 02 20:00:44.892335 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.892305 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-855b5668f6-rqjnd"] Jul 02 20:00:44.893785 ip-10-0-137-196 kubenswrapper[2560]: W0702 20:00:44.893763 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21e42879_3c87_40dc_9987_951850784aaa.slice/crio-dc3cae79f8e2f55fa79775cfad8c5d996bdbc9908af92dd13d0e70d29b835e10 WatchSource:0}: Error finding container dc3cae79f8e2f55fa79775cfad8c5d996bdbc9908af92dd13d0e70d29b835e10: Status 404 returned error can't find the container with id dc3cae79f8e2f55fa79775cfad8c5d996bdbc9908af92dd13d0e70d29b835e10 Jul 02 20:00:44.943563 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.943533 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqpjl\" (UniqueName: \"kubernetes.io/projected/0f19750d-58de-4b9c-b22c-2119542514b1-kube-api-access-pqpjl\") pod \"0f19750d-58de-4b9c-b22c-2119542514b1\" (UID: \"0f19750d-58de-4b9c-b22c-2119542514b1\") " Jul 02 20:00:44.943738 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.943591 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hhb7\" (UniqueName: \"kubernetes.io/projected/50a78c7c-5aa1-4690-8a49-d2a22834b2de-kube-api-access-9hhb7\") pod \"50a78c7c-5aa1-4690-8a49-d2a22834b2de\" (UID: \"50a78c7c-5aa1-4690-8a49-d2a22834b2de\") " Jul 02 20:00:44.943738 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.943622 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50a78c7c-5aa1-4690-8a49-d2a22834b2de-tls-cert\") pod \"50a78c7c-5aa1-4690-8a49-d2a22834b2de\" (UID: \"50a78c7c-5aa1-4690-8a49-d2a22834b2de\") " Jul 02 20:00:44.945817 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.945785 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50a78c7c-5aa1-4690-8a49-d2a22834b2de-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "50a78c7c-5aa1-4690-8a49-d2a22834b2de" (UID: "50a78c7c-5aa1-4690-8a49-d2a22834b2de"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:00:44.945931 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.945809 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f19750d-58de-4b9c-b22c-2119542514b1-kube-api-access-pqpjl" (OuterVolumeSpecName: "kube-api-access-pqpjl") pod "0f19750d-58de-4b9c-b22c-2119542514b1" (UID: "0f19750d-58de-4b9c-b22c-2119542514b1"). InnerVolumeSpecName "kube-api-access-pqpjl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:00:44.945931 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:44.945860 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50a78c7c-5aa1-4690-8a49-d2a22834b2de-kube-api-access-9hhb7" (OuterVolumeSpecName: "kube-api-access-9hhb7") pod "50a78c7c-5aa1-4690-8a49-d2a22834b2de" (UID: "50a78c7c-5aa1-4690-8a49-d2a22834b2de"). InnerVolumeSpecName "kube-api-access-9hhb7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:00:45.045278 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:45.045147 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hhb7\" (UniqueName: \"kubernetes.io/projected/50a78c7c-5aa1-4690-8a49-d2a22834b2de-kube-api-access-9hhb7\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:00:45.045278 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:45.045178 2560 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50a78c7c-5aa1-4690-8a49-d2a22834b2de-tls-cert\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:00:45.045278 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:45.045188 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqpjl\" (UniqueName: \"kubernetes.io/projected/0f19750d-58de-4b9c-b22c-2119542514b1-kube-api-access-pqpjl\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:00:45.801393 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:45.801353 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-855b5668f6-rqjnd" event={"ID":"21e42879-3c87-40dc-9987-951850784aaa","Type":"ContainerStarted","Data":"63f76d689a4f84b8290808b189ac8480b5441b053e093fd61de2eb17e28656e4"} Jul 02 20:00:45.801393 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:45.801377 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dmtlg" Jul 02 20:00:45.801393 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:45.801390 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-hk27w" Jul 02 20:00:45.801872 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:45.801397 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-855b5668f6-rqjnd" event={"ID":"21e42879-3c87-40dc-9987-951850784aaa","Type":"ContainerStarted","Data":"dc3cae79f8e2f55fa79775cfad8c5d996bdbc9908af92dd13d0e70d29b835e10"} Jul 02 20:00:45.820282 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:45.820220 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-855b5668f6-rqjnd" podStartSLOduration=1.2480209389999999 podStartE2EDuration="1.82020515s" totalImagesPullingTime="572.184211ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:00:45.817686706 +0000 UTC m=+594.387290803" watchObservedRunningTime="2026-07-02 20:00:45.82020515 +0000 UTC m=+594.389809222" Jul 02 20:00:45.847819 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:45.847778 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dmtlg"] Jul 02 20:00:45.853709 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:45.853676 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fhdxg"] Jul 02 20:00:45.853949 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:45.853920 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-fhdxg" podUID="30b5407a-1542-4b8d-a441-5f68a096ef75" containerName="authorino" containerID="cri-o://64add70dcaccd91e06042b2e0469cfcbcd19ea92e8e972d72ec7d658360774f4" gracePeriod=30 Jul 02 20:00:45.856375 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:45.856350 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dmtlg"] Jul 02 20:00:45.890951 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:45.890920 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-hk27w"] Jul 02 20:00:45.895288 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:45.895232 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-hk27w"] Jul 02 20:00:45.934236 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:45.934203 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f19750d-58de-4b9c-b22c-2119542514b1" path="/var/lib/kubelet/pods/0f19750d-58de-4b9c-b22c-2119542514b1/volumes" Jul 02 20:00:45.934492 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:45.934480 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50a78c7c-5aa1-4690-8a49-d2a22834b2de" path="/var/lib/kubelet/pods/50a78c7c-5aa1-4690-8a49-d2a22834b2de/volumes" Jul 02 20:00:46.085550 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:46.085527 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fhdxg" Jul 02 20:00:46.257304 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:46.257276 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnxhk\" (UniqueName: \"kubernetes.io/projected/30b5407a-1542-4b8d-a441-5f68a096ef75-kube-api-access-vnxhk\") pod \"30b5407a-1542-4b8d-a441-5f68a096ef75\" (UID: \"30b5407a-1542-4b8d-a441-5f68a096ef75\") " Jul 02 20:00:46.259264 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:46.259220 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30b5407a-1542-4b8d-a441-5f68a096ef75-kube-api-access-vnxhk" (OuterVolumeSpecName: "kube-api-access-vnxhk") pod "30b5407a-1542-4b8d-a441-5f68a096ef75" (UID: "30b5407a-1542-4b8d-a441-5f68a096ef75"). InnerVolumeSpecName "kube-api-access-vnxhk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:00:46.358722 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:46.358694 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnxhk\" (UniqueName: \"kubernetes.io/projected/30b5407a-1542-4b8d-a441-5f68a096ef75-kube-api-access-vnxhk\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:00:46.807971 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:46.807934 2560 generic.go:356] "Generic (PLEG): container finished" podID="30b5407a-1542-4b8d-a441-5f68a096ef75" containerID="64add70dcaccd91e06042b2e0469cfcbcd19ea92e8e972d72ec7d658360774f4" exitCode=0 Jul 02 20:00:46.808508 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:46.807976 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fhdxg" Jul 02 20:00:46.808508 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:46.808017 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fhdxg" event={"ID":"30b5407a-1542-4b8d-a441-5f68a096ef75","Type":"ContainerDied","Data":"64add70dcaccd91e06042b2e0469cfcbcd19ea92e8e972d72ec7d658360774f4"} Jul 02 20:00:46.808508 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:46.808057 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fhdxg" event={"ID":"30b5407a-1542-4b8d-a441-5f68a096ef75","Type":"ContainerDied","Data":"b1ce0fbe6a2a0d592330d59d58cf4f92d0adec1ce349e9eb8bc1c0cf74938210"} Jul 02 20:00:46.808508 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:46.808075 2560 scope.go:117] "RemoveContainer" containerID="64add70dcaccd91e06042b2e0469cfcbcd19ea92e8e972d72ec7d658360774f4" Jul 02 20:00:46.817435 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:46.817418 2560 scope.go:117] "RemoveContainer" containerID="64add70dcaccd91e06042b2e0469cfcbcd19ea92e8e972d72ec7d658360774f4" Jul 02 20:00:46.817676 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:00:46.817657 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64add70dcaccd91e06042b2e0469cfcbcd19ea92e8e972d72ec7d658360774f4\": container with ID starting with 64add70dcaccd91e06042b2e0469cfcbcd19ea92e8e972d72ec7d658360774f4 not found: ID does not exist" containerID="64add70dcaccd91e06042b2e0469cfcbcd19ea92e8e972d72ec7d658360774f4" Jul 02 20:00:46.817763 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:46.817682 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64add70dcaccd91e06042b2e0469cfcbcd19ea92e8e972d72ec7d658360774f4"} err="failed to get container status \"64add70dcaccd91e06042b2e0469cfcbcd19ea92e8e972d72ec7d658360774f4\": rpc error: code = NotFound desc = could not find container \"64add70dcaccd91e06042b2e0469cfcbcd19ea92e8e972d72ec7d658360774f4\": container with ID starting with 64add70dcaccd91e06042b2e0469cfcbcd19ea92e8e972d72ec7d658360774f4 not found: ID does not exist" Jul 02 20:00:46.830859 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:46.830836 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fhdxg"] Jul 02 20:00:46.840260 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:46.840229 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fhdxg"] Jul 02 20:00:47.933822 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:47.933779 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30b5407a-1542-4b8d-a441-5f68a096ef75" path="/var/lib/kubelet/pods/30b5407a-1542-4b8d-a441-5f68a096ef75/volumes" Jul 02 20:00:51.868008 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:51.867981 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/1.log" Jul 02 20:00:51.869551 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:51.869529 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/1.log" Jul 02 20:00:51.871163 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:51.871147 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tkp7w_72996a08-b83d-4d1b-99c6-780e15c6722a/ovn-acl-logging/0.log" Jul 02 20:00:51.872705 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:00:51.872690 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tkp7w_72996a08-b83d-4d1b-99c6-780e15c6722a/ovn-acl-logging/0.log" Jul 02 20:01:35.090224 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:35.090136 2560 generic.go:356] "Generic (PLEG): container finished" podID="1bdccac3-910b-4dd9-bd76-3557fbd16838" containerID="ca803b2b9afb64f0f2326f355ef0b46fcbe6ffc09a0ebc1e5e6343ab8eb58c88" exitCode=0 Jul 02 20:01:35.090754 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:35.090222 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" event={"ID":"1bdccac3-910b-4dd9-bd76-3557fbd16838","Type":"ContainerDied","Data":"ca803b2b9afb64f0f2326f355ef0b46fcbe6ffc09a0ebc1e5e6343ab8eb58c88"} Jul 02 20:01:35.090754 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:35.090741 2560 scope.go:117] "RemoveContainer" containerID="ca803b2b9afb64f0f2326f355ef0b46fcbe6ffc09a0ebc1e5e6343ab8eb58c88" Jul 02 20:01:35.091858 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:35.091831 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:01:35.091999 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:35.091905 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:01:35.091999 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:35.091942 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:01:36.098014 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:36.097974 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" event={"ID":"1bdccac3-910b-4dd9-bd76-3557fbd16838","Type":"ContainerStarted","Data":"4e2b48d877b4cd251e33bea986a3df52c1cd9335aad7fcd67938115de95417a6"} Jul 02 20:01:37.017993 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:37.017963 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 20:01:37.018197 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:37.018176 2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-jzkvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 02 20:01:37.018242 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:37.018221 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" podUID="1bdccac3-910b-4dd9-bd76-3557fbd16838" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 02 20:01:38.017991 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:38.017952 2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-jzkvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 02 20:01:38.018400 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:38.018015 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" podUID="1bdccac3-910b-4dd9-bd76-3557fbd16838" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 02 20:01:39.018236 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:39.018198 2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-jzkvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 02 20:01:39.018671 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:39.018297 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" podUID="1bdccac3-910b-4dd9-bd76-3557fbd16838" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 02 20:01:40.021738 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:40.021699 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 20:01:40.022405 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:40.022374 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 20:01:40.023159 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:40.023130 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jzkvx" Jul 02 20:01:48.399027 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.398995 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d"] Jul 02 20:01:48.399382 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.399369 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30b5407a-1542-4b8d-a441-5f68a096ef75" containerName="authorino" Jul 02 20:01:48.399382 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.399380 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b5407a-1542-4b8d-a441-5f68a096ef75" containerName="authorino" Jul 02 20:01:48.399469 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.399459 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="30b5407a-1542-4b8d-a441-5f68a096ef75" containerName="authorino" Jul 02 20:01:48.401483 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.401463 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:48.406071 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.406046 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zdt7w\"" Jul 02 20:01:48.406208 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.406076 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 20:01:48.406208 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.406114 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 20:01:48.406208 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.406084 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 02 20:01:48.417091 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.417070 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d"] Jul 02 20:01:48.477785 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.477762 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c1c73f0-8280-45a1-833f-913485dcbe3c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d\" (UID: \"5c1c73f0-8280-45a1-833f-913485dcbe3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:48.477896 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.477797 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwszg\" (UniqueName: \"kubernetes.io/projected/5c1c73f0-8280-45a1-833f-913485dcbe3c-kube-api-access-hwszg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d\" (UID: \"5c1c73f0-8280-45a1-833f-913485dcbe3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:48.477896 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.477822 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c1c73f0-8280-45a1-833f-913485dcbe3c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d\" (UID: \"5c1c73f0-8280-45a1-833f-913485dcbe3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:48.477896 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.477868 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c1c73f0-8280-45a1-833f-913485dcbe3c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d\" (UID: \"5c1c73f0-8280-45a1-833f-913485dcbe3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:48.478052 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.477897 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c1c73f0-8280-45a1-833f-913485dcbe3c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d\" (UID: \"5c1c73f0-8280-45a1-833f-913485dcbe3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:48.478052 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.477925 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1c73f0-8280-45a1-833f-913485dcbe3c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d\" (UID: \"5c1c73f0-8280-45a1-833f-913485dcbe3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:48.578856 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.578824 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c1c73f0-8280-45a1-833f-913485dcbe3c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d\" (UID: \"5c1c73f0-8280-45a1-833f-913485dcbe3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:48.578996 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.578862 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwszg\" (UniqueName: \"kubernetes.io/projected/5c1c73f0-8280-45a1-833f-913485dcbe3c-kube-api-access-hwszg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d\" (UID: \"5c1c73f0-8280-45a1-833f-913485dcbe3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:48.578996 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.578886 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c1c73f0-8280-45a1-833f-913485dcbe3c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d\" (UID: \"5c1c73f0-8280-45a1-833f-913485dcbe3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:48.578996 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.578911 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c1c73f0-8280-45a1-833f-913485dcbe3c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d\" (UID: \"5c1c73f0-8280-45a1-833f-913485dcbe3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:48.578996 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.578934 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c1c73f0-8280-45a1-833f-913485dcbe3c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d\" (UID: \"5c1c73f0-8280-45a1-833f-913485dcbe3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:48.578996 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.578949 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1c73f0-8280-45a1-833f-913485dcbe3c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d\" (UID: \"5c1c73f0-8280-45a1-833f-913485dcbe3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:48.579284 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.579225 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c1c73f0-8280-45a1-833f-913485dcbe3c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d\" (UID: \"5c1c73f0-8280-45a1-833f-913485dcbe3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:48.579350 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.579301 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c1c73f0-8280-45a1-833f-913485dcbe3c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d\" (UID: \"5c1c73f0-8280-45a1-833f-913485dcbe3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:48.579350 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.579319 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c1c73f0-8280-45a1-833f-913485dcbe3c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d\" (UID: \"5c1c73f0-8280-45a1-833f-913485dcbe3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:48.581163 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.581139 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c1c73f0-8280-45a1-833f-913485dcbe3c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d\" (UID: \"5c1c73f0-8280-45a1-833f-913485dcbe3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:48.581468 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.581450 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1c73f0-8280-45a1-833f-913485dcbe3c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d\" (UID: \"5c1c73f0-8280-45a1-833f-913485dcbe3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:48.588065 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.588045 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwszg\" (UniqueName: \"kubernetes.io/projected/5c1c73f0-8280-45a1-833f-913485dcbe3c-kube-api-access-hwszg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d\" (UID: \"5c1c73f0-8280-45a1-833f-913485dcbe3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:48.711724 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.711691 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:48.867640 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.867615 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d"] Jul 02 20:01:48.868818 ip-10-0-137-196 kubenswrapper[2560]: W0702 20:01:48.868793 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c1c73f0_8280_45a1_833f_913485dcbe3c.slice/crio-ec20aa8f0c15c8a05d43b29842e14bb39b9565a5017f0b4c525779d4dc25dfec WatchSource:0}: Error finding container ec20aa8f0c15c8a05d43b29842e14bb39b9565a5017f0b4c525779d4dc25dfec: Status 404 returned error can't find the container with id ec20aa8f0c15c8a05d43b29842e14bb39b9565a5017f0b4c525779d4dc25dfec Jul 02 20:01:48.870171 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:48.870154 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 20:01:49.171728 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:49.171639 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" event={"ID":"5c1c73f0-8280-45a1-833f-913485dcbe3c","Type":"ContainerStarted","Data":"ec20aa8f0c15c8a05d43b29842e14bb39b9565a5017f0b4c525779d4dc25dfec"} Jul 02 20:01:50.178340 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:50.178309 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" event={"ID":"5c1c73f0-8280-45a1-833f-913485dcbe3c","Type":"ContainerStarted","Data":"766b967c5f51af8dad61a5bfd31e7f6564f22b51d9c92f769fd7e57c585c9c5b"} Jul 02 20:01:50.203193 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:50.203147 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" podStartSLOduration=1.028425629 podStartE2EDuration="2.203131765s" totalImagesPullingTime="1.174706136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:01:50.200958509 +0000 UTC m=+658.770562598" watchObservedRunningTime="2026-07-02 20:01:50.203131765 +0000 UTC m=+658.772735834" Jul 02 20:01:58.712109 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:58.712078 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:58.712607 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:58.712130 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:58.724986 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:58.724963 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:01:59.237797 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:01:59.237767 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d" Jul 02 20:02:03.595693 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.595655 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4"] Jul 02 20:02:03.598262 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.598234 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:03.601454 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.601430 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 02 20:02:03.614661 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.614633 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4"] Jul 02 20:02:03.706118 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.706091 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8bbbcf7-0ff0-493f-b63f-b77b4086b665-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n6zf4\" (UID: \"a8bbbcf7-0ff0-493f-b63f-b77b4086b665\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:03.706285 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.706132 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8bbbcf7-0ff0-493f-b63f-b77b4086b665-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n6zf4\" (UID: \"a8bbbcf7-0ff0-493f-b63f-b77b4086b665\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:03.706285 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.706195 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlwx7\" (UniqueName: \"kubernetes.io/projected/a8bbbcf7-0ff0-493f-b63f-b77b4086b665-kube-api-access-tlwx7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n6zf4\" (UID: \"a8bbbcf7-0ff0-493f-b63f-b77b4086b665\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:03.706285 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.706227 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8bbbcf7-0ff0-493f-b63f-b77b4086b665-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n6zf4\" (UID: \"a8bbbcf7-0ff0-493f-b63f-b77b4086b665\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:03.706403 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.706292 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8bbbcf7-0ff0-493f-b63f-b77b4086b665-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n6zf4\" (UID: \"a8bbbcf7-0ff0-493f-b63f-b77b4086b665\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:03.706403 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.706328 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8bbbcf7-0ff0-493f-b63f-b77b4086b665-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n6zf4\" (UID: \"a8bbbcf7-0ff0-493f-b63f-b77b4086b665\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:03.806893 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.806859 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8bbbcf7-0ff0-493f-b63f-b77b4086b665-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n6zf4\" (UID: \"a8bbbcf7-0ff0-493f-b63f-b77b4086b665\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:03.807072 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.806923 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8bbbcf7-0ff0-493f-b63f-b77b4086b665-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n6zf4\" (UID: \"a8bbbcf7-0ff0-493f-b63f-b77b4086b665\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:03.807072 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.806962 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8bbbcf7-0ff0-493f-b63f-b77b4086b665-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n6zf4\" (UID: \"a8bbbcf7-0ff0-493f-b63f-b77b4086b665\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:03.807072 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.807006 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlwx7\" (UniqueName: \"kubernetes.io/projected/a8bbbcf7-0ff0-493f-b63f-b77b4086b665-kube-api-access-tlwx7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n6zf4\" (UID: \"a8bbbcf7-0ff0-493f-b63f-b77b4086b665\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:03.807072 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.807035 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8bbbcf7-0ff0-493f-b63f-b77b4086b665-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n6zf4\" (UID: \"a8bbbcf7-0ff0-493f-b63f-b77b4086b665\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:03.807313 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.807076 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8bbbcf7-0ff0-493f-b63f-b77b4086b665-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n6zf4\" (UID: \"a8bbbcf7-0ff0-493f-b63f-b77b4086b665\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:03.807427 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.807404 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8bbbcf7-0ff0-493f-b63f-b77b4086b665-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n6zf4\" (UID: \"a8bbbcf7-0ff0-493f-b63f-b77b4086b665\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:03.807427 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.807415 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8bbbcf7-0ff0-493f-b63f-b77b4086b665-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n6zf4\" (UID: \"a8bbbcf7-0ff0-493f-b63f-b77b4086b665\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:03.807536 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.807455 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8bbbcf7-0ff0-493f-b63f-b77b4086b665-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n6zf4\" (UID: \"a8bbbcf7-0ff0-493f-b63f-b77b4086b665\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:03.809335 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.809312 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8bbbcf7-0ff0-493f-b63f-b77b4086b665-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n6zf4\" (UID: \"a8bbbcf7-0ff0-493f-b63f-b77b4086b665\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:03.809552 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.809537 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8bbbcf7-0ff0-493f-b63f-b77b4086b665-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n6zf4\" (UID: \"a8bbbcf7-0ff0-493f-b63f-b77b4086b665\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:03.816004 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.815985 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlwx7\" (UniqueName: \"kubernetes.io/projected/a8bbbcf7-0ff0-493f-b63f-b77b4086b665-kube-api-access-tlwx7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n6zf4\" (UID: \"a8bbbcf7-0ff0-493f-b63f-b77b4086b665\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:03.908399 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:03.908335 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:04.048631 ip-10-0-137-196 kubenswrapper[2560]: W0702 20:02:04.048600 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8bbbcf7_0ff0_493f_b63f_b77b4086b665.slice/crio-62231e7921da22364bf5519ad6fea08f4b9db827cd8127e9304351067a1dbd1c WatchSource:0}: Error finding container 62231e7921da22364bf5519ad6fea08f4b9db827cd8127e9304351067a1dbd1c: Status 404 returned error can't find the container with id 62231e7921da22364bf5519ad6fea08f4b9db827cd8127e9304351067a1dbd1c Jul 02 20:02:04.049101 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:04.049073 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4"] Jul 02 20:02:04.255191 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:04.255163 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" event={"ID":"a8bbbcf7-0ff0-493f-b63f-b77b4086b665","Type":"ContainerStarted","Data":"62231e7921da22364bf5519ad6fea08f4b9db827cd8127e9304351067a1dbd1c"} Jul 02 20:02:05.261553 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:05.261518 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" event={"ID":"a8bbbcf7-0ff0-493f-b63f-b77b4086b665","Type":"ContainerStarted","Data":"f24a937acd237e48e69cfeafde93238fb74b5cf637bbb3a885ae1bd8198d6439"} Jul 02 20:02:05.288928 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:05.288882 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" podStartSLOduration=2.101775068 podStartE2EDuration="2.288867477s" totalImagesPullingTime="187.092409ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:02:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:02:05.286332877 +0000 UTC m=+673.855936946" watchObservedRunningTime="2026-07-02 20:02:05.288867477 +0000 UTC m=+673.858471547" Jul 02 20:02:13.908913 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:13.908870 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:13.909330 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:13.908940 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:13.921452 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:13.921430 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:02:14.320887 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:02:14.320851 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n6zf4" Jul 02 20:03:55.032605 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:55.032572 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-599c685bf-8txd7"] Jul 02 20:03:55.035823 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:55.035806 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-599c685bf-8txd7" Jul 02 20:03:55.045221 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:55.045198 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-599c685bf-8txd7"] Jul 02 20:03:55.082241 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:55.082207 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3983e39c-367d-4ea4-98a0-87740d2c4442-tls-cert\") pod \"authorino-599c685bf-8txd7\" (UID: \"3983e39c-367d-4ea4-98a0-87740d2c4442\") " pod="kuadrant-system/authorino-599c685bf-8txd7" Jul 02 20:03:55.082409 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:55.082304 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz7cw\" (UniqueName: \"kubernetes.io/projected/3983e39c-367d-4ea4-98a0-87740d2c4442-kube-api-access-mz7cw\") pod \"authorino-599c685bf-8txd7\" (UID: \"3983e39c-367d-4ea4-98a0-87740d2c4442\") " pod="kuadrant-system/authorino-599c685bf-8txd7" Jul 02 20:03:55.183793 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:55.183757 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3983e39c-367d-4ea4-98a0-87740d2c4442-tls-cert\") pod \"authorino-599c685bf-8txd7\" (UID: \"3983e39c-367d-4ea4-98a0-87740d2c4442\") " pod="kuadrant-system/authorino-599c685bf-8txd7" Jul 02 20:03:55.183959 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:55.183824 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz7cw\" (UniqueName: \"kubernetes.io/projected/3983e39c-367d-4ea4-98a0-87740d2c4442-kube-api-access-mz7cw\") pod \"authorino-599c685bf-8txd7\" (UID: \"3983e39c-367d-4ea4-98a0-87740d2c4442\") " pod="kuadrant-system/authorino-599c685bf-8txd7" Jul 02 20:03:55.186191 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:55.186162 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3983e39c-367d-4ea4-98a0-87740d2c4442-tls-cert\") pod \"authorino-599c685bf-8txd7\" (UID: \"3983e39c-367d-4ea4-98a0-87740d2c4442\") " pod="kuadrant-system/authorino-599c685bf-8txd7" Jul 02 20:03:55.192805 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:55.192780 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz7cw\" (UniqueName: \"kubernetes.io/projected/3983e39c-367d-4ea4-98a0-87740d2c4442-kube-api-access-mz7cw\") pod \"authorino-599c685bf-8txd7\" (UID: \"3983e39c-367d-4ea4-98a0-87740d2c4442\") " pod="kuadrant-system/authorino-599c685bf-8txd7" Jul 02 20:03:55.345705 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:55.345625 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-599c685bf-8txd7" Jul 02 20:03:55.487113 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:55.487088 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-599c685bf-8txd7"] Jul 02 20:03:55.489115 ip-10-0-137-196 kubenswrapper[2560]: W0702 20:03:55.489076 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3983e39c_367d_4ea4_98a0_87740d2c4442.slice/crio-2c94f1c2500b95982f00a5f4dbf0a66de31efc6288fce0cb9d902adebd51430c WatchSource:0}: Error finding container 2c94f1c2500b95982f00a5f4dbf0a66de31efc6288fce0cb9d902adebd51430c: Status 404 returned error can't find the container with id 2c94f1c2500b95982f00a5f4dbf0a66de31efc6288fce0cb9d902adebd51430c Jul 02 20:03:55.856776 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:55.856739 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-599c685bf-8txd7" event={"ID":"3983e39c-367d-4ea4-98a0-87740d2c4442","Type":"ContainerStarted","Data":"2c94f1c2500b95982f00a5f4dbf0a66de31efc6288fce0cb9d902adebd51430c"} Jul 02 20:03:56.864351 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:56.864313 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-599c685bf-8txd7" event={"ID":"3983e39c-367d-4ea4-98a0-87740d2c4442","Type":"ContainerStarted","Data":"d2f3b156967e2b10f0f8c5e09632285e91fb8cea89cf1feae693568f388d8611"} Jul 02 20:03:56.887845 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:56.887779 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-599c685bf-8txd7" podStartSLOduration=1.372633935 podStartE2EDuration="1.887757102s" totalImagesPullingTime="515.123167ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:03:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:03:56.885847386 +0000 UTC m=+785.455451489" watchObservedRunningTime="2026-07-02 20:03:56.887757102 +0000 UTC m=+785.457361175" Jul 02 20:03:56.923207 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:56.923175 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-855b5668f6-rqjnd"] Jul 02 20:03:56.923430 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:56.923405 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-855b5668f6-rqjnd" podUID="21e42879-3c87-40dc-9987-951850784aaa" containerName="authorino" containerID="cri-o://63f76d689a4f84b8290808b189ac8480b5441b053e093fd61de2eb17e28656e4" gracePeriod=30 Jul 02 20:03:57.189499 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:57.189474 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-855b5668f6-rqjnd" Jul 02 20:03:57.304631 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:57.304593 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21e42879-3c87-40dc-9987-951850784aaa-tls-cert\") pod \"21e42879-3c87-40dc-9987-951850784aaa\" (UID: \"21e42879-3c87-40dc-9987-951850784aaa\") " Jul 02 20:03:57.304830 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:57.304736 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29b4m\" (UniqueName: \"kubernetes.io/projected/21e42879-3c87-40dc-9987-951850784aaa-kube-api-access-29b4m\") pod \"21e42879-3c87-40dc-9987-951850784aaa\" (UID: \"21e42879-3c87-40dc-9987-951850784aaa\") " Jul 02 20:03:57.307286 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:57.307235 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21e42879-3c87-40dc-9987-951850784aaa-kube-api-access-29b4m" (OuterVolumeSpecName: "kube-api-access-29b4m") pod "21e42879-3c87-40dc-9987-951850784aaa" (UID: "21e42879-3c87-40dc-9987-951850784aaa"). InnerVolumeSpecName "kube-api-access-29b4m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:03:57.315730 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:57.315707 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21e42879-3c87-40dc-9987-951850784aaa-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "21e42879-3c87-40dc-9987-951850784aaa" (UID: "21e42879-3c87-40dc-9987-951850784aaa"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:03:57.405403 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:57.405361 2560 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21e42879-3c87-40dc-9987-951850784aaa-tls-cert\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:03:57.405403 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:57.405389 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29b4m\" (UniqueName: \"kubernetes.io/projected/21e42879-3c87-40dc-9987-951850784aaa-kube-api-access-29b4m\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:03:57.870646 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:57.870611 2560 generic.go:356] "Generic (PLEG): container finished" podID="21e42879-3c87-40dc-9987-951850784aaa" containerID="63f76d689a4f84b8290808b189ac8480b5441b053e093fd61de2eb17e28656e4" exitCode=0 Jul 02 20:03:57.871109 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:57.870664 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-855b5668f6-rqjnd" Jul 02 20:03:57.871109 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:57.870697 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-855b5668f6-rqjnd" event={"ID":"21e42879-3c87-40dc-9987-951850784aaa","Type":"ContainerDied","Data":"63f76d689a4f84b8290808b189ac8480b5441b053e093fd61de2eb17e28656e4"} Jul 02 20:03:57.871109 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:57.870741 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-855b5668f6-rqjnd" event={"ID":"21e42879-3c87-40dc-9987-951850784aaa","Type":"ContainerDied","Data":"dc3cae79f8e2f55fa79775cfad8c5d996bdbc9908af92dd13d0e70d29b835e10"} Jul 02 20:03:57.871109 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:57.870766 2560 scope.go:117] "RemoveContainer" containerID="63f76d689a4f84b8290808b189ac8480b5441b053e093fd61de2eb17e28656e4" Jul 02 20:03:57.880894 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:57.880864 2560 scope.go:117] "RemoveContainer" containerID="63f76d689a4f84b8290808b189ac8480b5441b053e093fd61de2eb17e28656e4" Jul 02 20:03:57.881162 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:03:57.881144 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63f76d689a4f84b8290808b189ac8480b5441b053e093fd61de2eb17e28656e4\": container with ID starting with 63f76d689a4f84b8290808b189ac8480b5441b053e093fd61de2eb17e28656e4 not found: ID does not exist" containerID="63f76d689a4f84b8290808b189ac8480b5441b053e093fd61de2eb17e28656e4" Jul 02 20:03:57.881225 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:57.881171 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63f76d689a4f84b8290808b189ac8480b5441b053e093fd61de2eb17e28656e4"} err="failed to get container status \"63f76d689a4f84b8290808b189ac8480b5441b053e093fd61de2eb17e28656e4\": rpc error: code = NotFound desc = could not find container \"63f76d689a4f84b8290808b189ac8480b5441b053e093fd61de2eb17e28656e4\": container with ID starting with 63f76d689a4f84b8290808b189ac8480b5441b053e093fd61de2eb17e28656e4 not found: ID does not exist" Jul 02 20:03:57.898708 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:57.898675 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-855b5668f6-rqjnd"] Jul 02 20:03:57.900867 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:57.900847 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-855b5668f6-rqjnd"] Jul 02 20:03:57.934635 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:03:57.934600 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21e42879-3c87-40dc-9987-951850784aaa" path="/var/lib/kubelet/pods/21e42879-3c87-40dc-9987-951850784aaa/volumes" Jul 02 20:05:51.909448 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:05:51.909370 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/1.log" Jul 02 20:05:51.909993 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:05:51.909756 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/1.log" Jul 02 20:05:51.912967 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:05:51.912948 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tkp7w_72996a08-b83d-4d1b-99c6-780e15c6722a/ovn-acl-logging/0.log" Jul 02 20:05:51.913267 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:05:51.913238 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tkp7w_72996a08-b83d-4d1b-99c6-780e15c6722a/ovn-acl-logging/0.log" Jul 02 20:10:51.944969 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:10:51.944888 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/1.log" Jul 02 20:10:51.947500 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:10:51.947474 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/1.log" Jul 02 20:10:51.947660 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:10:51.947626 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tkp7w_72996a08-b83d-4d1b-99c6-780e15c6722a/ovn-acl-logging/0.log" Jul 02 20:10:51.950212 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:10:51.950194 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tkp7w_72996a08-b83d-4d1b-99c6-780e15c6722a/ovn-acl-logging/0.log" Jul 02 20:15:00.145121 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:00.145037 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29717055-zm7pv"] Jul 02 20:15:00.145648 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:00.145432 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21e42879-3c87-40dc-9987-951850784aaa" containerName="authorino" Jul 02 20:15:00.145648 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:00.145445 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="21e42879-3c87-40dc-9987-951850784aaa" containerName="authorino" Jul 02 20:15:00.145648 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:00.145517 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="21e42879-3c87-40dc-9987-951850784aaa" containerName="authorino" Jul 02 20:15:00.148563 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:00.148547 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717055-zm7pv" Jul 02 20:15:00.151347 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:00.151330 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-m88m6\"" Jul 02 20:15:00.168314 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:00.168282 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717055-zm7pv"] Jul 02 20:15:00.215174 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:00.215138 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhln4\" (UniqueName: \"kubernetes.io/projected/f2136c05-e542-44fd-8f8e-bab1cc54b8db-kube-api-access-qhln4\") pod \"maas-api-key-cleanup-29717055-zm7pv\" (UID: \"f2136c05-e542-44fd-8f8e-bab1cc54b8db\") " pod="opendatahub/maas-api-key-cleanup-29717055-zm7pv" Jul 02 20:15:00.316714 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:00.316662 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhln4\" (UniqueName: \"kubernetes.io/projected/f2136c05-e542-44fd-8f8e-bab1cc54b8db-kube-api-access-qhln4\") pod \"maas-api-key-cleanup-29717055-zm7pv\" (UID: \"f2136c05-e542-44fd-8f8e-bab1cc54b8db\") " pod="opendatahub/maas-api-key-cleanup-29717055-zm7pv" Jul 02 20:15:00.325574 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:00.325550 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhln4\" (UniqueName: \"kubernetes.io/projected/f2136c05-e542-44fd-8f8e-bab1cc54b8db-kube-api-access-qhln4\") pod \"maas-api-key-cleanup-29717055-zm7pv\" (UID: \"f2136c05-e542-44fd-8f8e-bab1cc54b8db\") " pod="opendatahub/maas-api-key-cleanup-29717055-zm7pv" Jul 02 20:15:00.458811 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:00.458785 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717055-zm7pv" Jul 02 20:15:00.596116 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:00.596092 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717055-zm7pv"] Jul 02 20:15:00.597958 ip-10-0-137-196 kubenswrapper[2560]: W0702 20:15:00.597920 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2136c05_e542_44fd_8f8e_bab1cc54b8db.slice/crio-a9e9a8d38db847ca1508852cfdce3a7c47d397a10ac398b09cf5cbb9ed6a582e WatchSource:0}: Error finding container a9e9a8d38db847ca1508852cfdce3a7c47d397a10ac398b09cf5cbb9ed6a582e: Status 404 returned error can't find the container with id a9e9a8d38db847ca1508852cfdce3a7c47d397a10ac398b09cf5cbb9ed6a582e Jul 02 20:15:00.599757 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:00.599741 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 20:15:01.516954 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:01.516919 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717055-zm7pv" event={"ID":"f2136c05-e542-44fd-8f8e-bab1cc54b8db","Type":"ContainerStarted","Data":"a9e9a8d38db847ca1508852cfdce3a7c47d397a10ac398b09cf5cbb9ed6a582e"} Jul 02 20:15:04.536109 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:04.536064 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717055-zm7pv" event={"ID":"f2136c05-e542-44fd-8f8e-bab1cc54b8db","Type":"ContainerStarted","Data":"c198fd13997a1f528eb3c9567552618010d0c0769ce2cb6fc05af6036fb1d1d6"} Jul 02 20:15:04.552915 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:04.552870 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29717055-zm7pv" podStartSLOduration=1.210025599 podStartE2EDuration="4.55285352s" totalImagesPullingTime="3.342827921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:15:04.551364807 +0000 UTC m=+1453.120968879" watchObservedRunningTime="2026-07-02 20:15:04.55285352 +0000 UTC m=+1453.122457592" Jul 02 20:15:05.542544 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:05.542506 2560 generic.go:356] "Generic (PLEG): container finished" podID="f2136c05-e542-44fd-8f8e-bab1cc54b8db" containerID="c198fd13997a1f528eb3c9567552618010d0c0769ce2cb6fc05af6036fb1d1d6" exitCode=0 Jul 02 20:15:05.542943 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:05.542575 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717055-zm7pv" event={"ID":"f2136c05-e542-44fd-8f8e-bab1cc54b8db","Type":"ContainerDied","Data":"c198fd13997a1f528eb3c9567552618010d0c0769ce2cb6fc05af6036fb1d1d6"} Jul 02 20:15:06.679077 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:06.679050 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717055-zm7pv" Jul 02 20:15:06.779158 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:06.779122 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhln4\" (UniqueName: \"kubernetes.io/projected/f2136c05-e542-44fd-8f8e-bab1cc54b8db-kube-api-access-qhln4\") pod \"f2136c05-e542-44fd-8f8e-bab1cc54b8db\" (UID: \"f2136c05-e542-44fd-8f8e-bab1cc54b8db\") " Jul 02 20:15:06.781307 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:06.781281 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2136c05-e542-44fd-8f8e-bab1cc54b8db-kube-api-access-qhln4" (OuterVolumeSpecName: "kube-api-access-qhln4") pod "f2136c05-e542-44fd-8f8e-bab1cc54b8db" (UID: "f2136c05-e542-44fd-8f8e-bab1cc54b8db"). InnerVolumeSpecName "kube-api-access-qhln4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:15:06.880827 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:06.880741 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhln4\" (UniqueName: \"kubernetes.io/projected/f2136c05-e542-44fd-8f8e-bab1cc54b8db-kube-api-access-qhln4\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:15:07.554625 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:07.554596 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717055-zm7pv" Jul 02 20:15:07.554805 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:07.554632 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717055-zm7pv" event={"ID":"f2136c05-e542-44fd-8f8e-bab1cc54b8db","Type":"ContainerDied","Data":"a9e9a8d38db847ca1508852cfdce3a7c47d397a10ac398b09cf5cbb9ed6a582e"} Jul 02 20:15:07.554805 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:07.554681 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9e9a8d38db847ca1508852cfdce3a7c47d397a10ac398b09cf5cbb9ed6a582e" Jul 02 20:15:51.979118 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:51.979086 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/1.log" Jul 02 20:15:51.982232 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:51.982212 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tkp7w_72996a08-b83d-4d1b-99c6-780e15c6722a/ovn-acl-logging/0.log" Jul 02 20:15:51.983680 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:51.983662 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/1.log" Jul 02 20:15:51.986624 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:15:51.986605 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tkp7w_72996a08-b83d-4d1b-99c6-780e15c6722a/ovn-acl-logging/0.log" Jul 02 20:17:08.065746 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.065711 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m"] Jul 02 20:17:08.066371 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.066347 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2136c05-e542-44fd-8f8e-bab1cc54b8db" containerName="cleanup" Jul 02 20:17:08.066461 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.066374 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2136c05-e542-44fd-8f8e-bab1cc54b8db" containerName="cleanup" Jul 02 20:17:08.066520 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.066498 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2136c05-e542-44fd-8f8e-bab1cc54b8db" containerName="cleanup" Jul 02 20:17:08.069759 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.069739 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.072512 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.072494 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f2f1ff11-openshift-default-dockercfg-s6r2l\"" Jul 02 20:17:08.098068 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.098038 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m"] Jul 02 20:17:08.177181 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.177142 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-envoy\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.177432 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.177194 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-podinfo\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.177432 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.177301 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-token\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.177569 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.177431 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-credential-socket\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.177569 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.177460 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-workload-certs\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.177569 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.177486 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-data\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.177734 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.177601 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istiod-ca-cert\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.177734 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.177636 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-workload-socket\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.177734 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.177686 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84f2k\" (UniqueName: \"kubernetes.io/projected/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-kube-api-access-84f2k\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.278692 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.278659 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-envoy\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.278692 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.278693 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-podinfo\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.278962 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.278714 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-token\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.278962 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.278759 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-credential-socket\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.278962 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.278774 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-workload-certs\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.278962 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.278799 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-data\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.278962 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.278853 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istiod-ca-cert\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.278962 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.278880 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-workload-socket\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.278962 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.278946 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84f2k\" (UniqueName: \"kubernetes.io/projected/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-kube-api-access-84f2k\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.279431 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.279169 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-credential-socket\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.279431 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.279300 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-data\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.279431 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.279347 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-workload-socket\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.279557 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.279491 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-workload-certs\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.279682 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.279663 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istiod-ca-cert\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.281147 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.281129 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-envoy\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.281346 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.281327 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-podinfo\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.287566 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.287542 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84f2k\" (UniqueName: \"kubernetes.io/projected/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-kube-api-access-84f2k\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.287864 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.287840 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-token\") pod \"e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.384185 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.384092 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:08.520278 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.520224 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m"] Jul 02 20:17:08.521611 ip-10-0-137-196 kubenswrapper[2560]: W0702 20:17:08.521587 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3289bfd0_e3a8_49d2_88b6_a243d21ac63a.slice/crio-fa73cdeec6bee15943dea1ead4eabdca442c191eb4e293f533e2e3f1645088f1 WatchSource:0}: Error finding container fa73cdeec6bee15943dea1ead4eabdca442c191eb4e293f533e2e3f1645088f1: Status 404 returned error can't find the container with id fa73cdeec6bee15943dea1ead4eabdca442c191eb4e293f533e2e3f1645088f1 Jul 02 20:17:08.523747 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.523714 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:17:08.523862 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.523799 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:17:08.523862 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:08.523848 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:17:09.234241 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:09.234199 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" event={"ID":"3289bfd0-e3a8-49d2-88b6-a243d21ac63a","Type":"ContainerStarted","Data":"4119e409eaea649cc27dc2bff675c5cb6a931b8882549367b282918c85759a82"} Jul 02 20:17:09.234698 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:09.234291 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" event={"ID":"3289bfd0-e3a8-49d2-88b6-a243d21ac63a","Type":"ContainerStarted","Data":"fa73cdeec6bee15943dea1ead4eabdca442c191eb4e293f533e2e3f1645088f1"} Jul 02 20:17:09.275783 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:09.275724 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" podStartSLOduration=1.275708207 podStartE2EDuration="1.275708207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:17:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:17:09.27054067 +0000 UTC m=+1577.840144740" watchObservedRunningTime="2026-07-02 20:17:09.275708207 +0000 UTC m=+1577.845312277" Jul 02 20:17:09.384697 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:09.384660 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:09.389559 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:09.389530 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:10.246323 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:10.246286 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:10.247196 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:10.247177 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:14.555022 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:14.554977 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m"] Jul 02 20:17:14.555641 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:14.555240 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" podUID="3289bfd0-e3a8-49d2-88b6-a243d21ac63a" containerName="istio-proxy" containerID="cri-o://4119e409eaea649cc27dc2bff675c5cb6a931b8882549367b282918c85759a82" gracePeriod=30 Jul 02 20:17:19.817986 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.817922 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:19.889744 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.889712 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-data\") pod \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " Jul 02 20:17:19.889744 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.889748 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-workload-certs\") pod \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " Jul 02 20:17:19.890008 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.889794 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-workload-socket\") pod \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " Jul 02 20:17:19.890008 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.889823 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-credential-socket\") pod \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " Jul 02 20:17:19.890008 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.889847 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istiod-ca-cert\") pod \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " Jul 02 20:17:19.890008 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.889884 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84f2k\" (UniqueName: \"kubernetes.io/projected/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-kube-api-access-84f2k\") pod \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " Jul 02 20:17:19.890008 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.889942 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-token\") pod \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " Jul 02 20:17:19.890008 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.889986 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-envoy\") pod \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " Jul 02 20:17:19.890304 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.890029 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-podinfo\") pod \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\" (UID: \"3289bfd0-e3a8-49d2-88b6-a243d21ac63a\") " Jul 02 20:17:19.890304 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.890023 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-data" (OuterVolumeSpecName: "istio-data") pod "3289bfd0-e3a8-49d2-88b6-a243d21ac63a" (UID: "3289bfd0-e3a8-49d2-88b6-a243d21ac63a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:17:19.890304 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.890115 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3289bfd0-e3a8-49d2-88b6-a243d21ac63a" (UID: "3289bfd0-e3a8-49d2-88b6-a243d21ac63a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:17:19.890304 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.890146 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3289bfd0-e3a8-49d2-88b6-a243d21ac63a" (UID: "3289bfd0-e3a8-49d2-88b6-a243d21ac63a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:17:19.890304 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.890194 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3289bfd0-e3a8-49d2-88b6-a243d21ac63a" (UID: "3289bfd0-e3a8-49d2-88b6-a243d21ac63a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:17:19.890304 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.890294 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3289bfd0-e3a8-49d2-88b6-a243d21ac63a" (UID: "3289bfd0-e3a8-49d2-88b6-a243d21ac63a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:17:19.890496 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.890355 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-data\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:19.890496 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.890368 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-workload-certs\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:19.890496 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.890376 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-workload-socket\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:19.890496 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.890384 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-credential-socket\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:19.894437 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.894407 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-kube-api-access-84f2k" (OuterVolumeSpecName: "kube-api-access-84f2k") pod "3289bfd0-e3a8-49d2-88b6-a243d21ac63a" (UID: "3289bfd0-e3a8-49d2-88b6-a243d21ac63a"). InnerVolumeSpecName "kube-api-access-84f2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:17:19.894558 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.894468 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-token" (OuterVolumeSpecName: "istio-token") pod "3289bfd0-e3a8-49d2-88b6-a243d21ac63a" (UID: "3289bfd0-e3a8-49d2-88b6-a243d21ac63a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:17:19.894604 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.894551 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3289bfd0-e3a8-49d2-88b6-a243d21ac63a" (UID: "3289bfd0-e3a8-49d2-88b6-a243d21ac63a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:17:19.894604 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.894561 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3289bfd0-e3a8-49d2-88b6-a243d21ac63a" (UID: "3289bfd0-e3a8-49d2-88b6-a243d21ac63a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:17:19.991616 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.991579 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istiod-ca-cert\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:19.991616 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.991610 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84f2k\" (UniqueName: \"kubernetes.io/projected/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-kube-api-access-84f2k\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:19.991616 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.991619 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-token\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:19.991869 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.991630 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-envoy\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:19.991869 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:19.991638 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3289bfd0-e3a8-49d2-88b6-a243d21ac63a-istio-podinfo\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:20.305979 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.305944 2560 generic.go:356] "Generic (PLEG): container finished" podID="3289bfd0-e3a8-49d2-88b6-a243d21ac63a" containerID="4119e409eaea649cc27dc2bff675c5cb6a931b8882549367b282918c85759a82" exitCode=0 Jul 02 20:17:20.306137 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.305991 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" Jul 02 20:17:20.306137 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.306031 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" event={"ID":"3289bfd0-e3a8-49d2-88b6-a243d21ac63a","Type":"ContainerDied","Data":"4119e409eaea649cc27dc2bff675c5cb6a931b8882549367b282918c85759a82"} Jul 02 20:17:20.306137 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.306085 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m" event={"ID":"3289bfd0-e3a8-49d2-88b6-a243d21ac63a","Type":"ContainerDied","Data":"fa73cdeec6bee15943dea1ead4eabdca442c191eb4e293f533e2e3f1645088f1"} Jul 02 20:17:20.306137 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.306108 2560 scope.go:117] "RemoveContainer" containerID="4119e409eaea649cc27dc2bff675c5cb6a931b8882549367b282918c85759a82" Jul 02 20:17:20.315609 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.315590 2560 scope.go:117] "RemoveContainer" containerID="4119e409eaea649cc27dc2bff675c5cb6a931b8882549367b282918c85759a82" Jul 02 20:17:20.315896 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:17:20.315875 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4119e409eaea649cc27dc2bff675c5cb6a931b8882549367b282918c85759a82\": container with ID starting with 4119e409eaea649cc27dc2bff675c5cb6a931b8882549367b282918c85759a82 not found: ID does not exist" containerID="4119e409eaea649cc27dc2bff675c5cb6a931b8882549367b282918c85759a82" Jul 02 20:17:20.315941 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.315905 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4119e409eaea649cc27dc2bff675c5cb6a931b8882549367b282918c85759a82"} err="failed to get container status \"4119e409eaea649cc27dc2bff675c5cb6a931b8882549367b282918c85759a82\": rpc error: code = NotFound desc = could not find container \"4119e409eaea649cc27dc2bff675c5cb6a931b8882549367b282918c85759a82\": container with ID starting with 4119e409eaea649cc27dc2bff675c5cb6a931b8882549367b282918c85759a82 not found: ID does not exist" Jul 02 20:17:20.329385 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.329355 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m"] Jul 02 20:17:20.333467 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.333440 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f2f1ff11-openshift-default-86f7446597-qsx5m"] Jul 02 20:17:20.759975 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.759941 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg"] Jul 02 20:17:20.760846 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.760814 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3289bfd0-e3a8-49d2-88b6-a243d21ac63a" containerName="istio-proxy" Jul 02 20:17:20.760846 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.760847 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3289bfd0-e3a8-49d2-88b6-a243d21ac63a" containerName="istio-proxy" Jul 02 20:17:20.761009 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.760987 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3289bfd0-e3a8-49d2-88b6-a243d21ac63a" containerName="istio-proxy" Jul 02 20:17:20.765529 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.765509 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:20.768114 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.768095 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c837d017-openshift-default-dockercfg-mth8c\"" Jul 02 20:17:20.777597 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.777569 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg"] Jul 02 20:17:20.900119 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.900081 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91a31da4-ef73-4832-8c6d-2c1498341231-istio-podinfo\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:20.900119 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.900125 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-credential-socket\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:20.900579 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.900150 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-workload-certs\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:20.900579 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.900178 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-istio-envoy\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:20.900579 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.900211 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91a31da4-ef73-4832-8c6d-2c1498341231-istio-token\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:20.900579 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.900238 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnzfc\" (UniqueName: \"kubernetes.io/projected/91a31da4-ef73-4832-8c6d-2c1498341231-kube-api-access-wnzfc\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:20.900579 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.900341 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91a31da4-ef73-4832-8c6d-2c1498341231-istiod-ca-cert\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:20.900579 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.900408 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-workload-socket\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:20.900579 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:20.900451 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-istio-data\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:21.001430 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.001384 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-credential-socket\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:21.001430 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.001433 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-workload-certs\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:21.001684 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.001566 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-istio-envoy\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:21.001684 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.001646 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91a31da4-ef73-4832-8c6d-2c1498341231-istio-token\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:21.001684 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.001677 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnzfc\" (UniqueName: \"kubernetes.io/projected/91a31da4-ef73-4832-8c6d-2c1498341231-kube-api-access-wnzfc\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:21.001861 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.001737 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91a31da4-ef73-4832-8c6d-2c1498341231-istiod-ca-cert\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:21.001861 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.001833 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-credential-socket\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:21.001979 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.001885 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-workload-socket\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:21.001979 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.001968 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-istio-data\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:21.002115 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.002094 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91a31da4-ef73-4832-8c6d-2c1498341231-istio-podinfo\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:21.002179 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.001884 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-workload-certs\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:21.002502 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.002477 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-workload-socket\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:21.002611 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.002574 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91a31da4-ef73-4832-8c6d-2c1498341231-istiod-ca-cert\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:21.002697 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.002676 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-istio-data\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:21.004130 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.004105 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-istio-envoy\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:21.004605 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.004588 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91a31da4-ef73-4832-8c6d-2c1498341231-istio-podinfo\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:21.012124 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.012069 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91a31da4-ef73-4832-8c6d-2c1498341231-istio-token\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:21.012429 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.012398 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnzfc\" (UniqueName: \"kubernetes.io/projected/91a31da4-ef73-4832-8c6d-2c1498341231-kube-api-access-wnzfc\") pod \"e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:21.078324 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.078289 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:21.223839 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.223808 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg"] Jul 02 20:17:21.224901 ip-10-0-137-196 kubenswrapper[2560]: W0702 20:17:21.224864 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91a31da4_ef73_4832_8c6d_2c1498341231.slice/crio-04cae10e0cc653b234698d3491ff9ac6101cfb0eff1e3c615d34d991e7220566 WatchSource:0}: Error finding container 04cae10e0cc653b234698d3491ff9ac6101cfb0eff1e3c615d34d991e7220566: Status 404 returned error can't find the container with id 04cae10e0cc653b234698d3491ff9ac6101cfb0eff1e3c615d34d991e7220566 Jul 02 20:17:21.227130 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.227093 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:17:21.227221 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.227164 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:17:21.227221 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.227195 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:17:21.317091 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.317057 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" event={"ID":"91a31da4-ef73-4832-8c6d-2c1498341231","Type":"ContainerStarted","Data":"984ab7b448a32667803a0ed5edf34de7548d86cb97bbe7fe0364dc980dd9049d"} Jul 02 20:17:21.317272 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.317111 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" event={"ID":"91a31da4-ef73-4832-8c6d-2c1498341231","Type":"ContainerStarted","Data":"04cae10e0cc653b234698d3491ff9ac6101cfb0eff1e3c615d34d991e7220566"} Jul 02 20:17:21.339194 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.339136 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" podStartSLOduration=1.339117231 podStartE2EDuration="1.339117231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:17:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:17:21.337001042 +0000 UTC m=+1589.906605113" watchObservedRunningTime="2026-07-02 20:17:21.339117231 +0000 UTC m=+1589.908721302" Jul 02 20:17:21.934539 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:21.934507 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3289bfd0-e3a8-49d2-88b6-a243d21ac63a" path="/var/lib/kubelet/pods/3289bfd0-e3a8-49d2-88b6-a243d21ac63a/volumes" Jul 02 20:17:22.079199 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:22.079167 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:22.084562 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:22.084538 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:22.322819 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:22.322780 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:22.323931 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:22.323900 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:33.399642 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:33.399595 2560 generic.go:356] "Generic (PLEG): container finished" podID="91a31da4-ef73-4832-8c6d-2c1498341231" containerID="984ab7b448a32667803a0ed5edf34de7548d86cb97bbe7fe0364dc980dd9049d" exitCode=0 Jul 02 20:17:33.399642 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:33.399629 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" event={"ID":"91a31da4-ef73-4832-8c6d-2c1498341231","Type":"ContainerDied","Data":"984ab7b448a32667803a0ed5edf34de7548d86cb97bbe7fe0364dc980dd9049d"} Jul 02 20:17:33.400392 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:33.400229 2560 scope.go:117] "RemoveContainer" containerID="984ab7b448a32667803a0ed5edf34de7548d86cb97bbe7fe0364dc980dd9049d" Jul 02 20:17:33.401561 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:33.401524 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:17:33.401675 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:33.401617 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:17:33.401675 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:33.401665 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:17:33.440993 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:33.440962 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg"] Jul 02 20:17:34.408123 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:34.408071 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" event={"ID":"91a31da4-ef73-4832-8c6d-2c1498341231","Type":"ContainerStarted","Data":"4f84a8fa0734a0e55e1b042fa3af78dc62459ea43934698833e8edf5be04a893"} Jul 02 20:17:34.408549 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:34.408145 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" podUID="91a31da4-ef73-4832-8c6d-2c1498341231" containerName="istio-proxy" containerID="cri-o://4f84a8fa0734a0e55e1b042fa3af78dc62459ea43934698833e8edf5be04a893" gracePeriod=30 Jul 02 20:17:37.323649 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:37.323612 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:39.636057 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.636024 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2"] Jul 02 20:17:39.639158 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.639132 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.644099 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.644071 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-1535425b-openshift-default-dockercfg-gbft9\"" Jul 02 20:17:39.654593 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.654567 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2"] Jul 02 20:17:39.683420 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.683367 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgfvt\" (UniqueName: \"kubernetes.io/projected/b5814a49-6774-4b41-bab3-a96709bbf33a-kube-api-access-sgfvt\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.683571 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.683450 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-token\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.683571 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.683510 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-envoy\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.683571 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.683550 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-workload-certs\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.683707 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.683651 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-workload-socket\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.683707 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.683693 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-podinfo\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.683783 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.683727 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-data\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.683839 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.683801 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-credential-socket\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.683893 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.683836 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5814a49-6774-4b41-bab3-a96709bbf33a-istiod-ca-cert\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.693706 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.693675 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:39.784661 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.784625 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-credential-socket\") pod \"91a31da4-ef73-4832-8c6d-2c1498341231\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " Jul 02 20:17:39.784661 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.784658 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-istio-data\") pod \"91a31da4-ef73-4832-8c6d-2c1498341231\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " Jul 02 20:17:39.784888 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.784718 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91a31da4-ef73-4832-8c6d-2c1498341231-istiod-ca-cert\") pod \"91a31da4-ef73-4832-8c6d-2c1498341231\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " Jul 02 20:17:39.784888 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.784738 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-workload-socket\") pod \"91a31da4-ef73-4832-8c6d-2c1498341231\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " Jul 02 20:17:39.784888 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.784756 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-workload-certs\") pod \"91a31da4-ef73-4832-8c6d-2c1498341231\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " Jul 02 20:17:39.784888 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.784799 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91a31da4-ef73-4832-8c6d-2c1498341231-istio-podinfo\") pod \"91a31da4-ef73-4832-8c6d-2c1498341231\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " Jul 02 20:17:39.784888 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.784836 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnzfc\" (UniqueName: \"kubernetes.io/projected/91a31da4-ef73-4832-8c6d-2c1498341231-kube-api-access-wnzfc\") pod \"91a31da4-ef73-4832-8c6d-2c1498341231\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " Jul 02 20:17:39.784888 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.784866 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-istio-envoy\") pod \"91a31da4-ef73-4832-8c6d-2c1498341231\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " Jul 02 20:17:39.785180 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.784929 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91a31da4-ef73-4832-8c6d-2c1498341231-istio-token\") pod \"91a31da4-ef73-4832-8c6d-2c1498341231\" (UID: \"91a31da4-ef73-4832-8c6d-2c1498341231\") " Jul 02 20:17:39.785180 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.784995 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "91a31da4-ef73-4832-8c6d-2c1498341231" (UID: "91a31da4-ef73-4832-8c6d-2c1498341231"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:17:39.785180 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.785062 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-podinfo\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.785180 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.785071 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "91a31da4-ef73-4832-8c6d-2c1498341231" (UID: "91a31da4-ef73-4832-8c6d-2c1498341231"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:17:39.785180 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.785096 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "91a31da4-ef73-4832-8c6d-2c1498341231" (UID: "91a31da4-ef73-4832-8c6d-2c1498341231"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:17:39.785180 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.785105 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-data\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.785180 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.785140 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91a31da4-ef73-4832-8c6d-2c1498341231-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "91a31da4-ef73-4832-8c6d-2c1498341231" (UID: "91a31da4-ef73-4832-8c6d-2c1498341231"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:17:39.785180 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.785151 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-credential-socket\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.785180 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.785187 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5814a49-6774-4b41-bab3-a96709bbf33a-istiod-ca-cert\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.785655 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.785294 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgfvt\" (UniqueName: \"kubernetes.io/projected/b5814a49-6774-4b41-bab3-a96709bbf33a-kube-api-access-sgfvt\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.785655 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.785347 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-token\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.785655 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.785383 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-envoy\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.785655 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.785419 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-workload-certs\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.785655 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.785490 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-workload-socket\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.785655 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.785549 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-credential-socket\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:39.785655 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.785568 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91a31da4-ef73-4832-8c6d-2c1498341231-istiod-ca-cert\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:39.785655 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.785581 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-workload-socket\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:39.785655 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.785593 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-workload-certs\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:39.786108 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.785840 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-istio-data" (OuterVolumeSpecName: "istio-data") pod "91a31da4-ef73-4832-8c6d-2c1498341231" (UID: "91a31da4-ef73-4832-8c6d-2c1498341231"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:17:39.786108 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.785869 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-data\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.786108 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.785880 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-workload-socket\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.786348 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.786318 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-workload-certs\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.786751 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.786726 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-credential-socket\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.787631 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.787607 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5814a49-6774-4b41-bab3-a96709bbf33a-istiod-ca-cert\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.787802 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.787779 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "91a31da4-ef73-4832-8c6d-2c1498341231" (UID: "91a31da4-ef73-4832-8c6d-2c1498341231"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:17:39.787876 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.787802 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/91a31da4-ef73-4832-8c6d-2c1498341231-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "91a31da4-ef73-4832-8c6d-2c1498341231" (UID: "91a31da4-ef73-4832-8c6d-2c1498341231"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:17:39.787935 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.787917 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91a31da4-ef73-4832-8c6d-2c1498341231-kube-api-access-wnzfc" (OuterVolumeSpecName: "kube-api-access-wnzfc") pod "91a31da4-ef73-4832-8c6d-2c1498341231" (UID: "91a31da4-ef73-4832-8c6d-2c1498341231"). InnerVolumeSpecName "kube-api-access-wnzfc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:17:39.788032 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.788015 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91a31da4-ef73-4832-8c6d-2c1498341231-istio-token" (OuterVolumeSpecName: "istio-token") pod "91a31da4-ef73-4832-8c6d-2c1498341231" (UID: "91a31da4-ef73-4832-8c6d-2c1498341231"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:17:39.788437 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.788417 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-envoy\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.788551 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.788532 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-podinfo\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.794038 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.794015 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgfvt\" (UniqueName: \"kubernetes.io/projected/b5814a49-6774-4b41-bab3-a96709bbf33a-kube-api-access-sgfvt\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.794530 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.794506 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-token\") pod \"e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:39.886298 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.886233 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91a31da4-ef73-4832-8c6d-2c1498341231-istio-podinfo\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:39.886298 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.886299 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnzfc\" (UniqueName: \"kubernetes.io/projected/91a31da4-ef73-4832-8c6d-2c1498341231-kube-api-access-wnzfc\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:39.886513 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.886314 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-istio-envoy\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:39.886513 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.886326 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91a31da4-ef73-4832-8c6d-2c1498341231-istio-token\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:39.886513 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.886336 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91a31da4-ef73-4832-8c6d-2c1498341231-istio-data\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:39.949921 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:39.949893 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:40.094000 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:40.093968 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2"] Jul 02 20:17:40.094813 ip-10-0-137-196 kubenswrapper[2560]: W0702 20:17:40.094787 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5814a49_6774_4b41_bab3_a96709bbf33a.slice/crio-c6fb8f8479861a484016343d2725b0bc823cde44323b316a830dfea1a3c6910f WatchSource:0}: Error finding container c6fb8f8479861a484016343d2725b0bc823cde44323b316a830dfea1a3c6910f: Status 404 returned error can't find the container with id c6fb8f8479861a484016343d2725b0bc823cde44323b316a830dfea1a3c6910f Jul 02 20:17:40.096946 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:40.096914 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:17:40.097022 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:40.096983 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:17:40.097022 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:40.097011 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:17:40.446864 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:40.446823 2560 generic.go:356] "Generic (PLEG): container finished" podID="91a31da4-ef73-4832-8c6d-2c1498341231" containerID="4f84a8fa0734a0e55e1b042fa3af78dc62459ea43934698833e8edf5be04a893" exitCode=0 Jul 02 20:17:40.446864 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:40.446866 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" Jul 02 20:17:40.447116 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:40.446896 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" event={"ID":"91a31da4-ef73-4832-8c6d-2c1498341231","Type":"ContainerDied","Data":"4f84a8fa0734a0e55e1b042fa3af78dc62459ea43934698833e8edf5be04a893"} Jul 02 20:17:40.447116 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:40.446942 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg" event={"ID":"91a31da4-ef73-4832-8c6d-2c1498341231","Type":"ContainerDied","Data":"04cae10e0cc653b234698d3491ff9ac6101cfb0eff1e3c615d34d991e7220566"} Jul 02 20:17:40.447116 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:40.446968 2560 scope.go:117] "RemoveContainer" containerID="4f84a8fa0734a0e55e1b042fa3af78dc62459ea43934698833e8edf5be04a893" Jul 02 20:17:40.448826 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:40.448806 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" event={"ID":"b5814a49-6774-4b41-bab3-a96709bbf33a","Type":"ContainerStarted","Data":"940a7173be5118e6dfc6a8bfc67cf2d8b5083ec9bcc9ad044500b1506773d90b"} Jul 02 20:17:40.448956 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:40.448846 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" event={"ID":"b5814a49-6774-4b41-bab3-a96709bbf33a","Type":"ContainerStarted","Data":"c6fb8f8479861a484016343d2725b0bc823cde44323b316a830dfea1a3c6910f"} Jul 02 20:17:40.456401 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:40.456366 2560 scope.go:117] "RemoveContainer" containerID="984ab7b448a32667803a0ed5edf34de7548d86cb97bbe7fe0364dc980dd9049d" Jul 02 20:17:40.468660 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:40.468242 2560 scope.go:117] "RemoveContainer" containerID="4f84a8fa0734a0e55e1b042fa3af78dc62459ea43934698833e8edf5be04a893" Jul 02 20:17:40.469464 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:40.469437 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg"] Jul 02 20:17:40.469663 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:17:40.469563 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f84a8fa0734a0e55e1b042fa3af78dc62459ea43934698833e8edf5be04a893\": container with ID starting with 4f84a8fa0734a0e55e1b042fa3af78dc62459ea43934698833e8edf5be04a893 not found: ID does not exist" containerID="4f84a8fa0734a0e55e1b042fa3af78dc62459ea43934698833e8edf5be04a893" Jul 02 20:17:40.469778 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:40.469672 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f84a8fa0734a0e55e1b042fa3af78dc62459ea43934698833e8edf5be04a893"} err="failed to get container status \"4f84a8fa0734a0e55e1b042fa3af78dc62459ea43934698833e8edf5be04a893\": rpc error: code = NotFound desc = could not find container \"4f84a8fa0734a0e55e1b042fa3af78dc62459ea43934698833e8edf5be04a893\": container with ID starting with 4f84a8fa0734a0e55e1b042fa3af78dc62459ea43934698833e8edf5be04a893 not found: ID does not exist" Jul 02 20:17:40.469778 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:40.469701 2560 scope.go:117] "RemoveContainer" containerID="984ab7b448a32667803a0ed5edf34de7548d86cb97bbe7fe0364dc980dd9049d" Jul 02 20:17:40.470009 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:17:40.469990 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"984ab7b448a32667803a0ed5edf34de7548d86cb97bbe7fe0364dc980dd9049d\": container with ID starting with 984ab7b448a32667803a0ed5edf34de7548d86cb97bbe7fe0364dc980dd9049d not found: ID does not exist" containerID="984ab7b448a32667803a0ed5edf34de7548d86cb97bbe7fe0364dc980dd9049d" Jul 02 20:17:40.470080 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:40.470014 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"984ab7b448a32667803a0ed5edf34de7548d86cb97bbe7fe0364dc980dd9049d"} err="failed to get container status \"984ab7b448a32667803a0ed5edf34de7548d86cb97bbe7fe0364dc980dd9049d\": rpc error: code = NotFound desc = could not find container \"984ab7b448a32667803a0ed5edf34de7548d86cb97bbe7fe0364dc980dd9049d\": container with ID starting with 984ab7b448a32667803a0ed5edf34de7548d86cb97bbe7fe0364dc980dd9049d not found: ID does not exist" Jul 02 20:17:40.471727 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:40.471702 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c837d017-openshift-default-76849b69cc-w2ztg"] Jul 02 20:17:40.488795 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:40.488746 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" podStartSLOduration=1.488731378 podStartE2EDuration="1.488731378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:17:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:17:40.487183552 +0000 UTC m=+1609.056787623" watchObservedRunningTime="2026-07-02 20:17:40.488731378 +0000 UTC m=+1609.058335440" Jul 02 20:17:40.950609 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:40.950557 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:41.934772 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:41.934737 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91a31da4-ef73-4832-8c6d-2c1498341231" path="/var/lib/kubelet/pods/91a31da4-ef73-4832-8c6d-2c1498341231/volumes" Jul 02 20:17:41.955396 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:41.955363 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:42.461551 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:42.461522 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:42.462640 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:42.462618 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:45.479720 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:45.479640 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2"] Jul 02 20:17:45.480101 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:45.479826 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" podUID="b5814a49-6774-4b41-bab3-a96709bbf33a" containerName="istio-proxy" containerID="cri-o://940a7173be5118e6dfc6a8bfc67cf2d8b5083ec9bcc9ad044500b1506773d90b" gracePeriod=30 Jul 02 20:17:50.740091 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.740038 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:50.786946 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.786912 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-podinfo\") pod \"b5814a49-6774-4b41-bab3-a96709bbf33a\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " Jul 02 20:17:50.787118 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.786966 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5814a49-6774-4b41-bab3-a96709bbf33a-istiod-ca-cert\") pod \"b5814a49-6774-4b41-bab3-a96709bbf33a\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " Jul 02 20:17:50.787118 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.786992 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-token\") pod \"b5814a49-6774-4b41-bab3-a96709bbf33a\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " Jul 02 20:17:50.787118 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.787031 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-data\") pod \"b5814a49-6774-4b41-bab3-a96709bbf33a\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " Jul 02 20:17:50.787118 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.787060 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-envoy\") pod \"b5814a49-6774-4b41-bab3-a96709bbf33a\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " Jul 02 20:17:50.787118 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.787109 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-workload-certs\") pod \"b5814a49-6774-4b41-bab3-a96709bbf33a\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " Jul 02 20:17:50.787415 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.787184 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-workload-socket\") pod \"b5814a49-6774-4b41-bab3-a96709bbf33a\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " Jul 02 20:17:50.787415 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.787231 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgfvt\" (UniqueName: \"kubernetes.io/projected/b5814a49-6774-4b41-bab3-a96709bbf33a-kube-api-access-sgfvt\") pod \"b5814a49-6774-4b41-bab3-a96709bbf33a\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " Jul 02 20:17:50.787415 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.787380 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-data" (OuterVolumeSpecName: "istio-data") pod "b5814a49-6774-4b41-bab3-a96709bbf33a" (UID: "b5814a49-6774-4b41-bab3-a96709bbf33a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:17:50.787579 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.787446 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5814a49-6774-4b41-bab3-a96709bbf33a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b5814a49-6774-4b41-bab3-a96709bbf33a" (UID: "b5814a49-6774-4b41-bab3-a96709bbf33a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:17:50.787825 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.787534 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b5814a49-6774-4b41-bab3-a96709bbf33a" (UID: "b5814a49-6774-4b41-bab3-a96709bbf33a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:17:50.787929 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.787614 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b5814a49-6774-4b41-bab3-a96709bbf33a" (UID: "b5814a49-6774-4b41-bab3-a96709bbf33a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:17:50.787929 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.787867 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-credential-socket\") pod \"b5814a49-6774-4b41-bab3-a96709bbf33a\" (UID: \"b5814a49-6774-4b41-bab3-a96709bbf33a\") " Jul 02 20:17:50.788192 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.788106 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b5814a49-6774-4b41-bab3-a96709bbf33a" (UID: "b5814a49-6774-4b41-bab3-a96709bbf33a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:17:50.788368 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.788322 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-credential-socket\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:50.788368 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.788349 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5814a49-6774-4b41-bab3-a96709bbf33a-istiod-ca-cert\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:50.788368 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.788363 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-data\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:50.788549 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.788376 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-workload-certs\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:50.788549 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.788388 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-workload-socket\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:50.789635 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.789606 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b5814a49-6774-4b41-bab3-a96709bbf33a" (UID: "b5814a49-6774-4b41-bab3-a96709bbf33a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:17:50.789771 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.789749 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b5814a49-6774-4b41-bab3-a96709bbf33a" (UID: "b5814a49-6774-4b41-bab3-a96709bbf33a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:17:50.789975 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.789954 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-token" (OuterVolumeSpecName: "istio-token") pod "b5814a49-6774-4b41-bab3-a96709bbf33a" (UID: "b5814a49-6774-4b41-bab3-a96709bbf33a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:17:50.790041 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.789982 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5814a49-6774-4b41-bab3-a96709bbf33a-kube-api-access-sgfvt" (OuterVolumeSpecName: "kube-api-access-sgfvt") pod "b5814a49-6774-4b41-bab3-a96709bbf33a" (UID: "b5814a49-6774-4b41-bab3-a96709bbf33a"). InnerVolumeSpecName "kube-api-access-sgfvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:17:50.889469 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.889434 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgfvt\" (UniqueName: \"kubernetes.io/projected/b5814a49-6774-4b41-bab3-a96709bbf33a-kube-api-access-sgfvt\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:50.889469 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.889461 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-podinfo\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:50.889469 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.889472 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-token\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:50.889707 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:50.889482 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5814a49-6774-4b41-bab3-a96709bbf33a-istio-envoy\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:17:51.514149 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:51.514118 2560 generic.go:356] "Generic (PLEG): container finished" podID="b5814a49-6774-4b41-bab3-a96709bbf33a" containerID="940a7173be5118e6dfc6a8bfc67cf2d8b5083ec9bcc9ad044500b1506773d90b" exitCode=0 Jul 02 20:17:51.514363 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:51.514164 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" Jul 02 20:17:51.514363 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:51.514207 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" event={"ID":"b5814a49-6774-4b41-bab3-a96709bbf33a","Type":"ContainerDied","Data":"940a7173be5118e6dfc6a8bfc67cf2d8b5083ec9bcc9ad044500b1506773d90b"} Jul 02 20:17:51.514363 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:51.514286 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2" event={"ID":"b5814a49-6774-4b41-bab3-a96709bbf33a","Type":"ContainerDied","Data":"c6fb8f8479861a484016343d2725b0bc823cde44323b316a830dfea1a3c6910f"} Jul 02 20:17:51.514363 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:51.514315 2560 scope.go:117] "RemoveContainer" containerID="940a7173be5118e6dfc6a8bfc67cf2d8b5083ec9bcc9ad044500b1506773d90b" Jul 02 20:17:51.524112 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:51.524083 2560 scope.go:117] "RemoveContainer" containerID="940a7173be5118e6dfc6a8bfc67cf2d8b5083ec9bcc9ad044500b1506773d90b" Jul 02 20:17:51.524401 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:17:51.524383 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"940a7173be5118e6dfc6a8bfc67cf2d8b5083ec9bcc9ad044500b1506773d90b\": container with ID starting with 940a7173be5118e6dfc6a8bfc67cf2d8b5083ec9bcc9ad044500b1506773d90b not found: ID does not exist" containerID="940a7173be5118e6dfc6a8bfc67cf2d8b5083ec9bcc9ad044500b1506773d90b" Jul 02 20:17:51.524482 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:51.524408 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"940a7173be5118e6dfc6a8bfc67cf2d8b5083ec9bcc9ad044500b1506773d90b"} err="failed to get container status \"940a7173be5118e6dfc6a8bfc67cf2d8b5083ec9bcc9ad044500b1506773d90b\": rpc error: code = NotFound desc = could not find container \"940a7173be5118e6dfc6a8bfc67cf2d8b5083ec9bcc9ad044500b1506773d90b\": container with ID starting with 940a7173be5118e6dfc6a8bfc67cf2d8b5083ec9bcc9ad044500b1506773d90b not found: ID does not exist" Jul 02 20:17:51.538001 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:51.537974 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2"] Jul 02 20:17:51.546514 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:51.546485 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-1535425b-openshift-default-6c697ff6ff-4zmp2"] Jul 02 20:17:51.934125 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:17:51.934022 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5814a49-6774-4b41-bab3-a96709bbf33a" path="/var/lib/kubelet/pods/b5814a49-6774-4b41-bab3-a96709bbf33a/volumes" Jul 02 20:19:27.393897 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.393860 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d"] Jul 02 20:19:27.394365 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.394292 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91a31da4-ef73-4832-8c6d-2c1498341231" containerName="istio-proxy" Jul 02 20:19:27.394365 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.394306 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="91a31da4-ef73-4832-8c6d-2c1498341231" containerName="istio-proxy" Jul 02 20:19:27.394365 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.394319 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5814a49-6774-4b41-bab3-a96709bbf33a" containerName="istio-proxy" Jul 02 20:19:27.394365 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.394325 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5814a49-6774-4b41-bab3-a96709bbf33a" containerName="istio-proxy" Jul 02 20:19:27.394542 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.394390 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="91a31da4-ef73-4832-8c6d-2c1498341231" containerName="istio-proxy" Jul 02 20:19:27.394542 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.394399 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5814a49-6774-4b41-bab3-a96709bbf33a" containerName="istio-proxy" Jul 02 20:19:27.394542 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.394405 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="91a31da4-ef73-4832-8c6d-2c1498341231" containerName="istio-proxy" Jul 02 20:19:27.396488 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.396466 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.398916 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.398897 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-29f89d80-openshift-default-dockercfg-mfhwn\"" Jul 02 20:19:27.419366 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.419339 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d"] Jul 02 20:19:27.505087 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.505045 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-token\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.505303 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.505093 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-workload-socket\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.505303 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.505185 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-credential-socket\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.505303 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.505224 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-envoy\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.505303 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.505244 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-data\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.505517 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.505319 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91e8c34a-5365-416e-981c-086d7c2ede1c-istiod-ca-cert\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.505517 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.505343 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqq4m\" (UniqueName: \"kubernetes.io/projected/91e8c34a-5365-416e-981c-086d7c2ede1c-kube-api-access-wqq4m\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.505517 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.505396 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-workload-certs\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.505517 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.505476 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-podinfo\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.606369 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.606317 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-credential-socket\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.606369 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.606372 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-envoy\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.606631 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.606401 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-data\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.606631 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.606447 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91e8c34a-5365-416e-981c-086d7c2ede1c-istiod-ca-cert\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.606631 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.606471 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqq4m\" (UniqueName: \"kubernetes.io/projected/91e8c34a-5365-416e-981c-086d7c2ede1c-kube-api-access-wqq4m\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.606631 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.606518 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-workload-certs\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.606631 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.606570 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-podinfo\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.606903 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.606635 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-token\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.606903 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.606750 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-credential-socket\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.606903 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.606802 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-workload-socket\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.607055 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.606932 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-workload-certs\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.607055 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.607011 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-data\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.607164 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.607083 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-workload-socket\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.607222 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.607171 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91e8c34a-5365-416e-981c-086d7c2ede1c-istiod-ca-cert\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.608918 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.608893 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-envoy\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.609037 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.609007 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-podinfo\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.616660 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.616606 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-token\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.616804 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.616752 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqq4m\" (UniqueName: \"kubernetes.io/projected/91e8c34a-5365-416e-981c-086d7c2ede1c-kube-api-access-wqq4m\") pod \"e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.706883 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.706850 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:27.850866 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.850841 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d"] Jul 02 20:19:27.853237 ip-10-0-137-196 kubenswrapper[2560]: W0702 20:19:27.853202 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e8c34a_5365_416e_981c_086d7c2ede1c.slice/crio-44c6bf8498bc388d6b6597e49b7622869870683560a25139c1709d87626a6e56 WatchSource:0}: Error finding container 44c6bf8498bc388d6b6597e49b7622869870683560a25139c1709d87626a6e56: Status 404 returned error can't find the container with id 44c6bf8498bc388d6b6597e49b7622869870683560a25139c1709d87626a6e56 Jul 02 20:19:27.855493 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.855459 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:19:27.855571 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.855532 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:19:27.855571 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:27.855561 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:19:28.038331 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:28.038214 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" event={"ID":"91e8c34a-5365-416e-981c-086d7c2ede1c","Type":"ContainerStarted","Data":"20aae7d651781e42927658086366517f7e58e7bf8618b51942c010c1ab761dcf"} Jul 02 20:19:28.038331 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:28.038304 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" event={"ID":"91e8c34a-5365-416e-981c-086d7c2ede1c","Type":"ContainerStarted","Data":"44c6bf8498bc388d6b6597e49b7622869870683560a25139c1709d87626a6e56"} Jul 02 20:19:28.059229 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:28.059176 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" podStartSLOduration=1.059156721 podStartE2EDuration="1.059156721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:19:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:19:28.058617057 +0000 UTC m=+1716.628221129" watchObservedRunningTime="2026-07-02 20:19:28.059156721 +0000 UTC m=+1716.628760792" Jul 02 20:19:28.707602 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:28.707563 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:28.712608 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:28.712575 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:29.043806 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:29.043728 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:29.044684 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:29.044668 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:44.045438 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:44.045402 2560 patch_prober.go:28] interesting pod/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 02 20:19:44.045902 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:44.045460 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" podUID="91e8c34a-5365-416e-981c-086d7c2ede1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 02 20:19:44.128480 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:44.128393 2560 generic.go:356] "Generic (PLEG): container finished" podID="91e8c34a-5365-416e-981c-086d7c2ede1c" containerID="20aae7d651781e42927658086366517f7e58e7bf8618b51942c010c1ab761dcf" exitCode=0 Jul 02 20:19:44.128480 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:44.128467 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" event={"ID":"91e8c34a-5365-416e-981c-086d7c2ede1c","Type":"ContainerDied","Data":"20aae7d651781e42927658086366517f7e58e7bf8618b51942c010c1ab761dcf"} Jul 02 20:19:44.128906 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:44.128891 2560 scope.go:117] "RemoveContainer" containerID="20aae7d651781e42927658086366517f7e58e7bf8618b51942c010c1ab761dcf" Jul 02 20:19:44.136369 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:44.130343 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:19:44.136369 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:44.130513 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:19:44.136369 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:44.130612 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:19:45.138296 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:45.138227 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" event={"ID":"91e8c34a-5365-416e-981c-086d7c2ede1c","Type":"ContainerStarted","Data":"bc4542b7947f51c7835d428ec6e8cf202d5a283ccb99151ae914aeaeb24130b7"} Jul 02 20:19:45.707009 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:45.706979 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:45.707459 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:45.707222 2560 patch_prober.go:28] interesting pod/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 02 20:19:45.707459 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:45.707287 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" podUID="91e8c34a-5365-416e-981c-086d7c2ede1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 02 20:19:46.708239 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:46.708188 2560 patch_prober.go:28] interesting pod/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 02 20:19:46.708752 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:46.708288 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" podUID="91e8c34a-5365-416e-981c-086d7c2ede1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 02 20:19:47.707422 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:47.707385 2560 patch_prober.go:28] interesting pod/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 02 20:19:47.707608 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:47.707443 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" podUID="91e8c34a-5365-416e-981c-086d7c2ede1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 02 20:19:48.707539 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:48.707499 2560 patch_prober.go:28] interesting pod/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 02 20:19:48.707963 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:48.707557 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" podUID="91e8c34a-5365-416e-981c-086d7c2ede1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 02 20:19:49.396770 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:49.396733 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d"] Jul 02 20:19:49.397041 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:49.396945 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" podUID="91e8c34a-5365-416e-981c-086d7c2ede1c" containerName="istio-proxy" containerID="cri-o://bc4542b7947f51c7835d428ec6e8cf202d5a283ccb99151ae914aeaeb24130b7" gracePeriod=30 Jul 02 20:19:54.645444 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.645418 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:54.771138 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.771099 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-workload-socket\") pod \"91e8c34a-5365-416e-981c-086d7c2ede1c\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " Jul 02 20:19:54.771343 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.771204 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-workload-certs\") pod \"91e8c34a-5365-416e-981c-086d7c2ede1c\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " Jul 02 20:19:54.771343 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.771240 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqq4m\" (UniqueName: \"kubernetes.io/projected/91e8c34a-5365-416e-981c-086d7c2ede1c-kube-api-access-wqq4m\") pod \"91e8c34a-5365-416e-981c-086d7c2ede1c\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " Jul 02 20:19:54.771343 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.771293 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-data\") pod \"91e8c34a-5365-416e-981c-086d7c2ede1c\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " Jul 02 20:19:54.771343 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.771317 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-token\") pod \"91e8c34a-5365-416e-981c-086d7c2ede1c\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " Jul 02 20:19:54.771343 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.771343 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-podinfo\") pod \"91e8c34a-5365-416e-981c-086d7c2ede1c\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " Jul 02 20:19:54.771707 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.771431 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91e8c34a-5365-416e-981c-086d7c2ede1c-istiod-ca-cert\") pod \"91e8c34a-5365-416e-981c-086d7c2ede1c\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " Jul 02 20:19:54.771707 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.771461 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-envoy\") pod \"91e8c34a-5365-416e-981c-086d7c2ede1c\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " Jul 02 20:19:54.771707 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.771487 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-credential-socket\") pod \"91e8c34a-5365-416e-981c-086d7c2ede1c\" (UID: \"91e8c34a-5365-416e-981c-086d7c2ede1c\") " Jul 02 20:19:54.771707 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.771475 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "91e8c34a-5365-416e-981c-086d7c2ede1c" (UID: "91e8c34a-5365-416e-981c-086d7c2ede1c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:19:54.771707 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.771571 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "91e8c34a-5365-416e-981c-086d7c2ede1c" (UID: "91e8c34a-5365-416e-981c-086d7c2ede1c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:19:54.772038 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.771809 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91e8c34a-5365-416e-981c-086d7c2ede1c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "91e8c34a-5365-416e-981c-086d7c2ede1c" (UID: "91e8c34a-5365-416e-981c-086d7c2ede1c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:19:54.772038 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.771825 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-workload-socket\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:19:54.772038 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.771846 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-workload-certs\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:19:54.772038 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.771879 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "91e8c34a-5365-416e-981c-086d7c2ede1c" (UID: "91e8c34a-5365-416e-981c-086d7c2ede1c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:19:54.772403 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.772372 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-data" (OuterVolumeSpecName: "istio-data") pod "91e8c34a-5365-416e-981c-086d7c2ede1c" (UID: "91e8c34a-5365-416e-981c-086d7c2ede1c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:19:54.773719 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.773689 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "91e8c34a-5365-416e-981c-086d7c2ede1c" (UID: "91e8c34a-5365-416e-981c-086d7c2ede1c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:19:54.773719 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.773702 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-token" (OuterVolumeSpecName: "istio-token") pod "91e8c34a-5365-416e-981c-086d7c2ede1c" (UID: "91e8c34a-5365-416e-981c-086d7c2ede1c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:19:54.773854 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.773722 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91e8c34a-5365-416e-981c-086d7c2ede1c-kube-api-access-wqq4m" (OuterVolumeSpecName: "kube-api-access-wqq4m") pod "91e8c34a-5365-416e-981c-086d7c2ede1c" (UID: "91e8c34a-5365-416e-981c-086d7c2ede1c"). InnerVolumeSpecName "kube-api-access-wqq4m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:19:54.773854 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.773790 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "91e8c34a-5365-416e-981c-086d7c2ede1c" (UID: "91e8c34a-5365-416e-981c-086d7c2ede1c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:19:54.872738 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.872690 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91e8c34a-5365-416e-981c-086d7c2ede1c-istiod-ca-cert\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:19:54.872738 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.872731 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-envoy\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:19:54.872738 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.872743 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-credential-socket\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:19:54.873004 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.872756 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqq4m\" (UniqueName: \"kubernetes.io/projected/91e8c34a-5365-416e-981c-086d7c2ede1c-kube-api-access-wqq4m\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:19:54.873004 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.872769 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-data\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:19:54.873004 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.872779 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-token\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:19:54.873004 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:54.872789 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91e8c34a-5365-416e-981c-086d7c2ede1c-istio-podinfo\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:19:55.207325 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:55.207286 2560 generic.go:356] "Generic (PLEG): container finished" podID="91e8c34a-5365-416e-981c-086d7c2ede1c" containerID="bc4542b7947f51c7835d428ec6e8cf202d5a283ccb99151ae914aeaeb24130b7" exitCode=0 Jul 02 20:19:55.207483 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:55.207390 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" Jul 02 20:19:55.207483 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:55.207389 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" event={"ID":"91e8c34a-5365-416e-981c-086d7c2ede1c","Type":"ContainerDied","Data":"bc4542b7947f51c7835d428ec6e8cf202d5a283ccb99151ae914aeaeb24130b7"} Jul 02 20:19:55.207556 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:55.207519 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d" event={"ID":"91e8c34a-5365-416e-981c-086d7c2ede1c","Type":"ContainerDied","Data":"44c6bf8498bc388d6b6597e49b7622869870683560a25139c1709d87626a6e56"} Jul 02 20:19:55.207556 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:55.207546 2560 scope.go:117] "RemoveContainer" containerID="bc4542b7947f51c7835d428ec6e8cf202d5a283ccb99151ae914aeaeb24130b7" Jul 02 20:19:55.217675 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:55.217658 2560 scope.go:117] "RemoveContainer" containerID="20aae7d651781e42927658086366517f7e58e7bf8618b51942c010c1ab761dcf" Jul 02 20:19:55.226322 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:55.226304 2560 scope.go:117] "RemoveContainer" containerID="bc4542b7947f51c7835d428ec6e8cf202d5a283ccb99151ae914aeaeb24130b7" Jul 02 20:19:55.226559 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:19:55.226539 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc4542b7947f51c7835d428ec6e8cf202d5a283ccb99151ae914aeaeb24130b7\": container with ID starting with bc4542b7947f51c7835d428ec6e8cf202d5a283ccb99151ae914aeaeb24130b7 not found: ID does not exist" containerID="bc4542b7947f51c7835d428ec6e8cf202d5a283ccb99151ae914aeaeb24130b7" Jul 02 20:19:55.226599 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:55.226568 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc4542b7947f51c7835d428ec6e8cf202d5a283ccb99151ae914aeaeb24130b7"} err="failed to get container status \"bc4542b7947f51c7835d428ec6e8cf202d5a283ccb99151ae914aeaeb24130b7\": rpc error: code = NotFound desc = could not find container \"bc4542b7947f51c7835d428ec6e8cf202d5a283ccb99151ae914aeaeb24130b7\": container with ID starting with bc4542b7947f51c7835d428ec6e8cf202d5a283ccb99151ae914aeaeb24130b7 not found: ID does not exist" Jul 02 20:19:55.226599 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:55.226585 2560 scope.go:117] "RemoveContainer" containerID="20aae7d651781e42927658086366517f7e58e7bf8618b51942c010c1ab761dcf" Jul 02 20:19:55.226811 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:19:55.226798 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20aae7d651781e42927658086366517f7e58e7bf8618b51942c010c1ab761dcf\": container with ID starting with 20aae7d651781e42927658086366517f7e58e7bf8618b51942c010c1ab761dcf not found: ID does not exist" containerID="20aae7d651781e42927658086366517f7e58e7bf8618b51942c010c1ab761dcf" Jul 02 20:19:55.226848 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:55.226815 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20aae7d651781e42927658086366517f7e58e7bf8618b51942c010c1ab761dcf"} err="failed to get container status \"20aae7d651781e42927658086366517f7e58e7bf8618b51942c010c1ab761dcf\": rpc error: code = NotFound desc = could not find container \"20aae7d651781e42927658086366517f7e58e7bf8618b51942c010c1ab761dcf\": container with ID starting with 20aae7d651781e42927658086366517f7e58e7bf8618b51942c010c1ab761dcf not found: ID does not exist" Jul 02 20:19:55.231143 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:55.231122 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d"] Jul 02 20:19:55.235209 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:55.235188 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-29f89d80-openshift-default-7c79c7df4c-kpg5d"] Jul 02 20:19:55.934445 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:19:55.934411 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91e8c34a-5365-416e-981c-086d7c2ede1c" path="/var/lib/kubelet/pods/91e8c34a-5365-416e-981c-086d7c2ede1c/volumes" Jul 02 20:20:08.969968 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:08.969931 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp"] Jul 02 20:20:08.970554 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:08.970514 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91e8c34a-5365-416e-981c-086d7c2ede1c" containerName="istio-proxy" Jul 02 20:20:08.970554 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:08.970535 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="91e8c34a-5365-416e-981c-086d7c2ede1c" containerName="istio-proxy" Jul 02 20:20:08.970554 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:08.970550 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91a31da4-ef73-4832-8c6d-2c1498341231" containerName="istio-proxy" Jul 02 20:20:08.970721 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:08.970559 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="91a31da4-ef73-4832-8c6d-2c1498341231" containerName="istio-proxy" Jul 02 20:20:08.970721 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:08.970672 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="91e8c34a-5365-416e-981c-086d7c2ede1c" containerName="istio-proxy" Jul 02 20:20:08.970721 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:08.970687 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="91e8c34a-5365-416e-981c-086d7c2ede1c" containerName="istio-proxy" Jul 02 20:20:08.974301 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:08.974281 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:08.977110 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:08.977090 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b80982bb-openshift-default-dockercfg-v5gw9\"" Jul 02 20:20:08.986332 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:08.986304 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp"] Jul 02 20:20:09.100266 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.100206 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-workload-certs\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.100454 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.100286 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-workload-socket\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.100454 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.100323 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-credential-socket\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.100454 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.100339 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-envoy\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.100454 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.100417 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-podinfo\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.100655 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.100472 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-data\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.100655 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.100514 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istiod-ca-cert\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.100655 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.100569 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rkxn\" (UniqueName: \"kubernetes.io/projected/1f5b1475-d658-4a8b-9e68-30dd11172c3a-kube-api-access-5rkxn\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.100655 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.100596 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-token\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.201878 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.201838 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-workload-certs\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.201878 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.201880 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-workload-socket\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.202139 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.201907 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-credential-socket\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.202139 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.201923 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-envoy\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.202139 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.201948 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-podinfo\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.202139 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.201986 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-data\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.202139 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.202030 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istiod-ca-cert\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.202139 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.202093 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rkxn\" (UniqueName: \"kubernetes.io/projected/1f5b1475-d658-4a8b-9e68-30dd11172c3a-kube-api-access-5rkxn\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.202139 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.202118 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-token\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.202551 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.202321 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-workload-certs\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.202551 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.202389 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-workload-socket\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.202551 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.202445 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-credential-socket\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.202551 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.202516 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-data\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.203067 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.203044 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istiod-ca-cert\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.204168 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.204147 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-envoy\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.204594 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.204577 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-podinfo\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.210490 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.210465 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-token\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.211143 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.211120 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rkxn\" (UniqueName: \"kubernetes.io/projected/1f5b1475-d658-4a8b-9e68-30dd11172c3a-kube-api-access-5rkxn\") pod \"e2e-mt-b80982bb-openshift-default-75996df479-lvvxp\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.285080 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.284976 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:09.420167 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.420138 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp"] Jul 02 20:20:09.421542 ip-10-0-137-196 kubenswrapper[2560]: W0702 20:20:09.421512 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f5b1475_d658_4a8b_9e68_30dd11172c3a.slice/crio-b2afd2cbaf969aa79abcfa81dfa55a86cef346bf5a3d812ae6ff1dccaaf6e461 WatchSource:0}: Error finding container b2afd2cbaf969aa79abcfa81dfa55a86cef346bf5a3d812ae6ff1dccaaf6e461: Status 404 returned error can't find the container with id b2afd2cbaf969aa79abcfa81dfa55a86cef346bf5a3d812ae6ff1dccaaf6e461 Jul 02 20:20:09.424000 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.423961 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:20:09.424085 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.424030 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:20:09.424085 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:09.424061 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:20:10.296454 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:10.296417 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" event={"ID":"1f5b1475-d658-4a8b-9e68-30dd11172c3a","Type":"ContainerStarted","Data":"52666aee8bd21cc781eedd8f6cfd79719210a25dd8c5c7bc70e1111056327191"} Jul 02 20:20:10.296836 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:10.296471 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" event={"ID":"1f5b1475-d658-4a8b-9e68-30dd11172c3a","Type":"ContainerStarted","Data":"b2afd2cbaf969aa79abcfa81dfa55a86cef346bf5a3d812ae6ff1dccaaf6e461"} Jul 02 20:20:10.317675 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:10.317626 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" podStartSLOduration=2.317610575 podStartE2EDuration="2.317610575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:20:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:20:10.316456473 +0000 UTC m=+1758.886060544" watchObservedRunningTime="2026-07-02 20:20:10.317610575 +0000 UTC m=+1758.887214647" Jul 02 20:20:11.285541 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:11.285507 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:11.290282 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:11.290259 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:11.301558 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:11.301537 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:11.302329 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:11.302311 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:24.392371 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:24.392336 2560 generic.go:356] "Generic (PLEG): container finished" podID="1f5b1475-d658-4a8b-9e68-30dd11172c3a" containerID="52666aee8bd21cc781eedd8f6cfd79719210a25dd8c5c7bc70e1111056327191" exitCode=0 Jul 02 20:20:24.392775 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:24.392382 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" event={"ID":"1f5b1475-d658-4a8b-9e68-30dd11172c3a","Type":"ContainerDied","Data":"52666aee8bd21cc781eedd8f6cfd79719210a25dd8c5c7bc70e1111056327191"} Jul 02 20:20:24.392825 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:24.392783 2560 scope.go:117] "RemoveContainer" containerID="52666aee8bd21cc781eedd8f6cfd79719210a25dd8c5c7bc70e1111056327191" Jul 02 20:20:24.393834 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:24.393801 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:20:24.393906 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:24.393888 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:20:24.393948 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:24.393930 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:20:25.399093 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:25.399056 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" event={"ID":"1f5b1475-d658-4a8b-9e68-30dd11172c3a","Type":"ContainerStarted","Data":"96b54429e2aaba38e71023d50e3d3bd9a68883f5f6ecf2be220d322a82da47aa"} Jul 02 20:20:26.285638 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:26.285598 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:26.286687 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:26.286659 2560 patch_prober.go:28] interesting pod/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 02 20:20:26.286810 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:26.286708 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" podUID="1f5b1475-d658-4a8b-9e68-30dd11172c3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 02 20:20:26.302087 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:26.302069 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:27.285900 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:27.285863 2560 patch_prober.go:28] interesting pod/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 02 20:20:27.286334 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:27.285930 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" podUID="1f5b1475-d658-4a8b-9e68-30dd11172c3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 02 20:20:28.286243 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:28.286208 2560 patch_prober.go:28] interesting pod/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 02 20:20:28.286634 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:28.286302 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" podUID="1f5b1475-d658-4a8b-9e68-30dd11172c3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 02 20:20:29.285747 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:29.285700 2560 patch_prober.go:28] interesting pod/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 02 20:20:29.285937 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:29.285789 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" podUID="1f5b1475-d658-4a8b-9e68-30dd11172c3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 02 20:20:30.289239 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:30.289208 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:30.290193 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:30.290172 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:20:52.018783 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:52.018749 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/1.log" Jul 02 20:20:52.022066 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:52.022040 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tkp7w_72996a08-b83d-4d1b-99c6-780e15c6722a/ovn-acl-logging/0.log" Jul 02 20:20:52.025643 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:52.025623 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/1.log" Jul 02 20:20:52.028630 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:20:52.028615 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tkp7w_72996a08-b83d-4d1b-99c6-780e15c6722a/ovn-acl-logging/0.log" Jul 02 20:21:48.557340 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:48.557304 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp"] Jul 02 20:21:48.557908 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:48.557564 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" podUID="1f5b1475-d658-4a8b-9e68-30dd11172c3a" containerName="istio-proxy" containerID="cri-o://96b54429e2aaba38e71023d50e3d3bd9a68883f5f6ecf2be220d322a82da47aa" gracePeriod=30 Jul 02 20:21:53.823577 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.823509 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:21:53.848559 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.848526 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-data\") pod \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " Jul 02 20:21:53.848817 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.848571 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-token\") pod \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " Jul 02 20:21:53.848817 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.848683 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-workload-socket\") pod \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " Jul 02 20:21:53.848817 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.848729 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-workload-certs\") pod \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " Jul 02 20:21:53.848817 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.848761 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istiod-ca-cert\") pod \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " Jul 02 20:21:53.848817 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.848787 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-envoy\") pod \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " Jul 02 20:21:53.850644 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.848830 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-podinfo\") pod \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " Jul 02 20:21:53.850644 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.848871 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rkxn\" (UniqueName: \"kubernetes.io/projected/1f5b1475-d658-4a8b-9e68-30dd11172c3a-kube-api-access-5rkxn\") pod \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " Jul 02 20:21:53.850644 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.848900 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-credential-socket\") pod \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\" (UID: \"1f5b1475-d658-4a8b-9e68-30dd11172c3a\") " Jul 02 20:21:53.850644 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.849482 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1f5b1475-d658-4a8b-9e68-30dd11172c3a" (UID: "1f5b1475-d658-4a8b-9e68-30dd11172c3a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:21:53.850644 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.849954 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1f5b1475-d658-4a8b-9e68-30dd11172c3a" (UID: "1f5b1475-d658-4a8b-9e68-30dd11172c3a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:21:53.850644 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.850009 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1f5b1475-d658-4a8b-9e68-30dd11172c3a" (UID: "1f5b1475-d658-4a8b-9e68-30dd11172c3a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:21:53.850644 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.850237 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-workload-certs\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:21:53.850644 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.850278 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istiod-ca-cert\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:21:53.850644 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.850292 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-workload-socket\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:21:53.850644 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.850348 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1f5b1475-d658-4a8b-9e68-30dd11172c3a" (UID: "1f5b1475-d658-4a8b-9e68-30dd11172c3a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:21:53.851237 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.851041 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-data" (OuterVolumeSpecName: "istio-data") pod "1f5b1475-d658-4a8b-9e68-30dd11172c3a" (UID: "1f5b1475-d658-4a8b-9e68-30dd11172c3a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:21:53.852170 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.852142 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-token" (OuterVolumeSpecName: "istio-token") pod "1f5b1475-d658-4a8b-9e68-30dd11172c3a" (UID: "1f5b1475-d658-4a8b-9e68-30dd11172c3a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:21:53.852608 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.852577 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1f5b1475-d658-4a8b-9e68-30dd11172c3a" (UID: "1f5b1475-d658-4a8b-9e68-30dd11172c3a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:21:53.853128 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.853105 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f5b1475-d658-4a8b-9e68-30dd11172c3a-kube-api-access-5rkxn" (OuterVolumeSpecName: "kube-api-access-5rkxn") pod "1f5b1475-d658-4a8b-9e68-30dd11172c3a" (UID: "1f5b1475-d658-4a8b-9e68-30dd11172c3a"). InnerVolumeSpecName "kube-api-access-5rkxn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:21:53.853449 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.853425 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1f5b1475-d658-4a8b-9e68-30dd11172c3a" (UID: "1f5b1475-d658-4a8b-9e68-30dd11172c3a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:21:53.900496 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.900465 2560 generic.go:356] "Generic (PLEG): container finished" podID="1f5b1475-d658-4a8b-9e68-30dd11172c3a" containerID="96b54429e2aaba38e71023d50e3d3bd9a68883f5f6ecf2be220d322a82da47aa" exitCode=0 Jul 02 20:21:53.900638 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.900513 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" Jul 02 20:21:53.900638 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.900547 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" event={"ID":"1f5b1475-d658-4a8b-9e68-30dd11172c3a","Type":"ContainerDied","Data":"96b54429e2aaba38e71023d50e3d3bd9a68883f5f6ecf2be220d322a82da47aa"} Jul 02 20:21:53.900638 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.900618 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp" event={"ID":"1f5b1475-d658-4a8b-9e68-30dd11172c3a","Type":"ContainerDied","Data":"b2afd2cbaf969aa79abcfa81dfa55a86cef346bf5a3d812ae6ff1dccaaf6e461"} Jul 02 20:21:53.900744 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.900640 2560 scope.go:117] "RemoveContainer" containerID="96b54429e2aaba38e71023d50e3d3bd9a68883f5f6ecf2be220d322a82da47aa" Jul 02 20:21:53.912786 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.912766 2560 scope.go:117] "RemoveContainer" containerID="52666aee8bd21cc781eedd8f6cfd79719210a25dd8c5c7bc70e1111056327191" Jul 02 20:21:53.922043 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.922019 2560 scope.go:117] "RemoveContainer" containerID="96b54429e2aaba38e71023d50e3d3bd9a68883f5f6ecf2be220d322a82da47aa" Jul 02 20:21:53.922415 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:21:53.922388 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96b54429e2aaba38e71023d50e3d3bd9a68883f5f6ecf2be220d322a82da47aa\": container with ID starting with 96b54429e2aaba38e71023d50e3d3bd9a68883f5f6ecf2be220d322a82da47aa not found: ID does not exist" containerID="96b54429e2aaba38e71023d50e3d3bd9a68883f5f6ecf2be220d322a82da47aa" Jul 02 20:21:53.922506 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.922424 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96b54429e2aaba38e71023d50e3d3bd9a68883f5f6ecf2be220d322a82da47aa"} err="failed to get container status \"96b54429e2aaba38e71023d50e3d3bd9a68883f5f6ecf2be220d322a82da47aa\": rpc error: code = NotFound desc = could not find container \"96b54429e2aaba38e71023d50e3d3bd9a68883f5f6ecf2be220d322a82da47aa\": container with ID starting with 96b54429e2aaba38e71023d50e3d3bd9a68883f5f6ecf2be220d322a82da47aa not found: ID does not exist" Jul 02 20:21:53.922506 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.922446 2560 scope.go:117] "RemoveContainer" containerID="52666aee8bd21cc781eedd8f6cfd79719210a25dd8c5c7bc70e1111056327191" Jul 02 20:21:53.922741 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:21:53.922713 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52666aee8bd21cc781eedd8f6cfd79719210a25dd8c5c7bc70e1111056327191\": container with ID starting with 52666aee8bd21cc781eedd8f6cfd79719210a25dd8c5c7bc70e1111056327191 not found: ID does not exist" containerID="52666aee8bd21cc781eedd8f6cfd79719210a25dd8c5c7bc70e1111056327191" Jul 02 20:21:53.922794 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.922752 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52666aee8bd21cc781eedd8f6cfd79719210a25dd8c5c7bc70e1111056327191"} err="failed to get container status \"52666aee8bd21cc781eedd8f6cfd79719210a25dd8c5c7bc70e1111056327191\": rpc error: code = NotFound desc = could not find container \"52666aee8bd21cc781eedd8f6cfd79719210a25dd8c5c7bc70e1111056327191\": container with ID starting with 52666aee8bd21cc781eedd8f6cfd79719210a25dd8c5c7bc70e1111056327191 not found: ID does not exist" Jul 02 20:21:53.924971 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.924937 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp"] Jul 02 20:21:53.933870 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.933846 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b80982bb-openshift-default-75996df479-lvvxp"] Jul 02 20:21:53.951195 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.951171 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-data\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:21:53.951195 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.951192 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-token\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:21:53.951361 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.951200 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-envoy\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:21:53.951361 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.951209 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f5b1475-d658-4a8b-9e68-30dd11172c3a-istio-podinfo\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:21:53.951361 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.951217 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rkxn\" (UniqueName: \"kubernetes.io/projected/1f5b1475-d658-4a8b-9e68-30dd11172c3a-kube-api-access-5rkxn\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:21:53.951361 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:53.951227 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f5b1475-d658-4a8b-9e68-30dd11172c3a-credential-socket\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:21:55.933338 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:21:55.933307 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f5b1475-d658-4a8b-9e68-30dd11172c3a" path="/var/lib/kubelet/pods/1f5b1475-d658-4a8b-9e68-30dd11172c3a/volumes" Jul 02 20:22:43.325071 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.325041 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v"] Jul 02 20:22:43.325553 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.325430 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91e8c34a-5365-416e-981c-086d7c2ede1c" containerName="istio-proxy" Jul 02 20:22:43.325553 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.325442 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="91e8c34a-5365-416e-981c-086d7c2ede1c" containerName="istio-proxy" Jul 02 20:22:43.325553 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.325450 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f5b1475-d658-4a8b-9e68-30dd11172c3a" containerName="istio-proxy" Jul 02 20:22:43.325553 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.325459 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f5b1475-d658-4a8b-9e68-30dd11172c3a" containerName="istio-proxy" Jul 02 20:22:43.325687 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.325558 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f5b1475-d658-4a8b-9e68-30dd11172c3a" containerName="istio-proxy" Jul 02 20:22:43.325687 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.325569 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f5b1475-d658-4a8b-9e68-30dd11172c3a" containerName="istio-proxy" Jul 02 20:22:43.327567 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.327552 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.330164 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.330143 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-ba0616-openshift-default-dockercfg-cmv4l\"" Jul 02 20:22:43.340296 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.340276 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v"] Jul 02 20:22:43.376485 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.376460 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-credential-socket\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.376584 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.376508 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-workload-certs\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.376584 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.376548 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-envoy\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.376584 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.376572 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-data\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.376707 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.376637 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-podinfo\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.376707 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.376671 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-workload-socket\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.376770 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.376711 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-token\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.376770 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.376740 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b50e358-55bb-4357-be14-c62d3a4609a7-istiod-ca-cert\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.376770 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.376765 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7mq2\" (UniqueName: \"kubernetes.io/projected/1b50e358-55bb-4357-be14-c62d3a4609a7-kube-api-access-t7mq2\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.477579 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.477545 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-workload-certs\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.477579 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.477584 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-envoy\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.477810 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.477599 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-data\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.477810 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.477634 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-podinfo\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.477810 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.477664 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-workload-socket\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.477810 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.477692 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-token\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.477810 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.477725 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b50e358-55bb-4357-be14-c62d3a4609a7-istiod-ca-cert\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.477810 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.477749 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7mq2\" (UniqueName: \"kubernetes.io/projected/1b50e358-55bb-4357-be14-c62d3a4609a7-kube-api-access-t7mq2\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.477810 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.477786 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-credential-socket\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.478234 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.478010 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-workload-certs\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.478234 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.478124 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-data\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.478346 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.478291 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-credential-socket\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.478346 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.478317 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-workload-socket\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.478616 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.478599 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b50e358-55bb-4357-be14-c62d3a4609a7-istiod-ca-cert\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.479875 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.479855 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-envoy\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.480140 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.480118 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-podinfo\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.487207 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.487187 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7mq2\" (UniqueName: \"kubernetes.io/projected/1b50e358-55bb-4357-be14-c62d3a4609a7-kube-api-access-t7mq2\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.487329 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.487292 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-token\") pod \"e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.637990 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.637930 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:43.779613 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.779589 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v"] Jul 02 20:22:43.781757 ip-10-0-137-196 kubenswrapper[2560]: W0702 20:22:43.781729 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b50e358_55bb_4357_be14_c62d3a4609a7.slice/crio-1da18e888e3feaeeccb688e58fd822c9471cbd38febff8d1f435d12e197e626f WatchSource:0}: Error finding container 1da18e888e3feaeeccb688e58fd822c9471cbd38febff8d1f435d12e197e626f: Status 404 returned error can't find the container with id 1da18e888e3feaeeccb688e58fd822c9471cbd38febff8d1f435d12e197e626f Jul 02 20:22:43.783865 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.783830 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:22:43.783964 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.783911 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:22:43.784026 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:43.783959 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:22:44.190668 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:44.190632 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" event={"ID":"1b50e358-55bb-4357-be14-c62d3a4609a7","Type":"ContainerStarted","Data":"8267391c7c387ecaada4f10f14bfc45f46512fd5f3d376fba4a3c97ff067ac68"} Jul 02 20:22:44.190841 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:44.190690 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" event={"ID":"1b50e358-55bb-4357-be14-c62d3a4609a7","Type":"ContainerStarted","Data":"1da18e888e3feaeeccb688e58fd822c9471cbd38febff8d1f435d12e197e626f"} Jul 02 20:22:44.211221 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:44.211172 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" podStartSLOduration=1.211155908 podStartE2EDuration="1.211155908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:22:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:22:44.209202213 +0000 UTC m=+1912.778806285" watchObservedRunningTime="2026-07-02 20:22:44.211155908 +0000 UTC m=+1912.780759978" Jul 02 20:22:44.638656 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:44.638623 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:44.643654 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:44.643632 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:45.196348 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:45.196298 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:45.197236 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:45.197220 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:22:51.358724 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.358690 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s"] Jul 02 20:22:51.359283 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.359262 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f5b1475-d658-4a8b-9e68-30dd11172c3a" containerName="istio-proxy" Jul 02 20:22:51.359283 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.359283 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f5b1475-d658-4a8b-9e68-30dd11172c3a" containerName="istio-proxy" Jul 02 20:22:51.361996 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.361977 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.364602 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.364583 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-a3a257-openshift-default-dockercfg-qcwsw\"" Jul 02 20:22:51.373143 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.373117 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s"] Jul 02 20:22:51.449012 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.448974 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-workload-certs\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.449185 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.449067 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-envoy\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.449185 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.449141 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-workload-socket\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.449185 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.449179 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-credential-socket\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.449404 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.449220 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-data\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.450021 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.449998 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs4hc\" (UniqueName: \"kubernetes.io/projected/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-kube-api-access-gs4hc\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.450021 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.450035 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-podinfo\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.450208 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.450111 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-token\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.450208 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.450164 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istiod-ca-cert\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.551103 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.551068 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-token\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.551284 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.551113 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istiod-ca-cert\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.551284 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.551170 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-workload-certs\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.551284 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.551201 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-envoy\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.551284 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.551226 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-workload-socket\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.551284 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.551272 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-credential-socket\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.551555 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.551311 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-data\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.551555 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.551367 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs4hc\" (UniqueName: \"kubernetes.io/projected/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-kube-api-access-gs4hc\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.551555 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.551403 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-podinfo\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.551744 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.551716 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-credential-socket\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.551805 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.551773 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-workload-socket\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.551805 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.551798 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-data\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.551999 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.551978 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-workload-certs\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.552044 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.551994 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istiod-ca-cert\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.553579 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.553560 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-envoy\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.553804 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.553787 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-podinfo\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.561445 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.561421 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-token\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.561748 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.561725 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs4hc\" (UniqueName: \"kubernetes.io/projected/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-kube-api-access-gs4hc\") pod \"e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.672468 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.672397 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:51.814943 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.814920 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s"] Jul 02 20:22:51.817648 ip-10-0-137-196 kubenswrapper[2560]: W0702 20:22:51.817611 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b5e8ba_b1d3_4287_8e21_ebabd224ff6f.slice/crio-fb8d6a22d789af6b5fbefdd852d50a92f92d6369dca4ce93f2af6e1085389fc1 WatchSource:0}: Error finding container fb8d6a22d789af6b5fbefdd852d50a92f92d6369dca4ce93f2af6e1085389fc1: Status 404 returned error can't find the container with id fb8d6a22d789af6b5fbefdd852d50a92f92d6369dca4ce93f2af6e1085389fc1 Jul 02 20:22:51.819898 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.819860 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:22:51.819996 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.819948 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:22:51.820043 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:51.819990 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:22:52.241173 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:52.241137 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" event={"ID":"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f","Type":"ContainerStarted","Data":"eceb7d78468bc10ea59f31886604f0f193825b998bd77649ba06ab825114aaf6"} Jul 02 20:22:52.241347 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:52.241192 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" event={"ID":"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f","Type":"ContainerStarted","Data":"fb8d6a22d789af6b5fbefdd852d50a92f92d6369dca4ce93f2af6e1085389fc1"} Jul 02 20:22:52.263390 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:52.263344 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" podStartSLOduration=1.263328088 podStartE2EDuration="1.263328088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:22:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:22:52.261209876 +0000 UTC m=+1920.830813959" watchObservedRunningTime="2026-07-02 20:22:52.263328088 +0000 UTC m=+1920.832932159" Jul 02 20:22:52.673137 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:52.673105 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:52.678102 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:52.678079 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:53.248223 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:53.248185 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:22:53.249034 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:22:53.249017 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:23:01.237928 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:01.237400 2560 patch_prober.go:28] interesting pod/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 02 20:23:01.237928 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:01.237468 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" podUID="1b50e358-55bb-4357-be14-c62d3a4609a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 02 20:23:03.309686 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:03.309655 2560 generic.go:356] "Generic (PLEG): container finished" podID="1b50e358-55bb-4357-be14-c62d3a4609a7" containerID="8267391c7c387ecaada4f10f14bfc45f46512fd5f3d376fba4a3c97ff067ac68" exitCode=0 Jul 02 20:23:03.310081 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:03.309713 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" event={"ID":"1b50e358-55bb-4357-be14-c62d3a4609a7","Type":"ContainerDied","Data":"8267391c7c387ecaada4f10f14bfc45f46512fd5f3d376fba4a3c97ff067ac68"} Jul 02 20:23:03.310143 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:03.310085 2560 scope.go:117] "RemoveContainer" containerID="8267391c7c387ecaada4f10f14bfc45f46512fd5f3d376fba4a3c97ff067ac68" Jul 02 20:23:03.311128 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:03.311099 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:23:03.311192 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:03.311165 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:23:03.311229 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:03.311196 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:23:04.317371 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:04.317337 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" event={"ID":"1b50e358-55bb-4357-be14-c62d3a4609a7","Type":"ContainerStarted","Data":"4ceb94a6fe8894b1b15d29dfe2418e8cd0a1584a7d3aef0c41a60f91ed1bfca5"} Jul 02 20:23:04.638385 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:04.638285 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:23:04.638673 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:04.638645 2560 patch_prober.go:28] interesting pod/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 02 20:23:04.638881 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:04.638856 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" podUID="1b50e358-55bb-4357-be14-c62d3a4609a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 02 20:23:05.639723 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:05.639294 2560 patch_prober.go:28] interesting pod/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 02 20:23:05.639723 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:05.639351 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" podUID="1b50e358-55bb-4357-be14-c62d3a4609a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 02 20:23:06.638669 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:06.638620 2560 patch_prober.go:28] interesting pod/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 02 20:23:06.638872 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:06.638708 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" podUID="1b50e358-55bb-4357-be14-c62d3a4609a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 02 20:23:07.638843 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:07.638732 2560 patch_prober.go:28] interesting pod/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 02 20:23:07.638843 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:07.638813 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" podUID="1b50e358-55bb-4357-be14-c62d3a4609a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 02 20:23:08.250439 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:08.250399 2560 patch_prober.go:28] interesting pod/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 02 20:23:08.250647 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:08.250466 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" podUID="95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 02 20:23:08.343221 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:08.343190 2560 generic.go:356] "Generic (PLEG): container finished" podID="95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" containerID="eceb7d78468bc10ea59f31886604f0f193825b998bd77649ba06ab825114aaf6" exitCode=0 Jul 02 20:23:08.343389 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:08.343288 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" event={"ID":"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f","Type":"ContainerDied","Data":"eceb7d78468bc10ea59f31886604f0f193825b998bd77649ba06ab825114aaf6"} Jul 02 20:23:08.343683 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:08.343667 2560 scope.go:117] "RemoveContainer" containerID="eceb7d78468bc10ea59f31886604f0f193825b998bd77649ba06ab825114aaf6" Jul 02 20:23:08.344808 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:08.344777 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:23:08.344883 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:08.344866 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:23:08.344925 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:08.344907 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:23:08.641859 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:08.641774 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:23:08.642332 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:08.642154 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:23:08.642860 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:08.642837 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:23:09.355448 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:09.355409 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" event={"ID":"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f","Type":"ContainerStarted","Data":"32f96b73cc7bcda10c7e54a4363141f310a4001a3ca769f380c25cbeca5f3d2b"} Jul 02 20:23:09.672961 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:09.672871 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:23:09.673376 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:09.673119 2560 patch_prober.go:28] interesting pod/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 02 20:23:09.673376 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:09.673171 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" podUID="95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 02 20:23:10.673166 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:10.673127 2560 patch_prober.go:28] interesting pod/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 02 20:23:10.673679 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:10.673182 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" podUID="95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 02 20:23:11.673731 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:11.673694 2560 patch_prober.go:28] interesting pod/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 02 20:23:11.674113 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:11.673758 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" podUID="95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 02 20:23:12.673722 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:12.673682 2560 patch_prober.go:28] interesting pod/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 02 20:23:12.673909 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:12.673746 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" podUID="95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 02 20:23:13.676985 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:13.676959 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:23:13.677414 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:13.677222 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:23:13.677949 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:23:13.677931 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:24:56.390453 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:24:56.390420 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v"] Jul 02 20:24:56.391004 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:24:56.390671 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" podUID="1b50e358-55bb-4357-be14-c62d3a4609a7" containerName="istio-proxy" containerID="cri-o://4ceb94a6fe8894b1b15d29dfe2418e8cd0a1584a7d3aef0c41a60f91ed1bfca5" gracePeriod=30 Jul 02 20:25:01.644333 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.644309 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:25:01.748592 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.748551 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-token\") pod \"1b50e358-55bb-4357-be14-c62d3a4609a7\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " Jul 02 20:25:01.748788 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.748598 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-workload-certs\") pod \"1b50e358-55bb-4357-be14-c62d3a4609a7\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " Jul 02 20:25:01.748788 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.748662 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-podinfo\") pod \"1b50e358-55bb-4357-be14-c62d3a4609a7\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " Jul 02 20:25:01.748788 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.748687 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-credential-socket\") pod \"1b50e358-55bb-4357-be14-c62d3a4609a7\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " Jul 02 20:25:01.748788 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.748719 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-data\") pod \"1b50e358-55bb-4357-be14-c62d3a4609a7\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " Jul 02 20:25:01.748788 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.748760 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-workload-socket\") pod \"1b50e358-55bb-4357-be14-c62d3a4609a7\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " Jul 02 20:25:01.749051 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.748809 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b50e358-55bb-4357-be14-c62d3a4609a7-istiod-ca-cert\") pod \"1b50e358-55bb-4357-be14-c62d3a4609a7\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " Jul 02 20:25:01.749051 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.748850 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-envoy\") pod \"1b50e358-55bb-4357-be14-c62d3a4609a7\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " Jul 02 20:25:01.749051 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.748877 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7mq2\" (UniqueName: \"kubernetes.io/projected/1b50e358-55bb-4357-be14-c62d3a4609a7-kube-api-access-t7mq2\") pod \"1b50e358-55bb-4357-be14-c62d3a4609a7\" (UID: \"1b50e358-55bb-4357-be14-c62d3a4609a7\") " Jul 02 20:25:01.749051 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.748989 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1b50e358-55bb-4357-be14-c62d3a4609a7" (UID: "1b50e358-55bb-4357-be14-c62d3a4609a7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:01.749051 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.749029 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1b50e358-55bb-4357-be14-c62d3a4609a7" (UID: "1b50e358-55bb-4357-be14-c62d3a4609a7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:01.749320 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.749055 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1b50e358-55bb-4357-be14-c62d3a4609a7" (UID: "1b50e358-55bb-4357-be14-c62d3a4609a7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:01.749320 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.749302 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-workload-certs\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:01.749412 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.749325 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-credential-socket\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:01.749412 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.749341 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-workload-socket\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:01.749493 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.749416 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b50e358-55bb-4357-be14-c62d3a4609a7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1b50e358-55bb-4357-be14-c62d3a4609a7" (UID: "1b50e358-55bb-4357-be14-c62d3a4609a7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:25:01.749806 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.749772 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-data" (OuterVolumeSpecName: "istio-data") pod "1b50e358-55bb-4357-be14-c62d3a4609a7" (UID: "1b50e358-55bb-4357-be14-c62d3a4609a7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:01.750908 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.750884 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-token" (OuterVolumeSpecName: "istio-token") pod "1b50e358-55bb-4357-be14-c62d3a4609a7" (UID: "1b50e358-55bb-4357-be14-c62d3a4609a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:25:01.750997 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.750904 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1b50e358-55bb-4357-be14-c62d3a4609a7" (UID: "1b50e358-55bb-4357-be14-c62d3a4609a7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:25:01.751078 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.751058 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b50e358-55bb-4357-be14-c62d3a4609a7-kube-api-access-t7mq2" (OuterVolumeSpecName: "kube-api-access-t7mq2") pod "1b50e358-55bb-4357-be14-c62d3a4609a7" (UID: "1b50e358-55bb-4357-be14-c62d3a4609a7"). InnerVolumeSpecName "kube-api-access-t7mq2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:25:01.751221 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.751198 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1b50e358-55bb-4357-be14-c62d3a4609a7" (UID: "1b50e358-55bb-4357-be14-c62d3a4609a7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:01.850209 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.850175 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b50e358-55bb-4357-be14-c62d3a4609a7-istiod-ca-cert\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:01.850209 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.850204 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-envoy\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:01.850209 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.850213 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7mq2\" (UniqueName: \"kubernetes.io/projected/1b50e358-55bb-4357-be14-c62d3a4609a7-kube-api-access-t7mq2\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:01.850473 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.850223 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-token\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:01.850473 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.850232 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-podinfo\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:01.850473 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.850239 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b50e358-55bb-4357-be14-c62d3a4609a7-istio-data\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:01.999127 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.999054 2560 generic.go:356] "Generic (PLEG): container finished" podID="1b50e358-55bb-4357-be14-c62d3a4609a7" containerID="4ceb94a6fe8894b1b15d29dfe2418e8cd0a1584a7d3aef0c41a60f91ed1bfca5" exitCode=0 Jul 02 20:25:01.999127 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.999111 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" Jul 02 20:25:01.999127 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.999121 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" event={"ID":"1b50e358-55bb-4357-be14-c62d3a4609a7","Type":"ContainerDied","Data":"4ceb94a6fe8894b1b15d29dfe2418e8cd0a1584a7d3aef0c41a60f91ed1bfca5"} Jul 02 20:25:01.999390 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.999162 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v" event={"ID":"1b50e358-55bb-4357-be14-c62d3a4609a7","Type":"ContainerDied","Data":"1da18e888e3feaeeccb688e58fd822c9471cbd38febff8d1f435d12e197e626f"} Jul 02 20:25:01.999390 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:01.999183 2560 scope.go:117] "RemoveContainer" containerID="4ceb94a6fe8894b1b15d29dfe2418e8cd0a1584a7d3aef0c41a60f91ed1bfca5" Jul 02 20:25:02.008571 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:02.008553 2560 scope.go:117] "RemoveContainer" containerID="8267391c7c387ecaada4f10f14bfc45f46512fd5f3d376fba4a3c97ff067ac68" Jul 02 20:25:02.017150 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:02.017138 2560 scope.go:117] "RemoveContainer" containerID="4ceb94a6fe8894b1b15d29dfe2418e8cd0a1584a7d3aef0c41a60f91ed1bfca5" Jul 02 20:25:02.017226 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:02.017186 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v"] Jul 02 20:25:02.017438 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:25:02.017418 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ceb94a6fe8894b1b15d29dfe2418e8cd0a1584a7d3aef0c41a60f91ed1bfca5\": container with ID starting with 4ceb94a6fe8894b1b15d29dfe2418e8cd0a1584a7d3aef0c41a60f91ed1bfca5 not found: ID does not exist" containerID="4ceb94a6fe8894b1b15d29dfe2418e8cd0a1584a7d3aef0c41a60f91ed1bfca5" Jul 02 20:25:02.017490 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:02.017447 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ceb94a6fe8894b1b15d29dfe2418e8cd0a1584a7d3aef0c41a60f91ed1bfca5"} err="failed to get container status \"4ceb94a6fe8894b1b15d29dfe2418e8cd0a1584a7d3aef0c41a60f91ed1bfca5\": rpc error: code = NotFound desc = could not find container \"4ceb94a6fe8894b1b15d29dfe2418e8cd0a1584a7d3aef0c41a60f91ed1bfca5\": container with ID starting with 4ceb94a6fe8894b1b15d29dfe2418e8cd0a1584a7d3aef0c41a60f91ed1bfca5 not found: ID does not exist" Jul 02 20:25:02.017490 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:02.017465 2560 scope.go:117] "RemoveContainer" containerID="8267391c7c387ecaada4f10f14bfc45f46512fd5f3d376fba4a3c97ff067ac68" Jul 02 20:25:02.017724 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:25:02.017703 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8267391c7c387ecaada4f10f14bfc45f46512fd5f3d376fba4a3c97ff067ac68\": container with ID starting with 8267391c7c387ecaada4f10f14bfc45f46512fd5f3d376fba4a3c97ff067ac68 not found: ID does not exist" containerID="8267391c7c387ecaada4f10f14bfc45f46512fd5f3d376fba4a3c97ff067ac68" Jul 02 20:25:02.017849 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:02.017734 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8267391c7c387ecaada4f10f14bfc45f46512fd5f3d376fba4a3c97ff067ac68"} err="failed to get container status \"8267391c7c387ecaada4f10f14bfc45f46512fd5f3d376fba4a3c97ff067ac68\": rpc error: code = NotFound desc = could not find container \"8267391c7c387ecaada4f10f14bfc45f46512fd5f3d376fba4a3c97ff067ac68\": container with ID starting with 8267391c7c387ecaada4f10f14bfc45f46512fd5f3d376fba4a3c97ff067ac68 not found: ID does not exist" Jul 02 20:25:02.021013 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:02.020992 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-ba0616-openshift-default-86788f4669-lpw6v"] Jul 02 20:25:03.264915 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:03.264878 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s"] Jul 02 20:25:03.265368 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:03.265124 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" podUID="95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" containerName="istio-proxy" containerID="cri-o://32f96b73cc7bcda10c7e54a4363141f310a4001a3ca769f380c25cbeca5f3d2b" gracePeriod=30 Jul 02 20:25:03.934955 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:03.934925 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b50e358-55bb-4357-be14-c62d3a4609a7" path="/var/lib/kubelet/pods/1b50e358-55bb-4357-be14-c62d3a4609a7/volumes" Jul 02 20:25:04.246674 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.246646 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4"] Jul 02 20:25:04.247049 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.247037 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b50e358-55bb-4357-be14-c62d3a4609a7" containerName="istio-proxy" Jul 02 20:25:04.247094 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.247051 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b50e358-55bb-4357-be14-c62d3a4609a7" containerName="istio-proxy" Jul 02 20:25:04.247094 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.247061 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b50e358-55bb-4357-be14-c62d3a4609a7" containerName="istio-proxy" Jul 02 20:25:04.247094 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.247066 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b50e358-55bb-4357-be14-c62d3a4609a7" containerName="istio-proxy" Jul 02 20:25:04.247191 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.247130 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b50e358-55bb-4357-be14-c62d3a4609a7" containerName="istio-proxy" Jul 02 20:25:04.247191 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.247140 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b50e358-55bb-4357-be14-c62d3a4609a7" containerName="istio-proxy" Jul 02 20:25:04.250243 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.250224 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.253193 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.253172 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-91e0dd-openshift-default-dockercfg-qlkpz\"" Jul 02 20:25:04.272052 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.272027 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4"] Jul 02 20:25:04.375933 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.375892 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbzdg\" (UniqueName: \"kubernetes.io/projected/21581dc3-7886-4188-879d-ad4e94f371fb-kube-api-access-wbzdg\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.375933 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.375937 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-istio-envoy\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.376158 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.375959 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-credential-socket\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.376158 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.376038 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21581dc3-7886-4188-879d-ad4e94f371fb-istio-podinfo\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.376158 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.376062 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21581dc3-7886-4188-879d-ad4e94f371fb-istiod-ca-cert\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.376158 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.376095 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-workload-certs\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.376158 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.376145 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-istio-data\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.376385 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.376183 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21581dc3-7886-4188-879d-ad4e94f371fb-istio-token\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.376385 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.376236 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-workload-socket\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.477460 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.477423 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-workload-socket\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.477648 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.477488 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbzdg\" (UniqueName: \"kubernetes.io/projected/21581dc3-7886-4188-879d-ad4e94f371fb-kube-api-access-wbzdg\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.477648 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.477516 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-istio-envoy\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.477648 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.477547 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-credential-socket\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.477648 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.477591 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21581dc3-7886-4188-879d-ad4e94f371fb-istio-podinfo\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.477648 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.477615 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21581dc3-7886-4188-879d-ad4e94f371fb-istiod-ca-cert\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.477926 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.477653 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-workload-certs\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.477926 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.477693 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-istio-data\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.477926 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.477744 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21581dc3-7886-4188-879d-ad4e94f371fb-istio-token\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.477926 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.477865 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-workload-socket\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.478147 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.477950 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-credential-socket\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.478147 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.478029 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-istio-data\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.478147 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.478068 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-workload-certs\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.478487 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.478469 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21581dc3-7886-4188-879d-ad4e94f371fb-istiod-ca-cert\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.479959 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.479931 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-istio-envoy\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.480131 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.480113 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21581dc3-7886-4188-879d-ad4e94f371fb-istio-podinfo\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.485926 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.485903 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbzdg\" (UniqueName: \"kubernetes.io/projected/21581dc3-7886-4188-879d-ad4e94f371fb-kube-api-access-wbzdg\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.486052 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.486028 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21581dc3-7886-4188-879d-ad4e94f371fb-istio-token\") pod \"e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.560815 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.560714 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:04.697732 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.697704 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4"] Jul 02 20:25:04.698927 ip-10-0-137-196 kubenswrapper[2560]: W0702 20:25:04.698903 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21581dc3_7886_4188_879d_ad4e94f371fb.slice/crio-10c9624cb326dc85a0e2186494e4647e266eab0ed407612336d620c4e73b4166 WatchSource:0}: Error finding container 10c9624cb326dc85a0e2186494e4647e266eab0ed407612336d620c4e73b4166: Status 404 returned error can't find the container with id 10c9624cb326dc85a0e2186494e4647e266eab0ed407612336d620c4e73b4166 Jul 02 20:25:04.701124 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.701085 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:04.701203 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.701169 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:04.701268 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:04.701212 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:05.019470 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:05.019430 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" event={"ID":"21581dc3-7886-4188-879d-ad4e94f371fb","Type":"ContainerStarted","Data":"982e4a629d058f8ef7bc165461581c079fb10dece8a780cb416c87fd81ff355d"} Jul 02 20:25:05.019694 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:05.019490 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" event={"ID":"21581dc3-7886-4188-879d-ad4e94f371fb","Type":"ContainerStarted","Data":"10c9624cb326dc85a0e2186494e4647e266eab0ed407612336d620c4e73b4166"} Jul 02 20:25:05.041322 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:05.041272 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" podStartSLOduration=1.041258682 podStartE2EDuration="1.041258682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:25:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:25:05.038476575 +0000 UTC m=+2053.608080648" watchObservedRunningTime="2026-07-02 20:25:05.041258682 +0000 UTC m=+2053.610862745" Jul 02 20:25:05.561555 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:05.561524 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:05.566454 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:05.566432 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:06.025888 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:06.025855 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:06.026966 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:06.026945 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:08.504705 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.504678 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:25:08.515619 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.515596 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gs4hc\" (UniqueName: \"kubernetes.io/projected/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-kube-api-access-gs4hc\") pod \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " Jul 02 20:25:08.515745 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.515633 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-token\") pod \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " Jul 02 20:25:08.515745 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.515656 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-envoy\") pod \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " Jul 02 20:25:08.515868 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.515769 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-workload-socket\") pod \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " Jul 02 20:25:08.515868 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.515827 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istiod-ca-cert\") pod \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " Jul 02 20:25:08.515868 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.515856 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-data\") pod \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " Jul 02 20:25:08.516017 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.515893 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-workload-certs\") pod \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " Jul 02 20:25:08.516017 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.515979 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-podinfo\") pod \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " Jul 02 20:25:08.516117 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.516030 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" (UID: "95b5e8ba-b1d3-4287-8e21-ebabd224ff6f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:08.516117 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.516046 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-credential-socket\") pod \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\" (UID: \"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f\") " Jul 02 20:25:08.516305 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.516286 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" (UID: "95b5e8ba-b1d3-4287-8e21-ebabd224ff6f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:08.516383 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.516299 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" (UID: "95b5e8ba-b1d3-4287-8e21-ebabd224ff6f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:25:08.516383 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.516310 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" (UID: "95b5e8ba-b1d3-4287-8e21-ebabd224ff6f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:08.516485 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.516465 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-credential-socket\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:08.516529 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.516491 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-workload-socket\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:08.516529 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.516508 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istiod-ca-cert\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:08.516529 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.516522 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-workload-certs\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:08.516979 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.516955 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-data" (OuterVolumeSpecName: "istio-data") pod "95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" (UID: "95b5e8ba-b1d3-4287-8e21-ebabd224ff6f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:08.517949 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.517923 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-kube-api-access-gs4hc" (OuterVolumeSpecName: "kube-api-access-gs4hc") pod "95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" (UID: "95b5e8ba-b1d3-4287-8e21-ebabd224ff6f"). InnerVolumeSpecName "kube-api-access-gs4hc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:25:08.518063 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.517969 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" (UID: "95b5e8ba-b1d3-4287-8e21-ebabd224ff6f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:08.518063 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.517990 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-token" (OuterVolumeSpecName: "istio-token") pod "95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" (UID: "95b5e8ba-b1d3-4287-8e21-ebabd224ff6f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:25:08.518299 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.518283 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" (UID: "95b5e8ba-b1d3-4287-8e21-ebabd224ff6f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:25:08.616979 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.616951 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-podinfo\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:08.616979 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.616975 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gs4hc\" (UniqueName: \"kubernetes.io/projected/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-kube-api-access-gs4hc\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:08.617128 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.616985 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-token\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:08.617128 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.616993 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-envoy\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:08.617128 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:08.617001 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f-istio-data\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:09.045026 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:09.044988 2560 generic.go:356] "Generic (PLEG): container finished" podID="95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" containerID="32f96b73cc7bcda10c7e54a4363141f310a4001a3ca769f380c25cbeca5f3d2b" exitCode=0 Jul 02 20:25:09.045216 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:09.045040 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" Jul 02 20:25:09.045216 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:09.045072 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" event={"ID":"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f","Type":"ContainerDied","Data":"32f96b73cc7bcda10c7e54a4363141f310a4001a3ca769f380c25cbeca5f3d2b"} Jul 02 20:25:09.045216 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:09.045131 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s" event={"ID":"95b5e8ba-b1d3-4287-8e21-ebabd224ff6f","Type":"ContainerDied","Data":"fb8d6a22d789af6b5fbefdd852d50a92f92d6369dca4ce93f2af6e1085389fc1"} Jul 02 20:25:09.045216 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:09.045162 2560 scope.go:117] "RemoveContainer" containerID="32f96b73cc7bcda10c7e54a4363141f310a4001a3ca769f380c25cbeca5f3d2b" Jul 02 20:25:09.055802 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:09.055759 2560 scope.go:117] "RemoveContainer" containerID="eceb7d78468bc10ea59f31886604f0f193825b998bd77649ba06ab825114aaf6" Jul 02 20:25:09.064121 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:09.064104 2560 scope.go:117] "RemoveContainer" containerID="32f96b73cc7bcda10c7e54a4363141f310a4001a3ca769f380c25cbeca5f3d2b" Jul 02 20:25:09.064460 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:25:09.064442 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32f96b73cc7bcda10c7e54a4363141f310a4001a3ca769f380c25cbeca5f3d2b\": container with ID starting with 32f96b73cc7bcda10c7e54a4363141f310a4001a3ca769f380c25cbeca5f3d2b not found: ID does not exist" containerID="32f96b73cc7bcda10c7e54a4363141f310a4001a3ca769f380c25cbeca5f3d2b" Jul 02 20:25:09.064532 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:09.064467 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32f96b73cc7bcda10c7e54a4363141f310a4001a3ca769f380c25cbeca5f3d2b"} err="failed to get container status \"32f96b73cc7bcda10c7e54a4363141f310a4001a3ca769f380c25cbeca5f3d2b\": rpc error: code = NotFound desc = could not find container \"32f96b73cc7bcda10c7e54a4363141f310a4001a3ca769f380c25cbeca5f3d2b\": container with ID starting with 32f96b73cc7bcda10c7e54a4363141f310a4001a3ca769f380c25cbeca5f3d2b not found: ID does not exist" Jul 02 20:25:09.064532 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:09.064485 2560 scope.go:117] "RemoveContainer" containerID="eceb7d78468bc10ea59f31886604f0f193825b998bd77649ba06ab825114aaf6" Jul 02 20:25:09.064729 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:25:09.064708 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eceb7d78468bc10ea59f31886604f0f193825b998bd77649ba06ab825114aaf6\": container with ID starting with eceb7d78468bc10ea59f31886604f0f193825b998bd77649ba06ab825114aaf6 not found: ID does not exist" containerID="eceb7d78468bc10ea59f31886604f0f193825b998bd77649ba06ab825114aaf6" Jul 02 20:25:09.064835 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:09.064735 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eceb7d78468bc10ea59f31886604f0f193825b998bd77649ba06ab825114aaf6"} err="failed to get container status \"eceb7d78468bc10ea59f31886604f0f193825b998bd77649ba06ab825114aaf6\": rpc error: code = NotFound desc = could not find container \"eceb7d78468bc10ea59f31886604f0f193825b998bd77649ba06ab825114aaf6\": container with ID starting with eceb7d78468bc10ea59f31886604f0f193825b998bd77649ba06ab825114aaf6 not found: ID does not exist" Jul 02 20:25:09.068532 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:09.068507 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s"] Jul 02 20:25:09.078731 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:09.075798 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-a3a257-openshift-default-7d667c5d8f-7cl6s"] Jul 02 20:25:09.933970 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:09.933933 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" path="/var/lib/kubelet/pods/95b5e8ba-b1d3-4287-8e21-ebabd224ff6f/volumes" Jul 02 20:25:12.516747 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.516709 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk"] Jul 02 20:25:12.517143 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.517129 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" containerName="istio-proxy" Jul 02 20:25:12.517188 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.517144 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" containerName="istio-proxy" Jul 02 20:25:12.517188 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.517162 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" containerName="istio-proxy" Jul 02 20:25:12.517188 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.517168 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" containerName="istio-proxy" Jul 02 20:25:12.517318 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.517227 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" containerName="istio-proxy" Jul 02 20:25:12.520573 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.520554 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.523062 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.523041 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-58953a-openshift-default-dockercfg-598pg\"" Jul 02 20:25:12.531635 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.531614 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk"] Jul 02 20:25:12.651273 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.650889 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7253333f-66a1-4b07-a7a5-89500054ba62-istio-token\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.651273 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.650938 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdjfz\" (UniqueName: \"kubernetes.io/projected/7253333f-66a1-4b07-a7a5-89500054ba62-kube-api-access-wdjfz\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.651273 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.650988 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7253333f-66a1-4b07-a7a5-89500054ba62-istio-podinfo\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.651273 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.651015 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-workload-socket\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.651273 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.651066 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-workload-certs\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.651273 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.651093 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-istio-data\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.651273 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.651144 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-istio-envoy\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.651273 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.651203 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-credential-socket\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.651273 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.651232 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7253333f-66a1-4b07-a7a5-89500054ba62-istiod-ca-cert\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.751802 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.751757 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-istio-envoy\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.752010 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.751844 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-credential-socket\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.752010 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.751879 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7253333f-66a1-4b07-a7a5-89500054ba62-istiod-ca-cert\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.752010 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.751937 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7253333f-66a1-4b07-a7a5-89500054ba62-istio-token\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.752010 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.751966 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdjfz\" (UniqueName: \"kubernetes.io/projected/7253333f-66a1-4b07-a7a5-89500054ba62-kube-api-access-wdjfz\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.752010 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.752007 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7253333f-66a1-4b07-a7a5-89500054ba62-istio-podinfo\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.752356 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.752034 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-workload-socket\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.752356 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.752085 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-workload-certs\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.752356 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.752114 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-istio-data\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.752631 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.752591 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-istio-data\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.753555 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.753527 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-credential-socket\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.754168 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.754133 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7253333f-66a1-4b07-a7a5-89500054ba62-istiod-ca-cert\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.754658 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.754633 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-workload-socket\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.755280 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.755241 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-workload-certs\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.755660 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.755641 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-istio-envoy\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.757535 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.757512 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7253333f-66a1-4b07-a7a5-89500054ba62-istio-podinfo\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.762129 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.762072 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdjfz\" (UniqueName: \"kubernetes.io/projected/7253333f-66a1-4b07-a7a5-89500054ba62-kube-api-access-wdjfz\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.763287 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.762261 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7253333f-66a1-4b07-a7a5-89500054ba62-istio-token\") pod \"e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:12.831884 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:12.831821 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:13.008533 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:13.008504 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk"] Jul 02 20:25:13.009296 ip-10-0-137-196 kubenswrapper[2560]: W0702 20:25:13.009268 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7253333f_66a1_4b07_a7a5_89500054ba62.slice/crio-d0c250b1ed3b5d6d14174c81ad1653e24e4a4fd5553db5f2ccde7f186e7c599f WatchSource:0}: Error finding container d0c250b1ed3b5d6d14174c81ad1653e24e4a4fd5553db5f2ccde7f186e7c599f: Status 404 returned error can't find the container with id d0c250b1ed3b5d6d14174c81ad1653e24e4a4fd5553db5f2ccde7f186e7c599f Jul 02 20:25:13.011398 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:13.011358 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:13.011481 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:13.011441 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:13.011527 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:13.011486 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:13.072742 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:13.072717 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" event={"ID":"7253333f-66a1-4b07-a7a5-89500054ba62","Type":"ContainerStarted","Data":"d0c250b1ed3b5d6d14174c81ad1653e24e4a4fd5553db5f2ccde7f186e7c599f"} Jul 02 20:25:14.080641 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:14.080609 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" event={"ID":"7253333f-66a1-4b07-a7a5-89500054ba62","Type":"ContainerStarted","Data":"6615d12afd6478acd6e0844655562625455e02712d8bbe0e06ddf36b26719611"} Jul 02 20:25:14.100222 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:14.100172 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" podStartSLOduration=2.100155435 podStartE2EDuration="2.100155435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:25:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:25:14.100117989 +0000 UTC m=+2062.669722089" watchObservedRunningTime="2026-07-02 20:25:14.100155435 +0000 UTC m=+2062.669759505" Jul 02 20:25:14.832369 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:14.832291 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:14.845400 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:14.845363 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:15.086211 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:15.086127 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:15.087015 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:15.086994 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:19.112108 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:19.112077 2560 generic.go:356] "Generic (PLEG): container finished" podID="21581dc3-7886-4188-879d-ad4e94f371fb" containerID="982e4a629d058f8ef7bc165461581c079fb10dece8a780cb416c87fd81ff355d" exitCode=0 Jul 02 20:25:19.112570 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:19.112145 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" event={"ID":"21581dc3-7886-4188-879d-ad4e94f371fb","Type":"ContainerDied","Data":"982e4a629d058f8ef7bc165461581c079fb10dece8a780cb416c87fd81ff355d"} Jul 02 20:25:19.112613 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:19.112585 2560 scope.go:117] "RemoveContainer" containerID="982e4a629d058f8ef7bc165461581c079fb10dece8a780cb416c87fd81ff355d" Jul 02 20:25:19.113743 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:19.113714 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:19.113813 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:19.113796 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:19.113850 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:19.113841 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:20.119458 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:20.119422 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" event={"ID":"21581dc3-7886-4188-879d-ad4e94f371fb","Type":"ContainerStarted","Data":"728e8c65ab328ccf2a3c88ba91d11acb1a76728004eb08c7ce826af998f1e3c2"} Jul 02 20:25:20.562701 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:20.562648 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:20.562920 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:20.562720 2560 patch_prober.go:28] interesting pod/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 02 20:25:20.562920 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:20.562774 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" podUID="21581dc3-7886-4188-879d-ad4e94f371fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 02 20:25:21.026721 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:21.026684 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:21.561982 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:21.561938 2560 patch_prober.go:28] interesting pod/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 02 20:25:21.562478 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:21.562033 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" podUID="21581dc3-7886-4188-879d-ad4e94f371fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 02 20:25:22.561533 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:22.561497 2560 patch_prober.go:28] interesting pod/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 02 20:25:22.561751 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:22.561574 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" podUID="21581dc3-7886-4188-879d-ad4e94f371fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 02 20:25:23.561588 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:23.561546 2560 patch_prober.go:28] interesting pod/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 02 20:25:23.562061 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:23.561622 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" podUID="21581dc3-7886-4188-879d-ad4e94f371fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 02 20:25:24.561782 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:24.561749 2560 patch_prober.go:28] interesting pod/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 02 20:25:24.562227 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:24.561803 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" podUID="21581dc3-7886-4188-879d-ad4e94f371fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 02 20:25:25.565147 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:25.565112 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:25.566088 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:25.566071 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:31.127415 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:31.127375 2560 patch_prober.go:28] interesting pod/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 02 20:25:31.127840 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:31.127458 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" podUID="7253333f-66a1-4b07-a7a5-89500054ba62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 02 20:25:32.202003 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:32.201966 2560 generic.go:356] "Generic (PLEG): container finished" podID="7253333f-66a1-4b07-a7a5-89500054ba62" containerID="6615d12afd6478acd6e0844655562625455e02712d8bbe0e06ddf36b26719611" exitCode=0 Jul 02 20:25:32.202496 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:32.202039 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" event={"ID":"7253333f-66a1-4b07-a7a5-89500054ba62","Type":"ContainerDied","Data":"6615d12afd6478acd6e0844655562625455e02712d8bbe0e06ddf36b26719611"} Jul 02 20:25:32.202496 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:32.202473 2560 scope.go:117] "RemoveContainer" containerID="6615d12afd6478acd6e0844655562625455e02712d8bbe0e06ddf36b26719611" Jul 02 20:25:32.203485 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:32.203455 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:32.203578 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:32.203527 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:32.203578 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:32.203558 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:33.210067 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:33.210038 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" event={"ID":"7253333f-66a1-4b07-a7a5-89500054ba62","Type":"ContainerStarted","Data":"671c6172bb5c6c4e63835f65aa89a9b8f1376021e42a3b1f1f652cc5f69a5add"} Jul 02 20:25:33.832508 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:33.832470 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:33.832738 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:33.832715 2560 patch_prober.go:28] interesting pod/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 02 20:25:33.832796 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:33.832765 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" podUID="7253333f-66a1-4b07-a7a5-89500054ba62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 02 20:25:34.833175 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:34.833134 2560 patch_prober.go:28] interesting pod/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 02 20:25:34.833603 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:34.833198 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" podUID="7253333f-66a1-4b07-a7a5-89500054ba62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 02 20:25:35.503750 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:35.503717 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4"] Jul 02 20:25:35.503985 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:35.503958 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" podUID="21581dc3-7886-4188-879d-ad4e94f371fb" containerName="istio-proxy" containerID="cri-o://728e8c65ab328ccf2a3c88ba91d11acb1a76728004eb08c7ce826af998f1e3c2" gracePeriod=30 Jul 02 20:25:35.833167 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:35.833080 2560 patch_prober.go:28] interesting pod/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 02 20:25:35.833167 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:35.833133 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" podUID="7253333f-66a1-4b07-a7a5-89500054ba62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 02 20:25:36.832813 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:36.832772 2560 patch_prober.go:28] interesting pod/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 02 20:25:36.833041 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:36.832853 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" podUID="7253333f-66a1-4b07-a7a5-89500054ba62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 02 20:25:37.836118 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:37.836088 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:37.836600 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:37.836460 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:37.837299 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:37.837279 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:40.566787 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.566755 2560 patch_prober.go:28] interesting pod/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 02 20:25:40.567162 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.566826 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" podUID="21581dc3-7886-4188-879d-ad4e94f371fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 02 20:25:40.762201 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.762181 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:40.845538 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.845473 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-workload-certs\") pod \"21581dc3-7886-4188-879d-ad4e94f371fb\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " Jul 02 20:25:40.845538 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.845504 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-istio-data\") pod \"21581dc3-7886-4188-879d-ad4e94f371fb\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " Jul 02 20:25:40.845703 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.845563 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbzdg\" (UniqueName: \"kubernetes.io/projected/21581dc3-7886-4188-879d-ad4e94f371fb-kube-api-access-wbzdg\") pod \"21581dc3-7886-4188-879d-ad4e94f371fb\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " Jul 02 20:25:40.845703 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.845582 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21581dc3-7886-4188-879d-ad4e94f371fb-istiod-ca-cert\") pod \"21581dc3-7886-4188-879d-ad4e94f371fb\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " Jul 02 20:25:40.845703 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.845639 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21581dc3-7886-4188-879d-ad4e94f371fb-istio-token\") pod \"21581dc3-7886-4188-879d-ad4e94f371fb\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " Jul 02 20:25:40.845703 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.845676 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-workload-socket\") pod \"21581dc3-7886-4188-879d-ad4e94f371fb\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " Jul 02 20:25:40.845910 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.845710 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-credential-socket\") pod \"21581dc3-7886-4188-879d-ad4e94f371fb\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " Jul 02 20:25:40.845910 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.845721 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "21581dc3-7886-4188-879d-ad4e94f371fb" (UID: "21581dc3-7886-4188-879d-ad4e94f371fb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:40.845910 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.845738 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-istio-envoy\") pod \"21581dc3-7886-4188-879d-ad4e94f371fb\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " Jul 02 20:25:40.845910 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.845777 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21581dc3-7886-4188-879d-ad4e94f371fb-istio-podinfo\") pod \"21581dc3-7886-4188-879d-ad4e94f371fb\" (UID: \"21581dc3-7886-4188-879d-ad4e94f371fb\") " Jul 02 20:25:40.846129 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.845995 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "21581dc3-7886-4188-879d-ad4e94f371fb" (UID: "21581dc3-7886-4188-879d-ad4e94f371fb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:40.846129 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.846020 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "21581dc3-7886-4188-879d-ad4e94f371fb" (UID: "21581dc3-7886-4188-879d-ad4e94f371fb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:40.846129 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.846065 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21581dc3-7886-4188-879d-ad4e94f371fb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "21581dc3-7886-4188-879d-ad4e94f371fb" (UID: "21581dc3-7886-4188-879d-ad4e94f371fb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:25:40.846310 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.846157 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-credential-socket\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:40.846310 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.846171 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-workload-certs\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:40.846310 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.846180 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21581dc3-7886-4188-879d-ad4e94f371fb-istiod-ca-cert\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:40.846310 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.846188 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-workload-socket\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:40.846533 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.846511 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-istio-data" (OuterVolumeSpecName: "istio-data") pod "21581dc3-7886-4188-879d-ad4e94f371fb" (UID: "21581dc3-7886-4188-879d-ad4e94f371fb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:40.847887 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.847852 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21581dc3-7886-4188-879d-ad4e94f371fb-istio-token" (OuterVolumeSpecName: "istio-token") pod "21581dc3-7886-4188-879d-ad4e94f371fb" (UID: "21581dc3-7886-4188-879d-ad4e94f371fb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:25:40.848015 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.847912 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/21581dc3-7886-4188-879d-ad4e94f371fb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "21581dc3-7886-4188-879d-ad4e94f371fb" (UID: "21581dc3-7886-4188-879d-ad4e94f371fb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:25:40.848219 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.848191 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21581dc3-7886-4188-879d-ad4e94f371fb-kube-api-access-wbzdg" (OuterVolumeSpecName: "kube-api-access-wbzdg") pod "21581dc3-7886-4188-879d-ad4e94f371fb" (UID: "21581dc3-7886-4188-879d-ad4e94f371fb"). InnerVolumeSpecName "kube-api-access-wbzdg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:25:40.848307 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.848223 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "21581dc3-7886-4188-879d-ad4e94f371fb" (UID: "21581dc3-7886-4188-879d-ad4e94f371fb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:40.947111 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.947085 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbzdg\" (UniqueName: \"kubernetes.io/projected/21581dc3-7886-4188-879d-ad4e94f371fb-kube-api-access-wbzdg\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:40.947111 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.947108 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21581dc3-7886-4188-879d-ad4e94f371fb-istio-token\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:40.947301 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.947117 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-istio-envoy\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:40.947301 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.947126 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21581dc3-7886-4188-879d-ad4e94f371fb-istio-podinfo\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:40.947301 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:40.947134 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21581dc3-7886-4188-879d-ad4e94f371fb-istio-data\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:41.255522 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:41.255486 2560 generic.go:356] "Generic (PLEG): container finished" podID="21581dc3-7886-4188-879d-ad4e94f371fb" containerID="728e8c65ab328ccf2a3c88ba91d11acb1a76728004eb08c7ce826af998f1e3c2" exitCode=0 Jul 02 20:25:41.255689 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:41.255535 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" Jul 02 20:25:41.255689 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:41.255571 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" event={"ID":"21581dc3-7886-4188-879d-ad4e94f371fb","Type":"ContainerDied","Data":"728e8c65ab328ccf2a3c88ba91d11acb1a76728004eb08c7ce826af998f1e3c2"} Jul 02 20:25:41.255689 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:41.255622 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4" event={"ID":"21581dc3-7886-4188-879d-ad4e94f371fb","Type":"ContainerDied","Data":"10c9624cb326dc85a0e2186494e4647e266eab0ed407612336d620c4e73b4166"} Jul 02 20:25:41.255689 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:41.255642 2560 scope.go:117] "RemoveContainer" containerID="728e8c65ab328ccf2a3c88ba91d11acb1a76728004eb08c7ce826af998f1e3c2" Jul 02 20:25:41.265934 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:41.265919 2560 scope.go:117] "RemoveContainer" containerID="982e4a629d058f8ef7bc165461581c079fb10dece8a780cb416c87fd81ff355d" Jul 02 20:25:41.274018 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:41.274000 2560 scope.go:117] "RemoveContainer" containerID="728e8c65ab328ccf2a3c88ba91d11acb1a76728004eb08c7ce826af998f1e3c2" Jul 02 20:25:41.274261 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:25:41.274229 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"728e8c65ab328ccf2a3c88ba91d11acb1a76728004eb08c7ce826af998f1e3c2\": container with ID starting with 728e8c65ab328ccf2a3c88ba91d11acb1a76728004eb08c7ce826af998f1e3c2 not found: ID does not exist" containerID="728e8c65ab328ccf2a3c88ba91d11acb1a76728004eb08c7ce826af998f1e3c2" Jul 02 20:25:41.274314 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:41.274279 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"728e8c65ab328ccf2a3c88ba91d11acb1a76728004eb08c7ce826af998f1e3c2"} err="failed to get container status \"728e8c65ab328ccf2a3c88ba91d11acb1a76728004eb08c7ce826af998f1e3c2\": rpc error: code = NotFound desc = could not find container \"728e8c65ab328ccf2a3c88ba91d11acb1a76728004eb08c7ce826af998f1e3c2\": container with ID starting with 728e8c65ab328ccf2a3c88ba91d11acb1a76728004eb08c7ce826af998f1e3c2 not found: ID does not exist" Jul 02 20:25:41.274314 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:41.274296 2560 scope.go:117] "RemoveContainer" containerID="982e4a629d058f8ef7bc165461581c079fb10dece8a780cb416c87fd81ff355d" Jul 02 20:25:41.274564 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:25:41.274546 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"982e4a629d058f8ef7bc165461581c079fb10dece8a780cb416c87fd81ff355d\": container with ID starting with 982e4a629d058f8ef7bc165461581c079fb10dece8a780cb416c87fd81ff355d not found: ID does not exist" containerID="982e4a629d058f8ef7bc165461581c079fb10dece8a780cb416c87fd81ff355d" Jul 02 20:25:41.274618 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:41.274568 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"982e4a629d058f8ef7bc165461581c079fb10dece8a780cb416c87fd81ff355d"} err="failed to get container status \"982e4a629d058f8ef7bc165461581c079fb10dece8a780cb416c87fd81ff355d\": rpc error: code = NotFound desc = could not find container \"982e4a629d058f8ef7bc165461581c079fb10dece8a780cb416c87fd81ff355d\": container with ID starting with 982e4a629d058f8ef7bc165461581c079fb10dece8a780cb416c87fd81ff355d not found: ID does not exist" Jul 02 20:25:41.279489 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:41.279469 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4"] Jul 02 20:25:41.283589 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:41.283569 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-91e0dd-openshift-default-564b7fc8df-fplk4"] Jul 02 20:25:41.933977 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:41.933943 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21581dc3-7886-4188-879d-ad4e94f371fb" path="/var/lib/kubelet/pods/21581dc3-7886-4188-879d-ad4e94f371fb/volumes" Jul 02 20:25:42.439286 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:42.439236 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk"] Jul 02 20:25:42.439487 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:42.439465 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" podUID="7253333f-66a1-4b07-a7a5-89500054ba62" containerName="istio-proxy" containerID="cri-o://671c6172bb5c6c4e63835f65aa89a9b8f1376021e42a3b1f1f652cc5f69a5add" gracePeriod=30 Jul 02 20:25:43.376512 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.376475 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd"] Jul 02 20:25:43.377082 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.377059 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21581dc3-7886-4188-879d-ad4e94f371fb" containerName="istio-proxy" Jul 02 20:25:43.377161 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.377087 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="21581dc3-7886-4188-879d-ad4e94f371fb" containerName="istio-proxy" Jul 02 20:25:43.377161 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.377110 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21581dc3-7886-4188-879d-ad4e94f371fb" containerName="istio-proxy" Jul 02 20:25:43.377161 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.377119 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="21581dc3-7886-4188-879d-ad4e94f371fb" containerName="istio-proxy" Jul 02 20:25:43.377354 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.377229 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="21581dc3-7886-4188-879d-ad4e94f371fb" containerName="istio-proxy" Jul 02 20:25:43.377354 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.377273 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="95b5e8ba-b1d3-4287-8e21-ebabd224ff6f" containerName="istio-proxy" Jul 02 20:25:43.380499 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.380477 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.383208 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.383186 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-3136f3-openshift-default-dockercfg-wqldm\"" Jul 02 20:25:43.391573 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.391548 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd"] Jul 02 20:25:43.473276 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.473207 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-credential-socket\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.473470 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.473385 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-istio-data\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.473470 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.473418 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13899467-9e81-4837-bea0-b57ea05aaf37-istiod-ca-cert\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.473566 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.473516 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-istio-envoy\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.473566 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.473549 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13899467-9e81-4837-bea0-b57ea05aaf37-istio-podinfo\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.473675 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.473636 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-workload-certs\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.473730 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.473696 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htbpb\" (UniqueName: \"kubernetes.io/projected/13899467-9e81-4837-bea0-b57ea05aaf37-kube-api-access-htbpb\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.473787 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.473743 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-workload-socket\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.473787 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.473771 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13899467-9e81-4837-bea0-b57ea05aaf37-istio-token\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.574285 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.574231 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-workload-socket\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.574285 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.574288 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13899467-9e81-4837-bea0-b57ea05aaf37-istio-token\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.574552 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.574326 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-credential-socket\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.574552 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.574358 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-istio-data\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.574552 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.574380 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13899467-9e81-4837-bea0-b57ea05aaf37-istiod-ca-cert\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.574552 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.574440 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-istio-envoy\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.574552 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.574468 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13899467-9e81-4837-bea0-b57ea05aaf37-istio-podinfo\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.574552 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.574529 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-workload-certs\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.574889 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.574563 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htbpb\" (UniqueName: \"kubernetes.io/projected/13899467-9e81-4837-bea0-b57ea05aaf37-kube-api-access-htbpb\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.574889 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.574665 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-workload-socket\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.574889 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.574674 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-credential-socket\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.575035 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.574942 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-istio-data\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.575035 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.575002 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-workload-certs\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.575185 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.575165 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13899467-9e81-4837-bea0-b57ea05aaf37-istiod-ca-cert\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.576923 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.576904 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-istio-envoy\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.577073 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.577055 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13899467-9e81-4837-bea0-b57ea05aaf37-istio-podinfo\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.583686 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.583667 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13899467-9e81-4837-bea0-b57ea05aaf37-istio-token\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.583778 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.583695 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htbpb\" (UniqueName: \"kubernetes.io/projected/13899467-9e81-4837-bea0-b57ea05aaf37-kube-api-access-htbpb\") pod \"e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.691066 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.690969 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:43.862115 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.862089 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd"] Jul 02 20:25:43.863644 ip-10-0-137-196 kubenswrapper[2560]: W0702 20:25:43.863619 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13899467_9e81_4837_bea0_b57ea05aaf37.slice/crio-4b8842a03c6dc4d7f236ed5919636e40ac336f54ad6d9d35e9b54d24bb06e741 WatchSource:0}: Error finding container 4b8842a03c6dc4d7f236ed5919636e40ac336f54ad6d9d35e9b54d24bb06e741: Status 404 returned error can't find the container with id 4b8842a03c6dc4d7f236ed5919636e40ac336f54ad6d9d35e9b54d24bb06e741 Jul 02 20:25:43.865764 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.865730 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:43.865873 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.865808 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:43.865873 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:43.865853 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:44.283648 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:44.283610 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" event={"ID":"13899467-9e81-4837-bea0-b57ea05aaf37","Type":"ContainerStarted","Data":"664fffdb7083bc8943a80eb5ab1650db5f956944244396d91fd0dd9eaa46cb4a"} Jul 02 20:25:44.283850 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:44.283668 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" event={"ID":"13899467-9e81-4837-bea0-b57ea05aaf37","Type":"ContainerStarted","Data":"4b8842a03c6dc4d7f236ed5919636e40ac336f54ad6d9d35e9b54d24bb06e741"} Jul 02 20:25:44.309559 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:44.309513 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" podStartSLOduration=1.309498262 podStartE2EDuration="1.309498262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:25:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:25:44.306451057 +0000 UTC m=+2092.876055127" watchObservedRunningTime="2026-07-02 20:25:44.309498262 +0000 UTC m=+2092.879102333" Jul 02 20:25:44.691182 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:44.691100 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:44.695816 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:44.695793 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:45.289955 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:45.289924 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:45.290921 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:45.290898 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:25:47.692689 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.692665 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:47.713638 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.713616 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-workload-certs\") pod \"7253333f-66a1-4b07-a7a5-89500054ba62\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " Jul 02 20:25:47.713795 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.713699 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-istio-data\") pod \"7253333f-66a1-4b07-a7a5-89500054ba62\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " Jul 02 20:25:47.713795 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.713727 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7253333f-66a1-4b07-a7a5-89500054ba62-istio-podinfo\") pod \"7253333f-66a1-4b07-a7a5-89500054ba62\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " Jul 02 20:25:47.713795 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.713760 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7253333f-66a1-4b07-a7a5-89500054ba62-istiod-ca-cert\") pod \"7253333f-66a1-4b07-a7a5-89500054ba62\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " Jul 02 20:25:47.713962 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.713799 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7253333f-66a1-4b07-a7a5-89500054ba62-istio-token\") pod \"7253333f-66a1-4b07-a7a5-89500054ba62\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " Jul 02 20:25:47.713962 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.713820 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-workload-socket\") pod \"7253333f-66a1-4b07-a7a5-89500054ba62\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " Jul 02 20:25:47.713962 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.713841 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-credential-socket\") pod \"7253333f-66a1-4b07-a7a5-89500054ba62\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " Jul 02 20:25:47.713962 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.713864 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-istio-envoy\") pod \"7253333f-66a1-4b07-a7a5-89500054ba62\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " Jul 02 20:25:47.713962 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.713899 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdjfz\" (UniqueName: \"kubernetes.io/projected/7253333f-66a1-4b07-a7a5-89500054ba62-kube-api-access-wdjfz\") pod \"7253333f-66a1-4b07-a7a5-89500054ba62\" (UID: \"7253333f-66a1-4b07-a7a5-89500054ba62\") " Jul 02 20:25:47.713962 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.713901 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7253333f-66a1-4b07-a7a5-89500054ba62" (UID: "7253333f-66a1-4b07-a7a5-89500054ba62"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:47.714676 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.714140 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7253333f-66a1-4b07-a7a5-89500054ba62" (UID: "7253333f-66a1-4b07-a7a5-89500054ba62"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:47.714676 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.714198 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-workload-certs\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:47.714676 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.714274 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7253333f-66a1-4b07-a7a5-89500054ba62-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7253333f-66a1-4b07-a7a5-89500054ba62" (UID: "7253333f-66a1-4b07-a7a5-89500054ba62"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:25:47.714676 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.714441 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7253333f-66a1-4b07-a7a5-89500054ba62" (UID: "7253333f-66a1-4b07-a7a5-89500054ba62"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:47.715043 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.714896 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-istio-data" (OuterVolumeSpecName: "istio-data") pod "7253333f-66a1-4b07-a7a5-89500054ba62" (UID: "7253333f-66a1-4b07-a7a5-89500054ba62"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:47.716014 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.715971 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7253333f-66a1-4b07-a7a5-89500054ba62-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7253333f-66a1-4b07-a7a5-89500054ba62" (UID: "7253333f-66a1-4b07-a7a5-89500054ba62"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:25:47.716214 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.716187 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7253333f-66a1-4b07-a7a5-89500054ba62" (UID: "7253333f-66a1-4b07-a7a5-89500054ba62"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:47.716410 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.716392 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7253333f-66a1-4b07-a7a5-89500054ba62-istio-token" (OuterVolumeSpecName: "istio-token") pod "7253333f-66a1-4b07-a7a5-89500054ba62" (UID: "7253333f-66a1-4b07-a7a5-89500054ba62"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:25:47.716459 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.716434 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7253333f-66a1-4b07-a7a5-89500054ba62-kube-api-access-wdjfz" (OuterVolumeSpecName: "kube-api-access-wdjfz") pod "7253333f-66a1-4b07-a7a5-89500054ba62" (UID: "7253333f-66a1-4b07-a7a5-89500054ba62"). InnerVolumeSpecName "kube-api-access-wdjfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:25:47.814721 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.814680 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdjfz\" (UniqueName: \"kubernetes.io/projected/7253333f-66a1-4b07-a7a5-89500054ba62-kube-api-access-wdjfz\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:47.814721 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.814716 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-istio-data\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:47.814721 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.814725 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7253333f-66a1-4b07-a7a5-89500054ba62-istio-podinfo\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:47.814961 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.814734 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7253333f-66a1-4b07-a7a5-89500054ba62-istiod-ca-cert\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:47.814961 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.814742 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7253333f-66a1-4b07-a7a5-89500054ba62-istio-token\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:47.814961 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.814750 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-workload-socket\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:47.814961 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.814769 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-credential-socket\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:47.814961 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:47.814778 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7253333f-66a1-4b07-a7a5-89500054ba62-istio-envoy\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:25:48.309352 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:48.309316 2560 generic.go:356] "Generic (PLEG): container finished" podID="7253333f-66a1-4b07-a7a5-89500054ba62" containerID="671c6172bb5c6c4e63835f65aa89a9b8f1376021e42a3b1f1f652cc5f69a5add" exitCode=0 Jul 02 20:25:48.309537 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:48.309371 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" Jul 02 20:25:48.309537 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:48.309395 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" event={"ID":"7253333f-66a1-4b07-a7a5-89500054ba62","Type":"ContainerDied","Data":"671c6172bb5c6c4e63835f65aa89a9b8f1376021e42a3b1f1f652cc5f69a5add"} Jul 02 20:25:48.309537 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:48.309463 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk" event={"ID":"7253333f-66a1-4b07-a7a5-89500054ba62","Type":"ContainerDied","Data":"d0c250b1ed3b5d6d14174c81ad1653e24e4a4fd5553db5f2ccde7f186e7c599f"} Jul 02 20:25:48.309537 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:48.309487 2560 scope.go:117] "RemoveContainer" containerID="671c6172bb5c6c4e63835f65aa89a9b8f1376021e42a3b1f1f652cc5f69a5add" Jul 02 20:25:48.319207 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:48.319189 2560 scope.go:117] "RemoveContainer" containerID="6615d12afd6478acd6e0844655562625455e02712d8bbe0e06ddf36b26719611" Jul 02 20:25:48.327466 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:48.327444 2560 scope.go:117] "RemoveContainer" containerID="671c6172bb5c6c4e63835f65aa89a9b8f1376021e42a3b1f1f652cc5f69a5add" Jul 02 20:25:48.327716 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:25:48.327698 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"671c6172bb5c6c4e63835f65aa89a9b8f1376021e42a3b1f1f652cc5f69a5add\": container with ID starting with 671c6172bb5c6c4e63835f65aa89a9b8f1376021e42a3b1f1f652cc5f69a5add not found: ID does not exist" containerID="671c6172bb5c6c4e63835f65aa89a9b8f1376021e42a3b1f1f652cc5f69a5add" Jul 02 20:25:48.327767 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:48.327725 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"671c6172bb5c6c4e63835f65aa89a9b8f1376021e42a3b1f1f652cc5f69a5add"} err="failed to get container status \"671c6172bb5c6c4e63835f65aa89a9b8f1376021e42a3b1f1f652cc5f69a5add\": rpc error: code = NotFound desc = could not find container \"671c6172bb5c6c4e63835f65aa89a9b8f1376021e42a3b1f1f652cc5f69a5add\": container with ID starting with 671c6172bb5c6c4e63835f65aa89a9b8f1376021e42a3b1f1f652cc5f69a5add not found: ID does not exist" Jul 02 20:25:48.327767 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:48.327742 2560 scope.go:117] "RemoveContainer" containerID="6615d12afd6478acd6e0844655562625455e02712d8bbe0e06ddf36b26719611" Jul 02 20:25:48.327958 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:25:48.327939 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6615d12afd6478acd6e0844655562625455e02712d8bbe0e06ddf36b26719611\": container with ID starting with 6615d12afd6478acd6e0844655562625455e02712d8bbe0e06ddf36b26719611 not found: ID does not exist" containerID="6615d12afd6478acd6e0844655562625455e02712d8bbe0e06ddf36b26719611" Jul 02 20:25:48.328000 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:48.327966 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6615d12afd6478acd6e0844655562625455e02712d8bbe0e06ddf36b26719611"} err="failed to get container status \"6615d12afd6478acd6e0844655562625455e02712d8bbe0e06ddf36b26719611\": rpc error: code = NotFound desc = could not find container \"6615d12afd6478acd6e0844655562625455e02712d8bbe0e06ddf36b26719611\": container with ID starting with 6615d12afd6478acd6e0844655562625455e02712d8bbe0e06ddf36b26719611 not found: ID does not exist" Jul 02 20:25:48.336108 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:48.336089 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk"] Jul 02 20:25:48.340796 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:48.340775 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-58953a-openshift-default-7c48cc79dc-t8mhk"] Jul 02 20:25:49.934647 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:49.934611 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7253333f-66a1-4b07-a7a5-89500054ba62" path="/var/lib/kubelet/pods/7253333f-66a1-4b07-a7a5-89500054ba62/volumes" Jul 02 20:25:51.588834 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.588801 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk"] Jul 02 20:25:51.589277 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.589197 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7253333f-66a1-4b07-a7a5-89500054ba62" containerName="istio-proxy" Jul 02 20:25:51.589277 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.589209 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7253333f-66a1-4b07-a7a5-89500054ba62" containerName="istio-proxy" Jul 02 20:25:51.589277 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.589220 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7253333f-66a1-4b07-a7a5-89500054ba62" containerName="istio-proxy" Jul 02 20:25:51.589277 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.589225 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7253333f-66a1-4b07-a7a5-89500054ba62" containerName="istio-proxy" Jul 02 20:25:51.589474 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.589336 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7253333f-66a1-4b07-a7a5-89500054ba62" containerName="istio-proxy" Jul 02 20:25:51.589474 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.589354 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="21581dc3-7886-4188-879d-ad4e94f371fb" containerName="istio-proxy" Jul 02 20:25:51.592680 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.592659 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.595477 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.595460 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-c7f980-openshift-default-dockercfg-4w5xx\"" Jul 02 20:25:51.604853 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.604833 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk"] Jul 02 20:25:51.645046 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.645020 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-data\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.645178 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.645062 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-podinfo\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.645178 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.645084 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istiod-ca-cert\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.645178 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.645157 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-credential-socket\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.645412 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.645195 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-workload-socket\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.645412 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.645223 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-envoy\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.645412 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.645282 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-token\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.645412 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.645336 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-workload-certs\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.645412 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.645387 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58s29\" (UniqueName: \"kubernetes.io/projected/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-kube-api-access-58s29\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.746140 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.746109 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-podinfo\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.746140 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.746144 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istiod-ca-cert\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.746401 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.746165 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-credential-socket\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.746401 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.746189 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-workload-socket\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.746401 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.746279 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-envoy\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.746401 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.746310 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-token\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.746401 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.746349 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-workload-certs\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.746674 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.746426 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58s29\" (UniqueName: \"kubernetes.io/projected/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-kube-api-access-58s29\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.746674 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.746544 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-data\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.746674 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.746582 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-credential-socket\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.746674 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.746611 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-workload-socket\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.746674 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.746632 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-workload-certs\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.746965 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.746829 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-data\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.747065 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.747043 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istiod-ca-cert\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.748604 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.748580 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-envoy\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.748704 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.748672 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-podinfo\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.754222 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.754204 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-token\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.754596 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.754579 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58s29\" (UniqueName: \"kubernetes.io/projected/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-kube-api-access-58s29\") pod \"e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:51.906117 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.906046 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-c7f980-openshift-default-dockercfg-4w5xx\"" Jul 02 20:25:51.914153 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:51.914132 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:52.055108 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:52.055077 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk"] Jul 02 20:25:52.055354 ip-10-0-137-196 kubenswrapper[2560]: W0702 20:25:52.055324 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode91398b6_50e5_4f01_b22f_273b2b9a6ea0.slice/crio-30946ffa270479bf8a0b301939c09b5e78aba665f3d1b955c1cf923f8f2d86d3 WatchSource:0}: Error finding container 30946ffa270479bf8a0b301939c09b5e78aba665f3d1b955c1cf923f8f2d86d3: Status 404 returned error can't find the container with id 30946ffa270479bf8a0b301939c09b5e78aba665f3d1b955c1cf923f8f2d86d3 Jul 02 20:25:52.057786 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:52.057741 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:52.057881 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:52.057820 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:52.057940 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:52.057880 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:52.058513 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:52.058493 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/1.log" Jul 02 20:25:52.061497 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:52.061480 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tkp7w_72996a08-b83d-4d1b-99c6-780e15c6722a/ovn-acl-logging/0.log" Jul 02 20:25:52.066990 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:52.066975 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/1.log" Jul 02 20:25:52.069889 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:52.069875 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tkp7w_72996a08-b83d-4d1b-99c6-780e15c6722a/ovn-acl-logging/0.log" Jul 02 20:25:52.335027 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:52.334992 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" event={"ID":"e91398b6-50e5-4f01-b22f-273b2b9a6ea0","Type":"ContainerStarted","Data":"e01250593bf2786ddc8c10d875b24f8653e6b7fef8f4966a8feba5087b305d49"} Jul 02 20:25:52.335180 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:52.335056 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" event={"ID":"e91398b6-50e5-4f01-b22f-273b2b9a6ea0","Type":"ContainerStarted","Data":"30946ffa270479bf8a0b301939c09b5e78aba665f3d1b955c1cf923f8f2d86d3"} Jul 02 20:25:52.357298 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:52.357217 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" podStartSLOduration=1.357196458 podStartE2EDuration="1.357196458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:25:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:25:52.354492853 +0000 UTC m=+2100.924096924" watchObservedRunningTime="2026-07-02 20:25:52.357196458 +0000 UTC m=+2100.926800529" Jul 02 20:25:52.914591 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:52.914554 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:53.920115 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:53.920082 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:54.355628 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:54.355584 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:54.358046 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:54.358002 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:25:59.391640 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:59.391526 2560 generic.go:356] "Generic (PLEG): container finished" podID="13899467-9e81-4837-bea0-b57ea05aaf37" containerID="664fffdb7083bc8943a80eb5ab1650db5f956944244396d91fd0dd9eaa46cb4a" exitCode=0 Jul 02 20:25:59.391640 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:59.391575 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" event={"ID":"13899467-9e81-4837-bea0-b57ea05aaf37","Type":"ContainerDied","Data":"664fffdb7083bc8943a80eb5ab1650db5f956944244396d91fd0dd9eaa46cb4a"} Jul 02 20:25:59.392208 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:59.392061 2560 scope.go:117] "RemoveContainer" containerID="664fffdb7083bc8943a80eb5ab1650db5f956944244396d91fd0dd9eaa46cb4a" Jul 02 20:25:59.393114 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:59.393080 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:59.393219 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:59.393152 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:59.393219 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:25:59.393187 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:26:00.290310 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:00.290276 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:26:00.405269 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:00.405214 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" event={"ID":"13899467-9e81-4837-bea0-b57ea05aaf37","Type":"ContainerStarted","Data":"fcadaaaf9de628a811d46fbeb892288e2ac73db90d4d50576b36bd042abeccfc"} Jul 02 20:26:00.691870 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:00.691776 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:26:00.693072 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:00.693045 2560 patch_prober.go:28] interesting pod/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 02 20:26:00.693187 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:00.693095 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" podUID="13899467-9e81-4837-bea0-b57ea05aaf37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 02 20:26:01.692227 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:01.692190 2560 patch_prober.go:28] interesting pod/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 02 20:26:01.692751 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:01.692366 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" podUID="13899467-9e81-4837-bea0-b57ea05aaf37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 02 20:26:02.691476 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:02.691442 2560 patch_prober.go:28] interesting pod/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 02 20:26:02.691656 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:02.691510 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" podUID="13899467-9e81-4837-bea0-b57ea05aaf37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 02 20:26:03.692270 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:03.692216 2560 patch_prober.go:28] interesting pod/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 02 20:26:03.692663 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:03.692302 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" podUID="13899467-9e81-4837-bea0-b57ea05aaf37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 02 20:26:04.696268 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:04.696223 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:26:04.696646 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:04.696515 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:26:04.697347 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:04.697332 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:26:08.455719 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:08.455683 2560 generic.go:356] "Generic (PLEG): container finished" podID="e91398b6-50e5-4f01-b22f-273b2b9a6ea0" containerID="e01250593bf2786ddc8c10d875b24f8653e6b7fef8f4966a8feba5087b305d49" exitCode=0 Jul 02 20:26:08.456176 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:08.455748 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" event={"ID":"e91398b6-50e5-4f01-b22f-273b2b9a6ea0","Type":"ContainerDied","Data":"e01250593bf2786ddc8c10d875b24f8653e6b7fef8f4966a8feba5087b305d49"} Jul 02 20:26:08.456176 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:08.456125 2560 scope.go:117] "RemoveContainer" containerID="e01250593bf2786ddc8c10d875b24f8653e6b7fef8f4966a8feba5087b305d49" Jul 02 20:26:08.457131 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:08.457098 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:26:08.457231 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:08.457183 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:26:08.457317 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:08.457233 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:26:09.355639 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:09.355598 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:26:09.465579 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:09.465550 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" event={"ID":"e91398b6-50e5-4f01-b22f-273b2b9a6ea0","Type":"ContainerStarted","Data":"3c676d5453ca6617043e50fd45da74bceb94ca38900581ab01a217d35417bb76"} Jul 02 20:26:09.915238 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:09.915192 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:26:09.916593 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:09.916568 2560 patch_prober.go:28] interesting pod/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 02 20:26:09.916719 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:09.916617 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" podUID="e91398b6-50e5-4f01-b22f-273b2b9a6ea0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 02 20:26:10.914934 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:10.914897 2560 patch_prober.go:28] interesting pod/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 02 20:26:10.915345 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:10.914954 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" podUID="e91398b6-50e5-4f01-b22f-273b2b9a6ea0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 02 20:26:11.915582 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:11.915546 2560 patch_prober.go:28] interesting pod/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 02 20:26:11.915992 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:11.915609 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" podUID="e91398b6-50e5-4f01-b22f-273b2b9a6ea0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 02 20:26:12.914620 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:12.914584 2560 patch_prober.go:28] interesting pod/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 02 20:26:12.914798 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:12.914644 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" podUID="e91398b6-50e5-4f01-b22f-273b2b9a6ea0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 02 20:26:13.919081 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:13.919048 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:26:13.919501 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:13.919362 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:26:13.919935 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:26:13.919916 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:30:00.132624 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.132534 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-3136f3-29717070-2mjdq"] Jul 02 20:30:00.133231 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.133212 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7253333f-66a1-4b07-a7a5-89500054ba62" containerName="istio-proxy" Jul 02 20:30:00.139459 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.139427 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29717070-7jn9q"] Jul 02 20:30:00.141115 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.141090 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-3136f3-29717070-2mjdq" Jul 02 20:30:00.144986 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.144954 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-m88m6\"" Jul 02 20:30:00.145305 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.145271 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-c7f980-29717070-lbwwz"] Jul 02 20:30:00.146582 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.146557 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717070-7jn9q" Jul 02 20:30:00.149504 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.149157 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717070-7jn9q"] Jul 02 20:30:00.149697 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.149674 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-c7f980-29717070-lbwwz" Jul 02 20:30:00.152953 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.152541 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-c7f980-29717070-lbwwz"] Jul 02 20:30:00.155854 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.155829 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-3136f3-29717070-2mjdq"] Jul 02 20:30:00.234276 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.234217 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kllk\" (UniqueName: \"kubernetes.io/projected/d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f-kube-api-access-8kllk\") pod \"maas-api-key-cleanup-29717070-7jn9q\" (UID: \"d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f\") " pod="opendatahub/maas-api-key-cleanup-29717070-7jn9q" Jul 02 20:30:00.234435 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.234335 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z26sk\" (UniqueName: \"kubernetes.io/projected/8f750160-497a-4ac5-825e-f7c044d5e03b-kube-api-access-z26sk\") pod \"maas-api-key-cleanup-e2e-shared-b-c7f980-29717070-lbwwz\" (UID: \"8f750160-497a-4ac5-825e-f7c044d5e03b\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-c7f980-29717070-lbwwz" Jul 02 20:30:00.234435 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.234399 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp7tk\" (UniqueName: \"kubernetes.io/projected/3cf8c155-aa6c-4546-b525-e30d0b22b6c3-kube-api-access-jp7tk\") pod \"maas-api-key-cleanup-e2e-shared-a-3136f3-29717070-2mjdq\" (UID: \"3cf8c155-aa6c-4546-b525-e30d0b22b6c3\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-3136f3-29717070-2mjdq" Jul 02 20:30:00.335111 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.335071 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp7tk\" (UniqueName: \"kubernetes.io/projected/3cf8c155-aa6c-4546-b525-e30d0b22b6c3-kube-api-access-jp7tk\") pod \"maas-api-key-cleanup-e2e-shared-a-3136f3-29717070-2mjdq\" (UID: \"3cf8c155-aa6c-4546-b525-e30d0b22b6c3\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-3136f3-29717070-2mjdq" Jul 02 20:30:00.335327 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.335128 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kllk\" (UniqueName: \"kubernetes.io/projected/d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f-kube-api-access-8kllk\") pod \"maas-api-key-cleanup-29717070-7jn9q\" (UID: \"d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f\") " pod="opendatahub/maas-api-key-cleanup-29717070-7jn9q" Jul 02 20:30:00.335327 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.335179 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z26sk\" (UniqueName: \"kubernetes.io/projected/8f750160-497a-4ac5-825e-f7c044d5e03b-kube-api-access-z26sk\") pod \"maas-api-key-cleanup-e2e-shared-b-c7f980-29717070-lbwwz\" (UID: \"8f750160-497a-4ac5-825e-f7c044d5e03b\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-c7f980-29717070-lbwwz" Jul 02 20:30:00.343915 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.343891 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kllk\" (UniqueName: \"kubernetes.io/projected/d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f-kube-api-access-8kllk\") pod \"maas-api-key-cleanup-29717070-7jn9q\" (UID: \"d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f\") " pod="opendatahub/maas-api-key-cleanup-29717070-7jn9q" Jul 02 20:30:00.344032 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.343950 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp7tk\" (UniqueName: \"kubernetes.io/projected/3cf8c155-aa6c-4546-b525-e30d0b22b6c3-kube-api-access-jp7tk\") pod \"maas-api-key-cleanup-e2e-shared-a-3136f3-29717070-2mjdq\" (UID: \"3cf8c155-aa6c-4546-b525-e30d0b22b6c3\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-3136f3-29717070-2mjdq" Jul 02 20:30:00.344073 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.344026 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z26sk\" (UniqueName: \"kubernetes.io/projected/8f750160-497a-4ac5-825e-f7c044d5e03b-kube-api-access-z26sk\") pod \"maas-api-key-cleanup-e2e-shared-b-c7f980-29717070-lbwwz\" (UID: \"8f750160-497a-4ac5-825e-f7c044d5e03b\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-c7f980-29717070-lbwwz" Jul 02 20:30:00.458975 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.458948 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-3136f3-29717070-2mjdq" Jul 02 20:30:00.467101 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.467083 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717070-7jn9q" Jul 02 20:30:00.474090 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.474066 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-c7f980-29717070-lbwwz" Jul 02 20:30:00.822891 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.822855 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-3136f3-29717070-2mjdq"] Jul 02 20:30:00.823959 ip-10-0-137-196 kubenswrapper[2560]: W0702 20:30:00.823933 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf8c155_aa6c_4546_b525_e30d0b22b6c3.slice/crio-402dd88670564a52d5caea627972a66073e2ae3a4b13edcf3973216caaabb736 WatchSource:0}: Error finding container 402dd88670564a52d5caea627972a66073e2ae3a4b13edcf3973216caaabb736: Status 404 returned error can't find the container with id 402dd88670564a52d5caea627972a66073e2ae3a4b13edcf3973216caaabb736 Jul 02 20:30:00.854379 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.854351 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-c7f980-29717070-lbwwz"] Jul 02 20:30:00.856875 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:00.856848 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717070-7jn9q"] Jul 02 20:30:00.866605 ip-10-0-137-196 kubenswrapper[2560]: W0702 20:30:00.866580 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f750160_497a_4ac5_825e_f7c044d5e03b.slice/crio-c19bb71c938fcc8229efae5d950c8c46612d8529f387713e9e5dd19ac80ec157 WatchSource:0}: Error finding container c19bb71c938fcc8229efae5d950c8c46612d8529f387713e9e5dd19ac80ec157: Status 404 returned error can't find the container with id c19bb71c938fcc8229efae5d950c8c46612d8529f387713e9e5dd19ac80ec157 Jul 02 20:30:00.866787 ip-10-0-137-196 kubenswrapper[2560]: W0702 20:30:00.866766 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8eaf45c_55e4_4aa5_9d8a_300fa1d0eb2f.slice/crio-12a62bbc149344f0fbab6e36cde5580d74d8a550304445aa4ba7179b4b4c3077 WatchSource:0}: Error finding container 12a62bbc149344f0fbab6e36cde5580d74d8a550304445aa4ba7179b4b4c3077: Status 404 returned error can't find the container with id 12a62bbc149344f0fbab6e36cde5580d74d8a550304445aa4ba7179b4b4c3077 Jul 02 20:30:01.773380 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:01.773339 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-c7f980-29717070-lbwwz" event={"ID":"8f750160-497a-4ac5-825e-f7c044d5e03b","Type":"ContainerStarted","Data":"4d5444f4c80566d50b4317d8b666276e5becd0c715f7b56bd2b1d625e8920333"} Jul 02 20:30:01.773848 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:01.773401 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-c7f980-29717070-lbwwz" event={"ID":"8f750160-497a-4ac5-825e-f7c044d5e03b","Type":"ContainerStarted","Data":"c19bb71c938fcc8229efae5d950c8c46612d8529f387713e9e5dd19ac80ec157"} Jul 02 20:30:01.774828 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:01.774800 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717070-7jn9q" event={"ID":"d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f","Type":"ContainerStarted","Data":"cb96ae4ca995c2cc7ad612184096f314498c745f5d58b25dcb67cc40e1b221d5"} Jul 02 20:30:01.774917 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:01.774844 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717070-7jn9q" event={"ID":"d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f","Type":"ContainerStarted","Data":"12a62bbc149344f0fbab6e36cde5580d74d8a550304445aa4ba7179b4b4c3077"} Jul 02 20:30:01.776280 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:01.776259 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-3136f3-29717070-2mjdq" event={"ID":"3cf8c155-aa6c-4546-b525-e30d0b22b6c3","Type":"ContainerStarted","Data":"873724058f957074605dde351bcc343c114105a47f84ea18a7bfd6730f3909a8"} Jul 02 20:30:01.776390 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:01.776306 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-3136f3-29717070-2mjdq" event={"ID":"3cf8c155-aa6c-4546-b525-e30d0b22b6c3","Type":"ContainerStarted","Data":"402dd88670564a52d5caea627972a66073e2ae3a4b13edcf3973216caaabb736"} Jul 02 20:30:01.790402 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:01.790358 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-c7f980-29717070-lbwwz" podStartSLOduration=1.7903442520000001 podStartE2EDuration="1.790344252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:30:01.788685754 +0000 UTC m=+2350.358289825" watchObservedRunningTime="2026-07-02 20:30:01.790344252 +0000 UTC m=+2350.359948321" Jul 02 20:30:01.805113 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:01.805064 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-3136f3-29717070-2mjdq" podStartSLOduration=1.805050004 podStartE2EDuration="1.805050004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:30:01.803740423 +0000 UTC m=+2350.373344494" watchObservedRunningTime="2026-07-02 20:30:01.805050004 +0000 UTC m=+2350.374654101" Jul 02 20:30:01.822388 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:01.822338 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29717070-7jn9q" podStartSLOduration=1.8223139590000001 podStartE2EDuration="1.822313959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:30:01.821165567 +0000 UTC m=+2350.390769640" watchObservedRunningTime="2026-07-02 20:30:01.822313959 +0000 UTC m=+2350.391918029" Jul 02 20:30:02.783735 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:02.783704 2560 generic.go:356] "Generic (PLEG): container finished" podID="d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f" containerID="cb96ae4ca995c2cc7ad612184096f314498c745f5d58b25dcb67cc40e1b221d5" exitCode=0 Jul 02 20:30:02.784158 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:02.783797 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717070-7jn9q" event={"ID":"d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f","Type":"ContainerDied","Data":"cb96ae4ca995c2cc7ad612184096f314498c745f5d58b25dcb67cc40e1b221d5"} Jul 02 20:30:02.785276 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:02.785233 2560 generic.go:356] "Generic (PLEG): container finished" podID="3cf8c155-aa6c-4546-b525-e30d0b22b6c3" containerID="873724058f957074605dde351bcc343c114105a47f84ea18a7bfd6730f3909a8" exitCode=0 Jul 02 20:30:02.785366 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:02.785277 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-3136f3-29717070-2mjdq" event={"ID":"3cf8c155-aa6c-4546-b525-e30d0b22b6c3","Type":"ContainerDied","Data":"873724058f957074605dde351bcc343c114105a47f84ea18a7bfd6730f3909a8"} Jul 02 20:30:02.786775 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:02.786754 2560 generic.go:356] "Generic (PLEG): container finished" podID="8f750160-497a-4ac5-825e-f7c044d5e03b" containerID="4d5444f4c80566d50b4317d8b666276e5becd0c715f7b56bd2b1d625e8920333" exitCode=0 Jul 02 20:30:02.786864 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:02.786778 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-c7f980-29717070-lbwwz" event={"ID":"8f750160-497a-4ac5-825e-f7c044d5e03b","Type":"ContainerDied","Data":"4d5444f4c80566d50b4317d8b666276e5becd0c715f7b56bd2b1d625e8920333"} Jul 02 20:30:03.954880 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:03.954850 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-c7f980-29717070-lbwwz" Jul 02 20:30:03.987754 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:03.987732 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-3136f3-29717070-2mjdq" Jul 02 20:30:03.991079 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:03.991061 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717070-7jn9q" Jul 02 20:30:04.069665 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:04.069571 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kllk\" (UniqueName: \"kubernetes.io/projected/d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f-kube-api-access-8kllk\") pod \"d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f\" (UID: \"d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f\") " Jul 02 20:30:04.069842 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:04.069704 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp7tk\" (UniqueName: \"kubernetes.io/projected/3cf8c155-aa6c-4546-b525-e30d0b22b6c3-kube-api-access-jp7tk\") pod \"3cf8c155-aa6c-4546-b525-e30d0b22b6c3\" (UID: \"3cf8c155-aa6c-4546-b525-e30d0b22b6c3\") " Jul 02 20:30:04.069842 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:04.069730 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z26sk\" (UniqueName: \"kubernetes.io/projected/8f750160-497a-4ac5-825e-f7c044d5e03b-kube-api-access-z26sk\") pod \"8f750160-497a-4ac5-825e-f7c044d5e03b\" (UID: \"8f750160-497a-4ac5-825e-f7c044d5e03b\") " Jul 02 20:30:04.071701 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:04.071665 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf8c155-aa6c-4546-b525-e30d0b22b6c3-kube-api-access-jp7tk" (OuterVolumeSpecName: "kube-api-access-jp7tk") pod "3cf8c155-aa6c-4546-b525-e30d0b22b6c3" (UID: "3cf8c155-aa6c-4546-b525-e30d0b22b6c3"). InnerVolumeSpecName "kube-api-access-jp7tk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:30:04.071701 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:04.071696 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f-kube-api-access-8kllk" (OuterVolumeSpecName: "kube-api-access-8kllk") pod "d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f" (UID: "d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f"). InnerVolumeSpecName "kube-api-access-8kllk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:30:04.071852 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:04.071716 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f750160-497a-4ac5-825e-f7c044d5e03b-kube-api-access-z26sk" (OuterVolumeSpecName: "kube-api-access-z26sk") pod "8f750160-497a-4ac5-825e-f7c044d5e03b" (UID: "8f750160-497a-4ac5-825e-f7c044d5e03b"). InnerVolumeSpecName "kube-api-access-z26sk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:30:04.170732 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:04.170694 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jp7tk\" (UniqueName: \"kubernetes.io/projected/3cf8c155-aa6c-4546-b525-e30d0b22b6c3-kube-api-access-jp7tk\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:30:04.170732 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:04.170727 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z26sk\" (UniqueName: \"kubernetes.io/projected/8f750160-497a-4ac5-825e-f7c044d5e03b-kube-api-access-z26sk\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:30:04.170732 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:04.170736 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kllk\" (UniqueName: \"kubernetes.io/projected/d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f-kube-api-access-8kllk\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:30:04.806207 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:04.806180 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-c7f980-29717070-lbwwz" Jul 02 20:30:04.806379 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:04.806218 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-c7f980-29717070-lbwwz" event={"ID":"8f750160-497a-4ac5-825e-f7c044d5e03b","Type":"ContainerDied","Data":"c19bb71c938fcc8229efae5d950c8c46612d8529f387713e9e5dd19ac80ec157"} Jul 02 20:30:04.806379 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:04.806289 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c19bb71c938fcc8229efae5d950c8c46612d8529f387713e9e5dd19ac80ec157" Jul 02 20:30:04.807578 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:04.807547 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717070-7jn9q" Jul 02 20:30:04.807578 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:04.807561 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717070-7jn9q" event={"ID":"d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f","Type":"ContainerDied","Data":"12a62bbc149344f0fbab6e36cde5580d74d8a550304445aa4ba7179b4b4c3077"} Jul 02 20:30:04.807807 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:04.807593 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12a62bbc149344f0fbab6e36cde5580d74d8a550304445aa4ba7179b4b4c3077" Jul 02 20:30:04.809033 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:04.809015 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-3136f3-29717070-2mjdq" Jul 02 20:30:04.809124 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:04.809048 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-3136f3-29717070-2mjdq" event={"ID":"3cf8c155-aa6c-4546-b525-e30d0b22b6c3","Type":"ContainerDied","Data":"402dd88670564a52d5caea627972a66073e2ae3a4b13edcf3973216caaabb736"} Jul 02 20:30:04.809124 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:04.809075 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="402dd88670564a52d5caea627972a66073e2ae3a4b13edcf3973216caaabb736" Jul 02 20:30:52.097760 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:52.097733 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/1.log" Jul 02 20:30:52.100738 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:52.100718 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tkp7w_72996a08-b83d-4d1b-99c6-780e15c6722a/ovn-acl-logging/0.log" Jul 02 20:30:52.106783 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:52.106762 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/1.log" Jul 02 20:30:52.109363 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:30:52.109347 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tkp7w_72996a08-b83d-4d1b-99c6-780e15c6722a/ovn-acl-logging/0.log" Jul 02 20:31:36.966142 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:31:36.966061 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-3136f3-29717070-2mjdq"] Jul 02 20:31:36.970456 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:31:36.970436 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-3136f3-29717070-2mjdq"] Jul 02 20:31:37.934527 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:31:37.934494 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cf8c155-aa6c-4546-b525-e30d0b22b6c3" path="/var/lib/kubelet/pods/3cf8c155-aa6c-4546-b525-e30d0b22b6c3/volumes" Jul 02 20:32:08.080828 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:08.080791 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd"] Jul 02 20:32:08.081354 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:08.081056 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" podUID="13899467-9e81-4837-bea0-b57ea05aaf37" containerName="istio-proxy" containerID="cri-o://fcadaaaf9de628a811d46fbeb892288e2ac73db90d4d50576b36bd042abeccfc" gracePeriod=30 Jul 02 20:32:09.507270 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:09.507223 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-c7f980-29717070-lbwwz"] Jul 02 20:32:09.509627 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:09.509604 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-c7f980-29717070-lbwwz"] Jul 02 20:32:09.935383 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:09.935284 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f750160-497a-4ac5-825e-f7c044d5e03b" path="/var/lib/kubelet/pods/8f750160-497a-4ac5-825e-f7c044d5e03b/volumes" Jul 02 20:32:13.345866 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.345807 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:32:13.352512 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.352490 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13899467-9e81-4837-bea0-b57ea05aaf37-istio-podinfo\") pod \"13899467-9e81-4837-bea0-b57ea05aaf37\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " Jul 02 20:32:13.352631 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.352527 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-workload-certs\") pod \"13899467-9e81-4837-bea0-b57ea05aaf37\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " Jul 02 20:32:13.352631 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.352548 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-credential-socket\") pod \"13899467-9e81-4837-bea0-b57ea05aaf37\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " Jul 02 20:32:13.352631 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.352575 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-istio-envoy\") pod \"13899467-9e81-4837-bea0-b57ea05aaf37\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " Jul 02 20:32:13.352631 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.352615 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-istio-data\") pod \"13899467-9e81-4837-bea0-b57ea05aaf37\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " Jul 02 20:32:13.352852 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.352658 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htbpb\" (UniqueName: \"kubernetes.io/projected/13899467-9e81-4837-bea0-b57ea05aaf37-kube-api-access-htbpb\") pod \"13899467-9e81-4837-bea0-b57ea05aaf37\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " Jul 02 20:32:13.352852 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.352692 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13899467-9e81-4837-bea0-b57ea05aaf37-istiod-ca-cert\") pod \"13899467-9e81-4837-bea0-b57ea05aaf37\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " Jul 02 20:32:13.352852 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.352711 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13899467-9e81-4837-bea0-b57ea05aaf37-istio-token\") pod \"13899467-9e81-4837-bea0-b57ea05aaf37\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " Jul 02 20:32:13.352852 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.352730 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "13899467-9e81-4837-bea0-b57ea05aaf37" (UID: "13899467-9e81-4837-bea0-b57ea05aaf37"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:32:13.353067 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.352940 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "13899467-9e81-4837-bea0-b57ea05aaf37" (UID: "13899467-9e81-4837-bea0-b57ea05aaf37"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:32:13.353067 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.352991 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-workload-socket\") pod \"13899467-9e81-4837-bea0-b57ea05aaf37\" (UID: \"13899467-9e81-4837-bea0-b57ea05aaf37\") " Jul 02 20:32:13.353067 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.353045 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13899467-9e81-4837-bea0-b57ea05aaf37-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "13899467-9e81-4837-bea0-b57ea05aaf37" (UID: "13899467-9e81-4837-bea0-b57ea05aaf37"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:32:13.353355 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.353338 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13899467-9e81-4837-bea0-b57ea05aaf37-istiod-ca-cert\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:32:13.353447 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.353358 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-workload-certs\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:32:13.353447 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.353371 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-credential-socket\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:32:13.353568 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.353481 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "13899467-9e81-4837-bea0-b57ea05aaf37" (UID: "13899467-9e81-4837-bea0-b57ea05aaf37"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:32:13.353624 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.353563 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-istio-data" (OuterVolumeSpecName: "istio-data") pod "13899467-9e81-4837-bea0-b57ea05aaf37" (UID: "13899467-9e81-4837-bea0-b57ea05aaf37"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:32:13.354781 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.354764 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/13899467-9e81-4837-bea0-b57ea05aaf37-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "13899467-9e81-4837-bea0-b57ea05aaf37" (UID: "13899467-9e81-4837-bea0-b57ea05aaf37"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:32:13.354866 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.354857 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "13899467-9e81-4837-bea0-b57ea05aaf37" (UID: "13899467-9e81-4837-bea0-b57ea05aaf37"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:32:13.355283 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.355237 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13899467-9e81-4837-bea0-b57ea05aaf37-kube-api-access-htbpb" (OuterVolumeSpecName: "kube-api-access-htbpb") pod "13899467-9e81-4837-bea0-b57ea05aaf37" (UID: "13899467-9e81-4837-bea0-b57ea05aaf37"). InnerVolumeSpecName "kube-api-access-htbpb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:32:13.355397 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.355281 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13899467-9e81-4837-bea0-b57ea05aaf37-istio-token" (OuterVolumeSpecName: "istio-token") pod "13899467-9e81-4837-bea0-b57ea05aaf37" (UID: "13899467-9e81-4837-bea0-b57ea05aaf37"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:32:13.454119 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.454083 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-istio-data\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:32:13.454119 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.454113 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htbpb\" (UniqueName: \"kubernetes.io/projected/13899467-9e81-4837-bea0-b57ea05aaf37-kube-api-access-htbpb\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:32:13.454119 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.454123 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13899467-9e81-4837-bea0-b57ea05aaf37-istio-token\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:32:13.454394 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.454131 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-workload-socket\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:32:13.454394 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.454140 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13899467-9e81-4837-bea0-b57ea05aaf37-istio-podinfo\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:32:13.454394 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.454149 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13899467-9e81-4837-bea0-b57ea05aaf37-istio-envoy\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:32:13.541824 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.541787 2560 generic.go:356] "Generic (PLEG): container finished" podID="13899467-9e81-4837-bea0-b57ea05aaf37" containerID="fcadaaaf9de628a811d46fbeb892288e2ac73db90d4d50576b36bd042abeccfc" exitCode=0 Jul 02 20:32:13.541975 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.541832 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" Jul 02 20:32:13.541975 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.541874 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" event={"ID":"13899467-9e81-4837-bea0-b57ea05aaf37","Type":"ContainerDied","Data":"fcadaaaf9de628a811d46fbeb892288e2ac73db90d4d50576b36bd042abeccfc"} Jul 02 20:32:13.541975 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.541927 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd" event={"ID":"13899467-9e81-4837-bea0-b57ea05aaf37","Type":"ContainerDied","Data":"4b8842a03c6dc4d7f236ed5919636e40ac336f54ad6d9d35e9b54d24bb06e741"} Jul 02 20:32:13.541975 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.541953 2560 scope.go:117] "RemoveContainer" containerID="fcadaaaf9de628a811d46fbeb892288e2ac73db90d4d50576b36bd042abeccfc" Jul 02 20:32:13.552141 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.552122 2560 scope.go:117] "RemoveContainer" containerID="664fffdb7083bc8943a80eb5ab1650db5f956944244396d91fd0dd9eaa46cb4a" Jul 02 20:32:13.564508 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.564491 2560 scope.go:117] "RemoveContainer" containerID="fcadaaaf9de628a811d46fbeb892288e2ac73db90d4d50576b36bd042abeccfc" Jul 02 20:32:13.564818 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:32:13.564798 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcadaaaf9de628a811d46fbeb892288e2ac73db90d4d50576b36bd042abeccfc\": container with ID starting with fcadaaaf9de628a811d46fbeb892288e2ac73db90d4d50576b36bd042abeccfc not found: ID does not exist" containerID="fcadaaaf9de628a811d46fbeb892288e2ac73db90d4d50576b36bd042abeccfc" Jul 02 20:32:13.564895 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.564826 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcadaaaf9de628a811d46fbeb892288e2ac73db90d4d50576b36bd042abeccfc"} err="failed to get container status \"fcadaaaf9de628a811d46fbeb892288e2ac73db90d4d50576b36bd042abeccfc\": rpc error: code = NotFound desc = could not find container \"fcadaaaf9de628a811d46fbeb892288e2ac73db90d4d50576b36bd042abeccfc\": container with ID starting with fcadaaaf9de628a811d46fbeb892288e2ac73db90d4d50576b36bd042abeccfc not found: ID does not exist" Jul 02 20:32:13.564895 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.564848 2560 scope.go:117] "RemoveContainer" containerID="664fffdb7083bc8943a80eb5ab1650db5f956944244396d91fd0dd9eaa46cb4a" Jul 02 20:32:13.565104 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:32:13.565086 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"664fffdb7083bc8943a80eb5ab1650db5f956944244396d91fd0dd9eaa46cb4a\": container with ID starting with 664fffdb7083bc8943a80eb5ab1650db5f956944244396d91fd0dd9eaa46cb4a not found: ID does not exist" containerID="664fffdb7083bc8943a80eb5ab1650db5f956944244396d91fd0dd9eaa46cb4a" Jul 02 20:32:13.565144 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.565112 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"664fffdb7083bc8943a80eb5ab1650db5f956944244396d91fd0dd9eaa46cb4a"} err="failed to get container status \"664fffdb7083bc8943a80eb5ab1650db5f956944244396d91fd0dd9eaa46cb4a\": rpc error: code = NotFound desc = could not find container \"664fffdb7083bc8943a80eb5ab1650db5f956944244396d91fd0dd9eaa46cb4a\": container with ID starting with 664fffdb7083bc8943a80eb5ab1650db5f956944244396d91fd0dd9eaa46cb4a not found: ID does not exist" Jul 02 20:32:13.565575 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.565546 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd"] Jul 02 20:32:13.568755 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.568732 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-3136f3-openshift-default-844b794667-7sgwd"] Jul 02 20:32:13.938440 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:13.938399 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13899467-9e81-4837-bea0-b57ea05aaf37" path="/var/lib/kubelet/pods/13899467-9e81-4837-bea0-b57ea05aaf37/volumes" Jul 02 20:32:15.212471 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:15.212437 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk"] Jul 02 20:32:15.212867 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:15.212698 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" podUID="e91398b6-50e5-4f01-b22f-273b2b9a6ea0" containerName="istio-proxy" containerID="cri-o://3c676d5453ca6617043e50fd45da74bceb94ca38900581ab01a217d35417bb76" gracePeriod=30 Jul 02 20:32:15.875979 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:15.875944 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-599c685bf-8txd7_3983e39c-367d-4ea4-98a0-87740d2c4442/authorino/0.log" Jul 02 20:32:20.463714 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.463688 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:32:20.518628 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.518538 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-credential-socket\") pod \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " Jul 02 20:32:20.518628 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.518572 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-workload-socket\") pod \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " Jul 02 20:32:20.518628 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.518610 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-envoy\") pod \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " Jul 02 20:32:20.518628 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.518631 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istiod-ca-cert\") pod \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " Jul 02 20:32:20.518971 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.518650 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-podinfo\") pod \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " Jul 02 20:32:20.518971 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.518741 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58s29\" (UniqueName: \"kubernetes.io/projected/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-kube-api-access-58s29\") pod \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " Jul 02 20:32:20.518971 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.518765 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-workload-certs\") pod \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " Jul 02 20:32:20.518971 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.518789 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-data\") pod \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " Jul 02 20:32:20.518971 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.518811 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-token\") pod \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\" (UID: \"e91398b6-50e5-4f01-b22f-273b2b9a6ea0\") " Jul 02 20:32:20.518971 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.518832 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e91398b6-50e5-4f01-b22f-273b2b9a6ea0" (UID: "e91398b6-50e5-4f01-b22f-273b2b9a6ea0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:32:20.518971 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.518919 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e91398b6-50e5-4f01-b22f-273b2b9a6ea0" (UID: "e91398b6-50e5-4f01-b22f-273b2b9a6ea0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:32:20.519363 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.519003 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e91398b6-50e5-4f01-b22f-273b2b9a6ea0" (UID: "e91398b6-50e5-4f01-b22f-273b2b9a6ea0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:32:20.519363 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.519124 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e91398b6-50e5-4f01-b22f-273b2b9a6ea0" (UID: "e91398b6-50e5-4f01-b22f-273b2b9a6ea0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:32:20.519363 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.519193 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-workload-certs\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:32:20.519363 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.519219 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-credential-socket\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:32:20.519363 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.519232 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-workload-socket\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:32:20.520002 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.519978 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-data" (OuterVolumeSpecName: "istio-data") pod "e91398b6-50e5-4f01-b22f-273b2b9a6ea0" (UID: "e91398b6-50e5-4f01-b22f-273b2b9a6ea0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:32:20.521060 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.521037 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-kube-api-access-58s29" (OuterVolumeSpecName: "kube-api-access-58s29") pod "e91398b6-50e5-4f01-b22f-273b2b9a6ea0" (UID: "e91398b6-50e5-4f01-b22f-273b2b9a6ea0"). InnerVolumeSpecName "kube-api-access-58s29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:32:20.521150 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.521086 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e91398b6-50e5-4f01-b22f-273b2b9a6ea0" (UID: "e91398b6-50e5-4f01-b22f-273b2b9a6ea0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:32:20.521297 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.521278 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e91398b6-50e5-4f01-b22f-273b2b9a6ea0" (UID: "e91398b6-50e5-4f01-b22f-273b2b9a6ea0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:32:20.521427 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.521409 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-token" (OuterVolumeSpecName: "istio-token") pod "e91398b6-50e5-4f01-b22f-273b2b9a6ea0" (UID: "e91398b6-50e5-4f01-b22f-273b2b9a6ea0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:32:20.582338 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.582297 2560 generic.go:356] "Generic (PLEG): container finished" podID="e91398b6-50e5-4f01-b22f-273b2b9a6ea0" containerID="3c676d5453ca6617043e50fd45da74bceb94ca38900581ab01a217d35417bb76" exitCode=0 Jul 02 20:32:20.582504 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.582354 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" Jul 02 20:32:20.582504 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.582383 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" event={"ID":"e91398b6-50e5-4f01-b22f-273b2b9a6ea0","Type":"ContainerDied","Data":"3c676d5453ca6617043e50fd45da74bceb94ca38900581ab01a217d35417bb76"} Jul 02 20:32:20.582504 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.582466 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk" event={"ID":"e91398b6-50e5-4f01-b22f-273b2b9a6ea0","Type":"ContainerDied","Data":"30946ffa270479bf8a0b301939c09b5e78aba665f3d1b955c1cf923f8f2d86d3"} Jul 02 20:32:20.582504 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.582492 2560 scope.go:117] "RemoveContainer" containerID="3c676d5453ca6617043e50fd45da74bceb94ca38900581ab01a217d35417bb76" Jul 02 20:32:20.592821 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.592803 2560 scope.go:117] "RemoveContainer" containerID="e01250593bf2786ddc8c10d875b24f8653e6b7fef8f4966a8feba5087b305d49" Jul 02 20:32:20.601411 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.601393 2560 scope.go:117] "RemoveContainer" containerID="3c676d5453ca6617043e50fd45da74bceb94ca38900581ab01a217d35417bb76" Jul 02 20:32:20.601646 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:32:20.601627 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c676d5453ca6617043e50fd45da74bceb94ca38900581ab01a217d35417bb76\": container with ID starting with 3c676d5453ca6617043e50fd45da74bceb94ca38900581ab01a217d35417bb76 not found: ID does not exist" containerID="3c676d5453ca6617043e50fd45da74bceb94ca38900581ab01a217d35417bb76" Jul 02 20:32:20.601695 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.601655 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c676d5453ca6617043e50fd45da74bceb94ca38900581ab01a217d35417bb76"} err="failed to get container status \"3c676d5453ca6617043e50fd45da74bceb94ca38900581ab01a217d35417bb76\": rpc error: code = NotFound desc = could not find container \"3c676d5453ca6617043e50fd45da74bceb94ca38900581ab01a217d35417bb76\": container with ID starting with 3c676d5453ca6617043e50fd45da74bceb94ca38900581ab01a217d35417bb76 not found: ID does not exist" Jul 02 20:32:20.601695 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.601672 2560 scope.go:117] "RemoveContainer" containerID="e01250593bf2786ddc8c10d875b24f8653e6b7fef8f4966a8feba5087b305d49" Jul 02 20:32:20.601932 ip-10-0-137-196 kubenswrapper[2560]: E0702 20:32:20.601914 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e01250593bf2786ddc8c10d875b24f8653e6b7fef8f4966a8feba5087b305d49\": container with ID starting with e01250593bf2786ddc8c10d875b24f8653e6b7fef8f4966a8feba5087b305d49 not found: ID does not exist" containerID="e01250593bf2786ddc8c10d875b24f8653e6b7fef8f4966a8feba5087b305d49" Jul 02 20:32:20.601986 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.601939 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e01250593bf2786ddc8c10d875b24f8653e6b7fef8f4966a8feba5087b305d49"} err="failed to get container status \"e01250593bf2786ddc8c10d875b24f8653e6b7fef8f4966a8feba5087b305d49\": rpc error: code = NotFound desc = could not find container \"e01250593bf2786ddc8c10d875b24f8653e6b7fef8f4966a8feba5087b305d49\": container with ID starting with e01250593bf2786ddc8c10d875b24f8653e6b7fef8f4966a8feba5087b305d49 not found: ID does not exist" Jul 02 20:32:20.605541 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.605516 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk"] Jul 02 20:32:20.609469 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.609447 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-c7f980-openshift-default-6b7d66bb55-cvbgk"] Jul 02 20:32:20.620026 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.620009 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-data\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:32:20.620094 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.620028 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-token\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:32:20.620094 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.620037 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-envoy\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:32:20.620094 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.620044 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istiod-ca-cert\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:32:20.620094 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.620051 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-istio-podinfo\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:32:20.620094 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.620060 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58s29\" (UniqueName: \"kubernetes.io/projected/e91398b6-50e5-4f01-b22f-273b2b9a6ea0-kube-api-access-58s29\") on node \"ip-10-0-137-196.ec2.internal\" DevicePath \"\"" Jul 02 20:32:20.933407 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:20.933328 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717055-zm7pv_f2136c05-e542-44fd-8f8e-bab1cc54b8db/cleanup/0.log" Jul 02 20:32:21.046437 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:21.046413 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717070-7jn9q_d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f/cleanup/0.log" Jul 02 20:32:21.766208 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:21.766177 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj_e3e80534-78fe-4588-9013-485a405eb04d/copy-manifests/0.log" Jul 02 20:32:21.779728 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:21.779690 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj_e3e80534-78fe-4588-9013-485a405eb04d/manager/0.log" Jul 02 20:32:21.933772 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:21.933738 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e91398b6-50e5-4f01-b22f-273b2b9a6ea0" path="/var/lib/kubelet/pods/e91398b6-50e5-4f01-b22f-273b2b9a6ea0/volumes" Jul 02 20:32:22.669233 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:22.669203 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj_ddb369e1-f829-489a-b338-b1e1ae8d620c/extract/0.log" Jul 02 20:32:22.675963 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:22.675944 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj_ddb369e1-f829-489a-b338-b1e1ae8d620c/util/0.log" Jul 02 20:32:22.682762 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:22.682738 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj_ddb369e1-f829-489a-b338-b1e1ae8d620c/pull/0.log" Jul 02 20:32:22.795550 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:22.795510 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59_b361c4a0-67a4-46f9-9014-f7414d9a56e2/util/0.log" Jul 02 20:32:22.802344 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:22.802324 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59_b361c4a0-67a4-46f9-9014-f7414d9a56e2/pull/0.log" Jul 02 20:32:22.808898 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:22.808878 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59_b361c4a0-67a4-46f9-9014-f7414d9a56e2/extract/0.log" Jul 02 20:32:22.918000 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:22.917971 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6_58362ddd-9c5b-4f91-b65f-8555c125901d/util/0.log" Jul 02 20:32:22.924064 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:22.923997 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6_58362ddd-9c5b-4f91-b65f-8555c125901d/pull/0.log" Jul 02 20:32:22.930380 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:22.930360 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6_58362ddd-9c5b-4f91-b65f-8555c125901d/extract/0.log" Jul 02 20:32:23.042735 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:23.042708 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q_da425dd5-b9eb-4acb-925c-c7d413c71cf0/extract/0.log" Jul 02 20:32:23.053976 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:23.053953 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q_da425dd5-b9eb-4acb-925c-c7d413c71cf0/util/0.log" Jul 02 20:32:23.060720 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:23.060698 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q_da425dd5-b9eb-4acb-925c-c7d413c71cf0/pull/0.log" Jul 02 20:32:23.172482 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:23.172451 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-599c685bf-8txd7_3983e39c-367d-4ea4-98a0-87740d2c4442/authorino/0.log" Jul 02 20:32:23.291677 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:23.291652 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-b8vch_c195d448-406c-452f-b4d8-0362aa941eea/manager/0.log" Jul 02 20:32:23.645576 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:23.645497 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-cwqwb_243feb22-2f0e-40b1-b169-d7042f369294/registry-server/0.log" Jul 02 20:32:24.008705 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:24.008671 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vkmm9_580c85e9-4531-4e5a-a7fa-ad7b91a27b2d/manager/0.log" Jul 02 20:32:24.357003 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:24.356927 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4l79f7_38f43236-c979-40be-8733-b325081cd474/istio-proxy/0.log" Jul 02 20:32:24.827047 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:24.827018 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jzkvx_1bdccac3-910b-4dd9-bd76-3557fbd16838/istio-proxy/1.log" Jul 02 20:32:25.190524 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:25.190444 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-884f959fc-mnsl2_08935037-5736-4bbb-abb8-921a6b53ff92/router/0.log" Jul 02 20:32:25.543144 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:25.543107 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-tv69d_5c1c73f0-8280-45a1-833f-913485dcbe3c/main/0.log" Jul 02 20:32:25.649349 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:25.649322 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-n6zf4_a8bbbcf7-0ff0-493f-b63f-b77b4086b665/main/0.log" Jul 02 20:32:30.746454 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.746419 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t2l5b/must-gather-tzd8j"] Jul 02 20:32:30.746846 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.746790 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f" containerName="cleanup" Jul 02 20:32:30.746846 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.746801 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f" containerName="cleanup" Jul 02 20:32:30.746846 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.746813 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13899467-9e81-4837-bea0-b57ea05aaf37" containerName="istio-proxy" Jul 02 20:32:30.746846 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.746819 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="13899467-9e81-4837-bea0-b57ea05aaf37" containerName="istio-proxy" Jul 02 20:32:30.746846 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.746826 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf8c155-aa6c-4546-b525-e30d0b22b6c3" containerName="cleanup" Jul 02 20:32:30.746846 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.746831 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf8c155-aa6c-4546-b525-e30d0b22b6c3" containerName="cleanup" Jul 02 20:32:30.746846 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.746839 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f750160-497a-4ac5-825e-f7c044d5e03b" containerName="cleanup" Jul 02 20:32:30.746846 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.746844 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f750160-497a-4ac5-825e-f7c044d5e03b" containerName="cleanup" Jul 02 20:32:30.747121 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.746855 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e91398b6-50e5-4f01-b22f-273b2b9a6ea0" containerName="istio-proxy" Jul 02 20:32:30.747121 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.746860 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e91398b6-50e5-4f01-b22f-273b2b9a6ea0" containerName="istio-proxy" Jul 02 20:32:30.747121 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.746866 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e91398b6-50e5-4f01-b22f-273b2b9a6ea0" containerName="istio-proxy" Jul 02 20:32:30.747121 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.746871 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e91398b6-50e5-4f01-b22f-273b2b9a6ea0" containerName="istio-proxy" Jul 02 20:32:30.747121 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.746924 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e91398b6-50e5-4f01-b22f-273b2b9a6ea0" containerName="istio-proxy" Jul 02 20:32:30.747121 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.746936 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cf8c155-aa6c-4546-b525-e30d0b22b6c3" containerName="cleanup" Jul 02 20:32:30.747121 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.746944 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="13899467-9e81-4837-bea0-b57ea05aaf37" containerName="istio-proxy" Jul 02 20:32:30.747121 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.746953 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="13899467-9e81-4837-bea0-b57ea05aaf37" containerName="istio-proxy" Jul 02 20:32:30.747121 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.746966 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f" containerName="cleanup" Jul 02 20:32:30.747121 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.746973 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f750160-497a-4ac5-825e-f7c044d5e03b" containerName="cleanup" Jul 02 20:32:30.747121 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.747036 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13899467-9e81-4837-bea0-b57ea05aaf37" containerName="istio-proxy" Jul 02 20:32:30.747121 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.747041 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="13899467-9e81-4837-bea0-b57ea05aaf37" containerName="istio-proxy" Jul 02 20:32:30.747121 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.747096 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e91398b6-50e5-4f01-b22f-273b2b9a6ea0" containerName="istio-proxy" Jul 02 20:32:30.749993 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.749977 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t2l5b/must-gather-tzd8j" Jul 02 20:32:30.752758 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.752724 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t2l5b\"/\"default-dockercfg-gf6wg\"" Jul 02 20:32:30.752889 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.752768 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t2l5b\"/\"kube-root-ca.crt\"" Jul 02 20:32:30.753798 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.753780 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t2l5b\"/\"openshift-service-ca.crt\"" Jul 02 20:32:30.758775 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.758751 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t2l5b/must-gather-tzd8j"] Jul 02 20:32:30.812717 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.812681 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckzxc\" (UniqueName: \"kubernetes.io/projected/d2846556-b59e-4509-bf70-bb8d602ddfc6-kube-api-access-ckzxc\") pod \"must-gather-tzd8j\" (UID: \"d2846556-b59e-4509-bf70-bb8d602ddfc6\") " pod="openshift-must-gather-t2l5b/must-gather-tzd8j" Jul 02 20:32:30.812942 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.812918 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d2846556-b59e-4509-bf70-bb8d602ddfc6-must-gather-output\") pod \"must-gather-tzd8j\" (UID: \"d2846556-b59e-4509-bf70-bb8d602ddfc6\") " pod="openshift-must-gather-t2l5b/must-gather-tzd8j" Jul 02 20:32:30.913628 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.913590 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckzxc\" (UniqueName: \"kubernetes.io/projected/d2846556-b59e-4509-bf70-bb8d602ddfc6-kube-api-access-ckzxc\") pod \"must-gather-tzd8j\" (UID: \"d2846556-b59e-4509-bf70-bb8d602ddfc6\") " pod="openshift-must-gather-t2l5b/must-gather-tzd8j" Jul 02 20:32:30.913829 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.913642 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d2846556-b59e-4509-bf70-bb8d602ddfc6-must-gather-output\") pod \"must-gather-tzd8j\" (UID: \"d2846556-b59e-4509-bf70-bb8d602ddfc6\") " pod="openshift-must-gather-t2l5b/must-gather-tzd8j" Jul 02 20:32:30.913944 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.913927 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d2846556-b59e-4509-bf70-bb8d602ddfc6-must-gather-output\") pod \"must-gather-tzd8j\" (UID: \"d2846556-b59e-4509-bf70-bb8d602ddfc6\") " pod="openshift-must-gather-t2l5b/must-gather-tzd8j" Jul 02 20:32:30.928103 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:30.928071 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckzxc\" (UniqueName: \"kubernetes.io/projected/d2846556-b59e-4509-bf70-bb8d602ddfc6-kube-api-access-ckzxc\") pod \"must-gather-tzd8j\" (UID: \"d2846556-b59e-4509-bf70-bb8d602ddfc6\") " pod="openshift-must-gather-t2l5b/must-gather-tzd8j" Jul 02 20:32:31.059957 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:31.059870 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t2l5b/must-gather-tzd8j" Jul 02 20:32:31.201218 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:31.201184 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t2l5b/must-gather-tzd8j"] Jul 02 20:32:31.202686 ip-10-0-137-196 kubenswrapper[2560]: W0702 20:32:31.202655 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2846556_b59e_4509_bf70_bb8d602ddfc6.slice/crio-9c61b642fa4230f86704fb5cc1f7e8dc8deda74fc43eff1c35f443cbc85994d6 WatchSource:0}: Error finding container 9c61b642fa4230f86704fb5cc1f7e8dc8deda74fc43eff1c35f443cbc85994d6: Status 404 returned error can't find the container with id 9c61b642fa4230f86704fb5cc1f7e8dc8deda74fc43eff1c35f443cbc85994d6 Jul 02 20:32:31.205179 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:31.205157 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 20:32:31.649319 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:31.649283 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t2l5b/must-gather-tzd8j" event={"ID":"d2846556-b59e-4509-bf70-bb8d602ddfc6","Type":"ContainerStarted","Data":"9c61b642fa4230f86704fb5cc1f7e8dc8deda74fc43eff1c35f443cbc85994d6"} Jul 02 20:32:32.660383 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:32.660274 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t2l5b/must-gather-tzd8j" event={"ID":"d2846556-b59e-4509-bf70-bb8d602ddfc6","Type":"ContainerStarted","Data":"e56f6adc9d33e24dc41727c727e82c824459995358cb01d1d154aaa02bdc0c9c"} Jul 02 20:32:32.660383 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:32.660341 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t2l5b/must-gather-tzd8j" event={"ID":"d2846556-b59e-4509-bf70-bb8d602ddfc6","Type":"ContainerStarted","Data":"f817156f26180ce184c556b0f6498199788a254ef9bc4ba38f86d3fe7be6cee9"} Jul 02 20:32:32.678641 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:32.678589 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t2l5b/must-gather-tzd8j" podStartSLOduration=1.545000034 podStartE2EDuration="2.678572718s" totalImagesPullingTime="1.133572684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:32:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:32:32.676018726 +0000 UTC m=+2501.245622796" watchObservedRunningTime="2026-07-02 20:32:32.678572718 +0000 UTC m=+2501.248176788" Jul 02 20:32:33.928774 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:33.928733 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-94lwh_271b6a48-768b-4a1f-b7d2-3e9c120a2f55/global-pull-secret-syncer/0.log" Jul 02 20:32:34.054539 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:34.054509 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xztw7_c284b6aa-c1c4-4c3e-941f-ce7fbb7f8b67/konnectivity-agent/0.log" Jul 02 20:32:34.131663 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:34.131634 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-196.ec2.internal_06a5819e677929f2d6af4dd60c5f15f3/haproxy/0.log" Jul 02 20:32:38.397046 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:38.397008 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj_ddb369e1-f829-489a-b338-b1e1ae8d620c/extract/0.log" Jul 02 20:32:38.430378 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:38.430348 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj_ddb369e1-f829-489a-b338-b1e1ae8d620c/util/0.log" Jul 02 20:32:38.454772 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:38.454745 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jzkwj_ddb369e1-f829-489a-b338-b1e1ae8d620c/pull/0.log" Jul 02 20:32:38.488758 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:38.488678 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59_b361c4a0-67a4-46f9-9014-f7414d9a56e2/extract/0.log" Jul 02 20:32:38.506098 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:38.506063 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59_b361c4a0-67a4-46f9-9014-f7414d9a56e2/util/0.log" Jul 02 20:32:38.528446 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:38.528401 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zj59_b361c4a0-67a4-46f9-9014-f7414d9a56e2/pull/0.log" Jul 02 20:32:38.559086 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:38.559058 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6_58362ddd-9c5b-4f91-b65f-8555c125901d/extract/0.log" Jul 02 20:32:38.583993 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:38.583962 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6_58362ddd-9c5b-4f91-b65f-8555c125901d/util/0.log" Jul 02 20:32:38.607195 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:38.607139 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735zjd6_58362ddd-9c5b-4f91-b65f-8555c125901d/pull/0.log" Jul 02 20:32:38.633009 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:38.632958 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q_da425dd5-b9eb-4acb-925c-c7d413c71cf0/extract/0.log" Jul 02 20:32:38.653560 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:38.653461 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q_da425dd5-b9eb-4acb-925c-c7d413c71cf0/util/0.log" Jul 02 20:32:38.676174 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:38.676142 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jrw9q_da425dd5-b9eb-4acb-925c-c7d413c71cf0/pull/0.log" Jul 02 20:32:39.067775 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:39.067548 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-599c685bf-8txd7_3983e39c-367d-4ea4-98a0-87740d2c4442/authorino/0.log" Jul 02 20:32:39.104677 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:39.104422 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-b8vch_c195d448-406c-452f-b4d8-0362aa941eea/manager/0.log" Jul 02 20:32:39.233269 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:39.233199 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-cwqwb_243feb22-2f0e-40b1-b169-d7042f369294/registry-server/0.log" Jul 02 20:32:39.467848 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:39.467804 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vkmm9_580c85e9-4531-4e5a-a7fa-ad7b91a27b2d/manager/0.log" Jul 02 20:32:41.277554 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:41.277520 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-d9trw_0d890bc7-0743-463a-99c8-9177ee249ef5/cluster-monitoring-operator/0.log" Jul 02 20:32:41.315263 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:41.315219 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-fxj69_ef278fe8-7df7-4185-b9f2-4822ee252384/kube-state-metrics/0.log" Jul 02 20:32:41.336661 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:41.336627 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-fxj69_ef278fe8-7df7-4185-b9f2-4822ee252384/kube-rbac-proxy-main/0.log" Jul 02 20:32:41.362289 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:41.361602 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-fxj69_ef278fe8-7df7-4185-b9f2-4822ee252384/kube-rbac-proxy-self/0.log" Jul 02 20:32:41.606522 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:41.606430 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zk8jp_9855d8c0-ceb6-4488-9504-25be48d6ca4f/node-exporter/0.log" Jul 02 20:32:41.627708 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:41.627674 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zk8jp_9855d8c0-ceb6-4488-9504-25be48d6ca4f/kube-rbac-proxy/0.log" Jul 02 20:32:41.654291 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:41.654240 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zk8jp_9855d8c0-ceb6-4488-9504-25be48d6ca4f/init-textfile/0.log" Jul 02 20:32:42.033134 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:42.033095 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8444cc454c-ptjkd_16da836b-66c6-49a3-a9a0-a309ea5d9f20/telemeter-client/0.log" Jul 02 20:32:42.056168 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:42.056139 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8444cc454c-ptjkd_16da836b-66c6-49a3-a9a0-a309ea5d9f20/reload/0.log" Jul 02 20:32:42.075994 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:42.075964 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8444cc454c-ptjkd_16da836b-66c6-49a3-a9a0-a309ea5d9f20/kube-rbac-proxy/0.log" Jul 02 20:32:43.489315 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:43.489287 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-7v7pv_db3bd1af-2862-434d-b05b-5c05ee2422e1/networking-console-plugin/0.log" Jul 02 20:32:44.102957 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:44.102924 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/1.log" Jul 02 20:32:44.110276 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:44.110220 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t5vtb_e44c6e9d-8f1b-4e65-9b90-d89047b66f9b/console-operator/2.log" Jul 02 20:32:44.570056 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:44.569960 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh"] Jul 02 20:32:44.578910 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:44.578877 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh" Jul 02 20:32:44.582884 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:44.582851 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh"] Jul 02 20:32:44.662039 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:44.662007 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d7d2735-72c4-4c8f-aede-132107a21708-lib-modules\") pod \"perf-node-gather-daemonset-wp8hh\" (UID: \"2d7d2735-72c4-4c8f-aede-132107a21708\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh" Jul 02 20:32:44.662239 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:44.662051 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2d7d2735-72c4-4c8f-aede-132107a21708-podres\") pod \"perf-node-gather-daemonset-wp8hh\" (UID: \"2d7d2735-72c4-4c8f-aede-132107a21708\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh" Jul 02 20:32:44.662239 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:44.662103 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4skv\" (UniqueName: \"kubernetes.io/projected/2d7d2735-72c4-4c8f-aede-132107a21708-kube-api-access-v4skv\") pod \"perf-node-gather-daemonset-wp8hh\" (UID: \"2d7d2735-72c4-4c8f-aede-132107a21708\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh" Jul 02 20:32:44.662394 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:44.662279 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2d7d2735-72c4-4c8f-aede-132107a21708-proc\") pod \"perf-node-gather-daemonset-wp8hh\" (UID: \"2d7d2735-72c4-4c8f-aede-132107a21708\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh" Jul 02 20:32:44.662394 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:44.662356 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d7d2735-72c4-4c8f-aede-132107a21708-sys\") pod \"perf-node-gather-daemonset-wp8hh\" (UID: \"2d7d2735-72c4-4c8f-aede-132107a21708\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh" Jul 02 20:32:44.675048 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:44.674894 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-589bf44758-kjjls_392000fd-fbd2-459d-96e3-c0c5d38ad693/console/0.log" Jul 02 20:32:44.763967 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:44.763919 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d7d2735-72c4-4c8f-aede-132107a21708-lib-modules\") pod \"perf-node-gather-daemonset-wp8hh\" (UID: \"2d7d2735-72c4-4c8f-aede-132107a21708\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh" Jul 02 20:32:44.764173 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:44.763980 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2d7d2735-72c4-4c8f-aede-132107a21708-podres\") pod \"perf-node-gather-daemonset-wp8hh\" (UID: \"2d7d2735-72c4-4c8f-aede-132107a21708\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh" Jul 02 20:32:44.764173 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:44.764019 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4skv\" (UniqueName: \"kubernetes.io/projected/2d7d2735-72c4-4c8f-aede-132107a21708-kube-api-access-v4skv\") pod \"perf-node-gather-daemonset-wp8hh\" (UID: \"2d7d2735-72c4-4c8f-aede-132107a21708\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh" Jul 02 20:32:44.764173 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:44.764102 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2d7d2735-72c4-4c8f-aede-132107a21708-proc\") pod \"perf-node-gather-daemonset-wp8hh\" (UID: \"2d7d2735-72c4-4c8f-aede-132107a21708\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh" Jul 02 20:32:44.764173 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:44.764124 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d7d2735-72c4-4c8f-aede-132107a21708-lib-modules\") pod \"perf-node-gather-daemonset-wp8hh\" (UID: \"2d7d2735-72c4-4c8f-aede-132107a21708\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh" Jul 02 20:32:44.764173 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:44.764151 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d7d2735-72c4-4c8f-aede-132107a21708-sys\") pod \"perf-node-gather-daemonset-wp8hh\" (UID: \"2d7d2735-72c4-4c8f-aede-132107a21708\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh" Jul 02 20:32:44.764516 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:44.764215 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d7d2735-72c4-4c8f-aede-132107a21708-sys\") pod \"perf-node-gather-daemonset-wp8hh\" (UID: \"2d7d2735-72c4-4c8f-aede-132107a21708\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh" Jul 02 20:32:44.764516 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:44.764330 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2d7d2735-72c4-4c8f-aede-132107a21708-proc\") pod \"perf-node-gather-daemonset-wp8hh\" (UID: \"2d7d2735-72c4-4c8f-aede-132107a21708\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh" Jul 02 20:32:44.764516 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:44.764425 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2d7d2735-72c4-4c8f-aede-132107a21708-podres\") pod \"perf-node-gather-daemonset-wp8hh\" (UID: \"2d7d2735-72c4-4c8f-aede-132107a21708\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh" Jul 02 20:32:44.774930 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:44.774899 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4skv\" (UniqueName: \"kubernetes.io/projected/2d7d2735-72c4-4c8f-aede-132107a21708-kube-api-access-v4skv\") pod \"perf-node-gather-daemonset-wp8hh\" (UID: \"2d7d2735-72c4-4c8f-aede-132107a21708\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh" Jul 02 20:32:44.893044 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:44.892943 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh" Jul 02 20:32:45.083548 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:45.082413 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh"] Jul 02 20:32:45.395631 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:45.395602 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-8j9nr_2f03817d-9515-450a-b96c-9c862eb003d5/volume-data-source-validator/0.log" Jul 02 20:32:45.792204 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:45.792172 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh" event={"ID":"2d7d2735-72c4-4c8f-aede-132107a21708","Type":"ContainerStarted","Data":"bbd4745a7ccca778ea48002561d96eb066ed59be1fc1f239b4c137c69adce4e4"} Jul 02 20:32:45.792723 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:45.792234 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh" event={"ID":"2d7d2735-72c4-4c8f-aede-132107a21708","Type":"ContainerStarted","Data":"1a9b211c722c6d148d7f3ddcd1a8c2d18d1d68b4ad58aad7b79a3610103a334c"} Jul 02 20:32:45.792723 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:45.792404 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh" Jul 02 20:32:45.810139 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:45.810087 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh" podStartSLOduration=1.810064604 podStartE2EDuration="1.810064604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:32:45.807677595 +0000 UTC m=+2514.377281689" watchObservedRunningTime="2026-07-02 20:32:45.810064604 +0000 UTC m=+2514.379668676" Jul 02 20:32:46.452098 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:46.452070 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sh2cz_49b572e5-56d7-4217-96f3-7a19dfd56cda/dns/0.log" Jul 02 20:32:46.482968 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:46.482939 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sh2cz_49b572e5-56d7-4217-96f3-7a19dfd56cda/kube-rbac-proxy/0.log" Jul 02 20:32:46.567351 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:46.567324 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8wwq6_e8c0c3b5-e729-46f6-b927-ecd72af8af02/dns-node-resolver/0.log" Jul 02 20:32:47.194313 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:47.194283 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dfxtn_d454a862-97f9-4763-960f-cd1aaf123df4/node-ca/0.log" Jul 02 20:32:48.116932 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:48.116885 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4l79f7_38f43236-c979-40be-8733-b325081cd474/istio-proxy/0.log" Jul 02 20:32:48.303212 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:48.302725 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jzkvx_1bdccac3-910b-4dd9-bd76-3557fbd16838/istio-proxy/0.log" Jul 02 20:32:48.341705 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:48.341668 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jzkvx_1bdccac3-910b-4dd9-bd76-3557fbd16838/istio-proxy/1.log" Jul 02 20:32:48.443608 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:48.443536 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-884f959fc-mnsl2_08935037-5736-4bbb-abb8-921a6b53ff92/router/0.log" Jul 02 20:32:49.087072 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:49.087036 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-85wr2_29a0dda7-60a5-4f6b-bc15-4fb66164a986/serve-healthcheck-canary/0.log" Jul 02 20:32:49.631024 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:49.630989 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-wg2jz_135c70c7-2e29-45cf-8364-d5ebf0614fdb/insights-operator/0.log" Jul 02 20:32:49.631870 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:49.631840 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-wg2jz_135c70c7-2e29-45cf-8364-d5ebf0614fdb/insights-operator/1.log" Jul 02 20:32:49.721356 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:49.721331 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hzrnl_77c937cf-32be-40a0-8950-c53ebd9aa22e/kube-rbac-proxy/0.log" Jul 02 20:32:49.741524 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:49.741494 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hzrnl_77c937cf-32be-40a0-8950-c53ebd9aa22e/exporter/0.log" Jul 02 20:32:49.762836 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:49.762798 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hzrnl_77c937cf-32be-40a0-8950-c53ebd9aa22e/extractor/0.log" Jul 02 20:32:51.810585 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:51.810550 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-wp8hh" Jul 02 20:32:52.091172 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:52.091086 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717055-zm7pv_f2136c05-e542-44fd-8f8e-bab1cc54b8db/cleanup/0.log" Jul 02 20:32:52.113311 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:52.113280 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717070-7jn9q_d8eaf45c-55e4-4aa5-9d8a-300fa1d0eb2f/cleanup/0.log" Jul 02 20:32:52.464295 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:52.464231 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj_e3e80534-78fe-4588-9013-485a405eb04d/manager/0.log" Jul 02 20:32:52.485536 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:52.485505 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cc6b5b4c9-zxjvj_e3e80534-78fe-4588-9013-485a405eb04d/copy-manifests/0.log" Jul 02 20:32:53.934674 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:53.934592 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7fc9d97d57-k22gg_e0fc8cea-f218-4790-97d7-eced3beaf967/manager/0.log" Jul 02 20:32:54.760100 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:54.760066 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4l79f7_38f43236-c979-40be-8733-b325081cd474/istio-proxy/0.log" Jul 02 20:32:54.907335 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:54.903795 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jzkvx_1bdccac3-910b-4dd9-bd76-3557fbd16838/istio-proxy/0.log" Jul 02 20:32:54.941075 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:54.941043 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jzkvx_1bdccac3-910b-4dd9-bd76-3557fbd16838/istio-proxy/1.log" Jul 02 20:32:55.011064 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:55.011035 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-884f959fc-mnsl2_08935037-5736-4bbb-abb8-921a6b53ff92/router/0.log" Jul 02 20:32:56.159331 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:56.159304 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4l79f7_38f43236-c979-40be-8733-b325081cd474/istio-proxy/0.log" Jul 02 20:32:56.321283 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:56.320907 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jzkvx_1bdccac3-910b-4dd9-bd76-3557fbd16838/istio-proxy/0.log" Jul 02 20:32:56.364077 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:56.364016 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jzkvx_1bdccac3-910b-4dd9-bd76-3557fbd16838/istio-proxy/1.log" Jul 02 20:32:56.442689 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:56.442614 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-884f959fc-mnsl2_08935037-5736-4bbb-abb8-921a6b53ff92/router/0.log" Jul 02 20:32:59.438500 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:59.438278 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-92lg6_108d2c60-1768-434b-81d8-893cdae03a7b/kube-storage-version-migrator-operator/1.log" Jul 02 20:32:59.439578 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:32:59.439548 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-92lg6_108d2c60-1768-434b-81d8-893cdae03a7b/kube-storage-version-migrator-operator/0.log" Jul 02 20:33:00.403304 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:33:00.403272 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9cdpm_ad299c1f-ba3d-4088-bd88-84536a843b3d/kube-multus/0.log" Jul 02 20:33:00.580975 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:33:00.580943 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mzt7w_0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8/kube-multus-additional-cni-plugins/0.log" Jul 02 20:33:00.608015 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:33:00.607987 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mzt7w_0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8/egress-router-binary-copy/0.log" Jul 02 20:33:00.627774 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:33:00.627750 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mzt7w_0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8/cni-plugins/0.log" Jul 02 20:33:00.646917 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:33:00.646893 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mzt7w_0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8/bond-cni-plugin/0.log" Jul 02 20:33:00.671193 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:33:00.671125 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mzt7w_0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8/routeoverride-cni/0.log" Jul 02 20:33:00.700043 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:33:00.700017 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mzt7w_0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8/whereabouts-cni-bincopy/0.log" Jul 02 20:33:00.720993 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:33:00.720967 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mzt7w_0b85f94d-fc04-42c1-b7aa-5d5cdfd361a8/whereabouts-cni/0.log" Jul 02 20:33:00.919751 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:33:00.919721 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2vmw6_fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab/network-metrics-daemon/0.log" Jul 02 20:33:00.938700 ip-10-0-137-196 kubenswrapper[2560]: I0702 20:33:00.938630 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2vmw6_fddfe8b5-f0e1-4e93-9c8b-c5aee2d814ab/kube-rbac-proxy/0.log"