Jul 14 18:52:24.250247 ip-10-0-143-130 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 14 18:52:24.250261 ip-10-0-143-130 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 14 18:52:24.250271 ip-10-0-143-130 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 14 18:52:24.250567 ip-10-0-143-130 systemd[1]: Failed to start Kubernetes Kubelet. Jul 14 18:52:34.473884 ip-10-0-143-130 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 14 18:52:34.473905 ip-10-0-143-130 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 28c9ecc4f7364dd69101e90503368618 -- Jul 14 18:54:35.883926 ip-10-0-143-130 systemd[1]: Starting Kubernetes Kubelet... Jul 14 18:54:36.294013 ip-10-0-143-130 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 18:54:36.294013 ip-10-0-143-130 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 18:54:36.294013 ip-10-0-143-130 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 18:54:36.294013 ip-10-0-143-130 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 18:54:36.294013 ip-10-0-143-130 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 18:54:36.295932 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.295845 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 18:54:36.304639 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304611 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 18:54:36.304639 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304634 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 18:54:36.304639 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304638 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 18:54:36.304639 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304641 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 18:54:36.304639 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304644 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 18:54:36.304639 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304647 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 18:54:36.304854 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304650 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 18:54:36.304854 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304653 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 18:54:36.304854 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304658 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 18:54:36.304854 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304662 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 18:54:36.304854 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304665 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 18:54:36.304854 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304667 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 18:54:36.304854 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304670 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 18:54:36.304854 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304673 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 18:54:36.304854 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304675 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 18:54:36.304854 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304678 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 18:54:36.304854 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304680 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 18:54:36.304854 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304683 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 18:54:36.304854 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304685 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 18:54:36.304854 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304688 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 18:54:36.304854 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304690 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 18:54:36.304854 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304702 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 18:54:36.304854 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304707 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 18:54:36.304854 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304710 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 18:54:36.304854 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304713 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 18:54:36.305300 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304716 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 18:54:36.305300 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304719 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 18:54:36.305300 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304722 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 18:54:36.305300 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304725 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 18:54:36.305300 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304727 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 18:54:36.305300 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304730 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 18:54:36.305300 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304733 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 18:54:36.305300 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304735 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 14 18:54:36.305300 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304738 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 18:54:36.305300 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304740 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 18:54:36.305300 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304742 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 18:54:36.305300 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304745 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 18:54:36.305300 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304747 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 18:54:36.305300 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304750 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 18:54:36.305300 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304753 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 18:54:36.305300 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304756 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 18:54:36.305300 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304758 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 18:54:36.305300 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304761 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 18:54:36.305300 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304764 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 18:54:36.305300 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304766 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 18:54:36.305832 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304769 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 18:54:36.305832 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304771 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 18:54:36.305832 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304773 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 18:54:36.305832 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304776 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 18:54:36.305832 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304779 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 18:54:36.305832 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304781 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 18:54:36.305832 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304783 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 18:54:36.305832 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304786 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 18:54:36.305832 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304789 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 18:54:36.305832 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304791 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 18:54:36.305832 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304794 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 18:54:36.305832 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304796 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 18:54:36.305832 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304798 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 18:54:36.305832 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304801 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 18:54:36.305832 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304803 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 18:54:36.305832 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304806 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 18:54:36.305832 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304808 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 18:54:36.305832 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304810 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 18:54:36.305832 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304813 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 18:54:36.305832 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304815 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 18:54:36.306314 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304817 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 18:54:36.306314 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304821 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 18:54:36.306314 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304823 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 18:54:36.306314 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304826 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 18:54:36.306314 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304828 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 18:54:36.306314 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304832 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 18:54:36.306314 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304835 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 18:54:36.306314 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304838 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 18:54:36.306314 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304840 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 18:54:36.306314 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304843 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 18:54:36.306314 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304846 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 18:54:36.306314 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304848 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 18:54:36.306314 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304851 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 18:54:36.306314 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304853 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 18:54:36.306314 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304857 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 18:54:36.306314 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304861 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 18:54:36.306314 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304864 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 18:54:36.306314 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304867 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 18:54:36.306314 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304871 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 18:54:36.306785 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304874 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 18:54:36.306785 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304877 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 18:54:36.306785 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304879 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 18:54:36.306785 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304882 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 18:54:36.306785 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304884 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 18:54:36.306785 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304888 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 18:54:36.306785 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304890 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 18:54:36.306785 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304893 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 18:54:36.306785 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304895 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 18:54:36.306785 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304898 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 18:54:36.306785 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304900 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 18:54:36.306785 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304902 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 18:54:36.306785 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304905 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 18:54:36.306785 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304907 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 18:54:36.306785 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.304910 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 18:54:36.306785 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305621 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 18:54:36.306785 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305629 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 18:54:36.306785 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305632 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 18:54:36.306785 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305635 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 18:54:36.306785 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305638 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 18:54:36.307263 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305640 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 18:54:36.307263 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305643 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 18:54:36.307263 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305645 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 18:54:36.307263 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305648 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 18:54:36.307263 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305650 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 18:54:36.307263 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305653 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 18:54:36.307263 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305655 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 18:54:36.307263 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305658 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 18:54:36.307263 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305661 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 18:54:36.307263 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305663 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 18:54:36.307263 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305666 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 18:54:36.307263 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305670 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 18:54:36.307263 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305674 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 18:54:36.307263 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305677 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 18:54:36.307263 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305680 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 18:54:36.307263 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305683 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 18:54:36.307263 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305686 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 18:54:36.307263 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305689 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 18:54:36.307263 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305691 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 18:54:36.307739 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305694 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 18:54:36.307739 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305696 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 18:54:36.307739 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305699 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 18:54:36.307739 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305701 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 18:54:36.307739 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305704 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 18:54:36.307739 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305706 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 18:54:36.307739 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305710 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 18:54:36.307739 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305713 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 18:54:36.307739 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305716 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 18:54:36.307739 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305719 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 18:54:36.307739 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305722 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 18:54:36.307739 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305725 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 18:54:36.307739 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305728 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 18:54:36.307739 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305731 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 18:54:36.307739 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305733 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 18:54:36.307739 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305736 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 14 18:54:36.307739 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305740 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 18:54:36.307739 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305742 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 18:54:36.307739 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305744 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 18:54:36.308229 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305747 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 18:54:36.308229 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305749 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 18:54:36.308229 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305751 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 18:54:36.308229 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305754 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 18:54:36.308229 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305756 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 18:54:36.308229 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305759 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 18:54:36.308229 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305761 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 18:54:36.308229 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305764 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 18:54:36.308229 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305767 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 18:54:36.308229 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305769 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 18:54:36.308229 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305772 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 18:54:36.308229 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305774 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 18:54:36.308229 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305777 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 18:54:36.308229 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305779 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 18:54:36.308229 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305781 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 18:54:36.308229 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305784 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 18:54:36.308229 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305786 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 18:54:36.308229 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305789 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 18:54:36.308229 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305791 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 18:54:36.308229 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305793 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 18:54:36.308721 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305796 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 18:54:36.308721 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305798 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 18:54:36.308721 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305801 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 18:54:36.308721 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305803 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 18:54:36.308721 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305806 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 18:54:36.308721 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305809 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 18:54:36.308721 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305812 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 18:54:36.308721 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305814 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 18:54:36.308721 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305817 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 18:54:36.308721 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305819 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 18:54:36.308721 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305822 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 18:54:36.308721 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305824 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 18:54:36.308721 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305826 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 18:54:36.308721 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305829 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 18:54:36.308721 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305832 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 18:54:36.308721 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305834 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 18:54:36.308721 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305837 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 18:54:36.308721 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305839 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 18:54:36.308721 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305842 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 18:54:36.308721 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305845 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 18:54:36.309182 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305848 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 18:54:36.309182 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305850 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 18:54:36.309182 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305853 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 18:54:36.309182 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305855 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 18:54:36.309182 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305857 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 18:54:36.309182 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305861 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 18:54:36.309182 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305863 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 18:54:36.309182 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305867 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 18:54:36.309182 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305871 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 18:54:36.309182 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305873 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 18:54:36.309182 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305876 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 18:54:36.309182 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305878 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 18:54:36.309182 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305880 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 18:54:36.309182 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305883 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 18:54:36.309182 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305885 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 18:54:36.309182 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.305887 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 18:54:36.309182 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306271 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 18:54:36.309182 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306276 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 18:54:36.309182 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306279 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 18:54:36.309644 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306282 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 18:54:36.309644 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306284 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 18:54:36.309644 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306287 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 18:54:36.309644 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306289 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 18:54:36.309644 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306292 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 18:54:36.309644 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306294 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 18:54:36.309644 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306297 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 18:54:36.309644 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306299 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 18:54:36.309644 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306302 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 18:54:36.309644 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306305 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 18:54:36.309644 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306307 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 18:54:36.309644 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306309 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 18:54:36.309644 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306312 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 18:54:36.309644 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306315 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 18:54:36.309644 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306317 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 18:54:36.309644 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306320 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 18:54:36.309644 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306323 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 18:54:36.309644 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306325 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 18:54:36.309644 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306328 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 18:54:36.309644 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306331 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 18:54:36.310117 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306333 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 18:54:36.310117 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306336 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 18:54:36.310117 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306338 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 18:54:36.310117 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306341 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 18:54:36.310117 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306343 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 18:54:36.310117 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306346 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 18:54:36.310117 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306348 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 18:54:36.310117 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306350 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 18:54:36.310117 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306353 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 18:54:36.310117 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306355 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 18:54:36.310117 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306358 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 18:54:36.310117 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306361 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 18:54:36.310117 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306363 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 18:54:36.310117 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306366 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 18:54:36.310117 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306368 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 18:54:36.310117 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306371 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 18:54:36.310117 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306373 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 18:54:36.310117 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306376 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 18:54:36.310117 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306378 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 18:54:36.310117 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306381 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 18:54:36.310605 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306383 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 18:54:36.310605 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306386 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 18:54:36.310605 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306388 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 18:54:36.310605 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306391 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 18:54:36.310605 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306393 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 18:54:36.310605 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306395 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 18:54:36.310605 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306398 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 18:54:36.310605 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306401 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 18:54:36.310605 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306403 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 18:54:36.310605 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306406 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 18:54:36.310605 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306408 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 18:54:36.310605 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306411 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 18:54:36.310605 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306413 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 18:54:36.310605 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306415 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 18:54:36.310605 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306418 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 18:54:36.310605 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306426 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 18:54:36.310605 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306428 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 18:54:36.310605 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306431 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 18:54:36.310605 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306433 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 18:54:36.310605 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306436 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 18:54:36.311083 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306438 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 18:54:36.311083 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306441 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 18:54:36.311083 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306443 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 18:54:36.311083 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306446 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 18:54:36.311083 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306448 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 18:54:36.311083 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306451 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 18:54:36.311083 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306453 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 18:54:36.311083 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306455 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 18:54:36.311083 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306458 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 18:54:36.311083 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306460 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 18:54:36.311083 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306465 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 18:54:36.311083 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306468 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 18:54:36.311083 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306471 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 18:54:36.311083 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306473 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 18:54:36.311083 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306476 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 18:54:36.311083 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306479 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 18:54:36.311083 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306481 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 18:54:36.311083 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306484 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 18:54:36.311083 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306487 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 18:54:36.311083 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306490 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 14 18:54:36.311560 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306493 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 18:54:36.311560 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306495 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 18:54:36.311560 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306497 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 18:54:36.311560 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306500 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 18:54:36.311560 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306503 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 18:54:36.311560 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306505 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 18:54:36.311560 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306509 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 18:54:36.311560 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306512 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 18:54:36.311560 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306517 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 18:54:36.311560 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306522 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 18:54:36.311560 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306525 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 18:54:36.311560 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306528 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 18:54:36.311560 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306531 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 18:54:36.311560 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306534 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 18:54:36.311560 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306537 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 18:54:36.311560 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.306540 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 18:54:36.311560 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306647 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 18:54:36.311560 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306659 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 18:54:36.311560 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306666 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 18:54:36.311560 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306670 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306674 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306677 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306681 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306686 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306688 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306691 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306695 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306698 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306701 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306704 2563 flags.go:64] FLAG: --cgroup-root="" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306706 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306709 2563 flags.go:64] FLAG: --client-ca-file="" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306712 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306715 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306719 2563 flags.go:64] FLAG: --cluster-domain="" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306721 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306724 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306727 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306731 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306734 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306737 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306740 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 18:54:36.312043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306744 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306747 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306750 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306753 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306756 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306759 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306763 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306766 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306769 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306772 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306775 2563 flags.go:64] FLAG: --enable-server="true" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306778 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306782 2563 flags.go:64] FLAG: --event-burst="100" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306785 2563 flags.go:64] FLAG: --event-qps="50" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306788 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306791 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306794 2563 flags.go:64] FLAG: --eviction-hard="" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306800 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306804 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306807 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306809 2563 flags.go:64] FLAG: --eviction-soft="" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306812 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306815 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306818 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306821 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 18:54:36.312580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306824 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306827 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306829 2563 flags.go:64] FLAG: --feature-gates="" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306833 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306836 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306839 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306842 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306845 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306848 2563 flags.go:64] FLAG: --help="false" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306852 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-143-130.ec2.internal" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306855 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306858 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306861 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306864 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306867 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306870 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306872 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306875 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306878 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306881 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306884 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306886 2563 flags.go:64] FLAG: --kube-reserved="" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306889 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306892 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 18:54:36.313239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306896 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306899 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306902 2563 flags.go:64] FLAG: --lock-file="" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306905 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306908 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306911 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306916 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306920 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306923 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306925 2563 flags.go:64] FLAG: --logging-format="text" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306928 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306932 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306934 2563 flags.go:64] FLAG: --manifest-url="" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306937 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306941 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306944 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306948 2563 flags.go:64] FLAG: --max-pods="110" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306952 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306955 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306958 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306961 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306963 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306966 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306969 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306976 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 18:54:36.313865 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306979 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306982 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306985 2563 flags.go:64] FLAG: --pod-cidr="" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306988 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306993 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306996 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.306999 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307001 2563 flags.go:64] FLAG: --port="10250" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307006 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307009 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-028f0849ca2de1a6b" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307012 2563 flags.go:64] FLAG: --qos-reserved="" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307014 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307017 2563 flags.go:64] FLAG: --register-node="true" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307020 2563 flags.go:64] FLAG: --register-with-taints="" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307023 2563 flags.go:64] FLAG: --registry-burst="10" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307027 2563 flags.go:64] FLAG: --registry-qps="5" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307030 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307033 2563 flags.go:64] FLAG: --reserved-memory="" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307036 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307039 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307042 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307045 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307048 2563 flags.go:64] FLAG: --runonce="false" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307050 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307055 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 18:54:36.314522 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307057 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307060 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307063 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307066 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307068 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307071 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307074 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307077 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307080 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307083 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307085 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307088 2563 flags.go:64] FLAG: --system-cgroups="" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307091 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307096 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307099 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307103 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307106 2563 flags.go:64] FLAG: --tls-min-version="" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307109 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307112 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307115 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307118 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307121 2563 flags.go:64] FLAG: --v="2" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307124 2563 flags.go:64] FLAG: --version="false" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307128 2563 flags.go:64] FLAG: --vmodule="" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307132 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 18:54:36.315134 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.307135 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 18:54:36.315752 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307259 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 18:54:36.315752 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307263 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 18:54:36.315752 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307266 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 18:54:36.315752 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307269 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 18:54:36.315752 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307272 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 18:54:36.315752 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307276 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 18:54:36.315752 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307279 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 18:54:36.315752 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307282 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 18:54:36.315752 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307284 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 18:54:36.315752 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307286 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 18:54:36.315752 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307289 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 18:54:36.315752 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307292 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 18:54:36.315752 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307294 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 18:54:36.315752 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307297 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 18:54:36.315752 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307299 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 18:54:36.315752 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307302 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 18:54:36.315752 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307304 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 18:54:36.315752 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307307 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 18:54:36.315752 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307309 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 18:54:36.315752 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307312 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 18:54:36.316226 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307314 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 18:54:36.316226 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307318 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 18:54:36.316226 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307321 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 18:54:36.316226 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307323 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 18:54:36.316226 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307326 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 18:54:36.316226 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307329 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 18:54:36.316226 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307331 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 18:54:36.316226 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307334 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 18:54:36.316226 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307337 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 18:54:36.316226 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307339 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 18:54:36.316226 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307342 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 18:54:36.316226 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307345 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 18:54:36.316226 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307347 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 18:54:36.316226 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307349 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 18:54:36.316226 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307352 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 18:54:36.316226 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307354 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 18:54:36.316226 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307357 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 18:54:36.316226 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307361 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 18:54:36.316226 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307363 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 18:54:36.316694 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307366 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 18:54:36.316694 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307368 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 18:54:36.316694 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307371 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 18:54:36.316694 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307373 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 18:54:36.316694 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307376 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 18:54:36.316694 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307378 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 18:54:36.316694 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307381 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 18:54:36.316694 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307383 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 18:54:36.316694 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307386 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 18:54:36.316694 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307388 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 18:54:36.316694 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307391 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 18:54:36.316694 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307393 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 18:54:36.316694 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307396 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 18:54:36.316694 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307398 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 18:54:36.316694 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307402 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 14 18:54:36.316694 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307405 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 18:54:36.316694 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307407 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 18:54:36.316694 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307410 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 18:54:36.316694 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307412 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 18:54:36.316694 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307414 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 18:54:36.317198 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307417 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 18:54:36.317198 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307419 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 18:54:36.317198 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307422 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 18:54:36.317198 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307424 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 18:54:36.317198 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307428 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 18:54:36.317198 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307430 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 18:54:36.317198 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307433 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 18:54:36.317198 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307435 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 18:54:36.317198 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307437 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 18:54:36.317198 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307440 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 18:54:36.317198 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307445 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 18:54:36.317198 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307447 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 18:54:36.317198 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307450 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 18:54:36.317198 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307452 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 18:54:36.317198 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307455 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 18:54:36.317198 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307457 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 18:54:36.317198 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307460 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 18:54:36.317198 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307462 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 18:54:36.317198 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307465 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 18:54:36.317664 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307469 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 18:54:36.317664 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307472 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 18:54:36.317664 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307475 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 18:54:36.317664 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307478 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 18:54:36.317664 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307481 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 18:54:36.317664 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307484 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 18:54:36.317664 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307486 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 18:54:36.317664 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307491 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 18:54:36.317664 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307494 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 18:54:36.317664 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307497 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 18:54:36.317664 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307500 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 18:54:36.317664 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307502 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 18:54:36.317664 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307505 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 18:54:36.317664 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307507 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 18:54:36.317664 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307510 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 18:54:36.317664 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307512 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 18:54:36.317664 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307515 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 18:54:36.317664 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307518 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 18:54:36.317664 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307522 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 18:54:36.318137 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307525 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 18:54:36.318137 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.307527 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 18:54:36.318137 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.308549 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 18:54:36.318137 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.315176 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 18:54:36.318137 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.315192 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 18:54:36.318137 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.317007 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 18:54:36.318137 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.317015 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 18:54:36.318137 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317076 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 18:54:36.318137 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317082 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 18:54:36.318137 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317086 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 18:54:36.318137 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317089 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 18:54:36.318137 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317091 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 18:54:36.318137 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317094 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 18:54:36.318137 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317097 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 18:54:36.318491 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317100 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 18:54:36.318491 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317103 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 18:54:36.318491 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317105 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 18:54:36.318491 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317108 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 18:54:36.318491 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317110 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 18:54:36.318491 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317113 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 18:54:36.318491 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317115 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 18:54:36.318491 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317117 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 18:54:36.318491 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317120 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 18:54:36.318491 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317122 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 18:54:36.318491 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317126 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 18:54:36.318491 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317129 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 18:54:36.318491 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317132 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 18:54:36.318491 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317135 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 18:54:36.318491 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317137 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 18:54:36.318491 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317140 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 18:54:36.318491 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317142 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 18:54:36.318491 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317146 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 18:54:36.318491 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317149 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 18:54:36.318491 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317151 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 18:54:36.319009 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317153 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 18:54:36.319009 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317156 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 14 18:54:36.319009 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317160 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 18:54:36.319009 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317162 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 18:54:36.319009 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317165 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 18:54:36.319009 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317168 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 18:54:36.319009 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317171 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 18:54:36.319009 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317173 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 18:54:36.319009 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317176 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 18:54:36.319009 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317178 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 18:54:36.319009 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317181 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 18:54:36.319009 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317183 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 18:54:36.319009 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317186 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 18:54:36.319009 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317188 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 18:54:36.319009 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317190 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 18:54:36.319009 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317193 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 18:54:36.319009 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317196 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 18:54:36.319009 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317198 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 18:54:36.319009 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317201 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 18:54:36.319009 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317204 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 18:54:36.319503 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317206 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 18:54:36.319503 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317209 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 18:54:36.319503 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317212 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 18:54:36.319503 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317214 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 18:54:36.319503 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317217 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 18:54:36.319503 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317219 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 18:54:36.319503 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317222 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 18:54:36.319503 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317224 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 18:54:36.319503 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317227 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 18:54:36.319503 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317230 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 18:54:36.319503 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317233 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 18:54:36.319503 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317236 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 18:54:36.319503 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317238 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 18:54:36.319503 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317242 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 18:54:36.319503 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317244 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 18:54:36.319503 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317247 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 18:54:36.319503 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317249 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 18:54:36.319503 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317252 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 18:54:36.319503 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317255 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 18:54:36.319503 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317257 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 18:54:36.320041 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317259 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 18:54:36.320041 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317262 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 18:54:36.320041 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317264 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 18:54:36.320041 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317268 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 18:54:36.320041 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317271 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 18:54:36.320041 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317274 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 18:54:36.320041 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317277 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 18:54:36.320041 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317280 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 18:54:36.320041 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317284 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 18:54:36.320041 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317287 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 18:54:36.320041 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317290 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 18:54:36.320041 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317292 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 18:54:36.320041 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317295 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 18:54:36.320041 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317298 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 18:54:36.320041 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317300 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 18:54:36.320041 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317303 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 18:54:36.320041 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317306 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 18:54:36.320041 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317308 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 18:54:36.320041 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317311 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 18:54:36.320555 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317315 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 18:54:36.320555 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317317 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 18:54:36.320555 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317320 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 18:54:36.320555 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317322 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 18:54:36.320555 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317325 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 18:54:36.320555 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317328 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 18:54:36.320555 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317330 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 18:54:36.320555 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317333 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 18:54:36.320555 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317335 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 18:54:36.320555 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317337 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 18:54:36.320555 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317340 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 18:54:36.320555 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317343 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 18:54:36.320555 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317345 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 18:54:36.320555 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.317350 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 18:54:36.320555 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317463 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 18:54:36.320938 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317467 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 18:54:36.320938 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317470 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 18:54:36.320938 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317472 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 18:54:36.320938 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317475 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 18:54:36.320938 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317477 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 18:54:36.320938 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317480 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 18:54:36.320938 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317482 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 18:54:36.320938 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317485 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 14 18:54:36.320938 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317487 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 18:54:36.320938 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317489 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 18:54:36.320938 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317492 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 18:54:36.320938 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317494 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 18:54:36.320938 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317497 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 18:54:36.320938 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317499 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 18:54:36.320938 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317502 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 18:54:36.320938 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317504 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 18:54:36.320938 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317507 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 18:54:36.320938 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317510 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 18:54:36.320938 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317512 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 18:54:36.320938 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317515 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 18:54:36.321413 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317517 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 18:54:36.321413 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317520 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 18:54:36.321413 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317524 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 18:54:36.321413 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317528 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 18:54:36.321413 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317531 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 18:54:36.321413 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317534 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 18:54:36.321413 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317536 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 18:54:36.321413 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317539 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 18:54:36.321413 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317542 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 18:54:36.321413 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317544 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 18:54:36.321413 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317546 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 18:54:36.321413 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317549 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 18:54:36.321413 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317552 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 18:54:36.321413 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317554 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 18:54:36.321413 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317556 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 18:54:36.321413 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317559 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 18:54:36.321413 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317561 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 18:54:36.321413 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317564 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 18:54:36.321413 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317566 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 18:54:36.321883 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317568 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 18:54:36.321883 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317571 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 18:54:36.321883 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317573 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 18:54:36.321883 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317576 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 18:54:36.321883 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317578 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 18:54:36.321883 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317581 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 18:54:36.321883 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317584 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 18:54:36.321883 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317588 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 18:54:36.321883 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317608 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 18:54:36.321883 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317611 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 18:54:36.321883 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317614 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 18:54:36.321883 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317617 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 18:54:36.321883 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317620 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 18:54:36.321883 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317623 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 18:54:36.321883 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317625 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 18:54:36.321883 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317628 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 18:54:36.321883 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317631 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 18:54:36.321883 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317634 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 18:54:36.321883 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317637 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 18:54:36.322489 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317640 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 18:54:36.322489 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317642 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 18:54:36.322489 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317645 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 18:54:36.322489 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317647 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 18:54:36.322489 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317649 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 18:54:36.322489 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317652 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 18:54:36.322489 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317654 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 18:54:36.322489 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317657 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 18:54:36.322489 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317659 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 18:54:36.322489 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317661 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 18:54:36.322489 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317664 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 18:54:36.322489 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317666 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 18:54:36.322489 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317669 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 18:54:36.322489 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317672 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 18:54:36.322489 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317674 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 18:54:36.322489 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317677 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 18:54:36.322489 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317679 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 18:54:36.322489 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317681 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 18:54:36.322489 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317684 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 18:54:36.322489 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317686 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 18:54:36.323296 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317689 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 18:54:36.323296 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317691 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 18:54:36.323296 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317694 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 18:54:36.323296 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317697 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 18:54:36.323296 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317701 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 18:54:36.323296 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317703 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 18:54:36.323296 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317706 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 18:54:36.323296 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317709 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 18:54:36.323296 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317711 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 18:54:36.323296 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317714 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 18:54:36.323296 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317717 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 18:54:36.323296 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317719 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 18:54:36.323296 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317722 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 18:54:36.323296 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317724 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 18:54:36.323296 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317727 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 18:54:36.323296 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317729 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 18:54:36.323296 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317732 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 18:54:36.323296 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317734 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 18:54:36.323296 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317736 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 18:54:36.323296 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:36.317739 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 18:54:36.323822 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.317744 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 18:54:36.323822 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.317845 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 18:54:36.323822 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.319837 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 18:54:36.323822 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.322046 2563 server.go:1019] "Starting client certificate rotation" Jul 14 18:54:36.323822 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.322167 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 18:54:36.323822 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.322227 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 18:54:36.324455 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.324440 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 18:54:36.328298 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.328279 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 18:54:36.335153 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.335135 2563 log.go:25] "Validated CRI v1 runtime API" Jul 14 18:54:36.340416 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.340398 2563 log.go:25] "Validated CRI v1 image API" Jul 14 18:54:36.341880 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.341865 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 18:54:36.344445 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.344427 2563 fs.go:135] Filesystem UUIDs: map[4a290317-da85-4a51-9569-4a0403b19fca:/dev/nvme0n1p3 73c32970-e4cd-49df-8852-5d5b5c86542d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 14 18:54:36.344501 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.344446 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 18:54:36.349470 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.349362 2563 manager.go:216] Machine: {Timestamp:2026-07-14 18:54:36.348100777 +0000 UTC m=+0.346993586 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101186 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec216add289046cd2a49fb50393b873e SystemUUID:ec216add-2890-46cd-2a49-fb50393b873e BootID:28c9ecc4-f736-4dd6-9101-e90503368618 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7f:ff:19:97:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7f:ff:19:97:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:43:f1:ac:5f:fa Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 18:54:36.349470 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.349465 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 18:54:36.349584 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.349541 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 18:54:36.352965 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.352938 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 18:54:36.353094 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.352968 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-130.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 18:54:36.354260 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.354250 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 18:54:36.354293 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.354263 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 18:54:36.354293 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.354270 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 18:54:36.354885 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.354876 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 18:54:36.356055 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.356044 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 18:54:36.358929 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.358916 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 14 18:54:36.359042 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.359032 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 18:54:36.359086 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.359062 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 14 18:54:36.359086 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.359072 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 18:54:36.359139 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.359088 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 18:54:36.359139 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.359097 2563 kubelet.go:398] "Adding apiserver pod source" Jul 14 18:54:36.359139 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.359117 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 18:54:36.359631 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.359571 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 18:54:36.359631 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.359604 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 18:54:36.359822 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.359799 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 18:54:36.361907 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.361887 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 18:54:36.365501 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.365480 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 18:54:36.365742 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.365723 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 18:54:36.365963 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.365952 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 18:54:36.365997 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.365969 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 18:54:36.365997 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.365977 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 18:54:36.365997 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.365986 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 18:54:36.365997 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.365998 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 18:54:36.366104 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.366003 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 18:54:36.366505 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.366497 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 18:54:36.366537 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.366505 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 18:54:36.366537 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.366512 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 18:54:36.366537 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.366518 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 18:54:36.366537 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.366526 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 18:54:36.366537 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.366533 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 18:54:36.366684 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.366556 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 18:54:36.366684 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.366562 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 18:54:36.369778 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.369765 2563 server.go:1268] "Started kubelet" Jul 14 18:54:36.369886 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.369859 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 18:54:36.370131 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.369862 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 18:54:36.370259 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.370240 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 18:54:36.370738 ip-10-0-143-130 systemd[1]: Started Kubernetes Kubelet. Jul 14 18:54:36.371139 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.371115 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-130.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 18:54:36.371139 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:36.371132 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-130.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 18:54:36.371295 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:36.371266 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 18:54:36.371772 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.371753 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 18:54:36.371891 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.371879 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 14 18:54:36.374537 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:36.374519 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 18:54:36.377210 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.377195 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 18:54:36.377289 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.377213 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 18:54:36.377289 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:36.377265 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-130.ec2.internal\" not found" Jul 14 18:54:36.377903 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.377800 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 18:54:36.377903 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.377866 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 18:54:36.378018 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.377949 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 18:54:36.378082 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.378062 2563 factory.go:55] Registering systemd factory Jul 14 18:54:36.378140 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.378109 2563 factory.go:223] Registration of the systemd container factory successfully Jul 14 18:54:36.378140 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.378068 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 14 18:54:36.378231 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.378147 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 14 18:54:36.378321 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.378304 2563 factory.go:153] Registering CRI-O factory Jul 14 18:54:36.378321 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.378324 2563 factory.go:223] Registration of the crio container factory successfully Jul 14 18:54:36.378448 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.378412 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 18:54:36.378502 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.378453 2563 factory.go:103] Registering Raw factory Jul 14 18:54:36.378502 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.378468 2563 manager.go:1196] Started watching for new ooms in manager Jul 14 18:54:36.378943 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:36.377976 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-130.ec2.internal.18c23cd24fadfb62 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-130.ec2.internal,UID:ip-10-0-143-130.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-130.ec2.internal,},FirstTimestamp:2026-07-14 18:54:36.369738594 +0000 UTC m=+0.368631403,LastTimestamp:2026-07-14 18:54:36.369738594 +0000 UTC m=+0.368631403,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-130.ec2.internal,}" Jul 14 18:54:36.379528 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.379512 2563 manager.go:349] Starting recovery of all containers Jul 14 18:54:36.382686 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:36.382659 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 18:54:36.382751 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:36.382685 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-130.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 18:54:36.388864 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.388845 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5ffb7" Jul 14 18:54:36.391099 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.390911 2563 manager.go:354] Recovery completed Jul 14 18:54:36.396888 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.396876 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 18:54:36.398726 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.398707 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-130.ec2.internal" event="NodeHasSufficientMemory" Jul 14 18:54:36.398801 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.398739 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 18:54:36.398801 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.398749 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-130.ec2.internal" event="NodeHasSufficientPID" Jul 14 18:54:36.399299 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.399288 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 18:54:36.399299 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.399299 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 18:54:36.399369 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.399313 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 14 18:54:36.399369 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.399299 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 18:54:36.399730 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.399716 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5ffb7" Jul 14 18:54:36.400071 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.400054 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-130.ec2.internal" event="NodeHasSufficientMemory" Jul 14 18:54:36.400120 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.400086 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 18:54:36.400120 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.400099 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-130.ec2.internal" event="NodeHasSufficientPID" Jul 14 18:54:36.400550 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.400539 2563 policy_none.go:49] "None policy: Start" Jul 14 18:54:36.400587 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.400555 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 18:54:36.400587 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.400564 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 18:54:36.400917 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:36.400855 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-130.ec2.internal.18c23cd2516848bc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-130.ec2.internal,UID:ip-10-0-143-130.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-130.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-130.ec2.internal,},FirstTimestamp:2026-07-14 18:54:36.398725308 +0000 UTC m=+0.397618119,LastTimestamp:2026-07-14 18:54:36.398725308 +0000 UTC m=+0.397618119,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-130.ec2.internal,}" Jul 14 18:54:36.401864 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.401840 2563 policy_none.go:47] "Start" Jul 14 18:54:36.440065 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.440050 2563 manager.go:337] "Starting Device Plugin manager" Jul 14 18:54:36.440143 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:36.440084 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 18:54:36.440143 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.440095 2563 server.go:87] "Starting device plugin registration server" Jul 14 18:54:36.440396 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.440381 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 18:54:36.440444 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.440401 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 18:54:36.440533 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.440509 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 18:54:36.440654 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.440607 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 18:54:36.440654 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.440616 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 18:54:36.441106 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:36.441083 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 18:54:36.441178 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:36.441125 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-130.ec2.internal\" not found" Jul 14 18:54:36.541104 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.541068 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 18:54:36.542485 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.542066 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-130.ec2.internal" event="NodeHasSufficientMemory" Jul 14 18:54:36.542485 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.542093 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 18:54:36.542485 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.542107 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-130.ec2.internal" event="NodeHasSufficientPID" Jul 14 18:54:36.542485 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.542139 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-130.ec2.internal" Jul 14 18:54:36.550531 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.550487 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-130.ec2.internal" Jul 14 18:54:36.550531 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:36.550515 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-130.ec2.internal\": node \"ip-10-0-143-130.ec2.internal\" not found" Jul 14 18:54:36.558914 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.558892 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 18:54:36.560254 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.560237 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 18:54:36.560301 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.560284 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 18:54:36.560334 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.560307 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 18:54:36.560380 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:36.560345 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 18:54:36.562623 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.562589 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 18:54:36.566334 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:36.566313 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-130.ec2.internal\" not found" Jul 14 18:54:36.661436 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.661385 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-130.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-130.ec2.internal"] Jul 14 18:54:36.661546 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.661477 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 18:54:36.662462 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.662446 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-130.ec2.internal" event="NodeHasSufficientMemory" Jul 14 18:54:36.662534 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.662479 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 18:54:36.662534 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.662491 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-130.ec2.internal" event="NodeHasSufficientPID" Jul 14 18:54:36.664054 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.664041 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 18:54:36.664180 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.664165 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-130.ec2.internal" Jul 14 18:54:36.664215 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.664198 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 18:54:36.664779 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.664761 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-130.ec2.internal" event="NodeHasSufficientMemory" Jul 14 18:54:36.664843 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.664779 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-130.ec2.internal" event="NodeHasSufficientMemory" Jul 14 18:54:36.664843 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.664797 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 18:54:36.664843 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.664799 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 18:54:36.664843 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.664809 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-130.ec2.internal" event="NodeHasSufficientPID" Jul 14 18:54:36.664843 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.664817 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-130.ec2.internal" event="NodeHasSufficientPID" Jul 14 18:54:36.665975 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.665958 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-130.ec2.internal" Jul 14 18:54:36.666076 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.665986 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 18:54:36.666422 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:36.666392 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-130.ec2.internal\" not found" Jul 14 18:54:36.666659 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.666645 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-130.ec2.internal" event="NodeHasSufficientMemory" Jul 14 18:54:36.666727 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.666674 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 18:54:36.666727 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.666697 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-130.ec2.internal" event="NodeHasSufficientPID" Jul 14 18:54:36.680187 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.680169 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e89ed3faf2814d9256cb7f34bdd2bc49-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-130.ec2.internal\" (UID: \"e89ed3faf2814d9256cb7f34bdd2bc49\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-130.ec2.internal" Jul 14 18:54:36.680276 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.680192 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a9f761aa7d4495c36ad2e38608410c31-config\") pod \"kube-apiserver-proxy-ip-10-0-143-130.ec2.internal\" (UID: \"a9f761aa7d4495c36ad2e38608410c31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-130.ec2.internal" Jul 14 18:54:36.680276 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.680207 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e89ed3faf2814d9256cb7f34bdd2bc49-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-130.ec2.internal\" (UID: \"e89ed3faf2814d9256cb7f34bdd2bc49\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-130.ec2.internal" Jul 14 18:54:36.681130 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:36.681114 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-130.ec2.internal\" not found" node="ip-10-0-143-130.ec2.internal" Jul 14 18:54:36.684999 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:36.684985 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-130.ec2.internal\" not found" node="ip-10-0-143-130.ec2.internal" Jul 14 18:54:36.767065 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:36.767031 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-130.ec2.internal\" not found" Jul 14 18:54:36.781188 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.781158 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e89ed3faf2814d9256cb7f34bdd2bc49-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-130.ec2.internal\" (UID: \"e89ed3faf2814d9256cb7f34bdd2bc49\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-130.ec2.internal" Jul 14 18:54:36.781337 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.781187 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e89ed3faf2814d9256cb7f34bdd2bc49-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-130.ec2.internal\" (UID: \"e89ed3faf2814d9256cb7f34bdd2bc49\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-130.ec2.internal" Jul 14 18:54:36.781337 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.781233 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a9f761aa7d4495c36ad2e38608410c31-config\") pod \"kube-apiserver-proxy-ip-10-0-143-130.ec2.internal\" (UID: \"a9f761aa7d4495c36ad2e38608410c31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-130.ec2.internal" Jul 14 18:54:36.781337 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.781247 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e89ed3faf2814d9256cb7f34bdd2bc49-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-130.ec2.internal\" (UID: \"e89ed3faf2814d9256cb7f34bdd2bc49\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-130.ec2.internal" Jul 14 18:54:36.781337 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.781286 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e89ed3faf2814d9256cb7f34bdd2bc49-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-130.ec2.internal\" (UID: \"e89ed3faf2814d9256cb7f34bdd2bc49\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-130.ec2.internal" Jul 14 18:54:36.781337 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.781285 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a9f761aa7d4495c36ad2e38608410c31-config\") pod \"kube-apiserver-proxy-ip-10-0-143-130.ec2.internal\" (UID: \"a9f761aa7d4495c36ad2e38608410c31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-130.ec2.internal" Jul 14 18:54:36.867928 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:36.867840 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-130.ec2.internal\" not found" Jul 14 18:54:36.968394 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:36.968364 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-130.ec2.internal\" not found" Jul 14 18:54:36.982810 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.982780 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-130.ec2.internal" Jul 14 18:54:36.988404 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:36.987708 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-130.ec2.internal" Jul 14 18:54:37.070499 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:37.070455 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-130.ec2.internal\" not found" Jul 14 18:54:37.171377 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:37.171293 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-130.ec2.internal\" not found" Jul 14 18:54:37.275330 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:37.275287 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-130.ec2.internal\" not found" Jul 14 18:54:37.322290 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:37.322241 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 18:54:37.322855 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:37.322435 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 18:54:37.357793 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:37.357760 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 18:54:37.376473 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:37.376448 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-130.ec2.internal\" not found" Jul 14 18:54:37.402752 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:37.402709 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 18:49:36 +0000 UTC" deadline="2028-04-01 23:55:46.600893088 +0000 UTC" Jul 14 18:54:37.402752 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:37.402744 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15053h1m9.198152405s" Jul 14 18:54:37.477702 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:37.477616 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-130.ec2.internal\" not found" Jul 14 18:54:37.578681 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:37.578650 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-130.ec2.internal\" not found" Jul 14 18:54:37.679138 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:37.679107 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-130.ec2.internal\" not found" Jul 14 18:54:37.681279 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:37.681237 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9f761aa7d4495c36ad2e38608410c31.slice/crio-4d66ff49401c5267df1e655dd49868e0f4808bf6f1cc9290f2a68d2f12a62d35 WatchSource:0}: Error finding container 4d66ff49401c5267df1e655dd49868e0f4808bf6f1cc9290f2a68d2f12a62d35: Status 404 returned error can't find the container with id 4d66ff49401c5267df1e655dd49868e0f4808bf6f1cc9290f2a68d2f12a62d35 Jul 14 18:54:37.686059 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:37.686043 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 18:54:37.730472 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:37.730416 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 18:54:37.779414 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:37.779386 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-130.ec2.internal\" not found" Jul 14 18:54:37.812218 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:37.812194 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 18:54:37.878110 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:37.878068 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-130.ec2.internal" Jul 14 18:54:37.897260 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:37.897238 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 18:54:37.898544 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:37.898530 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-130.ec2.internal" Jul 14 18:54:37.910919 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:37.910899 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 18:54:38.360791 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.360752 2563 apiserver.go:52] "Watching apiserver" Jul 14 18:54:38.368348 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.368325 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 18:54:38.369582 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.369556 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-p59q5","openshift-multus/network-metrics-daemon-wkwn8","kube-system/konnectivity-agent-7mhm7","openshift-dns/node-resolver-gmbvx","openshift-image-registry/node-ca-ddrwt","openshift-network-diagnostics/network-check-target-dqjld","openshift-network-operator/iptables-alerter-ppdzr","openshift-ovn-kubernetes/ovnkube-node-trrs2","kube-system/global-pull-secret-syncer-4vl24","kube-system/kube-apiserver-proxy-ip-10-0-143-130.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6","openshift-cluster-node-tuning-operator/tuned-kdqhs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-130.ec2.internal","openshift-multus/multus-additional-cni-plugins-62zv6"] Jul 14 18:54:38.371253 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.371234 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ppdzr" Jul 14 18:54:38.372453 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.372435 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.374008 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.373883 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7mhm7" Jul 14 18:54:38.374437 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.374411 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 18:54:38.375216 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.374863 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 18:54:38.375216 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.374991 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 18:54:38.375216 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.375088 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rcmq4\"" Jul 14 18:54:38.375383 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.375229 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 18:54:38.375383 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.375350 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gmbvx" Jul 14 18:54:38.376410 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.376251 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 18:54:38.376410 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.376289 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 18:54:38.376769 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.376750 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ddrwt" Jul 14 18:54:38.377717 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.377690 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kw9nc\"" Jul 14 18:54:38.377822 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.377760 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 18:54:38.378174 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.378154 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 18:54:38.378372 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.378357 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:54:38.378452 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:38.378430 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqjld" podUID="0f406c4e-fac6-4430-a37f-8e8e1aa60215" Jul 14 18:54:38.380446 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.379093 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 18:54:38.380446 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.379190 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 18:54:38.380446 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.379208 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 18:54:38.380446 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.379211 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-56jqk\"" Jul 14 18:54:38.380446 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.379777 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:38.380446 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:38.379861 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vl24" podUID="b14d3ec3-b9f4-405e-b759-56a512688c5f" Jul 14 18:54:38.380957 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.380540 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vzj6n\"" Jul 14 18:54:38.380957 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.380711 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 18:54:38.380957 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.380778 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 18:54:38.380957 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.380842 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5dwqj\"" Jul 14 18:54:38.381152 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.381054 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 18:54:38.382142 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.382124 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.383566 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.383541 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:54:38.383683 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:38.383648 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwn8" podUID="028e2834-88e2-48da-a867-c1b791f58cec" Jul 14 18:54:38.385145 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.385124 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.387237 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.386615 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 18:54:38.387237 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.386665 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 18:54:38.387237 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.386701 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 18:54:38.387237 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.386754 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.387237 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.386910 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 18:54:38.387237 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.386985 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 18:54:38.387237 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.387001 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bfcdn\"" Jul 14 18:54:38.387817 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.387663 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 18:54:38.387817 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.387734 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 18:54:38.388107 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.388090 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-85wks\"" Jul 14 18:54:38.388669 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.388651 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.393651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.390502 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 18:54:38.393651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.390546 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 18:54:38.393651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.391054 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 18:54:38.393651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.391166 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 18:54:38.393651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.391395 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0eaee7a8-4488-4f23-ad7f-8ef2f36bad86-socket-dir\") pod \"aws-ebs-csi-driver-node-wpkz6\" (UID: \"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.393651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.391433 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0eaee7a8-4488-4f23-ad7f-8ef2f36bad86-registration-dir\") pod \"aws-ebs-csi-driver-node-wpkz6\" (UID: \"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.393651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.391446 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r9kkj\"" Jul 14 18:54:38.393651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.391464 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 18:54:38.393651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.391467 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0eaee7a8-4488-4f23-ad7f-8ef2f36bad86-etc-selinux\") pod \"aws-ebs-csi-driver-node-wpkz6\" (UID: \"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.393651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.391713 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ac30b61-e7a1-4c20-9d7d-937806a945ff-tmp-dir\") pod \"node-resolver-gmbvx\" (UID: \"0ac30b61-e7a1-4c20-9d7d-937806a945ff\") " pod="openshift-dns/node-resolver-gmbvx" Jul 14 18:54:38.393651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.391823 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5fbbc18a-4a27-4e86-8c87-902868a08e08-serviceca\") pod \"node-ca-ddrwt\" (UID: \"5fbbc18a-4a27-4e86-8c87-902868a08e08\") " pod="openshift-image-registry/node-ca-ddrwt" Jul 14 18:54:38.393651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.391876 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgfps\" (UniqueName: \"kubernetes.io/projected/5fbbc18a-4a27-4e86-8c87-902868a08e08-kube-api-access-zgfps\") pod \"node-ca-ddrwt\" (UID: \"5fbbc18a-4a27-4e86-8c87-902868a08e08\") " pod="openshift-image-registry/node-ca-ddrwt" Jul 14 18:54:38.393651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.391942 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0eaee7a8-4488-4f23-ad7f-8ef2f36bad86-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wpkz6\" (UID: \"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.393651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.392013 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8f754bf-1c44-4f17-bda8-5e1708679f80-agent-certs\") pod \"konnectivity-agent-7mhm7\" (UID: \"f8f754bf-1c44-4f17-bda8-5e1708679f80\") " pod="kube-system/konnectivity-agent-7mhm7" Jul 14 18:54:38.393651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.392099 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ac30b61-e7a1-4c20-9d7d-937806a945ff-hosts-file\") pod \"node-resolver-gmbvx\" (UID: \"0ac30b61-e7a1-4c20-9d7d-937806a945ff\") " pod="openshift-dns/node-resolver-gmbvx" Jul 14 18:54:38.393651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.392138 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwb9t\" (UniqueName: \"kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t\") pod \"network-check-target-dqjld\" (UID: \"0f406c4e-fac6-4430-a37f-8e8e1aa60215\") " pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:54:38.393651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.392175 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0eaee7a8-4488-4f23-ad7f-8ef2f36bad86-sys-fs\") pod \"aws-ebs-csi-driver-node-wpkz6\" (UID: \"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.393651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.392201 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcx5h\" (UniqueName: \"kubernetes.io/projected/0eaee7a8-4488-4f23-ad7f-8ef2f36bad86-kube-api-access-mcx5h\") pod \"aws-ebs-csi-driver-node-wpkz6\" (UID: \"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.393651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.392239 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80028423-783a-44f1-9f16-73f336cfeb50-iptables-alerter-script\") pod \"iptables-alerter-ppdzr\" (UID: \"80028423-783a-44f1-9f16-73f336cfeb50\") " pod="openshift-network-operator/iptables-alerter-ppdzr" Jul 14 18:54:38.394347 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.392302 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80028423-783a-44f1-9f16-73f336cfeb50-host-slash\") pod \"iptables-alerter-ppdzr\" (UID: \"80028423-783a-44f1-9f16-73f336cfeb50\") " pod="openshift-network-operator/iptables-alerter-ppdzr" Jul 14 18:54:38.394347 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.392332 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df6bc\" (UniqueName: \"kubernetes.io/projected/80028423-783a-44f1-9f16-73f336cfeb50-kube-api-access-df6bc\") pod \"iptables-alerter-ppdzr\" (UID: \"80028423-783a-44f1-9f16-73f336cfeb50\") " pod="openshift-network-operator/iptables-alerter-ppdzr" Jul 14 18:54:38.394347 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.392382 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0eaee7a8-4488-4f23-ad7f-8ef2f36bad86-device-dir\") pod \"aws-ebs-csi-driver-node-wpkz6\" (UID: \"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.394347 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.392423 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8f754bf-1c44-4f17-bda8-5e1708679f80-konnectivity-ca\") pod \"konnectivity-agent-7mhm7\" (UID: \"f8f754bf-1c44-4f17-bda8-5e1708679f80\") " pod="kube-system/konnectivity-agent-7mhm7" Jul 14 18:54:38.394347 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.392463 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg9sd\" (UniqueName: \"kubernetes.io/projected/0ac30b61-e7a1-4c20-9d7d-937806a945ff-kube-api-access-cg9sd\") pod \"node-resolver-gmbvx\" (UID: \"0ac30b61-e7a1-4c20-9d7d-937806a945ff\") " pod="openshift-dns/node-resolver-gmbvx" Jul 14 18:54:38.394347 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.392511 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fbbc18a-4a27-4e86-8c87-902868a08e08-host\") pod \"node-ca-ddrwt\" (UID: \"5fbbc18a-4a27-4e86-8c87-902868a08e08\") " pod="openshift-image-registry/node-ca-ddrwt" Jul 14 18:54:38.394347 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.394263 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 18:54:38.394347 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.394312 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 18:54:38.394347 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.394345 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f6dwn\"" Jul 14 18:54:38.399215 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.399194 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 18:54:38.437729 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.437692 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mhg95" Jul 14 18:54:38.445194 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.445174 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mhg95" Jul 14 18:54:38.479066 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.479038 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 18:54:38.493549 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.493508 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-run-ovn\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.493549 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.493550 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-host-cni-bin\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.493763 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.493572 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-multus-cni-dir\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.493763 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.493628 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ac30b61-e7a1-4c20-9d7d-937806a945ff-tmp-dir\") pod \"node-resolver-gmbvx\" (UID: \"0ac30b61-e7a1-4c20-9d7d-937806a945ff\") " pod="openshift-dns/node-resolver-gmbvx" Jul 14 18:54:38.493763 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.493661 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret\") pod \"global-pull-secret-syncer-4vl24\" (UID: \"b14d3ec3-b9f4-405e-b759-56a512688c5f\") " pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:38.493763 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.493684 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-multus-socket-dir-parent\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.493967 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.493784 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-host-var-lib-cni-multus\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.493967 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.493808 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwb9t\" (UniqueName: \"kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t\") pod \"network-check-target-dqjld\" (UID: \"0f406c4e-fac6-4430-a37f-8e8e1aa60215\") " pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:54:38.493967 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.493838 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59e0cda2-1a2f-4c52-872b-44696ecd101d-system-cni-dir\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.493967 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.493857 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-sys\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.493967 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.493884 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a5633a96-04d9-465c-ae2c-2b5d013f4381-env-overrides\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.493967 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.493921 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-cnibin\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.493967 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.493953 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf43df7b-db49-459d-8d26-3dd49ee44127-multus-daemon-config\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.494252 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.493987 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg9sd\" (UniqueName: \"kubernetes.io/projected/0ac30b61-e7a1-4c20-9d7d-937806a945ff-kube-api-access-cg9sd\") pod \"node-resolver-gmbvx\" (UID: \"0ac30b61-e7a1-4c20-9d7d-937806a945ff\") " pod="openshift-dns/node-resolver-gmbvx" Jul 14 18:54:38.494252 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494003 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ac30b61-e7a1-4c20-9d7d-937806a945ff-tmp-dir\") pod \"node-resolver-gmbvx\" (UID: \"0ac30b61-e7a1-4c20-9d7d-937806a945ff\") " pod="openshift-dns/node-resolver-gmbvx" Jul 14 18:54:38.494252 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494013 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-var-lib-kubelet\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.494252 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494036 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/889f11ba-784c-43c1-8e82-94cc371da75f-etc-tuned\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.494252 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494059 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-log-socket\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.494252 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494083 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a5633a96-04d9-465c-ae2c-2b5d013f4381-ovnkube-config\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.494252 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494101 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59e0cda2-1a2f-4c52-872b-44696ecd101d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.494252 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494118 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2958\" (UniqueName: \"kubernetes.io/projected/59e0cda2-1a2f-4c52-872b-44696ecd101d-kube-api-access-t2958\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.494252 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494157 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-lib-modules\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.494252 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494201 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-host\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.494252 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494226 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-etc-kubernetes\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.494777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494258 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-etc-openvswitch\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.494777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494291 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0eaee7a8-4488-4f23-ad7f-8ef2f36bad86-etc-selinux\") pod \"aws-ebs-csi-driver-node-wpkz6\" (UID: \"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.494777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494338 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-etc-sysconfig\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.494777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494379 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2fwn\" (UniqueName: \"kubernetes.io/projected/028e2834-88e2-48da-a867-c1b791f58cec-kube-api-access-r2fwn\") pod \"network-metrics-daemon-wkwn8\" (UID: \"028e2834-88e2-48da-a867-c1b791f58cec\") " pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:54:38.494777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494415 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5633a96-04d9-465c-ae2c-2b5d013f4381-ovn-node-metrics-cert\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.494777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494433 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0eaee7a8-4488-4f23-ad7f-8ef2f36bad86-etc-selinux\") pod \"aws-ebs-csi-driver-node-wpkz6\" (UID: \"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.494777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494455 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-multus-conf-dir\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.494777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494483 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ac30b61-e7a1-4c20-9d7d-937806a945ff-hosts-file\") pod \"node-resolver-gmbvx\" (UID: \"0ac30b61-e7a1-4c20-9d7d-937806a945ff\") " pod="openshift-dns/node-resolver-gmbvx" Jul 14 18:54:38.494777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494521 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59e0cda2-1a2f-4c52-872b-44696ecd101d-os-release\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.494777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494538 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf43df7b-db49-459d-8d26-3dd49ee44127-cni-binary-copy\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.494777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494565 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-host-run-multus-certs\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.494777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494595 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0eaee7a8-4488-4f23-ad7f-8ef2f36bad86-device-dir\") pod \"aws-ebs-csi-driver-node-wpkz6\" (UID: \"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.494777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494633 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ac30b61-e7a1-4c20-9d7d-937806a945ff-hosts-file\") pod \"node-resolver-gmbvx\" (UID: \"0ac30b61-e7a1-4c20-9d7d-937806a945ff\") " pod="openshift-dns/node-resolver-gmbvx" Jul 14 18:54:38.494777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494643 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/59e0cda2-1a2f-4c52-872b-44696ecd101d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.494777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494694 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs\") pod \"network-metrics-daemon-wkwn8\" (UID: \"028e2834-88e2-48da-a867-c1b791f58cec\") " pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:54:38.494777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494713 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0eaee7a8-4488-4f23-ad7f-8ef2f36bad86-device-dir\") pod \"aws-ebs-csi-driver-node-wpkz6\" (UID: \"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.495576 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494729 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-var-lib-openvswitch\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.495576 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494768 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-host-run-ovn-kubernetes\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.495576 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494798 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-host-run-netns\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.495576 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494836 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0eaee7a8-4488-4f23-ad7f-8ef2f36bad86-socket-dir\") pod \"aws-ebs-csi-driver-node-wpkz6\" (UID: \"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.495576 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494862 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b14d3ec3-b9f4-405e-b759-56a512688c5f-dbus\") pod \"global-pull-secret-syncer-4vl24\" (UID: \"b14d3ec3-b9f4-405e-b759-56a512688c5f\") " pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:38.495576 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494886 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-etc-sysctl-d\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.495576 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494912 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6q2s\" (UniqueName: \"kubernetes.io/projected/a5633a96-04d9-465c-ae2c-2b5d013f4381-kube-api-access-j6q2s\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.495576 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494938 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-host-var-lib-cni-bin\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.495576 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.494973 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0eaee7a8-4488-4f23-ad7f-8ef2f36bad86-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wpkz6\" (UID: \"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.495576 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495013 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0eaee7a8-4488-4f23-ad7f-8ef2f36bad86-socket-dir\") pod \"aws-ebs-csi-driver-node-wpkz6\" (UID: \"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.495576 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495032 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0eaee7a8-4488-4f23-ad7f-8ef2f36bad86-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wpkz6\" (UID: \"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.495576 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495065 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-host-slash\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.495576 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495087 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-run-openvswitch\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.495576 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495123 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-node-log\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.495576 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495154 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.495576 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495180 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-host-run-netns\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.496210 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495206 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0eaee7a8-4488-4f23-ad7f-8ef2f36bad86-sys-fs\") pod \"aws-ebs-csi-driver-node-wpkz6\" (UID: \"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.496210 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495233 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80028423-783a-44f1-9f16-73f336cfeb50-iptables-alerter-script\") pod \"iptables-alerter-ppdzr\" (UID: \"80028423-783a-44f1-9f16-73f336cfeb50\") " pod="openshift-network-operator/iptables-alerter-ppdzr" Jul 14 18:54:38.496210 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495259 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df6bc\" (UniqueName: \"kubernetes.io/projected/80028423-783a-44f1-9f16-73f336cfeb50-kube-api-access-df6bc\") pod \"iptables-alerter-ppdzr\" (UID: \"80028423-783a-44f1-9f16-73f336cfeb50\") " pod="openshift-network-operator/iptables-alerter-ppdzr" Jul 14 18:54:38.496210 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495282 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8f754bf-1c44-4f17-bda8-5e1708679f80-konnectivity-ca\") pod \"konnectivity-agent-7mhm7\" (UID: \"f8f754bf-1c44-4f17-bda8-5e1708679f80\") " pod="kube-system/konnectivity-agent-7mhm7" Jul 14 18:54:38.496210 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495289 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0eaee7a8-4488-4f23-ad7f-8ef2f36bad86-sys-fs\") pod \"aws-ebs-csi-driver-node-wpkz6\" (UID: \"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.496210 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495309 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-etc-modprobe-d\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.496210 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495333 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-run\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.496210 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495358 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59e0cda2-1a2f-4c52-872b-44696ecd101d-cni-binary-copy\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.496210 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495383 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fksgd\" (UniqueName: \"kubernetes.io/projected/889f11ba-784c-43c1-8e82-94cc371da75f-kube-api-access-fksgd\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.496210 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495405 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-run-systemd\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.496210 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495427 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-host-cni-netd\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.496210 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495448 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a5633a96-04d9-465c-ae2c-2b5d013f4381-ovnkube-script-lib\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.496210 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495473 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-system-cni-dir\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.496210 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495516 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-os-release\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.496210 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495558 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-host-run-k8s-cni-cncf-io\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.496210 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495579 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0eaee7a8-4488-4f23-ad7f-8ef2f36bad86-registration-dir\") pod \"aws-ebs-csi-driver-node-wpkz6\" (UID: \"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.496210 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495622 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5fbbc18a-4a27-4e86-8c87-902868a08e08-serviceca\") pod \"node-ca-ddrwt\" (UID: \"5fbbc18a-4a27-4e86-8c87-902868a08e08\") " pod="openshift-image-registry/node-ca-ddrwt" Jul 14 18:54:38.497076 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495650 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgfps\" (UniqueName: \"kubernetes.io/projected/5fbbc18a-4a27-4e86-8c87-902868a08e08-kube-api-access-zgfps\") pod \"node-ca-ddrwt\" (UID: \"5fbbc18a-4a27-4e86-8c87-902868a08e08\") " pod="openshift-image-registry/node-ca-ddrwt" Jul 14 18:54:38.497076 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495663 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0eaee7a8-4488-4f23-ad7f-8ef2f36bad86-registration-dir\") pod \"aws-ebs-csi-driver-node-wpkz6\" (UID: \"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.497076 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-systemd-units\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.497076 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495706 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-host-var-lib-kubelet\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.497076 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495803 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-hostroot\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.497076 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495836 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwjm6\" (UniqueName: \"kubernetes.io/projected/bf43df7b-db49-459d-8d26-3dd49ee44127-kube-api-access-qwjm6\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.497076 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495869 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8f754bf-1c44-4f17-bda8-5e1708679f80-agent-certs\") pod \"konnectivity-agent-7mhm7\" (UID: \"f8f754bf-1c44-4f17-bda8-5e1708679f80\") " pod="kube-system/konnectivity-agent-7mhm7" Jul 14 18:54:38.497076 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495879 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80028423-783a-44f1-9f16-73f336cfeb50-iptables-alerter-script\") pod \"iptables-alerter-ppdzr\" (UID: \"80028423-783a-44f1-9f16-73f336cfeb50\") " pod="openshift-network-operator/iptables-alerter-ppdzr" Jul 14 18:54:38.497076 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495896 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59e0cda2-1a2f-4c52-872b-44696ecd101d-cnibin\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.497076 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495934 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-etc-sysctl-conf\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.497076 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495938 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8f754bf-1c44-4f17-bda8-5e1708679f80-konnectivity-ca\") pod \"konnectivity-agent-7mhm7\" (UID: \"f8f754bf-1c44-4f17-bda8-5e1708679f80\") " pod="kube-system/konnectivity-agent-7mhm7" Jul 14 18:54:38.497076 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495974 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/889f11ba-784c-43c1-8e82-94cc371da75f-tmp\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.497076 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.495999 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-host-kubelet\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.497076 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.496039 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b14d3ec3-b9f4-405e-b759-56a512688c5f-kubelet-config\") pod \"global-pull-secret-syncer-4vl24\" (UID: \"b14d3ec3-b9f4-405e-b759-56a512688c5f\") " pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:38.497076 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.496045 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5fbbc18a-4a27-4e86-8c87-902868a08e08-serviceca\") pod \"node-ca-ddrwt\" (UID: \"5fbbc18a-4a27-4e86-8c87-902868a08e08\") " pod="openshift-image-registry/node-ca-ddrwt" Jul 14 18:54:38.497076 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.496072 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcx5h\" (UniqueName: \"kubernetes.io/projected/0eaee7a8-4488-4f23-ad7f-8ef2f36bad86-kube-api-access-mcx5h\") pod \"aws-ebs-csi-driver-node-wpkz6\" (UID: \"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.497076 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.496104 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80028423-783a-44f1-9f16-73f336cfeb50-host-slash\") pod \"iptables-alerter-ppdzr\" (UID: \"80028423-783a-44f1-9f16-73f336cfeb50\") " pod="openshift-network-operator/iptables-alerter-ppdzr" Jul 14 18:54:38.497651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.496168 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fbbc18a-4a27-4e86-8c87-902868a08e08-host\") pod \"node-ca-ddrwt\" (UID: \"5fbbc18a-4a27-4e86-8c87-902868a08e08\") " pod="openshift-image-registry/node-ca-ddrwt" Jul 14 18:54:38.497651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.496189 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 18:54:38.497651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.496209 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/59e0cda2-1a2f-4c52-872b-44696ecd101d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.497651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.496254 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80028423-783a-44f1-9f16-73f336cfeb50-host-slash\") pod \"iptables-alerter-ppdzr\" (UID: \"80028423-783a-44f1-9f16-73f336cfeb50\") " pod="openshift-network-operator/iptables-alerter-ppdzr" Jul 14 18:54:38.497651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.496272 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-etc-kubernetes\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.497651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.496278 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fbbc18a-4a27-4e86-8c87-902868a08e08-host\") pod \"node-ca-ddrwt\" (UID: \"5fbbc18a-4a27-4e86-8c87-902868a08e08\") " pod="openshift-image-registry/node-ca-ddrwt" Jul 14 18:54:38.497651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.496307 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-etc-systemd\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.499900 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.499879 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8f754bf-1c44-4f17-bda8-5e1708679f80-agent-certs\") pod \"konnectivity-agent-7mhm7\" (UID: \"f8f754bf-1c44-4f17-bda8-5e1708679f80\") " pod="kube-system/konnectivity-agent-7mhm7" Jul 14 18:54:38.507185 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:38.507162 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 18:54:38.507282 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:38.507194 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 18:54:38.507282 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:38.507209 2563 projected.go:196] Error preparing data for projected volume kube-api-access-zwb9t for pod openshift-network-diagnostics/network-check-target-dqjld: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:54:38.507282 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:38.507273 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t podName:0f406c4e-fac6-4430-a37f-8e8e1aa60215 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:39.007251616 +0000 UTC m=+3.006144416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zwb9t" (UniqueName: "kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t") pod "network-check-target-dqjld" (UID: "0f406c4e-fac6-4430-a37f-8e8e1aa60215") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:54:38.508897 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.508874 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgfps\" (UniqueName: \"kubernetes.io/projected/5fbbc18a-4a27-4e86-8c87-902868a08e08-kube-api-access-zgfps\") pod \"node-ca-ddrwt\" (UID: \"5fbbc18a-4a27-4e86-8c87-902868a08e08\") " pod="openshift-image-registry/node-ca-ddrwt" Jul 14 18:54:38.510118 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.510097 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcx5h\" (UniqueName: \"kubernetes.io/projected/0eaee7a8-4488-4f23-ad7f-8ef2f36bad86-kube-api-access-mcx5h\") pod \"aws-ebs-csi-driver-node-wpkz6\" (UID: \"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.510220 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.510151 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg9sd\" (UniqueName: \"kubernetes.io/projected/0ac30b61-e7a1-4c20-9d7d-937806a945ff-kube-api-access-cg9sd\") pod \"node-resolver-gmbvx\" (UID: \"0ac30b61-e7a1-4c20-9d7d-937806a945ff\") " pod="openshift-dns/node-resolver-gmbvx" Jul 14 18:54:38.510220 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.510148 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df6bc\" (UniqueName: \"kubernetes.io/projected/80028423-783a-44f1-9f16-73f336cfeb50-kube-api-access-df6bc\") pod \"iptables-alerter-ppdzr\" (UID: \"80028423-783a-44f1-9f16-73f336cfeb50\") " pod="openshift-network-operator/iptables-alerter-ppdzr" Jul 14 18:54:38.565358 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.565300 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-130.ec2.internal" event={"ID":"a9f761aa7d4495c36ad2e38608410c31","Type":"ContainerStarted","Data":"4d66ff49401c5267df1e655dd49868e0f4808bf6f1cc9290f2a68d2f12a62d35"} Jul 14 18:54:38.596219 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.596192 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 18:54:38.596556 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.596534 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59e0cda2-1a2f-4c52-872b-44696ecd101d-os-release\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.596645 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.596565 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf43df7b-db49-459d-8d26-3dd49ee44127-cni-binary-copy\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.596645 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.596582 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-host-run-multus-certs\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.596645 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.596599 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/59e0cda2-1a2f-4c52-872b-44696ecd101d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.596645 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.596642 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs\") pod \"network-metrics-daemon-wkwn8\" (UID: \"028e2834-88e2-48da-a867-c1b791f58cec\") " pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:54:38.596846 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.596648 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59e0cda2-1a2f-4c52-872b-44696ecd101d-os-release\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.596846 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.596660 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-host-run-multus-certs\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.596846 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.596666 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-var-lib-openvswitch\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.596846 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.596717 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-var-lib-openvswitch\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.596846 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.596728 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-host-run-ovn-kubernetes\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.596846 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.596756 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-host-run-netns\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.596846 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.596762 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-host-run-ovn-kubernetes\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.596846 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:38.596758 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:54:38.596846 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.596792 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b14d3ec3-b9f4-405e-b759-56a512688c5f-dbus\") pod \"global-pull-secret-syncer-4vl24\" (UID: \"b14d3ec3-b9f4-405e-b759-56a512688c5f\") " pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:38.596846 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:38.596833 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs podName:028e2834-88e2-48da-a867-c1b791f58cec nodeName:}" failed. No retries permitted until 2026-07-14 18:54:39.096809981 +0000 UTC m=+3.095702780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs") pod "network-metrics-daemon-wkwn8" (UID: "028e2834-88e2-48da-a867-c1b791f58cec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:54:38.597202 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.596851 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-etc-sysctl-d\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.597202 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.596877 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6q2s\" (UniqueName: \"kubernetes.io/projected/a5633a96-04d9-465c-ae2c-2b5d013f4381-kube-api-access-j6q2s\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.597202 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.596902 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-host-var-lib-cni-bin\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.597202 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.596934 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-host-slash\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.597202 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.596944 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b14d3ec3-b9f4-405e-b759-56a512688c5f-dbus\") pod \"global-pull-secret-syncer-4vl24\" (UID: \"b14d3ec3-b9f4-405e-b759-56a512688c5f\") " pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:38.597202 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.596959 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-run-openvswitch\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.597202 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.596983 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-node-log\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.597202 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597009 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.597202 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597036 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-host-run-netns\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.597202 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597069 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-etc-modprobe-d\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.597202 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597092 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-run\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.597202 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597105 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-etc-sysctl-d\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.597202 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597117 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59e0cda2-1a2f-4c52-872b-44696ecd101d-cni-binary-copy\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.597202 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597149 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fksgd\" (UniqueName: \"kubernetes.io/projected/889f11ba-784c-43c1-8e82-94cc371da75f-kube-api-access-fksgd\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.597202 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597174 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-run-systemd\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.597202 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597184 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-host-run-netns\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.597202 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597204 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-host-cni-netd\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.597745 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597225 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-host-slash\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.597745 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597232 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a5633a96-04d9-465c-ae2c-2b5d013f4381-ovnkube-script-lib\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.597745 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597250 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-host-var-lib-cni-bin\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.597745 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597260 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-system-cni-dir\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.597745 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597262 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf43df7b-db49-459d-8d26-3dd49ee44127-cni-binary-copy\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.597745 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597287 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-os-release\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.597745 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597316 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-host-run-k8s-cni-cncf-io\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.597745 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597344 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-systemd-units\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.597745 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597347 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-host-cni-netd\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.597745 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597357 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-run-openvswitch\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.597745 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597368 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-host-var-lib-kubelet\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.597745 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597393 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-hostroot\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.597745 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597401 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-node-log\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.597745 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597417 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-run-systemd\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.597745 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597418 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwjm6\" (UniqueName: \"kubernetes.io/projected/bf43df7b-db49-459d-8d26-3dd49ee44127-kube-api-access-qwjm6\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.597745 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597444 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-os-release\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.597745 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597456 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59e0cda2-1a2f-4c52-872b-44696ecd101d-cnibin\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.597745 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597464 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-host-var-lib-kubelet\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.598616 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597484 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-etc-sysctl-conf\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.598616 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597525 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/889f11ba-784c-43c1-8e82-94cc371da75f-tmp\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.598616 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597549 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-host-kubelet\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.598616 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597574 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b14d3ec3-b9f4-405e-b759-56a512688c5f-kubelet-config\") pod \"global-pull-secret-syncer-4vl24\" (UID: \"b14d3ec3-b9f4-405e-b759-56a512688c5f\") " pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:38.598616 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597606 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/59e0cda2-1a2f-4c52-872b-44696ecd101d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.598616 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597651 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-etc-kubernetes\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.598616 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597366 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/59e0cda2-1a2f-4c52-872b-44696ecd101d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.598616 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597716 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59e0cda2-1a2f-4c52-872b-44696ecd101d-cnibin\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.598616 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597725 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-system-cni-dir\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.598616 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597739 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-host-run-k8s-cni-cncf-io\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.598616 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597620 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-etc-sysctl-conf\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.598616 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597767 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-host-run-netns\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.598616 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597789 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-hostroot\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.598616 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597784 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.598616 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597799 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b14d3ec3-b9f4-405e-b759-56a512688c5f-kubelet-config\") pod \"global-pull-secret-syncer-4vl24\" (UID: \"b14d3ec3-b9f4-405e-b759-56a512688c5f\") " pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:38.598616 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597812 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-etc-systemd\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.598616 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597843 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-run-ovn\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.599490 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597848 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-etc-kubernetes\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.599490 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597843 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-etc-modprobe-d\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.599490 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597896 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-host-kubelet\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.599490 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597898 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-run-ovn\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.599490 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597898 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-run\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.599490 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597921 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-host-cni-bin\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.599490 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597945 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-etc-systemd\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.599490 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597956 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-host-cni-bin\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.599490 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597917 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-systemd-units\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.599490 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.597959 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-multus-cni-dir\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.599490 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598003 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret\") pod \"global-pull-secret-syncer-4vl24\" (UID: \"b14d3ec3-b9f4-405e-b759-56a512688c5f\") " pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:38.599490 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598016 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-multus-cni-dir\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.599490 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598033 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-multus-socket-dir-parent\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.599490 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598059 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-host-var-lib-cni-multus\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.599490 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598071 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a5633a96-04d9-465c-ae2c-2b5d013f4381-ovnkube-script-lib\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.599490 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598096 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59e0cda2-1a2f-4c52-872b-44696ecd101d-system-cni-dir\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.599490 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:38.598107 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 18:54:38.599490 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598115 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59e0cda2-1a2f-4c52-872b-44696ecd101d-cni-binary-copy\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.600152 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598123 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-sys\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.600152 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598133 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-multus-socket-dir-parent\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.600152 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598141 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-host-var-lib-cni-multus\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.600152 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598147 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a5633a96-04d9-465c-ae2c-2b5d013f4381-env-overrides\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.600152 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598167 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-sys\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.600152 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598168 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59e0cda2-1a2f-4c52-872b-44696ecd101d-system-cni-dir\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.600152 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:38.598168 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret podName:b14d3ec3-b9f4-405e-b759-56a512688c5f nodeName:}" failed. No retries permitted until 2026-07-14 18:54:39.098151244 +0000 UTC m=+3.097044059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret") pod "global-pull-secret-syncer-4vl24" (UID: "b14d3ec3-b9f4-405e-b759-56a512688c5f") : object "kube-system"/"original-pull-secret" not registered Jul 14 18:54:38.600152 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598226 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-cnibin\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.600152 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598253 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf43df7b-db49-459d-8d26-3dd49ee44127-multus-daemon-config\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.600152 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598280 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-var-lib-kubelet\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.600152 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598293 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-cnibin\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.600152 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598302 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/889f11ba-784c-43c1-8e82-94cc371da75f-etc-tuned\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.600152 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598316 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-var-lib-kubelet\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.600152 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598326 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-log-socket\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.600152 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598364 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-log-socket\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.600152 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598374 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a5633a96-04d9-465c-ae2c-2b5d013f4381-ovnkube-config\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.600152 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598403 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59e0cda2-1a2f-4c52-872b-44696ecd101d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.600777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598429 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2958\" (UniqueName: \"kubernetes.io/projected/59e0cda2-1a2f-4c52-872b-44696ecd101d-kube-api-access-t2958\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.600777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598454 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-lib-modules\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.600777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598477 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-host\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.600777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598502 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-etc-kubernetes\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.600777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598508 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a5633a96-04d9-465c-ae2c-2b5d013f4381-env-overrides\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.600777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598528 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-etc-openvswitch\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.600777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598553 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-etc-sysconfig\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.600777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598577 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2fwn\" (UniqueName: \"kubernetes.io/projected/028e2834-88e2-48da-a867-c1b791f58cec-kube-api-access-r2fwn\") pod \"network-metrics-daemon-wkwn8\" (UID: \"028e2834-88e2-48da-a867-c1b791f58cec\") " pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:54:38.600777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598600 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5633a96-04d9-465c-ae2c-2b5d013f4381-ovn-node-metrics-cert\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.600777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598648 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-multus-conf-dir\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.600777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598664 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/59e0cda2-1a2f-4c52-872b-44696ecd101d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.600777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598726 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-multus-conf-dir\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.600777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598773 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5633a96-04d9-465c-ae2c-2b5d013f4381-etc-openvswitch\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.600777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598783 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-etc-sysconfig\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.600777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598822 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59e0cda2-1a2f-4c52-872b-44696ecd101d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.600777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598826 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf43df7b-db49-459d-8d26-3dd49ee44127-etc-kubernetes\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.600777 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.598827 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-host\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.601406 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.599145 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/889f11ba-784c-43c1-8e82-94cc371da75f-lib-modules\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.601406 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.599213 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf43df7b-db49-459d-8d26-3dd49ee44127-multus-daemon-config\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.601406 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.599455 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a5633a96-04d9-465c-ae2c-2b5d013f4381-ovnkube-config\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.601406 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.600583 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/889f11ba-784c-43c1-8e82-94cc371da75f-tmp\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.601406 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.600734 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/889f11ba-784c-43c1-8e82-94cc371da75f-etc-tuned\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.601406 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.601187 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5633a96-04d9-465c-ae2c-2b5d013f4381-ovn-node-metrics-cert\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.607912 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.607864 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwjm6\" (UniqueName: \"kubernetes.io/projected/bf43df7b-db49-459d-8d26-3dd49ee44127-kube-api-access-qwjm6\") pod \"multus-p59q5\" (UID: \"bf43df7b-db49-459d-8d26-3dd49ee44127\") " pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.609620 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.609592 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fksgd\" (UniqueName: \"kubernetes.io/projected/889f11ba-784c-43c1-8e82-94cc371da75f-kube-api-access-fksgd\") pod \"tuned-kdqhs\" (UID: \"889f11ba-784c-43c1-8e82-94cc371da75f\") " pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.610499 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.610475 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6q2s\" (UniqueName: \"kubernetes.io/projected/a5633a96-04d9-465c-ae2c-2b5d013f4381-kube-api-access-j6q2s\") pod \"ovnkube-node-trrs2\" (UID: \"a5633a96-04d9-465c-ae2c-2b5d013f4381\") " pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.611210 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.611170 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2fwn\" (UniqueName: \"kubernetes.io/projected/028e2834-88e2-48da-a867-c1b791f58cec-kube-api-access-r2fwn\") pod \"network-metrics-daemon-wkwn8\" (UID: \"028e2834-88e2-48da-a867-c1b791f58cec\") " pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:54:38.611599 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.611582 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2958\" (UniqueName: \"kubernetes.io/projected/59e0cda2-1a2f-4c52-872b-44696ecd101d-kube-api-access-t2958\") pod \"multus-additional-cni-plugins-62zv6\" (UID: \"59e0cda2-1a2f-4c52-872b-44696ecd101d\") " pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.619273 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:38.619253 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode89ed3faf2814d9256cb7f34bdd2bc49.slice/crio-647169c84e6fe90035f0cf0776cd9c7de725f912c95dedd4b748b1217a04f23f WatchSource:0}: Error finding container 647169c84e6fe90035f0cf0776cd9c7de725f912c95dedd4b748b1217a04f23f: Status 404 returned error can't find the container with id 647169c84e6fe90035f0cf0776cd9c7de725f912c95dedd4b748b1217a04f23f Jul 14 18:54:38.686448 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.686422 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ppdzr" Jul 14 18:54:38.692800 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.692780 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" Jul 14 18:54:38.694651 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:38.694622 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80028423_783a_44f1_9f16_73f336cfeb50.slice/crio-a717c981dd0d21e19940df20b8642915421389b91d873596d26a9e6288e2e2a5 WatchSource:0}: Error finding container a717c981dd0d21e19940df20b8642915421389b91d873596d26a9e6288e2e2a5: Status 404 returned error can't find the container with id a717c981dd0d21e19940df20b8642915421389b91d873596d26a9e6288e2e2a5 Jul 14 18:54:38.701839 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.701816 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7mhm7" Jul 14 18:54:38.702069 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:38.702050 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eaee7a8_4488_4f23_ad7f_8ef2f36bad86.slice/crio-218b498430b2df4e3bb56e16a726e7bbf3815edb3f57992f3771123d44d48055 WatchSource:0}: Error finding container 218b498430b2df4e3bb56e16a726e7bbf3815edb3f57992f3771123d44d48055: Status 404 returned error can't find the container with id 218b498430b2df4e3bb56e16a726e7bbf3815edb3f57992f3771123d44d48055 Jul 14 18:54:38.705338 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.705320 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gmbvx" Jul 14 18:54:38.710853 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.710836 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ddrwt" Jul 14 18:54:38.711103 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:38.711083 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f754bf_1c44_4f17_bda8_5e1708679f80.slice/crio-fce0a69e8c66e9b8a4e3c1411823b09adbbbf9ea9d03a14dfc5ccd0febd6f988 WatchSource:0}: Error finding container fce0a69e8c66e9b8a4e3c1411823b09adbbbf9ea9d03a14dfc5ccd0febd6f988: Status 404 returned error can't find the container with id fce0a69e8c66e9b8a4e3c1411823b09adbbbf9ea9d03a14dfc5ccd0febd6f988 Jul 14 18:54:38.714089 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:38.714069 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ac30b61_e7a1_4c20_9d7d_937806a945ff.slice/crio-b59aead32d051963112185376010c814927db50480143a7959ef93c8900ed379 WatchSource:0}: Error finding container b59aead32d051963112185376010c814927db50480143a7959ef93c8900ed379: Status 404 returned error can't find the container with id b59aead32d051963112185376010c814927db50480143a7959ef93c8900ed379 Jul 14 18:54:38.716899 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.716658 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-62zv6" Jul 14 18:54:38.718985 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:38.718964 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fbbc18a_4a27_4e86_8c87_902868a08e08.slice/crio-2b148e213c51f68ddb85b95c1a45a24d0a04b8ab515fea22f4d277d36152b156 WatchSource:0}: Error finding container 2b148e213c51f68ddb85b95c1a45a24d0a04b8ab515fea22f4d277d36152b156: Status 404 returned error can't find the container with id 2b148e213c51f68ddb85b95c1a45a24d0a04b8ab515fea22f4d277d36152b156 Jul 14 18:54:38.722428 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.722358 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:54:38.724068 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:38.724050 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59e0cda2_1a2f_4c52_872b_44696ecd101d.slice/crio-8e3f05289c9aa20c9bf1a355379d00692ba2378a629c9dcd175227fde8ef60e6 WatchSource:0}: Error finding container 8e3f05289c9aa20c9bf1a355379d00692ba2378a629c9dcd175227fde8ef60e6: Status 404 returned error can't find the container with id 8e3f05289c9aa20c9bf1a355379d00692ba2378a629c9dcd175227fde8ef60e6 Jul 14 18:54:38.728897 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.728880 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p59q5" Jul 14 18:54:38.731005 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:38.730988 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5633a96_04d9_465c_ae2c_2b5d013f4381.slice/crio-71a694c922918fa2768c8cec1fc653ffb8ea79f0931e4f373412c5165d88771b WatchSource:0}: Error finding container 71a694c922918fa2768c8cec1fc653ffb8ea79f0931e4f373412c5165d88771b: Status 404 returned error can't find the container with id 71a694c922918fa2768c8cec1fc653ffb8ea79f0931e4f373412c5165d88771b Jul 14 18:54:38.732694 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:38.732676 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" Jul 14 18:54:38.738998 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:38.738978 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf43df7b_db49_459d_8d26_3dd49ee44127.slice/crio-2dd7708f7d8abc54598bc333ae82b06fd16e7dd4a8980dd6e2b4bc6d937605c8 WatchSource:0}: Error finding container 2dd7708f7d8abc54598bc333ae82b06fd16e7dd4a8980dd6e2b4bc6d937605c8: Status 404 returned error can't find the container with id 2dd7708f7d8abc54598bc333ae82b06fd16e7dd4a8980dd6e2b4bc6d937605c8 Jul 14 18:54:38.741935 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:54:38.741914 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod889f11ba_784c_43c1_8e82_94cc371da75f.slice/crio-669ea7ff8322a3932c3d90b52f8b73de346e7420065930cae213b89cb0d3f776 WatchSource:0}: Error finding container 669ea7ff8322a3932c3d90b52f8b73de346e7420065930cae213b89cb0d3f776: Status 404 returned error can't find the container with id 669ea7ff8322a3932c3d90b52f8b73de346e7420065930cae213b89cb0d3f776 Jul 14 18:54:39.102995 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:39.102912 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs\") pod \"network-metrics-daemon-wkwn8\" (UID: \"028e2834-88e2-48da-a867-c1b791f58cec\") " pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:54:39.102995 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:39.102964 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret\") pod \"global-pull-secret-syncer-4vl24\" (UID: \"b14d3ec3-b9f4-405e-b759-56a512688c5f\") " pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:39.103233 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:39.102986 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwb9t\" (UniqueName: \"kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t\") pod \"network-check-target-dqjld\" (UID: \"0f406c4e-fac6-4430-a37f-8e8e1aa60215\") " pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:54:39.103233 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:39.103103 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 18:54:39.103233 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:39.103173 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:54:39.103233 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:39.103210 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 18:54:39.103233 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:39.103179 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret podName:b14d3ec3-b9f4-405e-b759-56a512688c5f nodeName:}" failed. No retries permitted until 2026-07-14 18:54:40.103159879 +0000 UTC m=+4.102052678 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret") pod "global-pull-secret-syncer-4vl24" (UID: "b14d3ec3-b9f4-405e-b759-56a512688c5f") : object "kube-system"/"original-pull-secret" not registered Jul 14 18:54:39.103494 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:39.103234 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 18:54:39.103494 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:39.103269 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs podName:028e2834-88e2-48da-a867-c1b791f58cec nodeName:}" failed. No retries permitted until 2026-07-14 18:54:40.103250026 +0000 UTC m=+4.102142824 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs") pod "network-metrics-daemon-wkwn8" (UID: "028e2834-88e2-48da-a867-c1b791f58cec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:54:39.103494 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:39.103288 2563 projected.go:196] Error preparing data for projected volume kube-api-access-zwb9t for pod openshift-network-diagnostics/network-check-target-dqjld: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:54:39.103494 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:39.103332 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t podName:0f406c4e-fac6-4430-a37f-8e8e1aa60215 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:40.103318602 +0000 UTC m=+4.102211400 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwb9t" (UniqueName: "kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t") pod "network-check-target-dqjld" (UID: "0f406c4e-fac6-4430-a37f-8e8e1aa60215") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:54:39.459362 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:39.448178 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 18:49:38 +0000 UTC" deadline="2028-04-25 05:07:36.986543078 +0000 UTC" Jul 14 18:54:39.459362 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:39.448223 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15610h12m57.538326146s" Jul 14 18:54:39.560921 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:39.560883 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:54:39.561194 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:39.561129 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwn8" podUID="028e2834-88e2-48da-a867-c1b791f58cec" Jul 14 18:54:39.582854 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:39.582816 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" event={"ID":"889f11ba-784c-43c1-8e82-94cc371da75f","Type":"ContainerStarted","Data":"669ea7ff8322a3932c3d90b52f8b73de346e7420065930cae213b89cb0d3f776"} Jul 14 18:54:39.584613 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:39.584582 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p59q5" event={"ID":"bf43df7b-db49-459d-8d26-3dd49ee44127","Type":"ContainerStarted","Data":"2dd7708f7d8abc54598bc333ae82b06fd16e7dd4a8980dd6e2b4bc6d937605c8"} Jul 14 18:54:39.595043 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:39.595016 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" event={"ID":"a5633a96-04d9-465c-ae2c-2b5d013f4381","Type":"ContainerStarted","Data":"71a694c922918fa2768c8cec1fc653ffb8ea79f0931e4f373412c5165d88771b"} Jul 14 18:54:39.607135 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:39.607100 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ddrwt" event={"ID":"5fbbc18a-4a27-4e86-8c87-902868a08e08","Type":"ContainerStarted","Data":"2b148e213c51f68ddb85b95c1a45a24d0a04b8ab515fea22f4d277d36152b156"} Jul 14 18:54:39.618324 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:39.618287 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ppdzr" event={"ID":"80028423-783a-44f1-9f16-73f336cfeb50","Type":"ContainerStarted","Data":"a717c981dd0d21e19940df20b8642915421389b91d873596d26a9e6288e2e2a5"} Jul 14 18:54:39.632397 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:39.632315 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-130.ec2.internal" event={"ID":"e89ed3faf2814d9256cb7f34bdd2bc49","Type":"ContainerStarted","Data":"647169c84e6fe90035f0cf0776cd9c7de725f912c95dedd4b748b1217a04f23f"} Jul 14 18:54:39.653181 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:39.653118 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-62zv6" event={"ID":"59e0cda2-1a2f-4c52-872b-44696ecd101d","Type":"ContainerStarted","Data":"8e3f05289c9aa20c9bf1a355379d00692ba2378a629c9dcd175227fde8ef60e6"} Jul 14 18:54:39.672649 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:39.672547 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gmbvx" event={"ID":"0ac30b61-e7a1-4c20-9d7d-937806a945ff","Type":"ContainerStarted","Data":"b59aead32d051963112185376010c814927db50480143a7959ef93c8900ed379"} Jul 14 18:54:39.680229 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:39.680147 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7mhm7" event={"ID":"f8f754bf-1c44-4f17-bda8-5e1708679f80","Type":"ContainerStarted","Data":"fce0a69e8c66e9b8a4e3c1411823b09adbbbf9ea9d03a14dfc5ccd0febd6f988"} Jul 14 18:54:39.689123 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:39.689085 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" event={"ID":"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86","Type":"ContainerStarted","Data":"218b498430b2df4e3bb56e16a726e7bbf3815edb3f57992f3771123d44d48055"} Jul 14 18:54:40.112058 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:40.111963 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret\") pod \"global-pull-secret-syncer-4vl24\" (UID: \"b14d3ec3-b9f4-405e-b759-56a512688c5f\") " pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:40.112058 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:40.112021 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwb9t\" (UniqueName: \"kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t\") pod \"network-check-target-dqjld\" (UID: \"0f406c4e-fac6-4430-a37f-8e8e1aa60215\") " pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:54:40.112270 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:40.112071 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs\") pod \"network-metrics-daemon-wkwn8\" (UID: \"028e2834-88e2-48da-a867-c1b791f58cec\") " pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:54:40.112270 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:40.112211 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:54:40.112382 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:40.112276 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs podName:028e2834-88e2-48da-a867-c1b791f58cec nodeName:}" failed. No retries permitted until 2026-07-14 18:54:42.112255971 +0000 UTC m=+6.111148777 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs") pod "network-metrics-daemon-wkwn8" (UID: "028e2834-88e2-48da-a867-c1b791f58cec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:54:40.112750 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:40.112729 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 18:54:40.112862 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:40.112796 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret podName:b14d3ec3-b9f4-405e-b759-56a512688c5f nodeName:}" failed. No retries permitted until 2026-07-14 18:54:42.112779308 +0000 UTC m=+6.111672109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret") pod "global-pull-secret-syncer-4vl24" (UID: "b14d3ec3-b9f4-405e-b759-56a512688c5f") : object "kube-system"/"original-pull-secret" not registered Jul 14 18:54:40.112933 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:40.112895 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 18:54:40.112933 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:40.112909 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 18:54:40.112933 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:40.112924 2563 projected.go:196] Error preparing data for projected volume kube-api-access-zwb9t for pod openshift-network-diagnostics/network-check-target-dqjld: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:54:40.113089 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:40.112964 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t podName:0f406c4e-fac6-4430-a37f-8e8e1aa60215 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:42.112952107 +0000 UTC m=+6.111844926 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwb9t" (UniqueName: "kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t") pod "network-check-target-dqjld" (UID: "0f406c4e-fac6-4430-a37f-8e8e1aa60215") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:54:40.449095 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:40.448954 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 18:49:38 +0000 UTC" deadline="2028-04-27 10:53:53.664278616 +0000 UTC" Jul 14 18:54:40.449095 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:40.449019 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15663h59m13.215264065s" Jul 14 18:54:40.561562 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:40.561039 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:54:40.561562 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:40.561179 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqjld" podUID="0f406c4e-fac6-4430-a37f-8e8e1aa60215" Jul 14 18:54:40.562433 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:40.561768 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:40.562433 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:40.561883 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vl24" podUID="b14d3ec3-b9f4-405e-b759-56a512688c5f" Jul 14 18:54:41.561328 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:41.561296 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:54:41.561528 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:41.561463 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwn8" podUID="028e2834-88e2-48da-a867-c1b791f58cec" Jul 14 18:54:42.129390 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:42.129333 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret\") pod \"global-pull-secret-syncer-4vl24\" (UID: \"b14d3ec3-b9f4-405e-b759-56a512688c5f\") " pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:42.129390 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:42.129397 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwb9t\" (UniqueName: \"kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t\") pod \"network-check-target-dqjld\" (UID: \"0f406c4e-fac6-4430-a37f-8e8e1aa60215\") " pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:54:42.130052 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:42.129447 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs\") pod \"network-metrics-daemon-wkwn8\" (UID: \"028e2834-88e2-48da-a867-c1b791f58cec\") " pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:54:42.130052 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:42.129608 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:54:42.130052 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:42.129701 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs podName:028e2834-88e2-48da-a867-c1b791f58cec nodeName:}" failed. No retries permitted until 2026-07-14 18:54:46.129677121 +0000 UTC m=+10.128569932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs") pod "network-metrics-daemon-wkwn8" (UID: "028e2834-88e2-48da-a867-c1b791f58cec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:54:42.130223 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:42.130144 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 18:54:42.130223 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:42.130200 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret podName:b14d3ec3-b9f4-405e-b759-56a512688c5f nodeName:}" failed. No retries permitted until 2026-07-14 18:54:46.130182903 +0000 UTC m=+10.129075706 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret") pod "global-pull-secret-syncer-4vl24" (UID: "b14d3ec3-b9f4-405e-b759-56a512688c5f") : object "kube-system"/"original-pull-secret" not registered Jul 14 18:54:42.130338 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:42.130288 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 18:54:42.130338 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:42.130304 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 18:54:42.130338 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:42.130318 2563 projected.go:196] Error preparing data for projected volume kube-api-access-zwb9t for pod openshift-network-diagnostics/network-check-target-dqjld: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:54:42.130497 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:42.130363 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t podName:0f406c4e-fac6-4430-a37f-8e8e1aa60215 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:46.130347464 +0000 UTC m=+10.129240273 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwb9t" (UniqueName: "kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t") pod "network-check-target-dqjld" (UID: "0f406c4e-fac6-4430-a37f-8e8e1aa60215") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:54:42.562805 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:42.562722 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:54:42.562805 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:42.562752 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:42.563035 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:42.562880 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqjld" podUID="0f406c4e-fac6-4430-a37f-8e8e1aa60215" Jul 14 18:54:42.563035 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:42.562986 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vl24" podUID="b14d3ec3-b9f4-405e-b759-56a512688c5f" Jul 14 18:54:43.560911 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:43.560878 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:54:43.561356 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:43.561021 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwn8" podUID="028e2834-88e2-48da-a867-c1b791f58cec" Jul 14 18:54:44.564073 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:44.563371 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:54:44.564073 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:44.563505 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqjld" podUID="0f406c4e-fac6-4430-a37f-8e8e1aa60215" Jul 14 18:54:44.564073 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:44.563895 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:44.564073 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:44.564005 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vl24" podUID="b14d3ec3-b9f4-405e-b759-56a512688c5f" Jul 14 18:54:45.561579 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:45.561547 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:54:45.561763 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:45.561715 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwn8" podUID="028e2834-88e2-48da-a867-c1b791f58cec" Jul 14 18:54:46.164288 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:46.164252 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs\") pod \"network-metrics-daemon-wkwn8\" (UID: \"028e2834-88e2-48da-a867-c1b791f58cec\") " pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:54:46.164695 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:46.164320 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret\") pod \"global-pull-secret-syncer-4vl24\" (UID: \"b14d3ec3-b9f4-405e-b759-56a512688c5f\") " pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:46.164695 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:46.164354 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwb9t\" (UniqueName: \"kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t\") pod \"network-check-target-dqjld\" (UID: \"0f406c4e-fac6-4430-a37f-8e8e1aa60215\") " pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:54:46.164695 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:46.164528 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 18:54:46.164695 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:46.164545 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 18:54:46.164695 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:46.164558 2563 projected.go:196] Error preparing data for projected volume kube-api-access-zwb9t for pod openshift-network-diagnostics/network-check-target-dqjld: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:54:46.164695 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:46.164626 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t podName:0f406c4e-fac6-4430-a37f-8e8e1aa60215 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:54.164607416 +0000 UTC m=+18.163500226 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwb9t" (UniqueName: "kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t") pod "network-check-target-dqjld" (UID: "0f406c4e-fac6-4430-a37f-8e8e1aa60215") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:54:46.165007 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:46.164715 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:54:46.165007 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:46.164761 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs podName:028e2834-88e2-48da-a867-c1b791f58cec nodeName:}" failed. No retries permitted until 2026-07-14 18:54:54.164747132 +0000 UTC m=+18.163639930 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs") pod "network-metrics-daemon-wkwn8" (UID: "028e2834-88e2-48da-a867-c1b791f58cec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:54:46.165007 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:46.164812 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 18:54:46.165007 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:46.164841 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret podName:b14d3ec3-b9f4-405e-b759-56a512688c5f nodeName:}" failed. No retries permitted until 2026-07-14 18:54:54.1648315 +0000 UTC m=+18.163724298 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret") pod "global-pull-secret-syncer-4vl24" (UID: "b14d3ec3-b9f4-405e-b759-56a512688c5f") : object "kube-system"/"original-pull-secret" not registered Jul 14 18:54:46.561888 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:46.561675 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:54:46.561888 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:46.561796 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqjld" podUID="0f406c4e-fac6-4430-a37f-8e8e1aa60215" Jul 14 18:54:46.561888 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:46.561818 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:46.562168 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:46.561942 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vl24" podUID="b14d3ec3-b9f4-405e-b759-56a512688c5f" Jul 14 18:54:47.560771 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:47.560494 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:54:47.561225 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:47.560883 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwn8" podUID="028e2834-88e2-48da-a867-c1b791f58cec" Jul 14 18:54:48.561222 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:48.561188 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:54:48.561668 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:48.561297 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqjld" podUID="0f406c4e-fac6-4430-a37f-8e8e1aa60215" Jul 14 18:54:48.561668 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:48.561362 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:48.561668 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:48.561480 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vl24" podUID="b14d3ec3-b9f4-405e-b759-56a512688c5f" Jul 14 18:54:49.561247 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:49.561213 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:54:49.561706 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:49.561352 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwn8" podUID="028e2834-88e2-48da-a867-c1b791f58cec" Jul 14 18:54:50.562895 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:50.562863 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:54:50.563372 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:50.562967 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqjld" podUID="0f406c4e-fac6-4430-a37f-8e8e1aa60215" Jul 14 18:54:50.563372 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:50.563326 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:50.563477 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:50.563414 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vl24" podUID="b14d3ec3-b9f4-405e-b759-56a512688c5f" Jul 14 18:54:51.561446 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:51.561416 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:54:51.561608 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:51.561546 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwn8" podUID="028e2834-88e2-48da-a867-c1b791f58cec" Jul 14 18:54:52.560664 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:52.560626 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:54:52.561064 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:52.560630 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:52.561064 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:52.560767 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqjld" podUID="0f406c4e-fac6-4430-a37f-8e8e1aa60215" Jul 14 18:54:52.561064 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:52.560818 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vl24" podUID="b14d3ec3-b9f4-405e-b759-56a512688c5f" Jul 14 18:54:53.561537 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:53.561502 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:54:53.561982 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:53.561637 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwn8" podUID="028e2834-88e2-48da-a867-c1b791f58cec" Jul 14 18:54:54.225891 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:54.225852 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret\") pod \"global-pull-secret-syncer-4vl24\" (UID: \"b14d3ec3-b9f4-405e-b759-56a512688c5f\") " pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:54.226081 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:54.225902 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwb9t\" (UniqueName: \"kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t\") pod \"network-check-target-dqjld\" (UID: \"0f406c4e-fac6-4430-a37f-8e8e1aa60215\") " pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:54:54.226081 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:54.225936 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs\") pod \"network-metrics-daemon-wkwn8\" (UID: \"028e2834-88e2-48da-a867-c1b791f58cec\") " pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:54:54.226081 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:54.226022 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:54:54.226081 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:54.226020 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 18:54:54.226081 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:54.226071 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 18:54:54.226323 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:54.226089 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs podName:028e2834-88e2-48da-a867-c1b791f58cec nodeName:}" failed. No retries permitted until 2026-07-14 18:55:10.226069498 +0000 UTC m=+34.224962298 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs") pod "network-metrics-daemon-wkwn8" (UID: "028e2834-88e2-48da-a867-c1b791f58cec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:54:54.226323 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:54.226092 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 18:54:54.226323 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:54.226105 2563 projected.go:196] Error preparing data for projected volume kube-api-access-zwb9t for pod openshift-network-diagnostics/network-check-target-dqjld: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:54:54.226323 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:54.226108 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret podName:b14d3ec3-b9f4-405e-b759-56a512688c5f nodeName:}" failed. No retries permitted until 2026-07-14 18:55:10.226098137 +0000 UTC m=+34.224990933 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret") pod "global-pull-secret-syncer-4vl24" (UID: "b14d3ec3-b9f4-405e-b759-56a512688c5f") : object "kube-system"/"original-pull-secret" not registered Jul 14 18:54:54.226323 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:54.226136 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t podName:0f406c4e-fac6-4430-a37f-8e8e1aa60215 nodeName:}" failed. No retries permitted until 2026-07-14 18:55:10.226128156 +0000 UTC m=+34.225020952 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwb9t" (UniqueName: "kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t") pod "network-check-target-dqjld" (UID: "0f406c4e-fac6-4430-a37f-8e8e1aa60215") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:54:54.561359 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:54.561266 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:54:54.561359 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:54.561288 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:54.561575 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:54.561387 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqjld" podUID="0f406c4e-fac6-4430-a37f-8e8e1aa60215" Jul 14 18:54:54.561575 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:54.561522 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vl24" podUID="b14d3ec3-b9f4-405e-b759-56a512688c5f" Jul 14 18:54:55.561129 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:55.561097 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:54:55.561286 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:55.561205 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwn8" podUID="028e2834-88e2-48da-a867-c1b791f58cec" Jul 14 18:54:56.561957 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:56.561918 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:54:56.562334 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:56.562009 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqjld" podUID="0f406c4e-fac6-4430-a37f-8e8e1aa60215" Jul 14 18:54:56.562334 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:56.562077 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:56.562334 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:56.562163 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vl24" podUID="b14d3ec3-b9f4-405e-b759-56a512688c5f" Jul 14 18:54:57.561008 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:57.560973 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:54:57.561181 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:57.561112 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwn8" podUID="028e2834-88e2-48da-a867-c1b791f58cec" Jul 14 18:54:58.561303 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:58.561266 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:54:58.561954 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:58.561402 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqjld" podUID="0f406c4e-fac6-4430-a37f-8e8e1aa60215" Jul 14 18:54:58.562031 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:58.561993 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:54:58.562124 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:58.562099 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vl24" podUID="b14d3ec3-b9f4-405e-b759-56a512688c5f" Jul 14 18:54:59.561483 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:54:59.561446 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:54:59.561974 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:54:59.561624 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwn8" podUID="028e2834-88e2-48da-a867-c1b791f58cec" Jul 14 18:55:00.561369 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.561061 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:55:00.561618 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.561098 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:55:00.561618 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:00.561470 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqjld" podUID="0f406c4e-fac6-4430-a37f-8e8e1aa60215" Jul 14 18:55:00.561618 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:00.561509 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vl24" podUID="b14d3ec3-b9f4-405e-b759-56a512688c5f" Jul 14 18:55:00.749271 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.749232 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" event={"ID":"889f11ba-784c-43c1-8e82-94cc371da75f","Type":"ContainerStarted","Data":"f281db80d3213e3324c443bce74da5d66f8af283c7006ead1bae1ba11639990f"} Jul 14 18:55:00.750970 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.750941 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p59q5" event={"ID":"bf43df7b-db49-459d-8d26-3dd49ee44127","Type":"ContainerStarted","Data":"5dfbbfe7af32b6b9d166f76e7708355c5914f243bbc8f13cf89a50db911a5b0d"} Jul 14 18:55:00.754164 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.754139 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trrs2_a5633a96-04d9-465c-ae2c-2b5d013f4381/ovn-acl-logging/0.log" Jul 14 18:55:00.754486 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.754459 2563 generic.go:356] "Generic (PLEG): container finished" podID="a5633a96-04d9-465c-ae2c-2b5d013f4381" containerID="7b6ca10e814af90f02729e7fcd39afebaafe7ab1329e5496f611ac70ffd3a3a2" exitCode=1 Jul 14 18:55:00.754580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.754530 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" event={"ID":"a5633a96-04d9-465c-ae2c-2b5d013f4381","Type":"ContainerStarted","Data":"f429120cf1d49896469fa45f994a3ebb7cd6ed6720ccd30be51d08d742083ba6"} Jul 14 18:55:00.754667 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.754622 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" event={"ID":"a5633a96-04d9-465c-ae2c-2b5d013f4381","Type":"ContainerStarted","Data":"bdc5a234d5177423e3a950f8745014b34e3bf5fb8b1ea7b62111170d5ee948bf"} Jul 14 18:55:00.754722 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.754670 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" event={"ID":"a5633a96-04d9-465c-ae2c-2b5d013f4381","Type":"ContainerStarted","Data":"8d9ae7acd3bd0011ea7e7211ebd3605f53f5cc6707ec526b2cab702f0f8758b6"} Jul 14 18:55:00.754722 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.754717 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" event={"ID":"a5633a96-04d9-465c-ae2c-2b5d013f4381","Type":"ContainerStarted","Data":"3bdaaf8c19d7c10eee186625b0331e2759586ddb87d5ede58e73f6b8b042aa77"} Jul 14 18:55:00.754813 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.754765 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" event={"ID":"a5633a96-04d9-465c-ae2c-2b5d013f4381","Type":"ContainerDied","Data":"7b6ca10e814af90f02729e7fcd39afebaafe7ab1329e5496f611ac70ffd3a3a2"} Jul 14 18:55:00.755137 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.755115 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" event={"ID":"a5633a96-04d9-465c-ae2c-2b5d013f4381","Type":"ContainerStarted","Data":"593589cd204836f95a10bfff52361e8e5db5f89a354cda075f8f885e9d70c0f3"} Jul 14 18:55:00.756285 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.756259 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ddrwt" event={"ID":"5fbbc18a-4a27-4e86-8c87-902868a08e08","Type":"ContainerStarted","Data":"20cb06cfc44532f194b85162777a0d463a6fcaf481fc57423fa7591f96cf7499"} Jul 14 18:55:00.758301 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.758277 2563 generic.go:356] "Generic (PLEG): container finished" podID="e89ed3faf2814d9256cb7f34bdd2bc49" containerID="30363abb27335e6b1c8b15a8337b600b49f860e6284de3bde1bfd9b6a1e15db7" exitCode=0 Jul 14 18:55:00.758399 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.758341 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-130.ec2.internal" event={"ID":"e89ed3faf2814d9256cb7f34bdd2bc49","Type":"ContainerDied","Data":"30363abb27335e6b1c8b15a8337b600b49f860e6284de3bde1bfd9b6a1e15db7"} Jul 14 18:55:00.760104 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.760082 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-130.ec2.internal" event={"ID":"a9f761aa7d4495c36ad2e38608410c31","Type":"ContainerStarted","Data":"6476d1e2ad428b0e0265d679674ff008cdf6668ced7ecde87c31a83f60df7363"} Jul 14 18:55:00.762438 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.762329 2563 generic.go:356] "Generic (PLEG): container finished" podID="59e0cda2-1a2f-4c52-872b-44696ecd101d" containerID="b8680e99c07c108b9624e06f52970c2b2b877cf925cdcbe62701e203079d8b2d" exitCode=0 Jul 14 18:55:00.762438 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.762397 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-62zv6" event={"ID":"59e0cda2-1a2f-4c52-872b-44696ecd101d","Type":"ContainerDied","Data":"b8680e99c07c108b9624e06f52970c2b2b877cf925cdcbe62701e203079d8b2d"} Jul 14 18:55:00.764083 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.764009 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gmbvx" event={"ID":"0ac30b61-e7a1-4c20-9d7d-937806a945ff","Type":"ContainerStarted","Data":"e2be58d41a031d80fb2c02f2ab1bde96e12943f5fb13d4249a8167db4d4652de"} Jul 14 18:55:00.765699 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.765672 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7mhm7" event={"ID":"f8f754bf-1c44-4f17-bda8-5e1708679f80","Type":"ContainerStarted","Data":"a755c21c6c582d992e4c1abdd6cc97069c9c545e86e37d133b9120566578888c"} Jul 14 18:55:00.767519 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.767498 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" event={"ID":"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86","Type":"ContainerStarted","Data":"a81fdfb1c9e25b43e077b28fdbcb08ab8dc75b49b92a40829f36cb546ff8f1ee"} Jul 14 18:55:00.773286 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.773236 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kdqhs" podStartSLOduration=2.730829751 podStartE2EDuration="23.773224262s" totalImagesPullingTime="21.042394511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:00.772999146 +0000 UTC m=+24.771891965" watchObservedRunningTime="2026-07-14 18:55:00.773224262 +0000 UTC m=+24.772117080" Jul 14 18:55:00.803203 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.803165 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-p59q5" podStartSLOduration=2.730305705 podStartE2EDuration="23.80314733s" totalImagesPullingTime="21.072841625s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:00.801070749 +0000 UTC m=+24.799963567" watchObservedRunningTime="2026-07-14 18:55:00.80314733 +0000 UTC m=+24.802040152" Jul 14 18:55:00.887199 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.887146 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7mhm7" podStartSLOduration=2.8400327130000003 podStartE2EDuration="23.887127739s" totalImagesPullingTime="21.047095026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:00.886889657 +0000 UTC m=+24.885782475" watchObservedRunningTime="2026-07-14 18:55:00.887127739 +0000 UTC m=+24.886020608" Jul 14 18:55:00.887843 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.887800 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-130.ec2.internal" podStartSLOduration=22.887789783 podStartE2EDuration="22.887789783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:54:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:00.865753584 +0000 UTC m=+24.864646402" watchObservedRunningTime="2026-07-14 18:55:00.887789783 +0000 UTC m=+24.886682601" Jul 14 18:55:00.928667 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.928610 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gmbvx" podStartSLOduration=2.886575352 podStartE2EDuration="23.928569793s" totalImagesPullingTime="21.041994441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:00.908081717 +0000 UTC m=+24.906974535" watchObservedRunningTime="2026-07-14 18:55:00.928569793 +0000 UTC m=+24.927462614" Jul 14 18:55:00.954588 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:00.954530 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ddrwt" podStartSLOduration=2.922222261 podStartE2EDuration="23.954509366s" totalImagesPullingTime="21.032287105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:00.928745585 +0000 UTC m=+24.927638384" watchObservedRunningTime="2026-07-14 18:55:00.954509366 +0000 UTC m=+24.953402185" Jul 14 18:55:01.514213 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:01.514187 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 18:55:01.561580 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:01.561550 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:55:01.561754 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:01.561701 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwn8" podUID="028e2834-88e2-48da-a867-c1b791f58cec" Jul 14 18:55:01.773959 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:01.773919 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ppdzr" event={"ID":"80028423-783a-44f1-9f16-73f336cfeb50","Type":"ContainerStarted","Data":"cac5b2efcbfbc33acf97bd1b132b2baa47a97e407a3f49826f99f9af18fb4165"} Jul 14 18:55:01.776077 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:01.776045 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-130.ec2.internal" event={"ID":"e89ed3faf2814d9256cb7f34bdd2bc49","Type":"ContainerStarted","Data":"e8bca12f8f401486c1353d4af1d3f649f1eba04abc3ba330334843fee4c4717b"} Jul 14 18:55:01.777845 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:01.777819 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" event={"ID":"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86","Type":"ContainerStarted","Data":"b8bc6a180754cfa1e54f605223137c327cea7c845d1762f027fb5d8aba5ba995"} Jul 14 18:55:01.790936 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:01.790890 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ppdzr" podStartSLOduration=3.722920276 podStartE2EDuration="24.790875423s" totalImagesPullingTime="21.067955147s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:01.790327182 +0000 UTC m=+25.789220005" watchObservedRunningTime="2026-07-14 18:55:01.790875423 +0000 UTC m=+25.789768240" Jul 14 18:55:01.808247 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:01.808197 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-130.ec2.internal" podStartSLOduration=23.808179018 podStartE2EDuration="23.808179018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:54:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:01.807696124 +0000 UTC m=+25.806588942" watchObservedRunningTime="2026-07-14 18:55:01.808179018 +0000 UTC m=+25.807071837" Jul 14 18:55:02.252624 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:02.252519 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7mhm7" Jul 14 18:55:02.253242 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:02.253213 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7mhm7" Jul 14 18:55:02.455220 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:02.455084 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T18:55:01.514207065Z","UUID":"59b30bf7-670e-4912-ab07-36977b3b8612","Handler":null,"Name":"","Endpoint":""} Jul 14 18:55:02.457312 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:02.457290 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 18:55:02.457444 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:02.457329 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 18:55:02.561317 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:02.561232 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:55:02.561480 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:02.561350 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqjld" podUID="0f406c4e-fac6-4430-a37f-8e8e1aa60215" Jul 14 18:55:02.561480 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:02.561407 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:55:02.561590 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:02.561515 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vl24" podUID="b14d3ec3-b9f4-405e-b759-56a512688c5f" Jul 14 18:55:02.784188 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:02.784162 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trrs2_a5633a96-04d9-465c-ae2c-2b5d013f4381/ovn-acl-logging/0.log" Jul 14 18:55:02.785183 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:02.784859 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" event={"ID":"a5633a96-04d9-465c-ae2c-2b5d013f4381","Type":"ContainerStarted","Data":"660b8afe60de5097bde1613b22416ee4a38e2cb4c7d2d72ffde38cf53e2c7e18"} Jul 14 18:55:02.785183 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:02.785138 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7mhm7" Jul 14 18:55:02.785810 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:02.785791 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7mhm7" Jul 14 18:55:03.560775 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:03.560732 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:55:03.560954 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:03.560861 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwn8" podUID="028e2834-88e2-48da-a867-c1b791f58cec" Jul 14 18:55:04.561420 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:04.561118 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:55:04.561936 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:04.561118 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:55:04.561936 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:04.561481 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vl24" podUID="b14d3ec3-b9f4-405e-b759-56a512688c5f" Jul 14 18:55:04.561936 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:04.561543 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqjld" podUID="0f406c4e-fac6-4430-a37f-8e8e1aa60215" Jul 14 18:55:05.560707 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:05.560461 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:55:05.560837 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:05.560810 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwn8" podUID="028e2834-88e2-48da-a867-c1b791f58cec" Jul 14 18:55:05.795225 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:05.795143 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trrs2_a5633a96-04d9-465c-ae2c-2b5d013f4381/ovn-acl-logging/0.log" Jul 14 18:55:05.796092 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:05.795551 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" event={"ID":"a5633a96-04d9-465c-ae2c-2b5d013f4381","Type":"ContainerStarted","Data":"e59e9fe77e82b9d234a80802f9f53aa70bf9d3789192543dd961501fe9438432"} Jul 14 18:55:05.796092 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:05.795800 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:55:05.796557 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:05.796387 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:55:05.796557 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:05.796416 2563 scope.go:117] "RemoveContainer" containerID="7b6ca10e814af90f02729e7fcd39afebaafe7ab1329e5496f611ac70ffd3a3a2" Jul 14 18:55:05.800415 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:05.800389 2563 generic.go:356] "Generic (PLEG): container finished" podID="59e0cda2-1a2f-4c52-872b-44696ecd101d" containerID="f5442f611f395c25e3da8e5a5571a3a0585762cf4895192b5050187b649dd1fb" exitCode=0 Jul 14 18:55:05.800508 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:05.800465 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-62zv6" event={"ID":"59e0cda2-1a2f-4c52-872b-44696ecd101d","Type":"ContainerDied","Data":"f5442f611f395c25e3da8e5a5571a3a0585762cf4895192b5050187b649dd1fb"} Jul 14 18:55:05.804657 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:05.804633 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" event={"ID":"0eaee7a8-4488-4f23-ad7f-8ef2f36bad86","Type":"ContainerStarted","Data":"ca17b032e0bd0ec9c959aec3a13eb0cce34977aa7990ef8be9dd1eb96a9ba469"} Jul 14 18:55:05.814099 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:05.814081 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:55:05.884944 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:05.884907 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpkz6" podStartSLOduration=2.692800172 podStartE2EDuration="28.884892885s" totalImagesPullingTime="26.192092713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:54:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:05.884658884 +0000 UTC m=+29.883551892" watchObservedRunningTime="2026-07-14 18:55:05.884892885 +0000 UTC m=+29.883785703" Jul 14 18:55:06.561772 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:06.561742 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:55:06.562042 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:06.561827 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:55:06.562042 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:06.561834 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqjld" podUID="0f406c4e-fac6-4430-a37f-8e8e1aa60215" Jul 14 18:55:06.562042 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:06.562000 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vl24" podUID="b14d3ec3-b9f4-405e-b759-56a512688c5f" Jul 14 18:55:06.809568 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:06.809536 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trrs2_a5633a96-04d9-465c-ae2c-2b5d013f4381/ovn-acl-logging/0.log" Jul 14 18:55:06.810006 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:06.809914 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" event={"ID":"a5633a96-04d9-465c-ae2c-2b5d013f4381","Type":"ContainerStarted","Data":"662e0c8b9ece2ad7a19396a59d9415f6e4b5f5b838f13d003c359bff2acdcaa0"} Jul 14 18:55:06.810315 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:06.810296 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:55:06.825652 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:06.825580 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:55:06.923338 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:06.923301 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" podStartSLOduration=8.826672883 podStartE2EDuration="29.923286082s" totalImagesPullingTime="21.096613199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:06.867476043 +0000 UTC m=+30.866368861" watchObservedRunningTime="2026-07-14 18:55:06.923286082 +0000 UTC m=+30.922178904" Jul 14 18:55:07.560657 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:07.560623 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:55:07.560898 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:07.560736 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwn8" podUID="028e2834-88e2-48da-a867-c1b791f58cec" Jul 14 18:55:07.813852 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:07.813768 2563 generic.go:356] "Generic (PLEG): container finished" podID="59e0cda2-1a2f-4c52-872b-44696ecd101d" containerID="ffb0786b9043b5a83dc10da39b38fb02a2ba7403b7dbddab4cc789314f1434c0" exitCode=0 Jul 14 18:55:07.814292 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:07.813845 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-62zv6" event={"ID":"59e0cda2-1a2f-4c52-872b-44696ecd101d","Type":"ContainerDied","Data":"ffb0786b9043b5a83dc10da39b38fb02a2ba7403b7dbddab4cc789314f1434c0"} Jul 14 18:55:08.566387 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:08.566357 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:55:08.566554 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:08.566459 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vl24" podUID="b14d3ec3-b9f4-405e-b759-56a512688c5f" Jul 14 18:55:08.566554 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:08.566514 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:55:08.566700 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:08.566638 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqjld" podUID="0f406c4e-fac6-4430-a37f-8e8e1aa60215" Jul 14 18:55:09.560744 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:09.560716 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:55:09.561134 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:09.560819 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwn8" podUID="028e2834-88e2-48da-a867-c1b791f58cec" Jul 14 18:55:09.820296 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:09.820211 2563 generic.go:356] "Generic (PLEG): container finished" podID="59e0cda2-1a2f-4c52-872b-44696ecd101d" containerID="1d99e9bbacf282e393c7a28438a81500be0a83b835548582d9174cb781faf042" exitCode=0 Jul 14 18:55:09.820296 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:09.820274 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-62zv6" event={"ID":"59e0cda2-1a2f-4c52-872b-44696ecd101d","Type":"ContainerDied","Data":"1d99e9bbacf282e393c7a28438a81500be0a83b835548582d9174cb781faf042"} Jul 14 18:55:10.245670 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:10.245638 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs\") pod \"network-metrics-daemon-wkwn8\" (UID: \"028e2834-88e2-48da-a867-c1b791f58cec\") " pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:55:10.245835 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:10.245701 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret\") pod \"global-pull-secret-syncer-4vl24\" (UID: \"b14d3ec3-b9f4-405e-b759-56a512688c5f\") " pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:55:10.245835 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:10.245732 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwb9t\" (UniqueName: \"kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t\") pod \"network-check-target-dqjld\" (UID: \"0f406c4e-fac6-4430-a37f-8e8e1aa60215\") " pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:55:10.245835 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:10.245807 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:55:10.245835 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:10.245831 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 18:55:10.245963 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:10.245845 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 18:55:10.245963 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:10.245852 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 18:55:10.245963 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:10.245882 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs podName:028e2834-88e2-48da-a867-c1b791f58cec nodeName:}" failed. No retries permitted until 2026-07-14 18:55:42.245863203 +0000 UTC m=+66.244756016 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs") pod "network-metrics-daemon-wkwn8" (UID: "028e2834-88e2-48da-a867-c1b791f58cec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:55:10.245963 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:10.245905 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret podName:b14d3ec3-b9f4-405e-b759-56a512688c5f nodeName:}" failed. No retries permitted until 2026-07-14 18:55:42.245892754 +0000 UTC m=+66.244785555 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret") pod "global-pull-secret-syncer-4vl24" (UID: "b14d3ec3-b9f4-405e-b759-56a512688c5f") : object "kube-system"/"original-pull-secret" not registered Jul 14 18:55:10.245963 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:10.245856 2563 projected.go:196] Error preparing data for projected volume kube-api-access-zwb9t for pod openshift-network-diagnostics/network-check-target-dqjld: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:55:10.245963 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:10.245935 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t podName:0f406c4e-fac6-4430-a37f-8e8e1aa60215 nodeName:}" failed. No retries permitted until 2026-07-14 18:55:42.245929037 +0000 UTC m=+66.244821832 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwb9t" (UniqueName: "kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t") pod "network-check-target-dqjld" (UID: "0f406c4e-fac6-4430-a37f-8e8e1aa60215") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:55:10.560876 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:10.560796 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:55:10.561248 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:10.560796 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:55:10.561248 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:10.560919 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqjld" podUID="0f406c4e-fac6-4430-a37f-8e8e1aa60215" Jul 14 18:55:10.561248 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:10.560977 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vl24" podUID="b14d3ec3-b9f4-405e-b759-56a512688c5f" Jul 14 18:55:11.560746 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:11.560712 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:55:11.560930 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:11.560821 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwn8" podUID="028e2834-88e2-48da-a867-c1b791f58cec" Jul 14 18:55:12.560986 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:12.560952 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:55:12.561415 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:12.560952 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:55:12.561415 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:12.561081 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqjld" podUID="0f406c4e-fac6-4430-a37f-8e8e1aa60215" Jul 14 18:55:12.561415 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:12.561128 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vl24" podUID="b14d3ec3-b9f4-405e-b759-56a512688c5f" Jul 14 18:55:13.561340 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:13.561310 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:55:13.561804 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:13.561456 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwn8" podUID="028e2834-88e2-48da-a867-c1b791f58cec" Jul 14 18:55:14.265358 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:14.265153 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wkwn8"] Jul 14 18:55:14.265491 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:14.265438 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:55:14.265553 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:14.265535 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwn8" podUID="028e2834-88e2-48da-a867-c1b791f58cec" Jul 14 18:55:14.268312 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:14.268289 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dqjld"] Jul 14 18:55:14.268460 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:14.268370 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:55:14.268518 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:14.268466 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqjld" podUID="0f406c4e-fac6-4430-a37f-8e8e1aa60215" Jul 14 18:55:14.271552 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:14.271527 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4vl24"] Jul 14 18:55:14.271717 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:14.271660 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:55:14.271837 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:14.271752 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vl24" podUID="b14d3ec3-b9f4-405e-b759-56a512688c5f" Jul 14 18:55:14.836330 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:14.836298 2563 generic.go:356] "Generic (PLEG): container finished" podID="59e0cda2-1a2f-4c52-872b-44696ecd101d" containerID="218f68749f7e56d8042a707181364e7fbc69d5306e8bfc91e5de01ae9eee04e5" exitCode=0 Jul 14 18:55:14.836722 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:14.836341 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-62zv6" event={"ID":"59e0cda2-1a2f-4c52-872b-44696ecd101d","Type":"ContainerDied","Data":"218f68749f7e56d8042a707181364e7fbc69d5306e8bfc91e5de01ae9eee04e5"} Jul 14 18:55:15.561519 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:15.561480 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:55:15.561744 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:15.561483 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:55:15.561744 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:15.561614 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vl24" podUID="b14d3ec3-b9f4-405e-b759-56a512688c5f" Jul 14 18:55:15.561852 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:15.561736 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwn8" podUID="028e2834-88e2-48da-a867-c1b791f58cec" Jul 14 18:55:15.561852 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:15.561483 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:55:15.561852 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:15.561833 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqjld" podUID="0f406c4e-fac6-4430-a37f-8e8e1aa60215" Jul 14 18:55:15.842106 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:15.842002 2563 generic.go:356] "Generic (PLEG): container finished" podID="59e0cda2-1a2f-4c52-872b-44696ecd101d" containerID="97e9d5601acf3de2019b1ef19b30e3c1707d1783ec1d14cbb2f83e5f4263f518" exitCode=0 Jul 14 18:55:15.842106 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:15.842091 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-62zv6" event={"ID":"59e0cda2-1a2f-4c52-872b-44696ecd101d","Type":"ContainerDied","Data":"97e9d5601acf3de2019b1ef19b30e3c1707d1783ec1d14cbb2f83e5f4263f518"} Jul 14 18:55:16.847576 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:16.847545 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-62zv6" event={"ID":"59e0cda2-1a2f-4c52-872b-44696ecd101d","Type":"ContainerStarted","Data":"d7cd44ddfc8d34a58f130fae5d7cc9ef8a93aeecce72919474d96096025eca90"} Jul 14 18:55:17.561013 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:17.560977 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:55:17.561211 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:17.560992 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:55:17.561211 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:17.561089 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwn8" podUID="028e2834-88e2-48da-a867-c1b791f58cec" Jul 14 18:55:17.561211 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:17.561191 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vl24" podUID="b14d3ec3-b9f4-405e-b759-56a512688c5f" Jul 14 18:55:17.561337 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:17.561235 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:55:17.561337 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:17.561309 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqjld" podUID="0f406c4e-fac6-4430-a37f-8e8e1aa60215" Jul 14 18:55:18.830058 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.830030 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-130.ec2.internal" event="NodeReady" Jul 14 18:55:18.830501 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.830156 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 18:55:18.880642 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.880540 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-62zv6" podStartSLOduration=10.077979565 podStartE2EDuration="41.880519171s" totalImagesPullingTime="31.802539606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:54:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:16.919727928 +0000 UTC m=+40.918620746" watchObservedRunningTime="2026-07-14 18:55:18.880519171 +0000 UTC m=+42.879411991" Jul 14 18:55:18.881358 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.881336 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cjtpk"] Jul 14 18:55:18.907380 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.907352 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w4v8d"] Jul 14 18:55:18.907508 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.907456 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cjtpk" Jul 14 18:55:18.910235 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.910213 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 18:55:18.910359 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.910276 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 18:55:18.910518 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.910503 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 18:55:18.910698 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.910668 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x2zbd\"" Jul 14 18:55:18.931460 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.931428 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cjtpk"] Jul 14 18:55:18.931460 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.931438 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w4v8d" Jul 14 18:55:18.931679 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.931485 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w4v8d"] Jul 14 18:55:18.931679 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.931511 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nx6dq"] Jul 14 18:55:18.934247 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.934226 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 18:55:18.934247 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.934240 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 18:55:18.934403 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.934317 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 18:55:18.934460 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.934453 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p26hg\"" Jul 14 18:55:18.934712 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.934698 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 18:55:18.951495 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.951455 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nx6dq"] Jul 14 18:55:18.951672 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.951588 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nx6dq" Jul 14 18:55:18.954536 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.954512 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 18:55:18.954723 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.954708 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p5svp\"" Jul 14 18:55:18.954974 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:18.954957 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 18:55:19.007739 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.007699 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad8769b-f4a9-4b04-b024-3ee76145439e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4v8d\" (UID: \"cad8769b-f4a9-4b04-b024-3ee76145439e\") " pod="openshift-insights/insights-runtime-extractor-w4v8d" Jul 14 18:55:19.007910 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.007752 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad8769b-f4a9-4b04-b024-3ee76145439e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4v8d\" (UID: \"cad8769b-f4a9-4b04-b024-3ee76145439e\") " pod="openshift-insights/insights-runtime-extractor-w4v8d" Jul 14 18:55:19.007910 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.007845 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cad8769b-f4a9-4b04-b024-3ee76145439e-crio-socket\") pod \"insights-runtime-extractor-w4v8d\" (UID: \"cad8769b-f4a9-4b04-b024-3ee76145439e\") " pod="openshift-insights/insights-runtime-extractor-w4v8d" Jul 14 18:55:19.007910 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.007886 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cad8769b-f4a9-4b04-b024-3ee76145439e-data-volume\") pod \"insights-runtime-extractor-w4v8d\" (UID: \"cad8769b-f4a9-4b04-b024-3ee76145439e\") " pod="openshift-insights/insights-runtime-extractor-w4v8d" Jul 14 18:55:19.008011 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.007922 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecbd7240-6b76-4441-8ee6-dac75955e64a-cert\") pod \"ingress-canary-cjtpk\" (UID: \"ecbd7240-6b76-4441-8ee6-dac75955e64a\") " pod="openshift-ingress-canary/ingress-canary-cjtpk" Jul 14 18:55:19.008011 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.007952 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh25p\" (UniqueName: \"kubernetes.io/projected/ecbd7240-6b76-4441-8ee6-dac75955e64a-kube-api-access-hh25p\") pod \"ingress-canary-cjtpk\" (UID: \"ecbd7240-6b76-4441-8ee6-dac75955e64a\") " pod="openshift-ingress-canary/ingress-canary-cjtpk" Jul 14 18:55:19.008011 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.007980 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpvzf\" (UniqueName: \"kubernetes.io/projected/cad8769b-f4a9-4b04-b024-3ee76145439e-kube-api-access-zpvzf\") pod \"insights-runtime-extractor-w4v8d\" (UID: \"cad8769b-f4a9-4b04-b024-3ee76145439e\") " pod="openshift-insights/insights-runtime-extractor-w4v8d" Jul 14 18:55:19.109083 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.109002 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd9264b1-5a02-44c1-ba41-6eeeb3702ac8-tmp-dir\") pod \"dns-default-nx6dq\" (UID: \"fd9264b1-5a02-44c1-ba41-6eeeb3702ac8\") " pod="openshift-dns/dns-default-nx6dq" Jul 14 18:55:19.109083 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.109063 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad8769b-f4a9-4b04-b024-3ee76145439e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4v8d\" (UID: \"cad8769b-f4a9-4b04-b024-3ee76145439e\") " pod="openshift-insights/insights-runtime-extractor-w4v8d" Jul 14 18:55:19.109265 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.109093 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fd9264b1-5a02-44c1-ba41-6eeeb3702ac8-config-volume\") pod \"dns-default-nx6dq\" (UID: \"fd9264b1-5a02-44c1-ba41-6eeeb3702ac8\") " pod="openshift-dns/dns-default-nx6dq" Jul 14 18:55:19.109265 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.109133 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad8769b-f4a9-4b04-b024-3ee76145439e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4v8d\" (UID: \"cad8769b-f4a9-4b04-b024-3ee76145439e\") " pod="openshift-insights/insights-runtime-extractor-w4v8d" Jul 14 18:55:19.109265 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.109170 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmpnd\" (UniqueName: \"kubernetes.io/projected/fd9264b1-5a02-44c1-ba41-6eeeb3702ac8-kube-api-access-pmpnd\") pod \"dns-default-nx6dq\" (UID: \"fd9264b1-5a02-44c1-ba41-6eeeb3702ac8\") " pod="openshift-dns/dns-default-nx6dq" Jul 14 18:55:19.109265 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.109195 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cad8769b-f4a9-4b04-b024-3ee76145439e-crio-socket\") pod \"insights-runtime-extractor-w4v8d\" (UID: \"cad8769b-f4a9-4b04-b024-3ee76145439e\") " pod="openshift-insights/insights-runtime-extractor-w4v8d" Jul 14 18:55:19.109380 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.109324 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cad8769b-f4a9-4b04-b024-3ee76145439e-data-volume\") pod \"insights-runtime-extractor-w4v8d\" (UID: \"cad8769b-f4a9-4b04-b024-3ee76145439e\") " pod="openshift-insights/insights-runtime-extractor-w4v8d" Jul 14 18:55:19.109380 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.109375 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd9264b1-5a02-44c1-ba41-6eeeb3702ac8-metrics-tls\") pod \"dns-default-nx6dq\" (UID: \"fd9264b1-5a02-44c1-ba41-6eeeb3702ac8\") " pod="openshift-dns/dns-default-nx6dq" Jul 14 18:55:19.109470 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.109391 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cad8769b-f4a9-4b04-b024-3ee76145439e-crio-socket\") pod \"insights-runtime-extractor-w4v8d\" (UID: \"cad8769b-f4a9-4b04-b024-3ee76145439e\") " pod="openshift-insights/insights-runtime-extractor-w4v8d" Jul 14 18:55:19.109470 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.109400 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecbd7240-6b76-4441-8ee6-dac75955e64a-cert\") pod \"ingress-canary-cjtpk\" (UID: \"ecbd7240-6b76-4441-8ee6-dac75955e64a\") " pod="openshift-ingress-canary/ingress-canary-cjtpk" Jul 14 18:55:19.109470 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.109421 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh25p\" (UniqueName: \"kubernetes.io/projected/ecbd7240-6b76-4441-8ee6-dac75955e64a-kube-api-access-hh25p\") pod \"ingress-canary-cjtpk\" (UID: \"ecbd7240-6b76-4441-8ee6-dac75955e64a\") " pod="openshift-ingress-canary/ingress-canary-cjtpk" Jul 14 18:55:19.109640 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.109478 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpvzf\" (UniqueName: \"kubernetes.io/projected/cad8769b-f4a9-4b04-b024-3ee76145439e-kube-api-access-zpvzf\") pod \"insights-runtime-extractor-w4v8d\" (UID: \"cad8769b-f4a9-4b04-b024-3ee76145439e\") " pod="openshift-insights/insights-runtime-extractor-w4v8d" Jul 14 18:55:19.109722 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.109701 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cad8769b-f4a9-4b04-b024-3ee76145439e-data-volume\") pod \"insights-runtime-extractor-w4v8d\" (UID: \"cad8769b-f4a9-4b04-b024-3ee76145439e\") " pod="openshift-insights/insights-runtime-extractor-w4v8d" Jul 14 18:55:19.109830 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.109813 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad8769b-f4a9-4b04-b024-3ee76145439e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4v8d\" (UID: \"cad8769b-f4a9-4b04-b024-3ee76145439e\") " pod="openshift-insights/insights-runtime-extractor-w4v8d" Jul 14 18:55:19.113382 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.113352 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecbd7240-6b76-4441-8ee6-dac75955e64a-cert\") pod \"ingress-canary-cjtpk\" (UID: \"ecbd7240-6b76-4441-8ee6-dac75955e64a\") " pod="openshift-ingress-canary/ingress-canary-cjtpk" Jul 14 18:55:19.113382 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.113376 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad8769b-f4a9-4b04-b024-3ee76145439e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4v8d\" (UID: \"cad8769b-f4a9-4b04-b024-3ee76145439e\") " pod="openshift-insights/insights-runtime-extractor-w4v8d" Jul 14 18:55:19.118547 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.118524 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpvzf\" (UniqueName: \"kubernetes.io/projected/cad8769b-f4a9-4b04-b024-3ee76145439e-kube-api-access-zpvzf\") pod \"insights-runtime-extractor-w4v8d\" (UID: \"cad8769b-f4a9-4b04-b024-3ee76145439e\") " pod="openshift-insights/insights-runtime-extractor-w4v8d" Jul 14 18:55:19.119097 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.119081 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh25p\" (UniqueName: \"kubernetes.io/projected/ecbd7240-6b76-4441-8ee6-dac75955e64a-kube-api-access-hh25p\") pod \"ingress-canary-cjtpk\" (UID: \"ecbd7240-6b76-4441-8ee6-dac75955e64a\") " pod="openshift-ingress-canary/ingress-canary-cjtpk" Jul 14 18:55:19.212631 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.210674 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd9264b1-5a02-44c1-ba41-6eeeb3702ac8-tmp-dir\") pod \"dns-default-nx6dq\" (UID: \"fd9264b1-5a02-44c1-ba41-6eeeb3702ac8\") " pod="openshift-dns/dns-default-nx6dq" Jul 14 18:55:19.212631 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.210767 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fd9264b1-5a02-44c1-ba41-6eeeb3702ac8-config-volume\") pod \"dns-default-nx6dq\" (UID: \"fd9264b1-5a02-44c1-ba41-6eeeb3702ac8\") " pod="openshift-dns/dns-default-nx6dq" Jul 14 18:55:19.212631 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.210834 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmpnd\" (UniqueName: \"kubernetes.io/projected/fd9264b1-5a02-44c1-ba41-6eeeb3702ac8-kube-api-access-pmpnd\") pod \"dns-default-nx6dq\" (UID: \"fd9264b1-5a02-44c1-ba41-6eeeb3702ac8\") " pod="openshift-dns/dns-default-nx6dq" Jul 14 18:55:19.212631 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.210907 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd9264b1-5a02-44c1-ba41-6eeeb3702ac8-metrics-tls\") pod \"dns-default-nx6dq\" (UID: \"fd9264b1-5a02-44c1-ba41-6eeeb3702ac8\") " pod="openshift-dns/dns-default-nx6dq" Jul 14 18:55:19.214194 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.214161 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd9264b1-5a02-44c1-ba41-6eeeb3702ac8-tmp-dir\") pod \"dns-default-nx6dq\" (UID: \"fd9264b1-5a02-44c1-ba41-6eeeb3702ac8\") " pod="openshift-dns/dns-default-nx6dq" Jul 14 18:55:19.214314 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.214263 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fd9264b1-5a02-44c1-ba41-6eeeb3702ac8-config-volume\") pod \"dns-default-nx6dq\" (UID: \"fd9264b1-5a02-44c1-ba41-6eeeb3702ac8\") " pod="openshift-dns/dns-default-nx6dq" Jul 14 18:55:19.214314 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.214292 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd9264b1-5a02-44c1-ba41-6eeeb3702ac8-metrics-tls\") pod \"dns-default-nx6dq\" (UID: \"fd9264b1-5a02-44c1-ba41-6eeeb3702ac8\") " pod="openshift-dns/dns-default-nx6dq" Jul 14 18:55:19.216098 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.216081 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cjtpk" Jul 14 18:55:19.222724 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.222694 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77cfb85c85-h58qp"] Jul 14 18:55:19.230200 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.230172 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmpnd\" (UniqueName: \"kubernetes.io/projected/fd9264b1-5a02-44c1-ba41-6eeeb3702ac8-kube-api-access-pmpnd\") pod \"dns-default-nx6dq\" (UID: \"fd9264b1-5a02-44c1-ba41-6eeeb3702ac8\") " pod="openshift-dns/dns-default-nx6dq" Jul 14 18:55:19.240659 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.240626 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w4v8d" Jul 14 18:55:19.251502 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.251481 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77cfb85c85-h58qp"] Jul 14 18:55:19.251627 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.251614 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:19.255480 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.255452 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2jzd4\"" Jul 14 18:55:19.255644 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.255469 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 18:55:19.255644 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.255466 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 18:55:19.255760 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.255706 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 14 18:55:19.255760 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.255737 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 18:55:19.255849 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.255773 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 14 18:55:19.255962 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.255947 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 18:55:19.256240 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.256223 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 18:55:19.260004 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.259982 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nx6dq" Jul 14 18:55:19.412888 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.412542 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/372dd078-197e-42cc-a1de-1f97e111be1e-service-ca\") pod \"console-77cfb85c85-h58qp\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:19.412888 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.412589 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/372dd078-197e-42cc-a1de-1f97e111be1e-oauth-serving-cert\") pod \"console-77cfb85c85-h58qp\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:19.412888 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.412654 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zpst\" (UniqueName: \"kubernetes.io/projected/372dd078-197e-42cc-a1de-1f97e111be1e-kube-api-access-4zpst\") pod \"console-77cfb85c85-h58qp\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:19.412888 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.412683 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/372dd078-197e-42cc-a1de-1f97e111be1e-console-serving-cert\") pod \"console-77cfb85c85-h58qp\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:19.412888 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.412759 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/372dd078-197e-42cc-a1de-1f97e111be1e-console-oauth-config\") pod \"console-77cfb85c85-h58qp\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:19.412888 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.412795 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/372dd078-197e-42cc-a1de-1f97e111be1e-console-config\") pod \"console-77cfb85c85-h58qp\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:19.436621 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.436566 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w4v8d"] Jul 14 18:55:19.441020 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:55:19.440991 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad8769b_f4a9_4b04_b024_3ee76145439e.slice/crio-cf87d27ff14145ee2a7c185d1072679f5c510b8003d42d9c648fd707afa1e8c0 WatchSource:0}: Error finding container cf87d27ff14145ee2a7c185d1072679f5c510b8003d42d9c648fd707afa1e8c0: Status 404 returned error can't find the container with id cf87d27ff14145ee2a7c185d1072679f5c510b8003d42d9c648fd707afa1e8c0 Jul 14 18:55:19.514080 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.514044 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/372dd078-197e-42cc-a1de-1f97e111be1e-console-oauth-config\") pod \"console-77cfb85c85-h58qp\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:19.514246 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.514093 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/372dd078-197e-42cc-a1de-1f97e111be1e-console-config\") pod \"console-77cfb85c85-h58qp\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:19.514246 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.514132 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/372dd078-197e-42cc-a1de-1f97e111be1e-service-ca\") pod \"console-77cfb85c85-h58qp\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:19.514246 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.514157 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/372dd078-197e-42cc-a1de-1f97e111be1e-oauth-serving-cert\") pod \"console-77cfb85c85-h58qp\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:19.514372 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.514303 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zpst\" (UniqueName: \"kubernetes.io/projected/372dd078-197e-42cc-a1de-1f97e111be1e-kube-api-access-4zpst\") pod \"console-77cfb85c85-h58qp\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:19.514372 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.514339 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/372dd078-197e-42cc-a1de-1f97e111be1e-console-serving-cert\") pod \"console-77cfb85c85-h58qp\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:19.515007 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.514984 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/372dd078-197e-42cc-a1de-1f97e111be1e-oauth-serving-cert\") pod \"console-77cfb85c85-h58qp\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:19.515125 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.515049 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/372dd078-197e-42cc-a1de-1f97e111be1e-service-ca\") pod \"console-77cfb85c85-h58qp\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:19.515191 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.515171 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/372dd078-197e-42cc-a1de-1f97e111be1e-console-config\") pod \"console-77cfb85c85-h58qp\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:19.516658 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.516642 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/372dd078-197e-42cc-a1de-1f97e111be1e-console-oauth-config\") pod \"console-77cfb85c85-h58qp\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:19.516780 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.516763 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/372dd078-197e-42cc-a1de-1f97e111be1e-console-serving-cert\") pod \"console-77cfb85c85-h58qp\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:19.523959 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.523940 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zpst\" (UniqueName: \"kubernetes.io/projected/372dd078-197e-42cc-a1de-1f97e111be1e-kube-api-access-4zpst\") pod \"console-77cfb85c85-h58qp\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:19.560991 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.560958 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:19.561131 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.560995 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:55:19.561131 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.561023 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:55:19.561131 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.561112 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:55:19.564201 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.564182 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ltzph\"" Jul 14 18:55:19.564359 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.564220 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 18:55:19.564359 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.564235 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 18:55:19.564359 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.564182 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 18:55:19.564359 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.564262 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zn8zd\"" Jul 14 18:55:19.564359 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.564182 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 18:55:19.649946 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.649888 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cjtpk"] Jul 14 18:55:19.653133 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:55:19.653099 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecbd7240_6b76_4441_8ee6_dac75955e64a.slice/crio-42599e223abc9a4c9885ec23a57618be8f9212739abc47b1b40d124b5088e98a WatchSource:0}: Error finding container 42599e223abc9a4c9885ec23a57618be8f9212739abc47b1b40d124b5088e98a: Status 404 returned error can't find the container with id 42599e223abc9a4c9885ec23a57618be8f9212739abc47b1b40d124b5088e98a Jul 14 18:55:19.653293 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.653197 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nx6dq"] Jul 14 18:55:19.656431 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:55:19.656406 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd9264b1_5a02_44c1_ba41_6eeeb3702ac8.slice/crio-89122fda3a6e5c921c3316a5f4bcd87944e029d14b74130a48a1fe84569176fa WatchSource:0}: Error finding container 89122fda3a6e5c921c3316a5f4bcd87944e029d14b74130a48a1fe84569176fa: Status 404 returned error can't find the container with id 89122fda3a6e5c921c3316a5f4bcd87944e029d14b74130a48a1fe84569176fa Jul 14 18:55:19.721050 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.721018 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77cfb85c85-h58qp"] Jul 14 18:55:19.724025 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:55:19.723997 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod372dd078_197e_42cc_a1de_1f97e111be1e.slice/crio-637d053df56e5cbec8ac373945459de75a32d8939210466914ed65407e4cfcd3 WatchSource:0}: Error finding container 637d053df56e5cbec8ac373945459de75a32d8939210466914ed65407e4cfcd3: Status 404 returned error can't find the container with id 637d053df56e5cbec8ac373945459de75a32d8939210466914ed65407e4cfcd3 Jul 14 18:55:19.856077 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.856037 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w4v8d" event={"ID":"cad8769b-f4a9-4b04-b024-3ee76145439e","Type":"ContainerStarted","Data":"cf87d27ff14145ee2a7c185d1072679f5c510b8003d42d9c648fd707afa1e8c0"} Jul 14 18:55:19.857101 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.857076 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cjtpk" event={"ID":"ecbd7240-6b76-4441-8ee6-dac75955e64a","Type":"ContainerStarted","Data":"42599e223abc9a4c9885ec23a57618be8f9212739abc47b1b40d124b5088e98a"} Jul 14 18:55:19.858231 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.858206 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77cfb85c85-h58qp" event={"ID":"372dd078-197e-42cc-a1de-1f97e111be1e","Type":"ContainerStarted","Data":"637d053df56e5cbec8ac373945459de75a32d8939210466914ed65407e4cfcd3"} Jul 14 18:55:19.859153 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:19.859127 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nx6dq" event={"ID":"fd9264b1-5a02-44c1-ba41-6eeeb3702ac8","Type":"ContainerStarted","Data":"89122fda3a6e5c921c3316a5f4bcd87944e029d14b74130a48a1fe84569176fa"} Jul 14 18:55:23.570479 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:23.570439 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-2jbpg"] Jul 14 18:55:23.587982 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:23.587948 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-2jbpg" Jul 14 18:55:23.591833 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:23.591805 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 14 18:55:23.591995 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:23.591952 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mmg69\"" Jul 14 18:55:23.592841 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:23.592824 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 14 18:55:23.592841 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:23.592837 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 18:55:23.593199 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:23.593186 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 18:55:23.593199 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:23.593193 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 18:55:23.600002 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:23.599976 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-2jbpg"] Jul 14 18:55:23.751276 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:23.751236 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8321681e-5428-4412-b965-1c0f785b327b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-2jbpg\" (UID: \"8321681e-5428-4412-b965-1c0f785b327b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2jbpg" Jul 14 18:55:23.751477 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:23.751315 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5mjb\" (UniqueName: \"kubernetes.io/projected/8321681e-5428-4412-b965-1c0f785b327b-kube-api-access-f5mjb\") pod \"prometheus-operator-64785b6675-2jbpg\" (UID: \"8321681e-5428-4412-b965-1c0f785b327b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2jbpg" Jul 14 18:55:23.751477 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:23.751435 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8321681e-5428-4412-b965-1c0f785b327b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-2jbpg\" (UID: \"8321681e-5428-4412-b965-1c0f785b327b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2jbpg" Jul 14 18:55:23.751564 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:23.751479 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8321681e-5428-4412-b965-1c0f785b327b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-2jbpg\" (UID: \"8321681e-5428-4412-b965-1c0f785b327b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2jbpg" Jul 14 18:55:23.852205 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:23.852120 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8321681e-5428-4412-b965-1c0f785b327b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-2jbpg\" (UID: \"8321681e-5428-4412-b965-1c0f785b327b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2jbpg" Jul 14 18:55:23.852205 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:23.852175 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8321681e-5428-4412-b965-1c0f785b327b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-2jbpg\" (UID: \"8321681e-5428-4412-b965-1c0f785b327b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2jbpg" Jul 14 18:55:23.852425 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:23.852250 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8321681e-5428-4412-b965-1c0f785b327b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-2jbpg\" (UID: \"8321681e-5428-4412-b965-1c0f785b327b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2jbpg" Jul 14 18:55:23.852425 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:23.852304 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5mjb\" (UniqueName: \"kubernetes.io/projected/8321681e-5428-4412-b965-1c0f785b327b-kube-api-access-f5mjb\") pod \"prometheus-operator-64785b6675-2jbpg\" (UID: \"8321681e-5428-4412-b965-1c0f785b327b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2jbpg" Jul 14 18:55:23.852518 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:23.852426 2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 14 18:55:23.852568 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:23.852526 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8321681e-5428-4412-b965-1c0f785b327b-prometheus-operator-tls podName:8321681e-5428-4412-b965-1c0f785b327b nodeName:}" failed. No retries permitted until 2026-07-14 18:55:24.352503152 +0000 UTC m=+48.351395947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8321681e-5428-4412-b965-1c0f785b327b-prometheus-operator-tls") pod "prometheus-operator-64785b6675-2jbpg" (UID: "8321681e-5428-4412-b965-1c0f785b327b") : secret "prometheus-operator-tls" not found Jul 14 18:55:23.853035 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:23.853010 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8321681e-5428-4412-b965-1c0f785b327b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-2jbpg\" (UID: \"8321681e-5428-4412-b965-1c0f785b327b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2jbpg" Jul 14 18:55:23.854935 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:23.854914 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8321681e-5428-4412-b965-1c0f785b327b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-2jbpg\" (UID: \"8321681e-5428-4412-b965-1c0f785b327b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2jbpg" Jul 14 18:55:23.861577 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:23.861548 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5mjb\" (UniqueName: \"kubernetes.io/projected/8321681e-5428-4412-b965-1c0f785b327b-kube-api-access-f5mjb\") pod \"prometheus-operator-64785b6675-2jbpg\" (UID: \"8321681e-5428-4412-b965-1c0f785b327b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2jbpg" Jul 14 18:55:24.355666 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:24.355629 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8321681e-5428-4412-b965-1c0f785b327b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-2jbpg\" (UID: \"8321681e-5428-4412-b965-1c0f785b327b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2jbpg" Jul 14 18:55:24.358485 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:24.358455 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8321681e-5428-4412-b965-1c0f785b327b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-2jbpg\" (UID: \"8321681e-5428-4412-b965-1c0f785b327b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2jbpg" Jul 14 18:55:24.498431 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:24.498395 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-2jbpg" Jul 14 18:55:25.210983 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.210950 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56977bf987-bm4l4"] Jul 14 18:55:25.237078 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.237042 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56977bf987-bm4l4"] Jul 14 18:55:25.237224 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.237185 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:25.246920 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.246894 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 14 18:55:25.362678 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.362643 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-console-config\") pod \"console-56977bf987-bm4l4\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:25.362678 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.362689 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lmkv\" (UniqueName: \"kubernetes.io/projected/112ee496-6089-4143-a016-164fc11f002e-kube-api-access-4lmkv\") pod \"console-56977bf987-bm4l4\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:25.362887 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.362720 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/112ee496-6089-4143-a016-164fc11f002e-console-oauth-config\") pod \"console-56977bf987-bm4l4\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:25.362887 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.362821 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-oauth-serving-cert\") pod \"console-56977bf987-bm4l4\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:25.362976 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.362899 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-service-ca\") pod \"console-56977bf987-bm4l4\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:25.362976 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.362947 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-trusted-ca-bundle\") pod \"console-56977bf987-bm4l4\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:25.363046 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.362974 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/112ee496-6089-4143-a016-164fc11f002e-console-serving-cert\") pod \"console-56977bf987-bm4l4\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:25.464083 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.464000 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-oauth-serving-cert\") pod \"console-56977bf987-bm4l4\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:25.464083 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.464080 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-service-ca\") pod \"console-56977bf987-bm4l4\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:25.464308 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.464121 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-trusted-ca-bundle\") pod \"console-56977bf987-bm4l4\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:25.464308 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.464147 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/112ee496-6089-4143-a016-164fc11f002e-console-serving-cert\") pod \"console-56977bf987-bm4l4\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:25.464308 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.464176 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-console-config\") pod \"console-56977bf987-bm4l4\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:25.464308 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.464208 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lmkv\" (UniqueName: \"kubernetes.io/projected/112ee496-6089-4143-a016-164fc11f002e-kube-api-access-4lmkv\") pod \"console-56977bf987-bm4l4\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:25.464308 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.464231 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/112ee496-6089-4143-a016-164fc11f002e-console-oauth-config\") pod \"console-56977bf987-bm4l4\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:25.464895 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.464865 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-oauth-serving-cert\") pod \"console-56977bf987-bm4l4\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:25.465365 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.465343 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-service-ca\") pod \"console-56977bf987-bm4l4\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:25.465493 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.465346 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-console-config\") pod \"console-56977bf987-bm4l4\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:25.465547 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.465491 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-trusted-ca-bundle\") pod \"console-56977bf987-bm4l4\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:25.467392 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.467368 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/112ee496-6089-4143-a016-164fc11f002e-console-oauth-config\") pod \"console-56977bf987-bm4l4\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:25.467493 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.467445 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/112ee496-6089-4143-a016-164fc11f002e-console-serving-cert\") pod \"console-56977bf987-bm4l4\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:25.474438 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.474419 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lmkv\" (UniqueName: \"kubernetes.io/projected/112ee496-6089-4143-a016-164fc11f002e-kube-api-access-4lmkv\") pod \"console-56977bf987-bm4l4\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:25.547879 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:25.547839 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:27.297980 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:27.297825 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-2jbpg"] Jul 14 18:55:27.300554 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:55:27.300531 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8321681e_5428_4412_b965_1c0f785b327b.slice/crio-996aa68638928f225c2967771e3636f2ad4b350ded08996103194221bb803c5e WatchSource:0}: Error finding container 996aa68638928f225c2967771e3636f2ad4b350ded08996103194221bb803c5e: Status 404 returned error can't find the container with id 996aa68638928f225c2967771e3636f2ad4b350ded08996103194221bb803c5e Jul 14 18:55:27.320854 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:27.320824 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56977bf987-bm4l4"] Jul 14 18:55:27.449459 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:55:27.449383 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod112ee496_6089_4143_a016_164fc11f002e.slice/crio-c33bd68110d8a299c40b31babde9acc5cf66f448be7efae5812d240d72c57d4d WatchSource:0}: Error finding container c33bd68110d8a299c40b31babde9acc5cf66f448be7efae5812d240d72c57d4d: Status 404 returned error can't find the container with id c33bd68110d8a299c40b31babde9acc5cf66f448be7efae5812d240d72c57d4d Jul 14 18:55:27.886836 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:27.886796 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cjtpk" event={"ID":"ecbd7240-6b76-4441-8ee6-dac75955e64a","Type":"ContainerStarted","Data":"95945cab5766648bc975aef6f5361afa38a3c19abd9b4af06bdcd157a718ca6f"} Jul 14 18:55:27.888058 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:27.888032 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-2jbpg" event={"ID":"8321681e-5428-4412-b965-1c0f785b327b","Type":"ContainerStarted","Data":"996aa68638928f225c2967771e3636f2ad4b350ded08996103194221bb803c5e"} Jul 14 18:55:27.889507 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:27.889483 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77cfb85c85-h58qp" event={"ID":"372dd078-197e-42cc-a1de-1f97e111be1e","Type":"ContainerStarted","Data":"4dfad6a816cb3d46646d41a7a285985de714c28ddd6045aefddcd60dc32dfb65"} Jul 14 18:55:27.891256 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:27.891235 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nx6dq" event={"ID":"fd9264b1-5a02-44c1-ba41-6eeeb3702ac8","Type":"ContainerStarted","Data":"b9b5d45c72800ef30ad5401363877949fc5cfe1ef09f89a90137da475894f4a6"} Jul 14 18:55:27.891389 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:27.891271 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nx6dq" event={"ID":"fd9264b1-5a02-44c1-ba41-6eeeb3702ac8","Type":"ContainerStarted","Data":"8fa5c2b4641868a6264c2cfe8eb921e04f1791825117aa113702d013b31b4dc9"} Jul 14 18:55:27.891389 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:27.891362 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nx6dq" Jul 14 18:55:27.892775 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:27.892744 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56977bf987-bm4l4" event={"ID":"112ee496-6089-4143-a016-164fc11f002e","Type":"ContainerStarted","Data":"797a7a9c1bde5ba12cc591b21551c0894aed250ea16efe769fb97d15485cf0ee"} Jul 14 18:55:27.892890 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:27.892792 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56977bf987-bm4l4" event={"ID":"112ee496-6089-4143-a016-164fc11f002e","Type":"ContainerStarted","Data":"c33bd68110d8a299c40b31babde9acc5cf66f448be7efae5812d240d72c57d4d"} Jul 14 18:55:27.894169 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:27.894151 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w4v8d" event={"ID":"cad8769b-f4a9-4b04-b024-3ee76145439e","Type":"ContainerStarted","Data":"23db62df51597bd64d1880b1d6eb38dd9bb860e767235f079e4018e54587b465"} Jul 14 18:55:27.905304 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:27.905252 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cjtpk" podStartSLOduration=2.4031666 podStartE2EDuration="9.905233914s" totalImagesPullingTime="7.502067314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:27.905137086 +0000 UTC m=+51.904029905" watchObservedRunningTime="2026-07-14 18:55:27.905233914 +0000 UTC m=+51.904126733" Jul 14 18:55:27.943814 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:27.943750 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nx6dq" podStartSLOduration=2.477644683 podStartE2EDuration="9.943719933s" totalImagesPullingTime="7.46607525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:27.942953781 +0000 UTC m=+51.941846591" watchObservedRunningTime="2026-07-14 18:55:27.943719933 +0000 UTC m=+51.942612729" Jul 14 18:55:27.964316 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:27.964259 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77cfb85c85-h58qp" podStartSLOduration=1.5424543 podStartE2EDuration="8.964239728s" totalImagesPullingTime="7.421785428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:27.963029477 +0000 UTC m=+51.961922297" watchObservedRunningTime="2026-07-14 18:55:27.964239728 +0000 UTC m=+51.963132547" Jul 14 18:55:27.980930 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:27.980881 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56977bf987-bm4l4" podStartSLOduration=2.980862403 podStartE2EDuration="2.980862403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:55:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:27.9799652 +0000 UTC m=+51.978858019" watchObservedRunningTime="2026-07-14 18:55:27.980862403 +0000 UTC m=+51.979755221" Jul 14 18:55:28.900862 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:28.900762 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w4v8d" event={"ID":"cad8769b-f4a9-4b04-b024-3ee76145439e","Type":"ContainerStarted","Data":"4100f9ea033fef7458b8c2b085028d69e40da8697547137a578a03eb2647c2ed"} Jul 14 18:55:29.561524 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:29.561482 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:29.561740 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:29.561568 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:29.567316 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:29.567287 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:29.906654 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:29.906622 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-2jbpg" event={"ID":"8321681e-5428-4412-b965-1c0f785b327b","Type":"ContainerStarted","Data":"7412f82a563e25933c151893d769cf06890f4e245b91a1d08eb1dde037e7fd54"} Jul 14 18:55:29.907139 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:29.906688 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-2jbpg" event={"ID":"8321681e-5428-4412-b965-1c0f785b327b","Type":"ContainerStarted","Data":"54c2d9735fd72b9d04bc785eac9b7e6b291766691cc47d3c4288ea7546086ef3"} Jul 14 18:55:29.911226 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:29.911201 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:55:29.948372 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:29.948318 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-2jbpg" podStartSLOduration=4.784595445 podStartE2EDuration="6.948301779s" totalImagesPullingTime="2.163706334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:55:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:29.925574249 +0000 UTC m=+53.924467067" watchObservedRunningTime="2026-07-14 18:55:29.948301779 +0000 UTC m=+53.947194598" Jul 14 18:55:31.951803 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:31.951768 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2fpxw"] Jul 14 18:55:31.965438 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:31.965407 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:31.968454 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:31.968427 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rkcqk\"" Jul 14 18:55:31.968612 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:31.968490 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 18:55:31.968801 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:31.968784 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 18:55:31.969408 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:31.969389 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 18:55:32.023017 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.022997 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-node-exporter-textfile\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.023065 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.023048 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-root\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.023142 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.023122 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-node-exporter-tls\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.023173 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.023144 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjwwv\" (UniqueName: \"kubernetes.io/projected/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-kube-api-access-vjwwv\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.023221 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.023171 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-sys\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.023221 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.023212 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-metrics-client-ca\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.023290 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.023272 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.023359 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.023337 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.023410 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.023394 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-node-exporter-wtmp\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.124165 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.124129 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-node-exporter-tls\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.124165 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.124162 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjwwv\" (UniqueName: \"kubernetes.io/projected/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-kube-api-access-vjwwv\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.124401 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.124183 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-sys\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.124401 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.124200 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-metrics-client-ca\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.124401 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.124219 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.124401 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.124252 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.124401 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.124280 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-sys\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.124401 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.124290 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-node-exporter-wtmp\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.124401 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.124356 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-node-exporter-textfile\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.124401 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.124399 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-root\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.124401 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.124402 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-node-exporter-wtmp\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.124800 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.124513 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-root\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.124800 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.124700 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-node-exporter-textfile\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.124915 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.124888 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.125010 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.124904 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-metrics-client-ca\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.126696 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.126668 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.126795 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.126738 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-node-exporter-tls\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.133117 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.133090 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjwwv\" (UniqueName: \"kubernetes.io/projected/e8d48bb3-2437-4ba1-bf7c-8f87aace84d4-kube-api-access-vjwwv\") pod \"node-exporter-2fpxw\" (UID: \"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4\") " pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.274644 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.274612 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2fpxw" Jul 14 18:55:32.296701 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:55:32.296677 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d48bb3_2437_4ba1_bf7c_8f87aace84d4.slice/crio-210d873e2b374a3e6e027180f99136ed2e6dceffd8e3fc1351293a5f5c507d4a WatchSource:0}: Error finding container 210d873e2b374a3e6e027180f99136ed2e6dceffd8e3fc1351293a5f5c507d4a: Status 404 returned error can't find the container with id 210d873e2b374a3e6e027180f99136ed2e6dceffd8e3fc1351293a5f5c507d4a Jul 14 18:55:32.917975 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.917935 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w4v8d" event={"ID":"cad8769b-f4a9-4b04-b024-3ee76145439e","Type":"ContainerStarted","Data":"b93867f0fae523e1e9abd1e42cfb916d23b7e291dffba8ce72681f5e350eb10b"} Jul 14 18:55:32.919331 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.919305 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2fpxw" event={"ID":"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4","Type":"ContainerStarted","Data":"210d873e2b374a3e6e027180f99136ed2e6dceffd8e3fc1351293a5f5c507d4a"} Jul 14 18:55:32.937546 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.937497 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w4v8d" podStartSLOduration=2.564823493 podStartE2EDuration="14.937480065s" totalImagesPullingTime="12.372656572s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:55:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:32.936368354 +0000 UTC m=+56.935261174" watchObservedRunningTime="2026-07-14 18:55:32.937480065 +0000 UTC m=+56.936372861" Jul 14 18:55:32.991395 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:32.991355 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 18:55:33.014389 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.014347 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 18:55:33.014518 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.014460 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.017193 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.017164 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 14 18:55:33.017458 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.017433 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 14 18:55:33.019257 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.019235 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 14 18:55:33.019383 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.019368 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 14 18:55:33.019791 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.019771 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 14 18:55:33.019936 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.019805 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 14 18:55:33.019936 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.019813 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 14 18:55:33.019936 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.019864 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zvn4x\"" Jul 14 18:55:33.019936 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.019899 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 14 18:55:33.019936 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.019866 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 14 18:55:33.031041 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.031015 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03b2580e-86bd-4d57-a062-97ecd5f943f0-config-out\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.031136 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.031084 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03b2580e-86bd-4d57-a062-97ecd5f943f0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.031183 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.031138 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.031183 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.031168 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.031284 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.031201 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-config-volume\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.031284 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.031229 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03b2580e-86bd-4d57-a062-97ecd5f943f0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.031284 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.031263 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03b2580e-86bd-4d57-a062-97ecd5f943f0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.031417 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.031300 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-web-config\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.031417 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.031331 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.031417 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.031361 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.031523 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.031414 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.031523 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.031448 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsn8l\" (UniqueName: \"kubernetes.io/projected/03b2580e-86bd-4d57-a062-97ecd5f943f0-kube-api-access-dsn8l\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.031523 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.031483 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03b2580e-86bd-4d57-a062-97ecd5f943f0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.132137 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.132097 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.132137 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.132136 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.132381 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.132156 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-config-volume\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.132381 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.132195 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03b2580e-86bd-4d57-a062-97ecd5f943f0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.132381 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.132211 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03b2580e-86bd-4d57-a062-97ecd5f943f0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.132381 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.132241 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-web-config\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.132381 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.132270 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.132381 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:33.132283 2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 14 18:55:33.132381 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.132307 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.132381 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:33.132356 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-main-tls podName:03b2580e-86bd-4d57-a062-97ecd5f943f0 nodeName:}" failed. No retries permitted until 2026-07-14 18:55:33.632336157 +0000 UTC m=+57.631228958 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "03b2580e-86bd-4d57-a062-97ecd5f943f0") : secret "alertmanager-main-tls" not found Jul 14 18:55:33.132802 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.132397 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.132802 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.132429 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsn8l\" (UniqueName: \"kubernetes.io/projected/03b2580e-86bd-4d57-a062-97ecd5f943f0-kube-api-access-dsn8l\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.132802 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.132456 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03b2580e-86bd-4d57-a062-97ecd5f943f0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.132802 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.132649 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03b2580e-86bd-4d57-a062-97ecd5f943f0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.132998 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.132940 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03b2580e-86bd-4d57-a062-97ecd5f943f0-config-out\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.132998 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.133009 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03b2580e-86bd-4d57-a062-97ecd5f943f0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.133269 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:33.133139 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/03b2580e-86bd-4d57-a062-97ecd5f943f0-alertmanager-trusted-ca-bundle podName:03b2580e-86bd-4d57-a062-97ecd5f943f0 nodeName:}" failed. No retries permitted until 2026-07-14 18:55:33.633120328 +0000 UTC m=+57.632013149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/03b2580e-86bd-4d57-a062-97ecd5f943f0-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "03b2580e-86bd-4d57-a062-97ecd5f943f0") : configmap references non-existent config key: ca-bundle.crt Jul 14 18:55:33.134162 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.134136 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03b2580e-86bd-4d57-a062-97ecd5f943f0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.137328 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.137251 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.137436 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.137364 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.138396 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.137663 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03b2580e-86bd-4d57-a062-97ecd5f943f0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.138396 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.137722 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03b2580e-86bd-4d57-a062-97ecd5f943f0-config-out\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.138396 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.137751 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-config-volume\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.138396 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.137959 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-web-config\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.140891 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.138958 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.140891 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.139778 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.147932 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.147910 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsn8l\" (UniqueName: \"kubernetes.io/projected/03b2580e-86bd-4d57-a062-97ecd5f943f0-kube-api-access-dsn8l\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.637408 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.637360 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03b2580e-86bd-4d57-a062-97ecd5f943f0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.637408 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.637412 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.638092 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.638058 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03b2580e-86bd-4d57-a062-97ecd5f943f0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.639906 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.639884 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:33.924285 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.924251 2563 generic.go:356] "Generic (PLEG): container finished" podID="e8d48bb3-2437-4ba1-bf7c-8f87aace84d4" containerID="35af9d70bce675e7c655ec27db733381a79939d24fc6623f93c4112c5612b7bf" exitCode=0 Jul 14 18:55:33.924445 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.924339 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2fpxw" event={"ID":"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4","Type":"ContainerDied","Data":"35af9d70bce675e7c655ec27db733381a79939d24fc6623f93c4112c5612b7bf"} Jul 14 18:55:33.924939 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:33.924918 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:55:34.071202 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:34.071166 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 18:55:34.091782 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:55:34.091756 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03b2580e_86bd_4d57_a062_97ecd5f943f0.slice/crio-887580bd243f80acbdb55fe30b7c12f53c337d8ed3e156b48ed3c0f759f3acd9 WatchSource:0}: Error finding container 887580bd243f80acbdb55fe30b7c12f53c337d8ed3e156b48ed3c0f759f3acd9: Status 404 returned error can't find the container with id 887580bd243f80acbdb55fe30b7c12f53c337d8ed3e156b48ed3c0f759f3acd9 Jul 14 18:55:34.930378 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:34.930336 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b2580e-86bd-4d57-a062-97ecd5f943f0","Type":"ContainerStarted","Data":"887580bd243f80acbdb55fe30b7c12f53c337d8ed3e156b48ed3c0f759f3acd9"} Jul 14 18:55:34.932740 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:34.932714 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2fpxw" event={"ID":"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4","Type":"ContainerStarted","Data":"cb81afee825effbab20fa4151af76ad8c7fac79718e3e6b36a804c85dc19441c"} Jul 14 18:55:34.932877 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:34.932764 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2fpxw" event={"ID":"e8d48bb3-2437-4ba1-bf7c-8f87aace84d4","Type":"ContainerStarted","Data":"c999cb0bdfc00be723049430810d9721e8dd757c723daedd985e872f1b597256"} Jul 14 18:55:34.977391 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:34.977343 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2fpxw" podStartSLOduration=2.500740702 podStartE2EDuration="3.977326528s" totalImagesPullingTime="1.367196863s" totalInitContainerRuntime="109.388963ms" isStatefulPod=true podCreationTimestamp="2026-07-14 18:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:34.976861576 +0000 UTC m=+58.975754394" watchObservedRunningTime="2026-07-14 18:55:34.977326528 +0000 UTC m=+58.976219346" Jul 14 18:55:35.548693 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:35.548652 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:35.549055 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:35.548725 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:35.553408 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:35.553386 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:35.938358 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:35.938324 2563 generic.go:356] "Generic (PLEG): container finished" podID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerID="de5e8a236cdd661a75f4b2990c234aa812a8c3740de5087f45073c120fd953e6" exitCode=0 Jul 14 18:55:35.938533 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:35.938416 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b2580e-86bd-4d57-a062-97ecd5f943f0","Type":"ContainerDied","Data":"de5e8a236cdd661a75f4b2990c234aa812a8c3740de5087f45073c120fd953e6"} Jul 14 18:55:35.942663 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:35.942643 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:55:36.044256 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.044227 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77cfb85c85-h58qp"] Jul 14 18:55:36.252192 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.252159 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7f88cb85f6-8wplj"] Jul 14 18:55:36.274122 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.274095 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7f88cb85f6-8wplj"] Jul 14 18:55:36.274261 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.274194 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.277031 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.277011 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 14 18:55:36.277153 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.277127 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 14 18:55:36.277260 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.277245 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 14 18:55:36.277338 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.277246 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 14 18:55:36.277338 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.277324 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6oqbdms907c9c\"" Jul 14 18:55:36.277440 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.277345 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pbzcc\"" Jul 14 18:55:36.359032 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.358996 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3dd6ef3d-dce9-4d47-b361-f32e9e49691d-metrics-server-audit-profiles\") pod \"metrics-server-7f88cb85f6-8wplj\" (UID: \"3dd6ef3d-dce9-4d47-b361-f32e9e49691d\") " pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.359205 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.359047 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3dd6ef3d-dce9-4d47-b361-f32e9e49691d-secret-metrics-server-client-certs\") pod \"metrics-server-7f88cb85f6-8wplj\" (UID: \"3dd6ef3d-dce9-4d47-b361-f32e9e49691d\") " pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.359205 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.359079 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3dd6ef3d-dce9-4d47-b361-f32e9e49691d-client-ca-bundle\") pod \"metrics-server-7f88cb85f6-8wplj\" (UID: \"3dd6ef3d-dce9-4d47-b361-f32e9e49691d\") " pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.359205 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.359121 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dd6ef3d-dce9-4d47-b361-f32e9e49691d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f88cb85f6-8wplj\" (UID: \"3dd6ef3d-dce9-4d47-b361-f32e9e49691d\") " pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.359205 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.359162 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zlbk\" (UniqueName: \"kubernetes.io/projected/3dd6ef3d-dce9-4d47-b361-f32e9e49691d-kube-api-access-6zlbk\") pod \"metrics-server-7f88cb85f6-8wplj\" (UID: \"3dd6ef3d-dce9-4d47-b361-f32e9e49691d\") " pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.359205 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.359185 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3dd6ef3d-dce9-4d47-b361-f32e9e49691d-secret-metrics-server-tls\") pod \"metrics-server-7f88cb85f6-8wplj\" (UID: \"3dd6ef3d-dce9-4d47-b361-f32e9e49691d\") " pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.359369 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.359257 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3dd6ef3d-dce9-4d47-b361-f32e9e49691d-audit-log\") pod \"metrics-server-7f88cb85f6-8wplj\" (UID: \"3dd6ef3d-dce9-4d47-b361-f32e9e49691d\") " pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.459616 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.459562 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3dd6ef3d-dce9-4d47-b361-f32e9e49691d-secret-metrics-server-client-certs\") pod \"metrics-server-7f88cb85f6-8wplj\" (UID: \"3dd6ef3d-dce9-4d47-b361-f32e9e49691d\") " pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.459780 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.459659 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3dd6ef3d-dce9-4d47-b361-f32e9e49691d-client-ca-bundle\") pod \"metrics-server-7f88cb85f6-8wplj\" (UID: \"3dd6ef3d-dce9-4d47-b361-f32e9e49691d\") " pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.459780 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.459692 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dd6ef3d-dce9-4d47-b361-f32e9e49691d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f88cb85f6-8wplj\" (UID: \"3dd6ef3d-dce9-4d47-b361-f32e9e49691d\") " pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.459780 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.459719 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zlbk\" (UniqueName: \"kubernetes.io/projected/3dd6ef3d-dce9-4d47-b361-f32e9e49691d-kube-api-access-6zlbk\") pod \"metrics-server-7f88cb85f6-8wplj\" (UID: \"3dd6ef3d-dce9-4d47-b361-f32e9e49691d\") " pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.459979 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.459946 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3dd6ef3d-dce9-4d47-b361-f32e9e49691d-secret-metrics-server-tls\") pod \"metrics-server-7f88cb85f6-8wplj\" (UID: \"3dd6ef3d-dce9-4d47-b361-f32e9e49691d\") " pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.460091 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.460009 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3dd6ef3d-dce9-4d47-b361-f32e9e49691d-audit-log\") pod \"metrics-server-7f88cb85f6-8wplj\" (UID: \"3dd6ef3d-dce9-4d47-b361-f32e9e49691d\") " pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.460091 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.460084 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3dd6ef3d-dce9-4d47-b361-f32e9e49691d-metrics-server-audit-profiles\") pod \"metrics-server-7f88cb85f6-8wplj\" (UID: \"3dd6ef3d-dce9-4d47-b361-f32e9e49691d\") " pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.460471 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.460450 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3dd6ef3d-dce9-4d47-b361-f32e9e49691d-audit-log\") pod \"metrics-server-7f88cb85f6-8wplj\" (UID: \"3dd6ef3d-dce9-4d47-b361-f32e9e49691d\") " pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.462810 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.462782 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 14 18:55:36.462965 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.462947 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 14 18:55:36.463042 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.462979 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6oqbdms907c9c\"" Jul 14 18:55:36.463042 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.462979 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 14 18:55:36.463147 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.462956 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 14 18:55:36.469217 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.469191 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zlbk\" (UniqueName: \"kubernetes.io/projected/3dd6ef3d-dce9-4d47-b361-f32e9e49691d-kube-api-access-6zlbk\") pod \"metrics-server-7f88cb85f6-8wplj\" (UID: \"3dd6ef3d-dce9-4d47-b361-f32e9e49691d\") " pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.470399 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.470374 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dd6ef3d-dce9-4d47-b361-f32e9e49691d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f88cb85f6-8wplj\" (UID: \"3dd6ef3d-dce9-4d47-b361-f32e9e49691d\") " pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.471249 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.471226 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3dd6ef3d-dce9-4d47-b361-f32e9e49691d-metrics-server-audit-profiles\") pod \"metrics-server-7f88cb85f6-8wplj\" (UID: \"3dd6ef3d-dce9-4d47-b361-f32e9e49691d\") " pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.472201 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.472170 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3dd6ef3d-dce9-4d47-b361-f32e9e49691d-client-ca-bundle\") pod \"metrics-server-7f88cb85f6-8wplj\" (UID: \"3dd6ef3d-dce9-4d47-b361-f32e9e49691d\") " pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.472290 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.472274 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3dd6ef3d-dce9-4d47-b361-f32e9e49691d-secret-metrics-server-tls\") pod \"metrics-server-7f88cb85f6-8wplj\" (UID: \"3dd6ef3d-dce9-4d47-b361-f32e9e49691d\") " pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.472374 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.472353 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3dd6ef3d-dce9-4d47-b361-f32e9e49691d-secret-metrics-server-client-certs\") pod \"metrics-server-7f88cb85f6-8wplj\" (UID: \"3dd6ef3d-dce9-4d47-b361-f32e9e49691d\") " pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.587106 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.587033 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pbzcc\"" Jul 14 18:55:36.594339 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.594311 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:36.725638 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.725507 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-h5j4g"] Jul 14 18:55:36.727686 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:55:36.727660 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd6ef3d_dce9_4d47_b361_f32e9e49691d.slice/crio-dc7617b9584fe99a1620938844255985aaf109ea96a9c9965c234d37ab84e826 WatchSource:0}: Error finding container dc7617b9584fe99a1620938844255985aaf109ea96a9c9965c234d37ab84e826: Status 404 returned error can't find the container with id dc7617b9584fe99a1620938844255985aaf109ea96a9c9965c234d37ab84e826 Jul 14 18:55:36.728278 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.728258 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7f88cb85f6-8wplj"] Jul 14 18:55:36.728365 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.728355 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h5j4g" Jul 14 18:55:36.730965 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.730947 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 14 18:55:36.731055 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.730964 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-p5jnx\"" Jul 14 18:55:36.737985 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.737830 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-h5j4g"] Jul 14 18:55:36.763305 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.763277 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn789\" (UniqueName: \"kubernetes.io/projected/dd200391-5737-4aa0-81ae-e51f8ee75ae5-kube-api-access-fn789\") pod \"monitoring-plugin-5f68df7f58-h5j4g\" (UID: \"dd200391-5737-4aa0-81ae-e51f8ee75ae5\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h5j4g" Jul 14 18:55:36.763443 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.763337 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd200391-5737-4aa0-81ae-e51f8ee75ae5-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-h5j4g\" (UID: \"dd200391-5737-4aa0-81ae-e51f8ee75ae5\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h5j4g" Jul 14 18:55:36.863969 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.863892 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn789\" (UniqueName: \"kubernetes.io/projected/dd200391-5737-4aa0-81ae-e51f8ee75ae5-kube-api-access-fn789\") pod \"monitoring-plugin-5f68df7f58-h5j4g\" (UID: \"dd200391-5737-4aa0-81ae-e51f8ee75ae5\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h5j4g" Jul 14 18:55:36.863969 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.863944 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd200391-5737-4aa0-81ae-e51f8ee75ae5-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-h5j4g\" (UID: \"dd200391-5737-4aa0-81ae-e51f8ee75ae5\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h5j4g" Jul 14 18:55:36.864150 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:36.864067 2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 14 18:55:36.864150 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:36.864131 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd200391-5737-4aa0-81ae-e51f8ee75ae5-monitoring-plugin-cert podName:dd200391-5737-4aa0-81ae-e51f8ee75ae5 nodeName:}" failed. No retries permitted until 2026-07-14 18:55:37.364111531 +0000 UTC m=+61.363004327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/dd200391-5737-4aa0-81ae-e51f8ee75ae5-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-h5j4g" (UID: "dd200391-5737-4aa0-81ae-e51f8ee75ae5") : secret "monitoring-plugin-cert" not found Jul 14 18:55:36.873829 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.873801 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn789\" (UniqueName: \"kubernetes.io/projected/dd200391-5737-4aa0-81ae-e51f8ee75ae5-kube-api-access-fn789\") pod \"monitoring-plugin-5f68df7f58-h5j4g\" (UID: \"dd200391-5737-4aa0-81ae-e51f8ee75ae5\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h5j4g" Jul 14 18:55:36.945779 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:36.945743 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" event={"ID":"3dd6ef3d-dce9-4d47-b361-f32e9e49691d","Type":"ContainerStarted","Data":"dc7617b9584fe99a1620938844255985aaf109ea96a9c9965c234d37ab84e826"} Jul 14 18:55:37.167329 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.167249 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc"] Jul 14 18:55:37.169552 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.169536 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.172244 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.172221 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 14 18:55:37.172355 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.172245 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 14 18:55:37.172355 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.172255 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 14 18:55:37.172355 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.172257 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-fwkxr\"" Jul 14 18:55:37.172617 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.172584 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 14 18:55:37.172617 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.172605 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 14 18:55:37.178075 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.178055 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 14 18:55:37.184137 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.184117 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc"] Jul 14 18:55:37.267180 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.267142 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75797e11-5179-402a-9677-2df960fd1782-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.267356 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.267213 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/75797e11-5179-402a-9677-2df960fd1782-federate-client-tls\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.267356 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.267269 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75797e11-5179-402a-9677-2df960fd1782-serving-certs-ca-bundle\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.267356 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.267322 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/75797e11-5179-402a-9677-2df960fd1782-secret-telemeter-client\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.267475 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.267380 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75797e11-5179-402a-9677-2df960fd1782-metrics-client-ca\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.267475 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.267410 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/75797e11-5179-402a-9677-2df960fd1782-telemeter-client-tls\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.267475 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.267440 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75797e11-5179-402a-9677-2df960fd1782-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.267475 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.267458 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq42c\" (UniqueName: \"kubernetes.io/projected/75797e11-5179-402a-9677-2df960fd1782-kube-api-access-lq42c\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.368485 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.368448 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd200391-5737-4aa0-81ae-e51f8ee75ae5-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-h5j4g\" (UID: \"dd200391-5737-4aa0-81ae-e51f8ee75ae5\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h5j4g" Jul 14 18:55:37.368668 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.368512 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75797e11-5179-402a-9677-2df960fd1782-metrics-client-ca\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.368668 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.368567 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/75797e11-5179-402a-9677-2df960fd1782-telemeter-client-tls\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.368668 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.368616 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75797e11-5179-402a-9677-2df960fd1782-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.368668 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:37.368632 2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 14 18:55:37.368668 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.368647 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq42c\" (UniqueName: \"kubernetes.io/projected/75797e11-5179-402a-9677-2df960fd1782-kube-api-access-lq42c\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.368934 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:55:37.368713 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd200391-5737-4aa0-81ae-e51f8ee75ae5-monitoring-plugin-cert podName:dd200391-5737-4aa0-81ae-e51f8ee75ae5 nodeName:}" failed. No retries permitted until 2026-07-14 18:55:38.368691607 +0000 UTC m=+62.367584405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/dd200391-5737-4aa0-81ae-e51f8ee75ae5-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-h5j4g" (UID: "dd200391-5737-4aa0-81ae-e51f8ee75ae5") : secret "monitoring-plugin-cert" not found Jul 14 18:55:37.368934 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.368738 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75797e11-5179-402a-9677-2df960fd1782-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.368934 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.368796 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/75797e11-5179-402a-9677-2df960fd1782-federate-client-tls\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.368934 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.368828 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75797e11-5179-402a-9677-2df960fd1782-serving-certs-ca-bundle\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.368934 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.368858 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/75797e11-5179-402a-9677-2df960fd1782-secret-telemeter-client\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.369287 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.369266 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75797e11-5179-402a-9677-2df960fd1782-metrics-client-ca\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.369810 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.369783 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75797e11-5179-402a-9677-2df960fd1782-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.369904 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.369867 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75797e11-5179-402a-9677-2df960fd1782-serving-certs-ca-bundle\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.371633 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.371581 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/75797e11-5179-402a-9677-2df960fd1782-telemeter-client-tls\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.371790 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.371765 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75797e11-5179-402a-9677-2df960fd1782-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.371968 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.371945 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/75797e11-5179-402a-9677-2df960fd1782-secret-telemeter-client\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.372386 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.372370 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/75797e11-5179-402a-9677-2df960fd1782-federate-client-tls\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.378926 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.378850 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq42c\" (UniqueName: \"kubernetes.io/projected/75797e11-5179-402a-9677-2df960fd1782-kube-api-access-lq42c\") pod \"telemeter-client-5fbf95ddd6-qcxpc\" (UID: \"75797e11-5179-402a-9677-2df960fd1782\") " pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.479661 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.479571 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" Jul 14 18:55:37.801435 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.801410 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc"] Jul 14 18:55:37.803911 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.803702 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-568cb94f77-g6j2w"] Jul 14 18:55:37.808622 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:55:37.808033 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75797e11_5179_402a_9677_2df960fd1782.slice/crio-d01eda20b59af948f93e263ea77f342e511ac68ddd2d6829b3dddca0cc7ed595 WatchSource:0}: Error finding container d01eda20b59af948f93e263ea77f342e511ac68ddd2d6829b3dddca0cc7ed595: Status 404 returned error can't find the container with id d01eda20b59af948f93e263ea77f342e511ac68ddd2d6829b3dddca0cc7ed595 Jul 14 18:55:37.810207 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.810002 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:37.818080 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.818058 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-568cb94f77-g6j2w"] Jul 14 18:55:37.872518 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.872482 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8980a437-5f06-4230-830b-1863fb14a72d-console-oauth-config\") pod \"console-568cb94f77-g6j2w\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:37.872660 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.872518 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-console-config\") pod \"console-568cb94f77-g6j2w\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:37.872712 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.872649 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-service-ca\") pod \"console-568cb94f77-g6j2w\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:37.872712 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.872689 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8980a437-5f06-4230-830b-1863fb14a72d-console-serving-cert\") pod \"console-568cb94f77-g6j2w\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:37.872814 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.872741 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxqbw\" (UniqueName: \"kubernetes.io/projected/8980a437-5f06-4230-830b-1863fb14a72d-kube-api-access-dxqbw\") pod \"console-568cb94f77-g6j2w\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:37.872814 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.872798 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-oauth-serving-cert\") pod \"console-568cb94f77-g6j2w\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:37.872909 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.872828 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-trusted-ca-bundle\") pod \"console-568cb94f77-g6j2w\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:37.903009 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.902982 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nx6dq" Jul 14 18:55:37.949979 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.949947 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" event={"ID":"75797e11-5179-402a-9677-2df960fd1782","Type":"ContainerStarted","Data":"d01eda20b59af948f93e263ea77f342e511ac68ddd2d6829b3dddca0cc7ed595"} Jul 14 18:55:37.953155 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.953117 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b2580e-86bd-4d57-a062-97ecd5f943f0","Type":"ContainerStarted","Data":"546c39e377470972d05c0cf4978740e41c75d8f8d8a3dfac7d2c85839e3a800a"} Jul 14 18:55:37.953304 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.953206 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b2580e-86bd-4d57-a062-97ecd5f943f0","Type":"ContainerStarted","Data":"4f9b3f179baa594f4aaf2e67b989f3e37b0bf36cc8a8933039e75bbccf91bc7d"} Jul 14 18:55:37.953304 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.953249 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b2580e-86bd-4d57-a062-97ecd5f943f0","Type":"ContainerStarted","Data":"1c657d623daff5da55bab164cda51564840ccd5866386518c1fa41315d11405c"} Jul 14 18:55:37.974019 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.973990 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-service-ca\") pod \"console-568cb94f77-g6j2w\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:37.974588 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.974566 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-service-ca\") pod \"console-568cb94f77-g6j2w\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:37.976016 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.974685 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8980a437-5f06-4230-830b-1863fb14a72d-console-serving-cert\") pod \"console-568cb94f77-g6j2w\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:37.976016 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.975087 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxqbw\" (UniqueName: \"kubernetes.io/projected/8980a437-5f06-4230-830b-1863fb14a72d-kube-api-access-dxqbw\") pod \"console-568cb94f77-g6j2w\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:37.976016 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.975745 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-oauth-serving-cert\") pod \"console-568cb94f77-g6j2w\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:37.976340 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.976318 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-oauth-serving-cert\") pod \"console-568cb94f77-g6j2w\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:37.976411 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.975782 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-trusted-ca-bundle\") pod \"console-568cb94f77-g6j2w\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:37.977122 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.977080 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-trusted-ca-bundle\") pod \"console-568cb94f77-g6j2w\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:37.977751 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.977406 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8980a437-5f06-4230-830b-1863fb14a72d-console-oauth-config\") pod \"console-568cb94f77-g6j2w\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:37.977751 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.977666 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-console-config\") pod \"console-568cb94f77-g6j2w\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:37.977751 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.977740 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8980a437-5f06-4230-830b-1863fb14a72d-console-serving-cert\") pod \"console-568cb94f77-g6j2w\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:37.978436 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.978347 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-console-config\") pod \"console-568cb94f77-g6j2w\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:37.981032 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.981005 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8980a437-5f06-4230-830b-1863fb14a72d-console-oauth-config\") pod \"console-568cb94f77-g6j2w\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:37.989365 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:37.989300 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxqbw\" (UniqueName: \"kubernetes.io/projected/8980a437-5f06-4230-830b-1863fb14a72d-kube-api-access-dxqbw\") pod \"console-568cb94f77-g6j2w\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:38.132369 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:38.132336 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:38.278355 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:38.278319 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-568cb94f77-g6j2w"] Jul 14 18:55:38.283522 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:55:38.283497 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8980a437_5f06_4230_830b_1863fb14a72d.slice/crio-6ed54f20e9562ae4e966999a3fc3c6379e029ccc988b7bed484c974d84b09b71 WatchSource:0}: Error finding container 6ed54f20e9562ae4e966999a3fc3c6379e029ccc988b7bed484c974d84b09b71: Status 404 returned error can't find the container with id 6ed54f20e9562ae4e966999a3fc3c6379e029ccc988b7bed484c974d84b09b71 Jul 14 18:55:38.381517 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:38.381413 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd200391-5737-4aa0-81ae-e51f8ee75ae5-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-h5j4g\" (UID: \"dd200391-5737-4aa0-81ae-e51f8ee75ae5\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h5j4g" Jul 14 18:55:38.386209 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:38.386177 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd200391-5737-4aa0-81ae-e51f8ee75ae5-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-h5j4g\" (UID: \"dd200391-5737-4aa0-81ae-e51f8ee75ae5\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h5j4g" Jul 14 18:55:38.548980 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:38.548896 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h5j4g" Jul 14 18:55:38.734613 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:38.725142 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-h5j4g"] Jul 14 18:55:38.734613 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:55:38.727828 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd200391_5737_4aa0_81ae_e51f8ee75ae5.slice/crio-f252c7fe2c321de1b34421c3dfe5b1b71f0d08484e2fb1d259ca382c30660155 WatchSource:0}: Error finding container f252c7fe2c321de1b34421c3dfe5b1b71f0d08484e2fb1d259ca382c30660155: Status 404 returned error can't find the container with id f252c7fe2c321de1b34421c3dfe5b1b71f0d08484e2fb1d259ca382c30660155 Jul 14 18:55:38.832349 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:38.832263 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-trrs2" Jul 14 18:55:38.963421 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:38.963387 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b2580e-86bd-4d57-a062-97ecd5f943f0","Type":"ContainerStarted","Data":"d1f779006c2d9e94558da1ec59b2e6fa410e79ee5601ec43fc258b5f908a88ec"} Jul 14 18:55:38.963583 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:38.963462 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b2580e-86bd-4d57-a062-97ecd5f943f0","Type":"ContainerStarted","Data":"1b09f1bf569a953f22ac5067c231f5bb6dee20370aed0da2f759a38d74e01df1"} Jul 14 18:55:38.965365 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:38.965335 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568cb94f77-g6j2w" event={"ID":"8980a437-5f06-4230-830b-1863fb14a72d","Type":"ContainerStarted","Data":"3b75a91af9757341295954a00bbbf58e4a4b3c1f2b8ab20ecf669d079a07df2a"} Jul 14 18:55:38.965511 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:38.965389 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568cb94f77-g6j2w" event={"ID":"8980a437-5f06-4230-830b-1863fb14a72d","Type":"ContainerStarted","Data":"6ed54f20e9562ae4e966999a3fc3c6379e029ccc988b7bed484c974d84b09b71"} Jul 14 18:55:38.967898 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:38.967868 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h5j4g" event={"ID":"dd200391-5737-4aa0-81ae-e51f8ee75ae5","Type":"ContainerStarted","Data":"f252c7fe2c321de1b34421c3dfe5b1b71f0d08484e2fb1d259ca382c30660155"} Jul 14 18:55:38.990506 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:38.990459 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-568cb94f77-g6j2w" podStartSLOduration=1.990439456 podStartE2EDuration="1.990439456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:55:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:38.990057531 +0000 UTC m=+62.988950353" watchObservedRunningTime="2026-07-14 18:55:38.990439456 +0000 UTC m=+62.989332253" Jul 14 18:55:39.973833 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:39.973791 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" event={"ID":"3dd6ef3d-dce9-4d47-b361-f32e9e49691d","Type":"ContainerStarted","Data":"730987a26f886300c8f77d874f2e132259875ccf822ba3e7913a751f91e2eb47"} Jul 14 18:55:39.977317 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:39.977286 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b2580e-86bd-4d57-a062-97ecd5f943f0","Type":"ContainerStarted","Data":"f55fa4a934cc62e61998b54793c2d118394764d8d416a6918d4819a4fdf5cd3f"} Jul 14 18:55:39.994130 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:39.994090 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" podStartSLOduration=1.305977014 podStartE2EDuration="3.994076941s" totalImagesPullingTime="2.688099927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:55:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:39.992570923 +0000 UTC m=+63.991463741" watchObservedRunningTime="2026-07-14 18:55:39.994076941 +0000 UTC m=+63.992969758" Jul 14 18:55:40.022849 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:40.022797 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.233243145 podStartE2EDuration="8.022774588s" totalImagesPullingTime="4.766396389s" totalInitContainerRuntime="23.135054ms" isStatefulPod=false podCreationTimestamp="2026-07-14 18:55:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:40.020552118 +0000 UTC m=+64.019444960" watchObservedRunningTime="2026-07-14 18:55:40.022774588 +0000 UTC m=+64.021667405" Jul 14 18:55:40.982676 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:40.982634 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" event={"ID":"75797e11-5179-402a-9677-2df960fd1782","Type":"ContainerStarted","Data":"5a22e8c06e8db8f9a438b5e700314e93d9f193ae096dc0a694a93156e90d4a14"} Jul 14 18:55:40.983036 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:40.982707 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" event={"ID":"75797e11-5179-402a-9677-2df960fd1782","Type":"ContainerStarted","Data":"33a49f06d7ecc0a55ed9b7efc4c9b3d10e7fb7037bfb5b38e9224eb1af47dbe3"} Jul 14 18:55:40.983036 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:40.982741 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" event={"ID":"75797e11-5179-402a-9677-2df960fd1782","Type":"ContainerStarted","Data":"1725163ca9c94772c25cacbf1d368d547c530531aa7525b19dbdcc0e403e3a74"} Jul 14 18:55:41.007671 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:41.007622 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5fbf95ddd6-qcxpc" podStartSLOduration=1.836184393 podStartE2EDuration="4.007584995s" totalImagesPullingTime="2.171400602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:55:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:41.0067116 +0000 UTC m=+65.005604419" watchObservedRunningTime="2026-07-14 18:55:41.007584995 +0000 UTC m=+65.006477836" Jul 14 18:55:41.939738 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:41.939701 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-568cb94f77-g6j2w"] Jul 14 18:55:42.042415 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.042381 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-789f69bddf-52ms6"] Jul 14 18:55:42.044852 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.044831 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.057688 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.057665 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789f69bddf-52ms6"] Jul 14 18:55:42.122572 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.122541 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-console-config\") pod \"console-789f69bddf-52ms6\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.122747 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.122590 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/518d57d8-730a-4919-9a0c-483fdc2370c5-console-oauth-config\") pod \"console-789f69bddf-52ms6\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.122747 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.122650 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-service-ca\") pod \"console-789f69bddf-52ms6\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.122747 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.122672 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/518d57d8-730a-4919-9a0c-483fdc2370c5-console-serving-cert\") pod \"console-789f69bddf-52ms6\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.122747 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.122736 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-oauth-serving-cert\") pod \"console-789f69bddf-52ms6\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.122874 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.122776 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdhfq\" (UniqueName: \"kubernetes.io/projected/518d57d8-730a-4919-9a0c-483fdc2370c5-kube-api-access-mdhfq\") pod \"console-789f69bddf-52ms6\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.122874 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.122798 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-trusted-ca-bundle\") pod \"console-789f69bddf-52ms6\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.224058 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.223965 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdhfq\" (UniqueName: \"kubernetes.io/projected/518d57d8-730a-4919-9a0c-483fdc2370c5-kube-api-access-mdhfq\") pod \"console-789f69bddf-52ms6\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.224058 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.224012 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-trusted-ca-bundle\") pod \"console-789f69bddf-52ms6\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.224058 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.224039 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-console-config\") pod \"console-789f69bddf-52ms6\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.224295 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.224221 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/518d57d8-730a-4919-9a0c-483fdc2370c5-console-oauth-config\") pod \"console-789f69bddf-52ms6\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.224342 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.224303 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-service-ca\") pod \"console-789f69bddf-52ms6\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.224389 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.224344 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/518d57d8-730a-4919-9a0c-483fdc2370c5-console-serving-cert\") pod \"console-789f69bddf-52ms6\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.224435 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.224419 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-oauth-serving-cert\") pod \"console-789f69bddf-52ms6\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.224750 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.224727 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-console-config\") pod \"console-789f69bddf-52ms6\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.225172 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.225151 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-service-ca\") pod \"console-789f69bddf-52ms6\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.225258 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.225151 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-oauth-serving-cert\") pod \"console-789f69bddf-52ms6\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.225258 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.225234 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-trusted-ca-bundle\") pod \"console-789f69bddf-52ms6\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.226781 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.226760 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/518d57d8-730a-4919-9a0c-483fdc2370c5-console-oauth-config\") pod \"console-789f69bddf-52ms6\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.226885 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.226869 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/518d57d8-730a-4919-9a0c-483fdc2370c5-console-serving-cert\") pod \"console-789f69bddf-52ms6\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.235728 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.235708 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdhfq\" (UniqueName: \"kubernetes.io/projected/518d57d8-730a-4919-9a0c-483fdc2370c5-kube-api-access-mdhfq\") pod \"console-789f69bddf-52ms6\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.325824 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.325785 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret\") pod \"global-pull-secret-syncer-4vl24\" (UID: \"b14d3ec3-b9f4-405e-b759-56a512688c5f\") " pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:55:42.326021 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.325852 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwb9t\" (UniqueName: \"kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t\") pod \"network-check-target-dqjld\" (UID: \"0f406c4e-fac6-4430-a37f-8e8e1aa60215\") " pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:55:42.326021 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.325880 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs\") pod \"network-metrics-daemon-wkwn8\" (UID: \"028e2834-88e2-48da-a867-c1b791f58cec\") " pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:55:42.330533 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.330509 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 18:55:42.330690 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.330511 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 18:55:42.330836 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.330822 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 18:55:42.338787 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.338761 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/028e2834-88e2-48da-a867-c1b791f58cec-metrics-certs\") pod \"network-metrics-daemon-wkwn8\" (UID: \"028e2834-88e2-48da-a867-c1b791f58cec\") " pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:55:42.338787 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.338768 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b14d3ec3-b9f4-405e-b759-56a512688c5f-original-pull-secret\") pod \"global-pull-secret-syncer-4vl24\" (UID: \"b14d3ec3-b9f4-405e-b759-56a512688c5f\") " pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:55:42.339223 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.339205 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 18:55:42.348992 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.348968 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwb9t\" (UniqueName: \"kubernetes.io/projected/0f406c4e-fac6-4430-a37f-8e8e1aa60215-kube-api-access-zwb9t\") pod \"network-check-target-dqjld\" (UID: \"0f406c4e-fac6-4430-a37f-8e8e1aa60215\") " pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:55:42.353828 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.353809 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:42.370533 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.370509 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vl24" Jul 14 18:55:42.379113 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.379078 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ltzph\"" Jul 14 18:55:42.383839 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.383819 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zn8zd\"" Jul 14 18:55:42.386171 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.386149 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwn8" Jul 14 18:55:42.391745 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.391724 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:55:42.549131 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.549102 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789f69bddf-52ms6"] Jul 14 18:55:42.551006 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:55:42.550980 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod518d57d8_730a_4919_9a0c_483fdc2370c5.slice/crio-a19b4498ec381521d619e33ab31616fcc7c7f67dc279c47be98c87c0fdb44e61 WatchSource:0}: Error finding container a19b4498ec381521d619e33ab31616fcc7c7f67dc279c47be98c87c0fdb44e61: Status 404 returned error can't find the container with id a19b4498ec381521d619e33ab31616fcc7c7f67dc279c47be98c87c0fdb44e61 Jul 14 18:55:42.568732 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:55:42.568683 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb14d3ec3_b9f4_405e_b759_56a512688c5f.slice/crio-0289ef2fc26b88219cd1c3c867d0254cd21f0119921700a4fb0a6649425deca9 WatchSource:0}: Error finding container 0289ef2fc26b88219cd1c3c867d0254cd21f0119921700a4fb0a6649425deca9: Status 404 returned error can't find the container with id 0289ef2fc26b88219cd1c3c867d0254cd21f0119921700a4fb0a6649425deca9 Jul 14 18:55:42.571051 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.570514 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4vl24"] Jul 14 18:55:42.592952 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.592895 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wkwn8"] Jul 14 18:55:42.595510 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:55:42.595482 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod028e2834_88e2_48da_a867_c1b791f58cec.slice/crio-312dde6f380f2c9f73dd7cf84ef07212fe0262d4cea5542c1df30782683337a4 WatchSource:0}: Error finding container 312dde6f380f2c9f73dd7cf84ef07212fe0262d4cea5542c1df30782683337a4: Status 404 returned error can't find the container with id 312dde6f380f2c9f73dd7cf84ef07212fe0262d4cea5542c1df30782683337a4 Jul 14 18:55:42.613000 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.612969 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dqjld"] Jul 14 18:55:42.615774 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:55:42.615745 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f406c4e_fac6_4430_a37f_8e8e1aa60215.slice/crio-3cca2f0fe91f5a2a1b05514d37abc18ee3442a415d832dd3037a1d78af80c305 WatchSource:0}: Error finding container 3cca2f0fe91f5a2a1b05514d37abc18ee3442a415d832dd3037a1d78af80c305: Status 404 returned error can't find the container with id 3cca2f0fe91f5a2a1b05514d37abc18ee3442a415d832dd3037a1d78af80c305 Jul 14 18:55:42.994166 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.994124 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4vl24" event={"ID":"b14d3ec3-b9f4-405e-b759-56a512688c5f","Type":"ContainerStarted","Data":"0289ef2fc26b88219cd1c3c867d0254cd21f0119921700a4fb0a6649425deca9"} Jul 14 18:55:42.995954 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.995925 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789f69bddf-52ms6" event={"ID":"518d57d8-730a-4919-9a0c-483fdc2370c5","Type":"ContainerStarted","Data":"195b275453edb75f3208d1fbe3237bf5b6bd23a52576b809b511f1beb139cc05"} Jul 14 18:55:42.996067 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.995978 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789f69bddf-52ms6" event={"ID":"518d57d8-730a-4919-9a0c-483fdc2370c5","Type":"ContainerStarted","Data":"a19b4498ec381521d619e33ab31616fcc7c7f67dc279c47be98c87c0fdb44e61"} Jul 14 18:55:42.998000 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.997965 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wkwn8" event={"ID":"028e2834-88e2-48da-a867-c1b791f58cec","Type":"ContainerStarted","Data":"312dde6f380f2c9f73dd7cf84ef07212fe0262d4cea5542c1df30782683337a4"} Jul 14 18:55:42.999353 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:42.999326 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dqjld" event={"ID":"0f406c4e-fac6-4430-a37f-8e8e1aa60215","Type":"ContainerStarted","Data":"3cca2f0fe91f5a2a1b05514d37abc18ee3442a415d832dd3037a1d78af80c305"} Jul 14 18:55:43.001206 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:43.001181 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h5j4g" event={"ID":"dd200391-5737-4aa0-81ae-e51f8ee75ae5","Type":"ContainerStarted","Data":"0298fce3f81775044e8a79770e56fc4ffdcff7b83ca419606ab1b3c5fc303e0a"} Jul 14 18:55:43.001471 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:43.001425 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h5j4g" Jul 14 18:55:43.007702 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:43.007654 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h5j4g" Jul 14 18:55:43.019842 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:43.019794 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-789f69bddf-52ms6" podStartSLOduration=1.019779285 podStartE2EDuration="1.019779285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:55:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:43.019059295 +0000 UTC m=+67.017952114" watchObservedRunningTime="2026-07-14 18:55:43.019779285 +0000 UTC m=+67.018672103" Jul 14 18:55:43.040684 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:43.040639 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-h5j4g" podStartSLOduration=3.802120326 podStartE2EDuration="7.040624092s" totalImagesPullingTime="3.238503766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:55:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:43.039960291 +0000 UTC m=+67.038853110" watchObservedRunningTime="2026-07-14 18:55:43.040624092 +0000 UTC m=+67.039516910" Jul 14 18:55:44.008495 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:44.008459 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wkwn8" event={"ID":"028e2834-88e2-48da-a867-c1b791f58cec","Type":"ContainerStarted","Data":"e3b5b972d4179d5d57ad27396c42741506fb43401a2f7600cea245e473aee9dc"} Jul 14 18:55:45.015877 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:45.015822 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wkwn8" event={"ID":"028e2834-88e2-48da-a867-c1b791f58cec","Type":"ContainerStarted","Data":"cd610ff3d6b7b77fd1ae64aedc5bd8f1920e47716b31bf43f4c18d336dc88879"} Jul 14 18:55:45.034477 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:45.034419 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wkwn8" podStartSLOduration=66.743790892 podStartE2EDuration="1m8.034400689s" totalImagesPullingTime="1.290609797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:45.03408851 +0000 UTC m=+69.032981328" watchObservedRunningTime="2026-07-14 18:55:45.034400689 +0000 UTC m=+69.033293501" Jul 14 18:55:46.021985 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:46.021946 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dqjld" event={"ID":"0f406c4e-fac6-4430-a37f-8e8e1aa60215","Type":"ContainerStarted","Data":"c55ac62190728df6e877141a133c5d0db2768113aab38f43e57cee2f718f2de1"} Jul 14 18:55:46.022366 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:46.022277 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:55:46.042732 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:46.042678 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dqjld" podStartSLOduration=65.716096779 podStartE2EDuration="1m9.042662844s" totalImagesPullingTime="3.326566065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:46.041564705 +0000 UTC m=+70.040457520" watchObservedRunningTime="2026-07-14 18:55:46.042662844 +0000 UTC m=+70.041555661" Jul 14 18:55:48.040446 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:48.040404 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4vl24" event={"ID":"b14d3ec3-b9f4-405e-b759-56a512688c5f","Type":"ContainerStarted","Data":"1ba432509d577be37a4883f2cd24362c5f6cc52715284fa938cca495864c52ea"} Jul 14 18:55:48.057654 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:48.057531 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4vl24" podStartSLOduration=65.828953327 podStartE2EDuration="1m11.057514893s" totalImagesPullingTime="5.228561566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:48.056623013 +0000 UTC m=+72.055515833" watchObservedRunningTime="2026-07-14 18:55:48.057514893 +0000 UTC m=+72.056407711" Jul 14 18:55:48.133347 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:48.133309 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:55:52.354226 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:52.354194 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:52.354679 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:52.354263 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:52.359051 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:52.359027 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:53.063278 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:53.063250 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:55:53.118380 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:53.118347 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56977bf987-bm4l4"] Jul 14 18:55:56.594895 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:56.594788 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:55:56.594895 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:55:56.594835 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:56:01.068769 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:01.068693 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77cfb85c85-h58qp" podUID="372dd078-197e-42cc-a1de-1f97e111be1e" containerName="console" containerID="cri-o://4dfad6a816cb3d46646d41a7a285985de714c28ddd6045aefddcd60dc32dfb65" gracePeriod=15 Jul 14 18:56:01.304076 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:01.304053 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:56:01.399093 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:01.398997 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zpst\" (UniqueName: \"kubernetes.io/projected/372dd078-197e-42cc-a1de-1f97e111be1e-kube-api-access-4zpst\") pod \"372dd078-197e-42cc-a1de-1f97e111be1e\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " Jul 14 18:56:01.399093 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:01.399043 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/372dd078-197e-42cc-a1de-1f97e111be1e-console-oauth-config\") pod \"372dd078-197e-42cc-a1de-1f97e111be1e\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " Jul 14 18:56:01.399093 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:01.399070 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/372dd078-197e-42cc-a1de-1f97e111be1e-service-ca\") pod \"372dd078-197e-42cc-a1de-1f97e111be1e\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " Jul 14 18:56:01.399385 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:01.399119 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/372dd078-197e-42cc-a1de-1f97e111be1e-console-config\") pod \"372dd078-197e-42cc-a1de-1f97e111be1e\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " Jul 14 18:56:01.399385 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:01.399168 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/372dd078-197e-42cc-a1de-1f97e111be1e-oauth-serving-cert\") pod \"372dd078-197e-42cc-a1de-1f97e111be1e\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " Jul 14 18:56:01.399385 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:01.399199 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/372dd078-197e-42cc-a1de-1f97e111be1e-console-serving-cert\") pod \"372dd078-197e-42cc-a1de-1f97e111be1e\" (UID: \"372dd078-197e-42cc-a1de-1f97e111be1e\") " Jul 14 18:56:01.399526 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:01.399502 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/372dd078-197e-42cc-a1de-1f97e111be1e-console-config" (OuterVolumeSpecName: "console-config") pod "372dd078-197e-42cc-a1de-1f97e111be1e" (UID: "372dd078-197e-42cc-a1de-1f97e111be1e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:56:01.399569 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:01.399523 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/372dd078-197e-42cc-a1de-1f97e111be1e-service-ca" (OuterVolumeSpecName: "service-ca") pod "372dd078-197e-42cc-a1de-1f97e111be1e" (UID: "372dd078-197e-42cc-a1de-1f97e111be1e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:56:01.399650 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:01.399617 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/372dd078-197e-42cc-a1de-1f97e111be1e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "372dd078-197e-42cc-a1de-1f97e111be1e" (UID: "372dd078-197e-42cc-a1de-1f97e111be1e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:56:01.401641 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:01.401588 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/372dd078-197e-42cc-a1de-1f97e111be1e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "372dd078-197e-42cc-a1de-1f97e111be1e" (UID: "372dd078-197e-42cc-a1de-1f97e111be1e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 18:56:01.401776 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:01.401653 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/372dd078-197e-42cc-a1de-1f97e111be1e-kube-api-access-4zpst" (OuterVolumeSpecName: "kube-api-access-4zpst") pod "372dd078-197e-42cc-a1de-1f97e111be1e" (UID: "372dd078-197e-42cc-a1de-1f97e111be1e"). InnerVolumeSpecName "kube-api-access-4zpst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:56:01.401776 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:01.401666 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/372dd078-197e-42cc-a1de-1f97e111be1e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "372dd078-197e-42cc-a1de-1f97e111be1e" (UID: "372dd078-197e-42cc-a1de-1f97e111be1e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 18:56:01.500061 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:01.500019 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/372dd078-197e-42cc-a1de-1f97e111be1e-console-config\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:01.500061 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:01.500049 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/372dd078-197e-42cc-a1de-1f97e111be1e-oauth-serving-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:01.500061 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:01.500059 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/372dd078-197e-42cc-a1de-1f97e111be1e-console-serving-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:01.500061 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:01.500069 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zpst\" (UniqueName: \"kubernetes.io/projected/372dd078-197e-42cc-a1de-1f97e111be1e-kube-api-access-4zpst\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:01.500338 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:01.500077 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/372dd078-197e-42cc-a1de-1f97e111be1e-console-oauth-config\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:01.500338 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:01.500086 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/372dd078-197e-42cc-a1de-1f97e111be1e-service-ca\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:02.094107 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:02.094072 2563 generic.go:356] "Generic (PLEG): container finished" podID="372dd078-197e-42cc-a1de-1f97e111be1e" containerID="4dfad6a816cb3d46646d41a7a285985de714c28ddd6045aefddcd60dc32dfb65" exitCode=0 Jul 14 18:56:02.094518 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:02.094120 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77cfb85c85-h58qp" Jul 14 18:56:02.094518 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:02.094139 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77cfb85c85-h58qp" event={"ID":"372dd078-197e-42cc-a1de-1f97e111be1e","Type":"ContainerDied","Data":"4dfad6a816cb3d46646d41a7a285985de714c28ddd6045aefddcd60dc32dfb65"} Jul 14 18:56:02.094518 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:02.094181 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77cfb85c85-h58qp" event={"ID":"372dd078-197e-42cc-a1de-1f97e111be1e","Type":"ContainerDied","Data":"637d053df56e5cbec8ac373945459de75a32d8939210466914ed65407e4cfcd3"} Jul 14 18:56:02.094518 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:02.094200 2563 scope.go:117] "RemoveContainer" containerID="4dfad6a816cb3d46646d41a7a285985de714c28ddd6045aefddcd60dc32dfb65" Jul 14 18:56:02.103726 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:02.103707 2563 scope.go:117] "RemoveContainer" containerID="4dfad6a816cb3d46646d41a7a285985de714c28ddd6045aefddcd60dc32dfb65" Jul 14 18:56:02.103994 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:56:02.103974 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dfad6a816cb3d46646d41a7a285985de714c28ddd6045aefddcd60dc32dfb65\": container with ID starting with 4dfad6a816cb3d46646d41a7a285985de714c28ddd6045aefddcd60dc32dfb65 not found: ID does not exist" containerID="4dfad6a816cb3d46646d41a7a285985de714c28ddd6045aefddcd60dc32dfb65" Jul 14 18:56:02.104051 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:02.104003 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dfad6a816cb3d46646d41a7a285985de714c28ddd6045aefddcd60dc32dfb65"} err="failed to get container status \"4dfad6a816cb3d46646d41a7a285985de714c28ddd6045aefddcd60dc32dfb65\": rpc error: code = NotFound desc = could not find container \"4dfad6a816cb3d46646d41a7a285985de714c28ddd6045aefddcd60dc32dfb65\": container with ID starting with 4dfad6a816cb3d46646d41a7a285985de714c28ddd6045aefddcd60dc32dfb65 not found: ID does not exist" Jul 14 18:56:02.117240 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:02.117213 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77cfb85c85-h58qp"] Jul 14 18:56:02.121223 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:02.121198 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77cfb85c85-h58qp"] Jul 14 18:56:02.566058 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:02.566026 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="372dd078-197e-42cc-a1de-1f97e111be1e" path="/var/lib/kubelet/pods/372dd078-197e-42cc-a1de-1f97e111be1e/volumes" Jul 14 18:56:06.959970 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:06.959919 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-568cb94f77-g6j2w" podUID="8980a437-5f06-4230-830b-1863fb14a72d" containerName="console" containerID="cri-o://3b75a91af9757341295954a00bbbf58e4a4b3c1f2b8ab20ecf669d079a07df2a" gracePeriod=15 Jul 14 18:56:07.114767 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.114731 2563 generic.go:356] "Generic (PLEG): container finished" podID="8980a437-5f06-4230-830b-1863fb14a72d" containerID="3b75a91af9757341295954a00bbbf58e4a4b3c1f2b8ab20ecf669d079a07df2a" exitCode=0 Jul 14 18:56:07.114928 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.114792 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568cb94f77-g6j2w" event={"ID":"8980a437-5f06-4230-830b-1863fb14a72d","Type":"ContainerDied","Data":"3b75a91af9757341295954a00bbbf58e4a4b3c1f2b8ab20ecf669d079a07df2a"} Jul 14 18:56:07.205019 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.204995 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:56:07.352170 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.352135 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-trusted-ca-bundle\") pod \"8980a437-5f06-4230-830b-1863fb14a72d\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " Jul 14 18:56:07.352170 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.352176 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-console-config\") pod \"8980a437-5f06-4230-830b-1863fb14a72d\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " Jul 14 18:56:07.352421 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.352195 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-oauth-serving-cert\") pod \"8980a437-5f06-4230-830b-1863fb14a72d\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " Jul 14 18:56:07.352421 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.352236 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-service-ca\") pod \"8980a437-5f06-4230-830b-1863fb14a72d\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " Jul 14 18:56:07.352527 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.352437 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxqbw\" (UniqueName: \"kubernetes.io/projected/8980a437-5f06-4230-830b-1863fb14a72d-kube-api-access-dxqbw\") pod \"8980a437-5f06-4230-830b-1863fb14a72d\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " Jul 14 18:56:07.352527 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.352506 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8980a437-5f06-4230-830b-1863fb14a72d-console-serving-cert\") pod \"8980a437-5f06-4230-830b-1863fb14a72d\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " Jul 14 18:56:07.352656 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.352579 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8980a437-5f06-4230-830b-1863fb14a72d-console-oauth-config\") pod \"8980a437-5f06-4230-830b-1863fb14a72d\" (UID: \"8980a437-5f06-4230-830b-1863fb14a72d\") " Jul 14 18:56:07.352993 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.352942 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-service-ca" (OuterVolumeSpecName: "service-ca") pod "8980a437-5f06-4230-830b-1863fb14a72d" (UID: "8980a437-5f06-4230-830b-1863fb14a72d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:56:07.352993 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.352933 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8980a437-5f06-4230-830b-1863fb14a72d" (UID: "8980a437-5f06-4230-830b-1863fb14a72d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:56:07.353172 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.353004 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-console-config" (OuterVolumeSpecName: "console-config") pod "8980a437-5f06-4230-830b-1863fb14a72d" (UID: "8980a437-5f06-4230-830b-1863fb14a72d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:56:07.353172 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.353038 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8980a437-5f06-4230-830b-1863fb14a72d" (UID: "8980a437-5f06-4230-830b-1863fb14a72d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:56:07.355760 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.355693 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8980a437-5f06-4230-830b-1863fb14a72d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8980a437-5f06-4230-830b-1863fb14a72d" (UID: "8980a437-5f06-4230-830b-1863fb14a72d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 18:56:07.355885 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.355794 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8980a437-5f06-4230-830b-1863fb14a72d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8980a437-5f06-4230-830b-1863fb14a72d" (UID: "8980a437-5f06-4230-830b-1863fb14a72d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 18:56:07.358225 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.356192 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-service-ca\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:07.358225 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.356216 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8980a437-5f06-4230-830b-1863fb14a72d-console-serving-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:07.358225 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.356230 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8980a437-5f06-4230-830b-1863fb14a72d-console-oauth-config\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:07.358225 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.356244 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-trusted-ca-bundle\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:07.358225 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.356262 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-console-config\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:07.358225 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.356275 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8980a437-5f06-4230-830b-1863fb14a72d-oauth-serving-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:07.358775 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.358751 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8980a437-5f06-4230-830b-1863fb14a72d-kube-api-access-dxqbw" (OuterVolumeSpecName: "kube-api-access-dxqbw") pod "8980a437-5f06-4230-830b-1863fb14a72d" (UID: "8980a437-5f06-4230-830b-1863fb14a72d"). InnerVolumeSpecName "kube-api-access-dxqbw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:56:07.456750 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:07.456713 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxqbw\" (UniqueName: \"kubernetes.io/projected/8980a437-5f06-4230-830b-1863fb14a72d-kube-api-access-dxqbw\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:08.120670 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:08.120634 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568cb94f77-g6j2w" event={"ID":"8980a437-5f06-4230-830b-1863fb14a72d","Type":"ContainerDied","Data":"6ed54f20e9562ae4e966999a3fc3c6379e029ccc988b7bed484c974d84b09b71"} Jul 14 18:56:08.120670 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:08.120668 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568cb94f77-g6j2w" Jul 14 18:56:08.121145 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:08.120697 2563 scope.go:117] "RemoveContainer" containerID="3b75a91af9757341295954a00bbbf58e4a4b3c1f2b8ab20ecf669d079a07df2a" Jul 14 18:56:08.142225 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:08.142199 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-568cb94f77-g6j2w"] Jul 14 18:56:08.147006 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:08.146984 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-568cb94f77-g6j2w"] Jul 14 18:56:08.565629 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:08.565579 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8980a437-5f06-4230-830b-1863fb14a72d" path="/var/lib/kubelet/pods/8980a437-5f06-4230-830b-1863fb14a72d/volumes" Jul 14 18:56:16.602492 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:16.602462 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:56:16.606656 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:16.606630 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7f88cb85f6-8wplj" Jul 14 18:56:17.030072 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:17.030031 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dqjld" Jul 14 18:56:18.141351 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.141156 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56977bf987-bm4l4" podUID="112ee496-6089-4143-a016-164fc11f002e" containerName="console" containerID="cri-o://797a7a9c1bde5ba12cc591b21551c0894aed250ea16efe769fb97d15485cf0ee" gracePeriod=15 Jul 14 18:56:18.415796 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.415767 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:56:18.449282 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.449251 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/112ee496-6089-4143-a016-164fc11f002e-console-serving-cert\") pod \"112ee496-6089-4143-a016-164fc11f002e\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " Jul 14 18:56:18.449472 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.449328 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/112ee496-6089-4143-a016-164fc11f002e-console-oauth-config\") pod \"112ee496-6089-4143-a016-164fc11f002e\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " Jul 14 18:56:18.449472 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.449354 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-console-config\") pod \"112ee496-6089-4143-a016-164fc11f002e\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " Jul 14 18:56:18.449472 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.449374 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lmkv\" (UniqueName: \"kubernetes.io/projected/112ee496-6089-4143-a016-164fc11f002e-kube-api-access-4lmkv\") pod \"112ee496-6089-4143-a016-164fc11f002e\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " Jul 14 18:56:18.449472 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.449409 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-oauth-serving-cert\") pod \"112ee496-6089-4143-a016-164fc11f002e\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " Jul 14 18:56:18.449472 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.449433 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-service-ca\") pod \"112ee496-6089-4143-a016-164fc11f002e\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " Jul 14 18:56:18.449749 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.449491 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-trusted-ca-bundle\") pod \"112ee496-6089-4143-a016-164fc11f002e\" (UID: \"112ee496-6089-4143-a016-164fc11f002e\") " Jul 14 18:56:18.449749 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.449729 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-console-config" (OuterVolumeSpecName: "console-config") pod "112ee496-6089-4143-a016-164fc11f002e" (UID: "112ee496-6089-4143-a016-164fc11f002e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:56:18.449890 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.449865 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-service-ca" (OuterVolumeSpecName: "service-ca") pod "112ee496-6089-4143-a016-164fc11f002e" (UID: "112ee496-6089-4143-a016-164fc11f002e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:56:18.449985 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.449951 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "112ee496-6089-4143-a016-164fc11f002e" (UID: "112ee496-6089-4143-a016-164fc11f002e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:56:18.450199 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.450011 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "112ee496-6089-4143-a016-164fc11f002e" (UID: "112ee496-6089-4143-a016-164fc11f002e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:56:18.451794 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.451766 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/112ee496-6089-4143-a016-164fc11f002e-kube-api-access-4lmkv" (OuterVolumeSpecName: "kube-api-access-4lmkv") pod "112ee496-6089-4143-a016-164fc11f002e" (UID: "112ee496-6089-4143-a016-164fc11f002e"). InnerVolumeSpecName "kube-api-access-4lmkv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:56:18.451889 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.451864 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/112ee496-6089-4143-a016-164fc11f002e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "112ee496-6089-4143-a016-164fc11f002e" (UID: "112ee496-6089-4143-a016-164fc11f002e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 18:56:18.451943 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.451921 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/112ee496-6089-4143-a016-164fc11f002e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "112ee496-6089-4143-a016-164fc11f002e" (UID: "112ee496-6089-4143-a016-164fc11f002e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 18:56:18.550423 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.550386 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-oauth-serving-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:18.550423 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.550424 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-service-ca\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:18.550681 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.550437 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-trusted-ca-bundle\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:18.550681 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.550449 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/112ee496-6089-4143-a016-164fc11f002e-console-serving-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:18.550681 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.550462 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/112ee496-6089-4143-a016-164fc11f002e-console-oauth-config\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:18.550681 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.550473 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/112ee496-6089-4143-a016-164fc11f002e-console-config\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:18.550681 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:18.550485 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lmkv\" (UniqueName: \"kubernetes.io/projected/112ee496-6089-4143-a016-164fc11f002e-kube-api-access-4lmkv\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:19.166882 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:19.166844 2563 generic.go:356] "Generic (PLEG): container finished" podID="112ee496-6089-4143-a016-164fc11f002e" containerID="797a7a9c1bde5ba12cc591b21551c0894aed250ea16efe769fb97d15485cf0ee" exitCode=0 Jul 14 18:56:19.167289 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:19.166893 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56977bf987-bm4l4" Jul 14 18:56:19.167289 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:19.166912 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56977bf987-bm4l4" event={"ID":"112ee496-6089-4143-a016-164fc11f002e","Type":"ContainerDied","Data":"797a7a9c1bde5ba12cc591b21551c0894aed250ea16efe769fb97d15485cf0ee"} Jul 14 18:56:19.167289 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:19.166963 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56977bf987-bm4l4" event={"ID":"112ee496-6089-4143-a016-164fc11f002e","Type":"ContainerDied","Data":"c33bd68110d8a299c40b31babde9acc5cf66f448be7efae5812d240d72c57d4d"} Jul 14 18:56:19.167289 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:19.166989 2563 scope.go:117] "RemoveContainer" containerID="797a7a9c1bde5ba12cc591b21551c0894aed250ea16efe769fb97d15485cf0ee" Jul 14 18:56:19.182300 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:19.182278 2563 scope.go:117] "RemoveContainer" containerID="797a7a9c1bde5ba12cc591b21551c0894aed250ea16efe769fb97d15485cf0ee" Jul 14 18:56:19.182568 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:56:19.182537 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"797a7a9c1bde5ba12cc591b21551c0894aed250ea16efe769fb97d15485cf0ee\": container with ID starting with 797a7a9c1bde5ba12cc591b21551c0894aed250ea16efe769fb97d15485cf0ee not found: ID does not exist" containerID="797a7a9c1bde5ba12cc591b21551c0894aed250ea16efe769fb97d15485cf0ee" Jul 14 18:56:19.182697 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:19.182571 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"797a7a9c1bde5ba12cc591b21551c0894aed250ea16efe769fb97d15485cf0ee"} err="failed to get container status \"797a7a9c1bde5ba12cc591b21551c0894aed250ea16efe769fb97d15485cf0ee\": rpc error: code = NotFound desc = could not find container \"797a7a9c1bde5ba12cc591b21551c0894aed250ea16efe769fb97d15485cf0ee\": container with ID starting with 797a7a9c1bde5ba12cc591b21551c0894aed250ea16efe769fb97d15485cf0ee not found: ID does not exist" Jul 14 18:56:19.185848 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:19.185828 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56977bf987-bm4l4"] Jul 14 18:56:19.191443 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:19.191425 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56977bf987-bm4l4"] Jul 14 18:56:20.565783 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:20.565746 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="112ee496-6089-4143-a016-164fc11f002e" path="/var/lib/kubelet/pods/112ee496-6089-4143-a016-164fc11f002e/volumes" Jul 14 18:56:51.621994 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.621960 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fb95c757c-vx5s5"] Jul 14 18:56:51.622400 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.622218 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8980a437-5f06-4230-830b-1863fb14a72d" containerName="console" Jul 14 18:56:51.622400 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.622229 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8980a437-5f06-4230-830b-1863fb14a72d" containerName="console" Jul 14 18:56:51.622400 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.622245 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="372dd078-197e-42cc-a1de-1f97e111be1e" containerName="console" Jul 14 18:56:51.622400 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.622250 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="372dd078-197e-42cc-a1de-1f97e111be1e" containerName="console" Jul 14 18:56:51.622400 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.622262 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="112ee496-6089-4143-a016-164fc11f002e" containerName="console" Jul 14 18:56:51.622400 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.622267 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="112ee496-6089-4143-a016-164fc11f002e" containerName="console" Jul 14 18:56:51.622400 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.622305 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="112ee496-6089-4143-a016-164fc11f002e" containerName="console" Jul 14 18:56:51.622400 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.622315 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8980a437-5f06-4230-830b-1863fb14a72d" containerName="console" Jul 14 18:56:51.622400 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.622325 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="372dd078-197e-42cc-a1de-1f97e111be1e" containerName="console" Jul 14 18:56:51.625394 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.625376 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:51.639084 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.639062 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fb95c757c-vx5s5"] Jul 14 18:56:51.711315 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.711284 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-oauth-serving-cert\") pod \"console-7fb95c757c-vx5s5\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:51.711497 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.711322 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4394ffb6-e34b-4624-a076-e05444319f08-console-serving-cert\") pod \"console-7fb95c757c-vx5s5\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:51.711497 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.711348 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz68j\" (UniqueName: \"kubernetes.io/projected/4394ffb6-e34b-4624-a076-e05444319f08-kube-api-access-rz68j\") pod \"console-7fb95c757c-vx5s5\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:51.711497 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.711373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-console-config\") pod \"console-7fb95c757c-vx5s5\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:51.711497 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.711401 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-trusted-ca-bundle\") pod \"console-7fb95c757c-vx5s5\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:51.711497 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.711456 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4394ffb6-e34b-4624-a076-e05444319f08-console-oauth-config\") pod \"console-7fb95c757c-vx5s5\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:51.711497 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.711496 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-service-ca\") pod \"console-7fb95c757c-vx5s5\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:51.812250 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.812207 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-service-ca\") pod \"console-7fb95c757c-vx5s5\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:51.812394 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.812274 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-oauth-serving-cert\") pod \"console-7fb95c757c-vx5s5\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:51.812394 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.812292 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4394ffb6-e34b-4624-a076-e05444319f08-console-serving-cert\") pod \"console-7fb95c757c-vx5s5\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:51.812394 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.812307 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz68j\" (UniqueName: \"kubernetes.io/projected/4394ffb6-e34b-4624-a076-e05444319f08-kube-api-access-rz68j\") pod \"console-7fb95c757c-vx5s5\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:51.812394 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.812323 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-console-config\") pod \"console-7fb95c757c-vx5s5\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:51.812394 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.812346 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-trusted-ca-bundle\") pod \"console-7fb95c757c-vx5s5\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:51.812394 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.812373 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4394ffb6-e34b-4624-a076-e05444319f08-console-oauth-config\") pod \"console-7fb95c757c-vx5s5\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:51.813115 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.813086 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-oauth-serving-cert\") pod \"console-7fb95c757c-vx5s5\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:51.813301 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.813139 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-console-config\") pod \"console-7fb95c757c-vx5s5\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:51.813301 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.813283 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-service-ca\") pod \"console-7fb95c757c-vx5s5\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:51.813429 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.813307 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-trusted-ca-bundle\") pod \"console-7fb95c757c-vx5s5\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:51.814899 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.814880 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4394ffb6-e34b-4624-a076-e05444319f08-console-serving-cert\") pod \"console-7fb95c757c-vx5s5\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:51.814975 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.814948 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4394ffb6-e34b-4624-a076-e05444319f08-console-oauth-config\") pod \"console-7fb95c757c-vx5s5\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:51.821987 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.821969 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz68j\" (UniqueName: \"kubernetes.io/projected/4394ffb6-e34b-4624-a076-e05444319f08-kube-api-access-rz68j\") pod \"console-7fb95c757c-vx5s5\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:51.934423 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:51.934313 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:56:52.063061 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:52.063018 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fb95c757c-vx5s5"] Jul 14 18:56:52.065864 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:56:52.065832 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4394ffb6_e34b_4624_a076_e05444319f08.slice/crio-693a08faeed547c040bcd72d7d3c838210396105ef99c52fbaf1560f478f3f85 WatchSource:0}: Error finding container 693a08faeed547c040bcd72d7d3c838210396105ef99c52fbaf1560f478f3f85: Status 404 returned error can't find the container with id 693a08faeed547c040bcd72d7d3c838210396105ef99c52fbaf1560f478f3f85 Jul 14 18:56:52.287181 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:52.287146 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fb95c757c-vx5s5" event={"ID":"4394ffb6-e34b-4624-a076-e05444319f08","Type":"ContainerStarted","Data":"88477a642b82d676ae94e315b24f85a6db1ab98aadfc53dc5311c3c42810ce2c"} Jul 14 18:56:52.287372 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:52.287203 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fb95c757c-vx5s5" event={"ID":"4394ffb6-e34b-4624-a076-e05444319f08","Type":"ContainerStarted","Data":"693a08faeed547c040bcd72d7d3c838210396105ef99c52fbaf1560f478f3f85"} Jul 14 18:56:52.336833 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:52.336787 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7fb95c757c-vx5s5" podStartSLOduration=1.336772584 podStartE2EDuration="1.336772584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:56:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:56:52.336499893 +0000 UTC m=+136.335392711" watchObservedRunningTime="2026-07-14 18:56:52.336772584 +0000 UTC m=+136.335665467" Jul 14 18:56:52.396854 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:52.396819 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 18:56:52.397106 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:52.397083 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="alertmanager" containerID="cri-o://1c657d623daff5da55bab164cda51564840ccd5866386518c1fa41315d11405c" gracePeriod=120 Jul 14 18:56:52.397212 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:52.397175 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="kube-rbac-proxy" containerID="cri-o://1b09f1bf569a953f22ac5067c231f5bb6dee20370aed0da2f759a38d74e01df1" gracePeriod=120 Jul 14 18:56:52.397212 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:52.397160 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="kube-rbac-proxy-web" containerID="cri-o://546c39e377470972d05c0cf4978740e41c75d8f8d8a3dfac7d2c85839e3a800a" gracePeriod=120 Jul 14 18:56:52.397347 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:52.397212 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="config-reloader" containerID="cri-o://4f9b3f179baa594f4aaf2e67b989f3e37b0bf36cc8a8933039e75bbccf91bc7d" gracePeriod=120 Jul 14 18:56:52.397347 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:52.397230 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="prom-label-proxy" containerID="cri-o://f55fa4a934cc62e61998b54793c2d118394764d8d416a6918d4819a4fdf5cd3f" gracePeriod=120 Jul 14 18:56:52.397347 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:52.397158 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="kube-rbac-proxy-metric" containerID="cri-o://d1f779006c2d9e94558da1ec59b2e6fa410e79ee5601ec43fc258b5f908a88ec" gracePeriod=120 Jul 14 18:56:53.294609 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.294562 2563 generic.go:356] "Generic (PLEG): container finished" podID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerID="f55fa4a934cc62e61998b54793c2d118394764d8d416a6918d4819a4fdf5cd3f" exitCode=0 Jul 14 18:56:53.294609 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.294589 2563 generic.go:356] "Generic (PLEG): container finished" podID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerID="1b09f1bf569a953f22ac5067c231f5bb6dee20370aed0da2f759a38d74e01df1" exitCode=0 Jul 14 18:56:53.295114 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.294624 2563 generic.go:356] "Generic (PLEG): container finished" podID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerID="4f9b3f179baa594f4aaf2e67b989f3e37b0bf36cc8a8933039e75bbccf91bc7d" exitCode=0 Jul 14 18:56:53.295114 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.294632 2563 generic.go:356] "Generic (PLEG): container finished" podID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerID="1c657d623daff5da55bab164cda51564840ccd5866386518c1fa41315d11405c" exitCode=0 Jul 14 18:56:53.295114 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.294625 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b2580e-86bd-4d57-a062-97ecd5f943f0","Type":"ContainerDied","Data":"f55fa4a934cc62e61998b54793c2d118394764d8d416a6918d4819a4fdf5cd3f"} Jul 14 18:56:53.295114 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.294756 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b2580e-86bd-4d57-a062-97ecd5f943f0","Type":"ContainerDied","Data":"1b09f1bf569a953f22ac5067c231f5bb6dee20370aed0da2f759a38d74e01df1"} Jul 14 18:56:53.295114 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.294781 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b2580e-86bd-4d57-a062-97ecd5f943f0","Type":"ContainerDied","Data":"4f9b3f179baa594f4aaf2e67b989f3e37b0bf36cc8a8933039e75bbccf91bc7d"} Jul 14 18:56:53.295114 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.294806 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b2580e-86bd-4d57-a062-97ecd5f943f0","Type":"ContainerDied","Data":"1c657d623daff5da55bab164cda51564840ccd5866386518c1fa41315d11405c"} Jul 14 18:56:53.642165 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.642142 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:53.730473 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.730439 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03b2580e-86bd-4d57-a062-97ecd5f943f0-config-out\") pod \"03b2580e-86bd-4d57-a062-97ecd5f943f0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " Jul 14 18:56:53.730680 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.730482 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03b2580e-86bd-4d57-a062-97ecd5f943f0-metrics-client-ca\") pod \"03b2580e-86bd-4d57-a062-97ecd5f943f0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " Jul 14 18:56:53.730680 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.730508 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-kube-rbac-proxy\") pod \"03b2580e-86bd-4d57-a062-97ecd5f943f0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " Jul 14 18:56:53.730680 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.730539 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"03b2580e-86bd-4d57-a062-97ecd5f943f0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " Jul 14 18:56:53.730680 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.730563 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-web-config\") pod \"03b2580e-86bd-4d57-a062-97ecd5f943f0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " Jul 14 18:56:53.730680 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.730581 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-cluster-tls-config\") pod \"03b2580e-86bd-4d57-a062-97ecd5f943f0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " Jul 14 18:56:53.730680 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.730631 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-main-tls\") pod \"03b2580e-86bd-4d57-a062-97ecd5f943f0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " Jul 14 18:56:53.730680 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.730666 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03b2580e-86bd-4d57-a062-97ecd5f943f0-alertmanager-trusted-ca-bundle\") pod \"03b2580e-86bd-4d57-a062-97ecd5f943f0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " Jul 14 18:56:53.731042 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.730693 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-config-volume\") pod \"03b2580e-86bd-4d57-a062-97ecd5f943f0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " Jul 14 18:56:53.731042 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.730745 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03b2580e-86bd-4d57-a062-97ecd5f943f0-tls-assets\") pod \"03b2580e-86bd-4d57-a062-97ecd5f943f0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " Jul 14 18:56:53.731042 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.730783 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsn8l\" (UniqueName: \"kubernetes.io/projected/03b2580e-86bd-4d57-a062-97ecd5f943f0-kube-api-access-dsn8l\") pod \"03b2580e-86bd-4d57-a062-97ecd5f943f0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " Jul 14 18:56:53.731042 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.730812 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-kube-rbac-proxy-web\") pod \"03b2580e-86bd-4d57-a062-97ecd5f943f0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " Jul 14 18:56:53.731042 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.730838 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03b2580e-86bd-4d57-a062-97ecd5f943f0-alertmanager-main-db\") pod \"03b2580e-86bd-4d57-a062-97ecd5f943f0\" (UID: \"03b2580e-86bd-4d57-a062-97ecd5f943f0\") " Jul 14 18:56:53.731042 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.730927 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03b2580e-86bd-4d57-a062-97ecd5f943f0-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "03b2580e-86bd-4d57-a062-97ecd5f943f0" (UID: "03b2580e-86bd-4d57-a062-97ecd5f943f0"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:56:53.731498 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.731085 2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03b2580e-86bd-4d57-a062-97ecd5f943f0-metrics-client-ca\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:53.732155 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.732058 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03b2580e-86bd-4d57-a062-97ecd5f943f0-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "03b2580e-86bd-4d57-a062-97ecd5f943f0" (UID: "03b2580e-86bd-4d57-a062-97ecd5f943f0"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:56:53.732275 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.732226 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03b2580e-86bd-4d57-a062-97ecd5f943f0-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "03b2580e-86bd-4d57-a062-97ecd5f943f0" (UID: "03b2580e-86bd-4d57-a062-97ecd5f943f0"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:56:53.734089 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.734061 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03b2580e-86bd-4d57-a062-97ecd5f943f0-config-out" (OuterVolumeSpecName: "config-out") pod "03b2580e-86bd-4d57-a062-97ecd5f943f0" (UID: "03b2580e-86bd-4d57-a062-97ecd5f943f0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:56:53.734089 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.734073 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "03b2580e-86bd-4d57-a062-97ecd5f943f0" (UID: "03b2580e-86bd-4d57-a062-97ecd5f943f0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 18:56:53.734412 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.734371 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03b2580e-86bd-4d57-a062-97ecd5f943f0-kube-api-access-dsn8l" (OuterVolumeSpecName: "kube-api-access-dsn8l") pod "03b2580e-86bd-4d57-a062-97ecd5f943f0" (UID: "03b2580e-86bd-4d57-a062-97ecd5f943f0"). InnerVolumeSpecName "kube-api-access-dsn8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:56:53.734512 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.734489 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03b2580e-86bd-4d57-a062-97ecd5f943f0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "03b2580e-86bd-4d57-a062-97ecd5f943f0" (UID: "03b2580e-86bd-4d57-a062-97ecd5f943f0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:56:53.734573 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.734524 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "03b2580e-86bd-4d57-a062-97ecd5f943f0" (UID: "03b2580e-86bd-4d57-a062-97ecd5f943f0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 18:56:53.734657 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.734622 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "03b2580e-86bd-4d57-a062-97ecd5f943f0" (UID: "03b2580e-86bd-4d57-a062-97ecd5f943f0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 18:56:53.735149 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.735129 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-config-volume" (OuterVolumeSpecName: "config-volume") pod "03b2580e-86bd-4d57-a062-97ecd5f943f0" (UID: "03b2580e-86bd-4d57-a062-97ecd5f943f0"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 18:56:53.735229 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.735205 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "03b2580e-86bd-4d57-a062-97ecd5f943f0" (UID: "03b2580e-86bd-4d57-a062-97ecd5f943f0"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 18:56:53.738530 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.738509 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "03b2580e-86bd-4d57-a062-97ecd5f943f0" (UID: "03b2580e-86bd-4d57-a062-97ecd5f943f0"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 18:56:53.743867 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.743847 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-web-config" (OuterVolumeSpecName: "web-config") pod "03b2580e-86bd-4d57-a062-97ecd5f943f0" (UID: "03b2580e-86bd-4d57-a062-97ecd5f943f0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 18:56:53.831631 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.831573 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-main-tls\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:53.831631 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.831627 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03b2580e-86bd-4d57-a062-97ecd5f943f0-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:53.831760 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.831640 2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-config-volume\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:53.831760 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.831650 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03b2580e-86bd-4d57-a062-97ecd5f943f0-tls-assets\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:53.831760 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.831658 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsn8l\" (UniqueName: \"kubernetes.io/projected/03b2580e-86bd-4d57-a062-97ecd5f943f0-kube-api-access-dsn8l\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:53.831760 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.831667 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:53.831760 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.831675 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03b2580e-86bd-4d57-a062-97ecd5f943f0-alertmanager-main-db\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:53.831760 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.831684 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03b2580e-86bd-4d57-a062-97ecd5f943f0-config-out\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:53.831760 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.831692 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:53.831760 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.831702 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:53.831760 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.831711 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-web-config\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:53.831760 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:53.831718 2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03b2580e-86bd-4d57-a062-97ecd5f943f0-cluster-tls-config\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:56:54.301297 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.301259 2563 generic.go:356] "Generic (PLEG): container finished" podID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerID="d1f779006c2d9e94558da1ec59b2e6fa410e79ee5601ec43fc258b5f908a88ec" exitCode=0 Jul 14 18:56:54.301297 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.301291 2563 generic.go:356] "Generic (PLEG): container finished" podID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerID="546c39e377470972d05c0cf4978740e41c75d8f8d8a3dfac7d2c85839e3a800a" exitCode=0 Jul 14 18:56:54.301770 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.301336 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b2580e-86bd-4d57-a062-97ecd5f943f0","Type":"ContainerDied","Data":"d1f779006c2d9e94558da1ec59b2e6fa410e79ee5601ec43fc258b5f908a88ec"} Jul 14 18:56:54.301770 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.301351 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.301770 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.301408 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b2580e-86bd-4d57-a062-97ecd5f943f0","Type":"ContainerDied","Data":"546c39e377470972d05c0cf4978740e41c75d8f8d8a3dfac7d2c85839e3a800a"} Jul 14 18:56:54.301770 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.301435 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b2580e-86bd-4d57-a062-97ecd5f943f0","Type":"ContainerDied","Data":"887580bd243f80acbdb55fe30b7c12f53c337d8ed3e156b48ed3c0f759f3acd9"} Jul 14 18:56:54.301770 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.301466 2563 scope.go:117] "RemoveContainer" containerID="f55fa4a934cc62e61998b54793c2d118394764d8d416a6918d4819a4fdf5cd3f" Jul 14 18:56:54.309489 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.309259 2563 scope.go:117] "RemoveContainer" containerID="d1f779006c2d9e94558da1ec59b2e6fa410e79ee5601ec43fc258b5f908a88ec" Jul 14 18:56:54.318871 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.317984 2563 scope.go:117] "RemoveContainer" containerID="1b09f1bf569a953f22ac5067c231f5bb6dee20370aed0da2f759a38d74e01df1" Jul 14 18:56:54.325122 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.325098 2563 scope.go:117] "RemoveContainer" containerID="546c39e377470972d05c0cf4978740e41c75d8f8d8a3dfac7d2c85839e3a800a" Jul 14 18:56:54.327785 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.327765 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 18:56:54.332429 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.332412 2563 scope.go:117] "RemoveContainer" containerID="4f9b3f179baa594f4aaf2e67b989f3e37b0bf36cc8a8933039e75bbccf91bc7d" Jul 14 18:56:54.332771 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.332751 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 18:56:54.339138 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.339121 2563 scope.go:117] "RemoveContainer" containerID="1c657d623daff5da55bab164cda51564840ccd5866386518c1fa41315d11405c" Jul 14 18:56:54.346153 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.346136 2563 scope.go:117] "RemoveContainer" containerID="de5e8a236cdd661a75f4b2990c234aa812a8c3740de5087f45073c120fd953e6" Jul 14 18:56:54.352991 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.352970 2563 scope.go:117] "RemoveContainer" containerID="f55fa4a934cc62e61998b54793c2d118394764d8d416a6918d4819a4fdf5cd3f" Jul 14 18:56:54.353257 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:56:54.353236 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f55fa4a934cc62e61998b54793c2d118394764d8d416a6918d4819a4fdf5cd3f\": container with ID starting with f55fa4a934cc62e61998b54793c2d118394764d8d416a6918d4819a4fdf5cd3f not found: ID does not exist" containerID="f55fa4a934cc62e61998b54793c2d118394764d8d416a6918d4819a4fdf5cd3f" Jul 14 18:56:54.353311 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.353268 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f55fa4a934cc62e61998b54793c2d118394764d8d416a6918d4819a4fdf5cd3f"} err="failed to get container status \"f55fa4a934cc62e61998b54793c2d118394764d8d416a6918d4819a4fdf5cd3f\": rpc error: code = NotFound desc = could not find container \"f55fa4a934cc62e61998b54793c2d118394764d8d416a6918d4819a4fdf5cd3f\": container with ID starting with f55fa4a934cc62e61998b54793c2d118394764d8d416a6918d4819a4fdf5cd3f not found: ID does not exist" Jul 14 18:56:54.353311 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.353288 2563 scope.go:117] "RemoveContainer" containerID="d1f779006c2d9e94558da1ec59b2e6fa410e79ee5601ec43fc258b5f908a88ec" Jul 14 18:56:54.353550 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:56:54.353533 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1f779006c2d9e94558da1ec59b2e6fa410e79ee5601ec43fc258b5f908a88ec\": container with ID starting with d1f779006c2d9e94558da1ec59b2e6fa410e79ee5601ec43fc258b5f908a88ec not found: ID does not exist" containerID="d1f779006c2d9e94558da1ec59b2e6fa410e79ee5601ec43fc258b5f908a88ec" Jul 14 18:56:54.353626 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.353560 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f779006c2d9e94558da1ec59b2e6fa410e79ee5601ec43fc258b5f908a88ec"} err="failed to get container status \"d1f779006c2d9e94558da1ec59b2e6fa410e79ee5601ec43fc258b5f908a88ec\": rpc error: code = NotFound desc = could not find container \"d1f779006c2d9e94558da1ec59b2e6fa410e79ee5601ec43fc258b5f908a88ec\": container with ID starting with d1f779006c2d9e94558da1ec59b2e6fa410e79ee5601ec43fc258b5f908a88ec not found: ID does not exist" Jul 14 18:56:54.353626 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.353583 2563 scope.go:117] "RemoveContainer" containerID="1b09f1bf569a953f22ac5067c231f5bb6dee20370aed0da2f759a38d74e01df1" Jul 14 18:56:54.353846 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:56:54.353820 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b09f1bf569a953f22ac5067c231f5bb6dee20370aed0da2f759a38d74e01df1\": container with ID starting with 1b09f1bf569a953f22ac5067c231f5bb6dee20370aed0da2f759a38d74e01df1 not found: ID does not exist" containerID="1b09f1bf569a953f22ac5067c231f5bb6dee20370aed0da2f759a38d74e01df1" Jul 14 18:56:54.353896 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.353840 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b09f1bf569a953f22ac5067c231f5bb6dee20370aed0da2f759a38d74e01df1"} err="failed to get container status \"1b09f1bf569a953f22ac5067c231f5bb6dee20370aed0da2f759a38d74e01df1\": rpc error: code = NotFound desc = could not find container \"1b09f1bf569a953f22ac5067c231f5bb6dee20370aed0da2f759a38d74e01df1\": container with ID starting with 1b09f1bf569a953f22ac5067c231f5bb6dee20370aed0da2f759a38d74e01df1 not found: ID does not exist" Jul 14 18:56:54.353896 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.353855 2563 scope.go:117] "RemoveContainer" containerID="546c39e377470972d05c0cf4978740e41c75d8f8d8a3dfac7d2c85839e3a800a" Jul 14 18:56:54.354065 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:56:54.354048 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"546c39e377470972d05c0cf4978740e41c75d8f8d8a3dfac7d2c85839e3a800a\": container with ID starting with 546c39e377470972d05c0cf4978740e41c75d8f8d8a3dfac7d2c85839e3a800a not found: ID does not exist" containerID="546c39e377470972d05c0cf4978740e41c75d8f8d8a3dfac7d2c85839e3a800a" Jul 14 18:56:54.354102 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.354069 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"546c39e377470972d05c0cf4978740e41c75d8f8d8a3dfac7d2c85839e3a800a"} err="failed to get container status \"546c39e377470972d05c0cf4978740e41c75d8f8d8a3dfac7d2c85839e3a800a\": rpc error: code = NotFound desc = could not find container \"546c39e377470972d05c0cf4978740e41c75d8f8d8a3dfac7d2c85839e3a800a\": container with ID starting with 546c39e377470972d05c0cf4978740e41c75d8f8d8a3dfac7d2c85839e3a800a not found: ID does not exist" Jul 14 18:56:54.354102 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.354089 2563 scope.go:117] "RemoveContainer" containerID="4f9b3f179baa594f4aaf2e67b989f3e37b0bf36cc8a8933039e75bbccf91bc7d" Jul 14 18:56:54.354293 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:56:54.354275 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f9b3f179baa594f4aaf2e67b989f3e37b0bf36cc8a8933039e75bbccf91bc7d\": container with ID starting with 4f9b3f179baa594f4aaf2e67b989f3e37b0bf36cc8a8933039e75bbccf91bc7d not found: ID does not exist" containerID="4f9b3f179baa594f4aaf2e67b989f3e37b0bf36cc8a8933039e75bbccf91bc7d" Jul 14 18:56:54.354330 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.354299 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f9b3f179baa594f4aaf2e67b989f3e37b0bf36cc8a8933039e75bbccf91bc7d"} err="failed to get container status \"4f9b3f179baa594f4aaf2e67b989f3e37b0bf36cc8a8933039e75bbccf91bc7d\": rpc error: code = NotFound desc = could not find container \"4f9b3f179baa594f4aaf2e67b989f3e37b0bf36cc8a8933039e75bbccf91bc7d\": container with ID starting with 4f9b3f179baa594f4aaf2e67b989f3e37b0bf36cc8a8933039e75bbccf91bc7d not found: ID does not exist" Jul 14 18:56:54.354330 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.354313 2563 scope.go:117] "RemoveContainer" containerID="1c657d623daff5da55bab164cda51564840ccd5866386518c1fa41315d11405c" Jul 14 18:56:54.354557 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:56:54.354541 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c657d623daff5da55bab164cda51564840ccd5866386518c1fa41315d11405c\": container with ID starting with 1c657d623daff5da55bab164cda51564840ccd5866386518c1fa41315d11405c not found: ID does not exist" containerID="1c657d623daff5da55bab164cda51564840ccd5866386518c1fa41315d11405c" Jul 14 18:56:54.354627 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.354560 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c657d623daff5da55bab164cda51564840ccd5866386518c1fa41315d11405c"} err="failed to get container status \"1c657d623daff5da55bab164cda51564840ccd5866386518c1fa41315d11405c\": rpc error: code = NotFound desc = could not find container \"1c657d623daff5da55bab164cda51564840ccd5866386518c1fa41315d11405c\": container with ID starting with 1c657d623daff5da55bab164cda51564840ccd5866386518c1fa41315d11405c not found: ID does not exist" Jul 14 18:56:54.354627 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.354575 2563 scope.go:117] "RemoveContainer" containerID="de5e8a236cdd661a75f4b2990c234aa812a8c3740de5087f45073c120fd953e6" Jul 14 18:56:54.354832 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:56:54.354817 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de5e8a236cdd661a75f4b2990c234aa812a8c3740de5087f45073c120fd953e6\": container with ID starting with de5e8a236cdd661a75f4b2990c234aa812a8c3740de5087f45073c120fd953e6 not found: ID does not exist" containerID="de5e8a236cdd661a75f4b2990c234aa812a8c3740de5087f45073c120fd953e6" Jul 14 18:56:54.354871 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.354835 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5e8a236cdd661a75f4b2990c234aa812a8c3740de5087f45073c120fd953e6"} err="failed to get container status \"de5e8a236cdd661a75f4b2990c234aa812a8c3740de5087f45073c120fd953e6\": rpc error: code = NotFound desc = could not find container \"de5e8a236cdd661a75f4b2990c234aa812a8c3740de5087f45073c120fd953e6\": container with ID starting with de5e8a236cdd661a75f4b2990c234aa812a8c3740de5087f45073c120fd953e6 not found: ID does not exist" Jul 14 18:56:54.354871 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.354851 2563 scope.go:117] "RemoveContainer" containerID="f55fa4a934cc62e61998b54793c2d118394764d8d416a6918d4819a4fdf5cd3f" Jul 14 18:56:54.355069 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.355049 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f55fa4a934cc62e61998b54793c2d118394764d8d416a6918d4819a4fdf5cd3f"} err="failed to get container status \"f55fa4a934cc62e61998b54793c2d118394764d8d416a6918d4819a4fdf5cd3f\": rpc error: code = NotFound desc = could not find container \"f55fa4a934cc62e61998b54793c2d118394764d8d416a6918d4819a4fdf5cd3f\": container with ID starting with f55fa4a934cc62e61998b54793c2d118394764d8d416a6918d4819a4fdf5cd3f not found: ID does not exist" Jul 14 18:56:54.355153 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.355070 2563 scope.go:117] "RemoveContainer" containerID="d1f779006c2d9e94558da1ec59b2e6fa410e79ee5601ec43fc258b5f908a88ec" Jul 14 18:56:54.355290 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.355271 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f779006c2d9e94558da1ec59b2e6fa410e79ee5601ec43fc258b5f908a88ec"} err="failed to get container status \"d1f779006c2d9e94558da1ec59b2e6fa410e79ee5601ec43fc258b5f908a88ec\": rpc error: code = NotFound desc = could not find container \"d1f779006c2d9e94558da1ec59b2e6fa410e79ee5601ec43fc258b5f908a88ec\": container with ID starting with d1f779006c2d9e94558da1ec59b2e6fa410e79ee5601ec43fc258b5f908a88ec not found: ID does not exist" Jul 14 18:56:54.355331 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.355291 2563 scope.go:117] "RemoveContainer" containerID="1b09f1bf569a953f22ac5067c231f5bb6dee20370aed0da2f759a38d74e01df1" Jul 14 18:56:54.355456 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.355441 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b09f1bf569a953f22ac5067c231f5bb6dee20370aed0da2f759a38d74e01df1"} err="failed to get container status \"1b09f1bf569a953f22ac5067c231f5bb6dee20370aed0da2f759a38d74e01df1\": rpc error: code = NotFound desc = could not find container \"1b09f1bf569a953f22ac5067c231f5bb6dee20370aed0da2f759a38d74e01df1\": container with ID starting with 1b09f1bf569a953f22ac5067c231f5bb6dee20370aed0da2f759a38d74e01df1 not found: ID does not exist" Jul 14 18:56:54.355496 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.355456 2563 scope.go:117] "RemoveContainer" containerID="546c39e377470972d05c0cf4978740e41c75d8f8d8a3dfac7d2c85839e3a800a" Jul 14 18:56:54.355721 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.355702 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"546c39e377470972d05c0cf4978740e41c75d8f8d8a3dfac7d2c85839e3a800a"} err="failed to get container status \"546c39e377470972d05c0cf4978740e41c75d8f8d8a3dfac7d2c85839e3a800a\": rpc error: code = NotFound desc = could not find container \"546c39e377470972d05c0cf4978740e41c75d8f8d8a3dfac7d2c85839e3a800a\": container with ID starting with 546c39e377470972d05c0cf4978740e41c75d8f8d8a3dfac7d2c85839e3a800a not found: ID does not exist" Jul 14 18:56:54.355785 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.355722 2563 scope.go:117] "RemoveContainer" containerID="4f9b3f179baa594f4aaf2e67b989f3e37b0bf36cc8a8933039e75bbccf91bc7d" Jul 14 18:56:54.355915 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.355899 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f9b3f179baa594f4aaf2e67b989f3e37b0bf36cc8a8933039e75bbccf91bc7d"} err="failed to get container status \"4f9b3f179baa594f4aaf2e67b989f3e37b0bf36cc8a8933039e75bbccf91bc7d\": rpc error: code = NotFound desc = could not find container \"4f9b3f179baa594f4aaf2e67b989f3e37b0bf36cc8a8933039e75bbccf91bc7d\": container with ID starting with 4f9b3f179baa594f4aaf2e67b989f3e37b0bf36cc8a8933039e75bbccf91bc7d not found: ID does not exist" Jul 14 18:56:54.355959 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.355915 2563 scope.go:117] "RemoveContainer" containerID="1c657d623daff5da55bab164cda51564840ccd5866386518c1fa41315d11405c" Jul 14 18:56:54.356117 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.356100 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c657d623daff5da55bab164cda51564840ccd5866386518c1fa41315d11405c"} err="failed to get container status \"1c657d623daff5da55bab164cda51564840ccd5866386518c1fa41315d11405c\": rpc error: code = NotFound desc = could not find container \"1c657d623daff5da55bab164cda51564840ccd5866386518c1fa41315d11405c\": container with ID starting with 1c657d623daff5da55bab164cda51564840ccd5866386518c1fa41315d11405c not found: ID does not exist" Jul 14 18:56:54.356157 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.356118 2563 scope.go:117] "RemoveContainer" containerID="de5e8a236cdd661a75f4b2990c234aa812a8c3740de5087f45073c120fd953e6" Jul 14 18:56:54.356317 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.356301 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5e8a236cdd661a75f4b2990c234aa812a8c3740de5087f45073c120fd953e6"} err="failed to get container status \"de5e8a236cdd661a75f4b2990c234aa812a8c3740de5087f45073c120fd953e6\": rpc error: code = NotFound desc = could not find container \"de5e8a236cdd661a75f4b2990c234aa812a8c3740de5087f45073c120fd953e6\": container with ID starting with de5e8a236cdd661a75f4b2990c234aa812a8c3740de5087f45073c120fd953e6 not found: ID does not exist" Jul 14 18:56:54.364153 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.364132 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 18:56:54.364426 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.364413 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="alertmanager" Jul 14 18:56:54.364461 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.364428 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="alertmanager" Jul 14 18:56:54.364461 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.364441 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="config-reloader" Jul 14 18:56:54.364461 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.364447 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="config-reloader" Jul 14 18:56:54.364461 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.364453 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="kube-rbac-proxy" Jul 14 18:56:54.364461 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.364458 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="kube-rbac-proxy" Jul 14 18:56:54.364629 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.364465 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="kube-rbac-proxy-metric" Jul 14 18:56:54.364629 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.364473 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="kube-rbac-proxy-metric" Jul 14 18:56:54.364629 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.364488 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="prom-label-proxy" Jul 14 18:56:54.364629 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.364494 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="prom-label-proxy" Jul 14 18:56:54.364629 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.364501 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="init-config-reloader" Jul 14 18:56:54.364629 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.364506 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="init-config-reloader" Jul 14 18:56:54.364629 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.364514 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="kube-rbac-proxy-web" Jul 14 18:56:54.364629 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.364519 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="kube-rbac-proxy-web" Jul 14 18:56:54.364629 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.364561 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="kube-rbac-proxy-web" Jul 14 18:56:54.364629 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.364573 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="kube-rbac-proxy-metric" Jul 14 18:56:54.364629 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.364579 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="kube-rbac-proxy" Jul 14 18:56:54.364629 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.364585 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="prom-label-proxy" Jul 14 18:56:54.364629 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.364608 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="alertmanager" Jul 14 18:56:54.364629 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.364616 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" containerName="config-reloader" Jul 14 18:56:54.368996 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.368976 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.371716 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.371696 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 14 18:56:54.371816 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.371748 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 14 18:56:54.371816 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.371773 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zvn4x\"" Jul 14 18:56:54.371939 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.371823 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 14 18:56:54.371939 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.371823 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 14 18:56:54.372066 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.372049 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 14 18:56:54.372066 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.372059 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 14 18:56:54.372066 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.372049 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 14 18:56:54.372256 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.372186 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 14 18:56:54.378034 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.378012 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 14 18:56:54.381913 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.381890 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 18:56:54.536879 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.536832 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/445ec7ac-618e-4734-a4a4-bb56c299714f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.537059 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.536922 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/445ec7ac-618e-4734-a4a4-bb56c299714f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.537059 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.536983 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/445ec7ac-618e-4734-a4a4-bb56c299714f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.537059 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.537015 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/445ec7ac-618e-4734-a4a4-bb56c299714f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.537059 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.537050 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/445ec7ac-618e-4734-a4a4-bb56c299714f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.537218 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.537079 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/445ec7ac-618e-4734-a4a4-bb56c299714f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.537218 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.537113 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/445ec7ac-618e-4734-a4a4-bb56c299714f-config-out\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.537218 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.537134 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/445ec7ac-618e-4734-a4a4-bb56c299714f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.537218 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.537150 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/445ec7ac-618e-4734-a4a4-bb56c299714f-config-volume\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.537218 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.537166 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msfvc\" (UniqueName: \"kubernetes.io/projected/445ec7ac-618e-4734-a4a4-bb56c299714f-kube-api-access-msfvc\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.537218 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.537196 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/445ec7ac-618e-4734-a4a4-bb56c299714f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.537218 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.537215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/445ec7ac-618e-4734-a4a4-bb56c299714f-web-config\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.537445 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.537238 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/445ec7ac-618e-4734-a4a4-bb56c299714f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.565623 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.565536 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03b2580e-86bd-4d57-a062-97ecd5f943f0" path="/var/lib/kubelet/pods/03b2580e-86bd-4d57-a062-97ecd5f943f0/volumes" Jul 14 18:56:54.637957 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.637923 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/445ec7ac-618e-4734-a4a4-bb56c299714f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.638191 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.637971 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/445ec7ac-618e-4734-a4a4-bb56c299714f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.638191 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.637992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/445ec7ac-618e-4734-a4a4-bb56c299714f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.638191 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.638010 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/445ec7ac-618e-4734-a4a4-bb56c299714f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.638191 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.638034 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/445ec7ac-618e-4734-a4a4-bb56c299714f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.638191 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.638051 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/445ec7ac-618e-4734-a4a4-bb56c299714f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.638191 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.638083 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/445ec7ac-618e-4734-a4a4-bb56c299714f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.638191 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.638120 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/445ec7ac-618e-4734-a4a4-bb56c299714f-config-out\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.638191 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.638144 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/445ec7ac-618e-4734-a4a4-bb56c299714f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.638191 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.638165 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/445ec7ac-618e-4734-a4a4-bb56c299714f-config-volume\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.638191 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.638190 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msfvc\" (UniqueName: \"kubernetes.io/projected/445ec7ac-618e-4734-a4a4-bb56c299714f-kube-api-access-msfvc\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.638699 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.638214 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/445ec7ac-618e-4734-a4a4-bb56c299714f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.638699 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.638235 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/445ec7ac-618e-4734-a4a4-bb56c299714f-web-config\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.638699 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.638475 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/445ec7ac-618e-4734-a4a4-bb56c299714f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.639555 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.639519 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/445ec7ac-618e-4734-a4a4-bb56c299714f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.639694 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.639325 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/445ec7ac-618e-4734-a4a4-bb56c299714f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.641528 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.641454 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/445ec7ac-618e-4734-a4a4-bb56c299714f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.641651 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.641552 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/445ec7ac-618e-4734-a4a4-bb56c299714f-config-out\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.641726 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.641659 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/445ec7ac-618e-4734-a4a4-bb56c299714f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.642017 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.641992 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/445ec7ac-618e-4734-a4a4-bb56c299714f-web-config\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.642180 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.642163 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/445ec7ac-618e-4734-a4a4-bb56c299714f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.642275 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.642176 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/445ec7ac-618e-4734-a4a4-bb56c299714f-config-volume\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.642275 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.642237 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/445ec7ac-618e-4734-a4a4-bb56c299714f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.642422 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.642404 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/445ec7ac-618e-4734-a4a4-bb56c299714f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.643014 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.642988 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/445ec7ac-618e-4734-a4a4-bb56c299714f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.648088 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.648064 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msfvc\" (UniqueName: \"kubernetes.io/projected/445ec7ac-618e-4734-a4a4-bb56c299714f-kube-api-access-msfvc\") pod \"alertmanager-main-0\" (UID: \"445ec7ac-618e-4734-a4a4-bb56c299714f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.678682 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.678648 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 18:56:54.815207 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:54.815176 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 18:56:54.818343 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:56:54.818317 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod445ec7ac_618e_4734_a4a4_bb56c299714f.slice/crio-df1d3cd5a8e2a7492bfebf324a0e8b49b50bb05f32f95947dd3768f70ece1f9d WatchSource:0}: Error finding container df1d3cd5a8e2a7492bfebf324a0e8b49b50bb05f32f95947dd3768f70ece1f9d: Status 404 returned error can't find the container with id df1d3cd5a8e2a7492bfebf324a0e8b49b50bb05f32f95947dd3768f70ece1f9d Jul 14 18:56:55.307979 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:55.307949 2563 generic.go:356] "Generic (PLEG): container finished" podID="445ec7ac-618e-4734-a4a4-bb56c299714f" containerID="efd546f3678e8c34f125f559a5074bcd185337e36c003b713d884c7f9b00d39c" exitCode=0 Jul 14 18:56:55.308378 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:55.308007 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"445ec7ac-618e-4734-a4a4-bb56c299714f","Type":"ContainerDied","Data":"efd546f3678e8c34f125f559a5074bcd185337e36c003b713d884c7f9b00d39c"} Jul 14 18:56:55.308378 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:55.308055 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"445ec7ac-618e-4734-a4a4-bb56c299714f","Type":"ContainerStarted","Data":"df1d3cd5a8e2a7492bfebf324a0e8b49b50bb05f32f95947dd3768f70ece1f9d"} Jul 14 18:56:56.314452 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:56.314412 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"445ec7ac-618e-4734-a4a4-bb56c299714f","Type":"ContainerStarted","Data":"c743da9b91cc6a1fb07ecade0f795f1ced25daaa8a2403d752ec0240870e69ab"} Jul 14 18:56:56.314918 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:56.314505 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"445ec7ac-618e-4734-a4a4-bb56c299714f","Type":"ContainerStarted","Data":"aa56938edf6967fe0dcc0b16d99a3c2367f6542e65296692e8d961762856c513"} Jul 14 18:56:56.314918 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:56.314536 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"445ec7ac-618e-4734-a4a4-bb56c299714f","Type":"ContainerStarted","Data":"c8608e333b0f0a290d2766aacf6017993220825302523dcfbd9b13667bcdd93a"} Jul 14 18:56:56.314918 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:56.314560 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"445ec7ac-618e-4734-a4a4-bb56c299714f","Type":"ContainerStarted","Data":"fdd5119efd3162f37485193b63f89385616c4c8a6639a1b7bbfd7f9ff04388f9"} Jul 14 18:56:56.314918 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:56.314582 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"445ec7ac-618e-4734-a4a4-bb56c299714f","Type":"ContainerStarted","Data":"e9d861f5647731003f33e62113b9056b70d8e9397ce1f7cba1e1aae5890822b7"} Jul 14 18:56:56.314918 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:56.314638 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"445ec7ac-618e-4734-a4a4-bb56c299714f","Type":"ContainerStarted","Data":"d4ac2a2bb560c4633da66fd4ca7a65bca85938d07755e212c54e06a2943d831a"} Jul 14 18:56:56.344301 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:56:56.344255 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.328248935 podStartE2EDuration="2.344238603s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.989668ms" isStatefulPod=false podCreationTimestamp="2026-07-14 18:56:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:56:56.343355187 +0000 UTC m=+140.342248005" watchObservedRunningTime="2026-07-14 18:56:56.344238603 +0000 UTC m=+140.343131418" Jul 14 18:57:01.935178 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:01.935141 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:57:01.935683 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:01.935204 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:57:01.939863 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:01.939840 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:57:02.343733 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:02.343705 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 18:57:02.397996 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:02.397956 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-789f69bddf-52ms6"] Jul 14 18:57:27.418039 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.417924 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-789f69bddf-52ms6" podUID="518d57d8-730a-4919-9a0c-483fdc2370c5" containerName="console" containerID="cri-o://195b275453edb75f3208d1fbe3237bf5b6bd23a52576b809b511f1beb139cc05" gracePeriod=15 Jul 14 18:57:27.652220 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.652193 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:57:27.699774 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.699694 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-service-ca\") pod \"518d57d8-730a-4919-9a0c-483fdc2370c5\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " Jul 14 18:57:27.699774 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.699737 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdhfq\" (UniqueName: \"kubernetes.io/projected/518d57d8-730a-4919-9a0c-483fdc2370c5-kube-api-access-mdhfq\") pod \"518d57d8-730a-4919-9a0c-483fdc2370c5\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " Jul 14 18:57:27.699774 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.699761 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/518d57d8-730a-4919-9a0c-483fdc2370c5-console-serving-cert\") pod \"518d57d8-730a-4919-9a0c-483fdc2370c5\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " Jul 14 18:57:27.700032 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.699785 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-trusted-ca-bundle\") pod \"518d57d8-730a-4919-9a0c-483fdc2370c5\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " Jul 14 18:57:27.700032 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.699814 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-console-config\") pod \"518d57d8-730a-4919-9a0c-483fdc2370c5\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " Jul 14 18:57:27.700032 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.699847 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/518d57d8-730a-4919-9a0c-483fdc2370c5-console-oauth-config\") pod \"518d57d8-730a-4919-9a0c-483fdc2370c5\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " Jul 14 18:57:27.700032 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.699869 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-oauth-serving-cert\") pod \"518d57d8-730a-4919-9a0c-483fdc2370c5\" (UID: \"518d57d8-730a-4919-9a0c-483fdc2370c5\") " Jul 14 18:57:27.700237 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.700133 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-service-ca" (OuterVolumeSpecName: "service-ca") pod "518d57d8-730a-4919-9a0c-483fdc2370c5" (UID: "518d57d8-730a-4919-9a0c-483fdc2370c5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:57:27.700326 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.700288 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "518d57d8-730a-4919-9a0c-483fdc2370c5" (UID: "518d57d8-730a-4919-9a0c-483fdc2370c5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:57:27.700326 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.700298 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-console-config" (OuterVolumeSpecName: "console-config") pod "518d57d8-730a-4919-9a0c-483fdc2370c5" (UID: "518d57d8-730a-4919-9a0c-483fdc2370c5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:57:27.700697 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.700339 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "518d57d8-730a-4919-9a0c-483fdc2370c5" (UID: "518d57d8-730a-4919-9a0c-483fdc2370c5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:57:27.702149 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.702121 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/518d57d8-730a-4919-9a0c-483fdc2370c5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "518d57d8-730a-4919-9a0c-483fdc2370c5" (UID: "518d57d8-730a-4919-9a0c-483fdc2370c5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 18:57:27.702236 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.702187 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/518d57d8-730a-4919-9a0c-483fdc2370c5-kube-api-access-mdhfq" (OuterVolumeSpecName: "kube-api-access-mdhfq") pod "518d57d8-730a-4919-9a0c-483fdc2370c5" (UID: "518d57d8-730a-4919-9a0c-483fdc2370c5"). InnerVolumeSpecName "kube-api-access-mdhfq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:57:27.702236 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.702209 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/518d57d8-730a-4919-9a0c-483fdc2370c5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "518d57d8-730a-4919-9a0c-483fdc2370c5" (UID: "518d57d8-730a-4919-9a0c-483fdc2370c5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 18:57:27.800687 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.800646 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdhfq\" (UniqueName: \"kubernetes.io/projected/518d57d8-730a-4919-9a0c-483fdc2370c5-kube-api-access-mdhfq\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:57:27.800687 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.800679 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/518d57d8-730a-4919-9a0c-483fdc2370c5-console-serving-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:57:27.800687 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.800688 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-trusted-ca-bundle\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:57:27.800925 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.800699 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-console-config\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:57:27.800925 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.800708 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/518d57d8-730a-4919-9a0c-483fdc2370c5-console-oauth-config\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:57:27.800925 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.800716 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-oauth-serving-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:57:27.800925 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:27.800725 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/518d57d8-730a-4919-9a0c-483fdc2370c5-service-ca\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:57:28.429851 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:28.429813 2563 generic.go:356] "Generic (PLEG): container finished" podID="518d57d8-730a-4919-9a0c-483fdc2370c5" containerID="195b275453edb75f3208d1fbe3237bf5b6bd23a52576b809b511f1beb139cc05" exitCode=0 Jul 14 18:57:28.430280 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:28.429857 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789f69bddf-52ms6" event={"ID":"518d57d8-730a-4919-9a0c-483fdc2370c5","Type":"ContainerDied","Data":"195b275453edb75f3208d1fbe3237bf5b6bd23a52576b809b511f1beb139cc05"} Jul 14 18:57:28.430280 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:28.429895 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789f69bddf-52ms6" event={"ID":"518d57d8-730a-4919-9a0c-483fdc2370c5","Type":"ContainerDied","Data":"a19b4498ec381521d619e33ab31616fcc7c7f67dc279c47be98c87c0fdb44e61"} Jul 14 18:57:28.430280 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:28.429915 2563 scope.go:117] "RemoveContainer" containerID="195b275453edb75f3208d1fbe3237bf5b6bd23a52576b809b511f1beb139cc05" Jul 14 18:57:28.430280 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:28.429861 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789f69bddf-52ms6" Jul 14 18:57:28.438206 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:28.438188 2563 scope.go:117] "RemoveContainer" containerID="195b275453edb75f3208d1fbe3237bf5b6bd23a52576b809b511f1beb139cc05" Jul 14 18:57:28.438481 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:57:28.438463 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"195b275453edb75f3208d1fbe3237bf5b6bd23a52576b809b511f1beb139cc05\": container with ID starting with 195b275453edb75f3208d1fbe3237bf5b6bd23a52576b809b511f1beb139cc05 not found: ID does not exist" containerID="195b275453edb75f3208d1fbe3237bf5b6bd23a52576b809b511f1beb139cc05" Jul 14 18:57:28.438523 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:28.438491 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"195b275453edb75f3208d1fbe3237bf5b6bd23a52576b809b511f1beb139cc05"} err="failed to get container status \"195b275453edb75f3208d1fbe3237bf5b6bd23a52576b809b511f1beb139cc05\": rpc error: code = NotFound desc = could not find container \"195b275453edb75f3208d1fbe3237bf5b6bd23a52576b809b511f1beb139cc05\": container with ID starting with 195b275453edb75f3208d1fbe3237bf5b6bd23a52576b809b511f1beb139cc05 not found: ID does not exist" Jul 14 18:57:28.450299 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:28.450272 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-789f69bddf-52ms6"] Jul 14 18:57:28.454258 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:28.454236 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-789f69bddf-52ms6"] Jul 14 18:57:28.565245 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:28.565219 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="518d57d8-730a-4919-9a0c-483fdc2370c5" path="/var/lib/kubelet/pods/518d57d8-730a-4919-9a0c-483fdc2370c5/volumes" Jul 14 18:57:41.765408 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:41.765370 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr"] Jul 14 18:57:41.765833 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:41.765732 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="518d57d8-730a-4919-9a0c-483fdc2370c5" containerName="console" Jul 14 18:57:41.765833 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:41.765745 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="518d57d8-730a-4919-9a0c-483fdc2370c5" containerName="console" Jul 14 18:57:41.765833 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:41.765793 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="518d57d8-730a-4919-9a0c-483fdc2370c5" containerName="console" Jul 14 18:57:41.770499 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:41.770482 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr" Jul 14 18:57:41.773463 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:41.773442 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 18:57:41.774585 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:41.774568 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 18:57:41.774691 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:41.774570 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-54lhf\"" Jul 14 18:57:41.779882 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:41.779861 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr"] Jul 14 18:57:41.913560 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:41.913519 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c95b91c-fcb0-45bf-b1df-e5b5f97ade78-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr\" (UID: \"8c95b91c-fcb0-45bf-b1df-e5b5f97ade78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr" Jul 14 18:57:41.913560 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:41.913564 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2lb7\" (UniqueName: \"kubernetes.io/projected/8c95b91c-fcb0-45bf-b1df-e5b5f97ade78-kube-api-access-f2lb7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr\" (UID: \"8c95b91c-fcb0-45bf-b1df-e5b5f97ade78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr" Jul 14 18:57:41.913814 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:41.913624 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c95b91c-fcb0-45bf-b1df-e5b5f97ade78-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr\" (UID: \"8c95b91c-fcb0-45bf-b1df-e5b5f97ade78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr" Jul 14 18:57:42.014638 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:42.014586 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c95b91c-fcb0-45bf-b1df-e5b5f97ade78-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr\" (UID: \"8c95b91c-fcb0-45bf-b1df-e5b5f97ade78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr" Jul 14 18:57:42.014820 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:42.014646 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2lb7\" (UniqueName: \"kubernetes.io/projected/8c95b91c-fcb0-45bf-b1df-e5b5f97ade78-kube-api-access-f2lb7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr\" (UID: \"8c95b91c-fcb0-45bf-b1df-e5b5f97ade78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr" Jul 14 18:57:42.014820 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:42.014679 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c95b91c-fcb0-45bf-b1df-e5b5f97ade78-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr\" (UID: \"8c95b91c-fcb0-45bf-b1df-e5b5f97ade78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr" Jul 14 18:57:42.015009 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:42.014983 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c95b91c-fcb0-45bf-b1df-e5b5f97ade78-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr\" (UID: \"8c95b91c-fcb0-45bf-b1df-e5b5f97ade78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr" Jul 14 18:57:42.015057 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:42.015009 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c95b91c-fcb0-45bf-b1df-e5b5f97ade78-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr\" (UID: \"8c95b91c-fcb0-45bf-b1df-e5b5f97ade78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr" Jul 14 18:57:42.024506 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:42.024446 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2lb7\" (UniqueName: \"kubernetes.io/projected/8c95b91c-fcb0-45bf-b1df-e5b5f97ade78-kube-api-access-f2lb7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr\" (UID: \"8c95b91c-fcb0-45bf-b1df-e5b5f97ade78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr" Jul 14 18:57:42.080703 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:42.080672 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr" Jul 14 18:57:42.209301 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:42.209280 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr"] Jul 14 18:57:42.212141 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:57:42.212103 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c95b91c_fcb0_45bf_b1df_e5b5f97ade78.slice/crio-704ce70e415e422e8929dfe6cd6b8b28765f833241636a1b05e8988ef2f6a6de WatchSource:0}: Error finding container 704ce70e415e422e8929dfe6cd6b8b28765f833241636a1b05e8988ef2f6a6de: Status 404 returned error can't find the container with id 704ce70e415e422e8929dfe6cd6b8b28765f833241636a1b05e8988ef2f6a6de Jul 14 18:57:42.484232 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:42.484135 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr" event={"ID":"8c95b91c-fcb0-45bf-b1df-e5b5f97ade78","Type":"ContainerStarted","Data":"704ce70e415e422e8929dfe6cd6b8b28765f833241636a1b05e8988ef2f6a6de"} Jul 14 18:57:49.513283 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:49.513247 2563 generic.go:356] "Generic (PLEG): container finished" podID="8c95b91c-fcb0-45bf-b1df-e5b5f97ade78" containerID="cdedeeaf636483afa286df4af988fca54439ef1ca03e5619ae13148f52c22bf9" exitCode=0 Jul 14 18:57:49.513857 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:49.513303 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr" event={"ID":"8c95b91c-fcb0-45bf-b1df-e5b5f97ade78","Type":"ContainerDied","Data":"cdedeeaf636483afa286df4af988fca54439ef1ca03e5619ae13148f52c22bf9"} Jul 14 18:57:52.525818 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:52.525785 2563 generic.go:356] "Generic (PLEG): container finished" podID="8c95b91c-fcb0-45bf-b1df-e5b5f97ade78" containerID="034886a6dbda9e41de3b3c175f5b544d9764b6964e0fca7a5a24142061b8ae09" exitCode=0 Jul 14 18:57:52.526194 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:57:52.525834 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr" event={"ID":"8c95b91c-fcb0-45bf-b1df-e5b5f97ade78","Type":"ContainerDied","Data":"034886a6dbda9e41de3b3c175f5b544d9764b6964e0fca7a5a24142061b8ae09"} Jul 14 18:58:02.566295 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:02.566263 2563 generic.go:356] "Generic (PLEG): container finished" podID="8c95b91c-fcb0-45bf-b1df-e5b5f97ade78" containerID="4e052fc6cde625ff92518790f07bd7856feaa1e37e3cb231673c2456a23b1aa3" exitCode=0 Jul 14 18:58:02.566720 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:02.566329 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr" event={"ID":"8c95b91c-fcb0-45bf-b1df-e5b5f97ade78","Type":"ContainerDied","Data":"4e052fc6cde625ff92518790f07bd7856feaa1e37e3cb231673c2456a23b1aa3"} Jul 14 18:58:03.739836 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:03.739801 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr" Jul 14 18:58:03.803778 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:03.803743 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c95b91c-fcb0-45bf-b1df-e5b5f97ade78-util\") pod \"8c95b91c-fcb0-45bf-b1df-e5b5f97ade78\" (UID: \"8c95b91c-fcb0-45bf-b1df-e5b5f97ade78\") " Jul 14 18:58:03.803932 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:03.803795 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c95b91c-fcb0-45bf-b1df-e5b5f97ade78-bundle\") pod \"8c95b91c-fcb0-45bf-b1df-e5b5f97ade78\" (UID: \"8c95b91c-fcb0-45bf-b1df-e5b5f97ade78\") " Jul 14 18:58:03.803932 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:03.803856 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2lb7\" (UniqueName: \"kubernetes.io/projected/8c95b91c-fcb0-45bf-b1df-e5b5f97ade78-kube-api-access-f2lb7\") pod \"8c95b91c-fcb0-45bf-b1df-e5b5f97ade78\" (UID: \"8c95b91c-fcb0-45bf-b1df-e5b5f97ade78\") " Jul 14 18:58:03.804448 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:03.804415 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c95b91c-fcb0-45bf-b1df-e5b5f97ade78-bundle" (OuterVolumeSpecName: "bundle") pod "8c95b91c-fcb0-45bf-b1df-e5b5f97ade78" (UID: "8c95b91c-fcb0-45bf-b1df-e5b5f97ade78"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:58:03.806144 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:03.806114 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c95b91c-fcb0-45bf-b1df-e5b5f97ade78-kube-api-access-f2lb7" (OuterVolumeSpecName: "kube-api-access-f2lb7") pod "8c95b91c-fcb0-45bf-b1df-e5b5f97ade78" (UID: "8c95b91c-fcb0-45bf-b1df-e5b5f97ade78"). InnerVolumeSpecName "kube-api-access-f2lb7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:58:03.808699 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:03.808680 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c95b91c-fcb0-45bf-b1df-e5b5f97ade78-util" (OuterVolumeSpecName: "util") pod "8c95b91c-fcb0-45bf-b1df-e5b5f97ade78" (UID: "8c95b91c-fcb0-45bf-b1df-e5b5f97ade78"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:58:03.905044 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:03.904956 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c95b91c-fcb0-45bf-b1df-e5b5f97ade78-util\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:58:03.905044 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:03.904986 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c95b91c-fcb0-45bf-b1df-e5b5f97ade78-bundle\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:58:03.905044 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:03.904997 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2lb7\" (UniqueName: \"kubernetes.io/projected/8c95b91c-fcb0-45bf-b1df-e5b5f97ade78-kube-api-access-f2lb7\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:58:04.576456 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:04.576434 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr" Jul 14 18:58:04.576567 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:04.576433 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hqthr" event={"ID":"8c95b91c-fcb0-45bf-b1df-e5b5f97ade78","Type":"ContainerDied","Data":"704ce70e415e422e8929dfe6cd6b8b28765f833241636a1b05e8988ef2f6a6de"} Jul 14 18:58:04.576567 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:04.576565 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="704ce70e415e422e8929dfe6cd6b8b28765f833241636a1b05e8988ef2f6a6de" Jul 14 18:58:10.090186 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:10.090149 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nzg7w"] Jul 14 18:58:10.090579 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:10.090430 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c95b91c-fcb0-45bf-b1df-e5b5f97ade78" containerName="pull" Jul 14 18:58:10.090579 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:10.090442 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c95b91c-fcb0-45bf-b1df-e5b5f97ade78" containerName="pull" Jul 14 18:58:10.090579 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:10.090453 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c95b91c-fcb0-45bf-b1df-e5b5f97ade78" containerName="util" Jul 14 18:58:10.090579 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:10.090459 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c95b91c-fcb0-45bf-b1df-e5b5f97ade78" containerName="util" Jul 14 18:58:10.090579 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:10.090466 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c95b91c-fcb0-45bf-b1df-e5b5f97ade78" containerName="extract" Jul 14 18:58:10.090579 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:10.090471 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c95b91c-fcb0-45bf-b1df-e5b5f97ade78" containerName="extract" Jul 14 18:58:10.090579 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:10.090515 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c95b91c-fcb0-45bf-b1df-e5b5f97ade78" containerName="extract" Jul 14 18:58:10.092335 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:10.092319 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nzg7w" Jul 14 18:58:10.095739 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:10.095712 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 14 18:58:10.096193 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:10.096170 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 14 18:58:10.096351 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:10.096226 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-qlqgq\"" Jul 14 18:58:10.111354 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:10.111327 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nzg7w"] Jul 14 18:58:10.156460 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:10.156418 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kfm8\" (UniqueName: \"kubernetes.io/projected/d999ca7c-602c-4099-bfa8-a913cbda06cc-kube-api-access-7kfm8\") pod \"cert-manager-operator-controller-manager-55c444bf86-nzg7w\" (UID: \"d999ca7c-602c-4099-bfa8-a913cbda06cc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nzg7w" Jul 14 18:58:10.156656 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:10.156472 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d999ca7c-602c-4099-bfa8-a913cbda06cc-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nzg7w\" (UID: \"d999ca7c-602c-4099-bfa8-a913cbda06cc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nzg7w" Jul 14 18:58:10.257444 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:10.257406 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d999ca7c-602c-4099-bfa8-a913cbda06cc-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nzg7w\" (UID: \"d999ca7c-602c-4099-bfa8-a913cbda06cc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nzg7w" Jul 14 18:58:10.257647 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:10.257486 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kfm8\" (UniqueName: \"kubernetes.io/projected/d999ca7c-602c-4099-bfa8-a913cbda06cc-kube-api-access-7kfm8\") pod \"cert-manager-operator-controller-manager-55c444bf86-nzg7w\" (UID: \"d999ca7c-602c-4099-bfa8-a913cbda06cc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nzg7w" Jul 14 18:58:10.257855 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:10.257834 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d999ca7c-602c-4099-bfa8-a913cbda06cc-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nzg7w\" (UID: \"d999ca7c-602c-4099-bfa8-a913cbda06cc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nzg7w" Jul 14 18:58:10.274474 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:10.274438 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kfm8\" (UniqueName: \"kubernetes.io/projected/d999ca7c-602c-4099-bfa8-a913cbda06cc-kube-api-access-7kfm8\") pod \"cert-manager-operator-controller-manager-55c444bf86-nzg7w\" (UID: \"d999ca7c-602c-4099-bfa8-a913cbda06cc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nzg7w" Jul 14 18:58:10.406018 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:10.405914 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nzg7w" Jul 14 18:58:10.544869 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:10.544823 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nzg7w"] Jul 14 18:58:10.547473 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:58:10.547442 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd999ca7c_602c_4099_bfa8_a913cbda06cc.slice/crio-a6a52b5cac3b8d4fa94b430ffe405ebb6f70fe8fa07daa50b1addec5d324ad43 WatchSource:0}: Error finding container a6a52b5cac3b8d4fa94b430ffe405ebb6f70fe8fa07daa50b1addec5d324ad43: Status 404 returned error can't find the container with id a6a52b5cac3b8d4fa94b430ffe405ebb6f70fe8fa07daa50b1addec5d324ad43 Jul 14 18:58:10.597781 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:10.597748 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nzg7w" event={"ID":"d999ca7c-602c-4099-bfa8-a913cbda06cc","Type":"ContainerStarted","Data":"a6a52b5cac3b8d4fa94b430ffe405ebb6f70fe8fa07daa50b1addec5d324ad43"} Jul 14 18:58:18.631555 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:18.631514 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nzg7w" event={"ID":"d999ca7c-602c-4099-bfa8-a913cbda06cc","Type":"ContainerStarted","Data":"02a670c999acbacaeab525d2f6c5703efef1a70d72f74ee6b13aa50af4e0d052"} Jul 14 18:58:18.658542 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:18.658486 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nzg7w" podStartSLOduration=1.392501191 podStartE2EDuration="8.658470074s" totalImagesPullingTime="7.265968883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:58:18.657960512 +0000 UTC m=+222.656853330" watchObservedRunningTime="2026-07-14 18:58:18.658470074 +0000 UTC m=+222.657362891" Jul 14 18:58:19.970811 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:19.970771 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw"] Jul 14 18:58:19.973414 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:19.973396 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw" Jul 14 18:58:19.977840 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:19.977812 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-54lhf\"" Jul 14 18:58:19.978058 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:19.978036 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 18:58:19.978988 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:19.978967 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 18:58:19.993254 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:19.993220 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw"] Jul 14 18:58:20.043420 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.043382 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxnzv\" (UniqueName: \"kubernetes.io/projected/f13884b7-d7a8-4c96-bb76-707d387d3c92-kube-api-access-cxnzv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw\" (UID: \"f13884b7-d7a8-4c96-bb76-707d387d3c92\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw" Jul 14 18:58:20.043635 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.043432 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f13884b7-d7a8-4c96-bb76-707d387d3c92-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw\" (UID: \"f13884b7-d7a8-4c96-bb76-707d387d3c92\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw" Jul 14 18:58:20.043635 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.043552 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f13884b7-d7a8-4c96-bb76-707d387d3c92-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw\" (UID: \"f13884b7-d7a8-4c96-bb76-707d387d3c92\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw" Jul 14 18:58:20.144491 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.144451 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f13884b7-d7a8-4c96-bb76-707d387d3c92-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw\" (UID: \"f13884b7-d7a8-4c96-bb76-707d387d3c92\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw" Jul 14 18:58:20.144715 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.144500 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxnzv\" (UniqueName: \"kubernetes.io/projected/f13884b7-d7a8-4c96-bb76-707d387d3c92-kube-api-access-cxnzv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw\" (UID: \"f13884b7-d7a8-4c96-bb76-707d387d3c92\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw" Jul 14 18:58:20.144715 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.144611 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f13884b7-d7a8-4c96-bb76-707d387d3c92-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw\" (UID: \"f13884b7-d7a8-4c96-bb76-707d387d3c92\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw" Jul 14 18:58:20.144889 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.144866 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f13884b7-d7a8-4c96-bb76-707d387d3c92-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw\" (UID: \"f13884b7-d7a8-4c96-bb76-707d387d3c92\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw" Jul 14 18:58:20.144947 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.144931 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f13884b7-d7a8-4c96-bb76-707d387d3c92-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw\" (UID: \"f13884b7-d7a8-4c96-bb76-707d387d3c92\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw" Jul 14 18:58:20.178589 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.178554 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxnzv\" (UniqueName: \"kubernetes.io/projected/f13884b7-d7a8-4c96-bb76-707d387d3c92-kube-api-access-cxnzv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw\" (UID: \"f13884b7-d7a8-4c96-bb76-707d387d3c92\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw" Jul 14 18:58:20.205338 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.205304 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kf779"] Jul 14 18:58:20.207367 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.207351 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-kf779" Jul 14 18:58:20.235376 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.235234 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kf779"] Jul 14 18:58:20.240567 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.240526 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 14 18:58:20.240727 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.240703 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 14 18:58:20.243341 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.243322 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-shj2f\"" Jul 14 18:58:20.282538 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.282507 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw" Jul 14 18:58:20.346070 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.346029 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56cx6\" (UniqueName: \"kubernetes.io/projected/638b487b-6e06-4ed7-8b1e-a59da289d604-kube-api-access-56cx6\") pod \"cert-manager-webhook-6486ffd997-kf779\" (UID: \"638b487b-6e06-4ed7-8b1e-a59da289d604\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kf779" Jul 14 18:58:20.346241 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.346099 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/638b487b-6e06-4ed7-8b1e-a59da289d604-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kf779\" (UID: \"638b487b-6e06-4ed7-8b1e-a59da289d604\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kf779" Jul 14 18:58:20.425149 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.425117 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw"] Jul 14 18:58:20.428264 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:58:20.428235 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13884b7_d7a8_4c96_bb76_707d387d3c92.slice/crio-07ef14764ffaa8032208d3f1e00fb9f12b012e1abee6df4241ebd6bb30b60318 WatchSource:0}: Error finding container 07ef14764ffaa8032208d3f1e00fb9f12b012e1abee6df4241ebd6bb30b60318: Status 404 returned error can't find the container with id 07ef14764ffaa8032208d3f1e00fb9f12b012e1abee6df4241ebd6bb30b60318 Jul 14 18:58:20.447238 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.447203 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/638b487b-6e06-4ed7-8b1e-a59da289d604-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kf779\" (UID: \"638b487b-6e06-4ed7-8b1e-a59da289d604\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kf779" Jul 14 18:58:20.447329 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.447303 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56cx6\" (UniqueName: \"kubernetes.io/projected/638b487b-6e06-4ed7-8b1e-a59da289d604-kube-api-access-56cx6\") pod \"cert-manager-webhook-6486ffd997-kf779\" (UID: \"638b487b-6e06-4ed7-8b1e-a59da289d604\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kf779" Jul 14 18:58:20.461778 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.461757 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56cx6\" (UniqueName: \"kubernetes.io/projected/638b487b-6e06-4ed7-8b1e-a59da289d604-kube-api-access-56cx6\") pod \"cert-manager-webhook-6486ffd997-kf779\" (UID: \"638b487b-6e06-4ed7-8b1e-a59da289d604\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kf779" Jul 14 18:58:20.463472 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.463454 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/638b487b-6e06-4ed7-8b1e-a59da289d604-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kf779\" (UID: \"638b487b-6e06-4ed7-8b1e-a59da289d604\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kf779" Jul 14 18:58:20.526820 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.526795 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-kf779" Jul 14 18:58:20.641330 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.641302 2563 generic.go:356] "Generic (PLEG): container finished" podID="f13884b7-d7a8-4c96-bb76-707d387d3c92" containerID="1227f3be925a8dbf88b73c15e35c54c7dcffbbff764329df11ff5a7019a7291f" exitCode=0 Jul 14 18:58:20.641330 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.641339 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw" event={"ID":"f13884b7-d7a8-4c96-bb76-707d387d3c92","Type":"ContainerDied","Data":"1227f3be925a8dbf88b73c15e35c54c7dcffbbff764329df11ff5a7019a7291f"} Jul 14 18:58:20.641701 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.641376 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw" event={"ID":"f13884b7-d7a8-4c96-bb76-707d387d3c92","Type":"ContainerStarted","Data":"07ef14764ffaa8032208d3f1e00fb9f12b012e1abee6df4241ebd6bb30b60318"} Jul 14 18:58:20.655953 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:20.655928 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kf779"] Jul 14 18:58:20.658565 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:58:20.658546 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod638b487b_6e06_4ed7_8b1e_a59da289d604.slice/crio-778133547bf3dbacd2498d46f2baf27127278086df2524ac3f0f9ba126ca81cb WatchSource:0}: Error finding container 778133547bf3dbacd2498d46f2baf27127278086df2524ac3f0f9ba126ca81cb: Status 404 returned error can't find the container with id 778133547bf3dbacd2498d46f2baf27127278086df2524ac3f0f9ba126ca81cb Jul 14 18:58:21.647174 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:21.647137 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-kf779" event={"ID":"638b487b-6e06-4ed7-8b1e-a59da289d604","Type":"ContainerStarted","Data":"778133547bf3dbacd2498d46f2baf27127278086df2524ac3f0f9ba126ca81cb"} Jul 14 18:58:21.883408 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:21.883336 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gl72w"] Jul 14 18:58:21.885895 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:21.885872 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gl72w" Jul 14 18:58:21.888572 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:21.888536 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-g6tmf\"" Jul 14 18:58:21.898201 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:21.898127 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gl72w"] Jul 14 18:58:21.960352 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:21.960300 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07164b5f-3276-4b60-8225-6a5a402f4dcc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gl72w\" (UID: \"07164b5f-3276-4b60-8225-6a5a402f4dcc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gl72w" Jul 14 18:58:21.960538 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:21.960390 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skrpd\" (UniqueName: \"kubernetes.io/projected/07164b5f-3276-4b60-8225-6a5a402f4dcc-kube-api-access-skrpd\") pod \"cert-manager-cainjector-559cdd8c87-gl72w\" (UID: \"07164b5f-3276-4b60-8225-6a5a402f4dcc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gl72w" Jul 14 18:58:22.061781 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:22.061721 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07164b5f-3276-4b60-8225-6a5a402f4dcc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gl72w\" (UID: \"07164b5f-3276-4b60-8225-6a5a402f4dcc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gl72w" Jul 14 18:58:22.061781 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:22.061774 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skrpd\" (UniqueName: \"kubernetes.io/projected/07164b5f-3276-4b60-8225-6a5a402f4dcc-kube-api-access-skrpd\") pod \"cert-manager-cainjector-559cdd8c87-gl72w\" (UID: \"07164b5f-3276-4b60-8225-6a5a402f4dcc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gl72w" Jul 14 18:58:22.071421 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:22.071386 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skrpd\" (UniqueName: \"kubernetes.io/projected/07164b5f-3276-4b60-8225-6a5a402f4dcc-kube-api-access-skrpd\") pod \"cert-manager-cainjector-559cdd8c87-gl72w\" (UID: \"07164b5f-3276-4b60-8225-6a5a402f4dcc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gl72w" Jul 14 18:58:22.075584 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:22.075560 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07164b5f-3276-4b60-8225-6a5a402f4dcc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gl72w\" (UID: \"07164b5f-3276-4b60-8225-6a5a402f4dcc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gl72w" Jul 14 18:58:22.199001 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:22.198888 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gl72w" Jul 14 18:58:22.368018 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:22.367985 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gl72w"] Jul 14 18:58:22.371544 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:58:22.371505 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07164b5f_3276_4b60_8225_6a5a402f4dcc.slice/crio-5edfca880d12ffaeb6bb1976be260b04b083f6ee5688f05eb44cc91b4f5ae2c7 WatchSource:0}: Error finding container 5edfca880d12ffaeb6bb1976be260b04b083f6ee5688f05eb44cc91b4f5ae2c7: Status 404 returned error can't find the container with id 5edfca880d12ffaeb6bb1976be260b04b083f6ee5688f05eb44cc91b4f5ae2c7 Jul 14 18:58:22.653233 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:22.653191 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gl72w" event={"ID":"07164b5f-3276-4b60-8225-6a5a402f4dcc","Type":"ContainerStarted","Data":"5edfca880d12ffaeb6bb1976be260b04b083f6ee5688f05eb44cc91b4f5ae2c7"} Jul 14 18:58:24.664145 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:24.664112 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-kf779" event={"ID":"638b487b-6e06-4ed7-8b1e-a59da289d604","Type":"ContainerStarted","Data":"d9376c056771a85a8ce5a59094679afd7049947894d3fdbc82841aaa57d20f64"} Jul 14 18:58:24.664567 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:24.664182 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-kf779" Jul 14 18:58:24.665716 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:24.665691 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gl72w" event={"ID":"07164b5f-3276-4b60-8225-6a5a402f4dcc","Type":"ContainerStarted","Data":"3490fc87dcf1d11d62f766348185990b58bf5d070cd1d98eed8fbb9f6e274e12"} Jul 14 18:58:24.667286 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:24.667261 2563 generic.go:356] "Generic (PLEG): container finished" podID="f13884b7-d7a8-4c96-bb76-707d387d3c92" containerID="a2375f2cb7943e192f580b9332e83ded563690604766a448b0a15ef16b9dba4f" exitCode=0 Jul 14 18:58:24.667370 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:24.667303 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw" event={"ID":"f13884b7-d7a8-4c96-bb76-707d387d3c92","Type":"ContainerDied","Data":"a2375f2cb7943e192f580b9332e83ded563690604766a448b0a15ef16b9dba4f"} Jul 14 18:58:24.684786 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:24.684742 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-kf779" podStartSLOduration=1.299673783 podStartE2EDuration="4.684725539s" totalImagesPullingTime="3.385051756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:58:24.682612475 +0000 UTC m=+228.681505292" watchObservedRunningTime="2026-07-14 18:58:24.684725539 +0000 UTC m=+228.683618357" Jul 14 18:58:24.701728 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:24.701684 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gl72w" podStartSLOduration=2.030186574 podStartE2EDuration="3.701670889s" totalImagesPullingTime="1.671484315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:58:24.6992754 +0000 UTC m=+228.698168219" watchObservedRunningTime="2026-07-14 18:58:24.701670889 +0000 UTC m=+228.700563706" Jul 14 18:58:25.673533 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:25.673498 2563 generic.go:356] "Generic (PLEG): container finished" podID="f13884b7-d7a8-4c96-bb76-707d387d3c92" containerID="4e1467c4080b216112a614ddf91a51d08f770373345a533186a876cbd0312c4c" exitCode=0 Jul 14 18:58:25.673991 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:25.673611 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw" event={"ID":"f13884b7-d7a8-4c96-bb76-707d387d3c92","Type":"ContainerDied","Data":"4e1467c4080b216112a614ddf91a51d08f770373345a533186a876cbd0312c4c"} Jul 14 18:58:26.805984 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:26.805960 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw" Jul 14 18:58:26.904913 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:26.904875 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f13884b7-d7a8-4c96-bb76-707d387d3c92-util\") pod \"f13884b7-d7a8-4c96-bb76-707d387d3c92\" (UID: \"f13884b7-d7a8-4c96-bb76-707d387d3c92\") " Jul 14 18:58:26.905105 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:26.904939 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxnzv\" (UniqueName: \"kubernetes.io/projected/f13884b7-d7a8-4c96-bb76-707d387d3c92-kube-api-access-cxnzv\") pod \"f13884b7-d7a8-4c96-bb76-707d387d3c92\" (UID: \"f13884b7-d7a8-4c96-bb76-707d387d3c92\") " Jul 14 18:58:26.905105 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:26.904989 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f13884b7-d7a8-4c96-bb76-707d387d3c92-bundle\") pod \"f13884b7-d7a8-4c96-bb76-707d387d3c92\" (UID: \"f13884b7-d7a8-4c96-bb76-707d387d3c92\") " Jul 14 18:58:26.905443 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:26.905415 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f13884b7-d7a8-4c96-bb76-707d387d3c92-bundle" (OuterVolumeSpecName: "bundle") pod "f13884b7-d7a8-4c96-bb76-707d387d3c92" (UID: "f13884b7-d7a8-4c96-bb76-707d387d3c92"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:58:26.907309 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:26.907278 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f13884b7-d7a8-4c96-bb76-707d387d3c92-kube-api-access-cxnzv" (OuterVolumeSpecName: "kube-api-access-cxnzv") pod "f13884b7-d7a8-4c96-bb76-707d387d3c92" (UID: "f13884b7-d7a8-4c96-bb76-707d387d3c92"). InnerVolumeSpecName "kube-api-access-cxnzv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:58:26.910022 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:26.909985 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f13884b7-d7a8-4c96-bb76-707d387d3c92-util" (OuterVolumeSpecName: "util") pod "f13884b7-d7a8-4c96-bb76-707d387d3c92" (UID: "f13884b7-d7a8-4c96-bb76-707d387d3c92"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:58:27.006487 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:27.006454 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f13884b7-d7a8-4c96-bb76-707d387d3c92-util\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:58:27.006487 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:27.006484 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxnzv\" (UniqueName: \"kubernetes.io/projected/f13884b7-d7a8-4c96-bb76-707d387d3c92-kube-api-access-cxnzv\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:58:27.006487 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:27.006495 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f13884b7-d7a8-4c96-bb76-707d387d3c92-bundle\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:58:27.683441 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:27.683412 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw" Jul 14 18:58:27.683627 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:27.683438 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8khw" event={"ID":"f13884b7-d7a8-4c96-bb76-707d387d3c92","Type":"ContainerDied","Data":"07ef14764ffaa8032208d3f1e00fb9f12b012e1abee6df4241ebd6bb30b60318"} Jul 14 18:58:27.683627 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:27.683480 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07ef14764ffaa8032208d3f1e00fb9f12b012e1abee6df4241ebd6bb30b60318" Jul 14 18:58:29.578161 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:29.578123 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkbnj"] Jul 14 18:58:29.578639 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:29.578421 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f13884b7-d7a8-4c96-bb76-707d387d3c92" containerName="util" Jul 14 18:58:29.578639 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:29.578433 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f13884b7-d7a8-4c96-bb76-707d387d3c92" containerName="util" Jul 14 18:58:29.578639 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:29.578444 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f13884b7-d7a8-4c96-bb76-707d387d3c92" containerName="pull" Jul 14 18:58:29.578639 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:29.578449 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f13884b7-d7a8-4c96-bb76-707d387d3c92" containerName="pull" Jul 14 18:58:29.578639 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:29.578460 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f13884b7-d7a8-4c96-bb76-707d387d3c92" containerName="extract" Jul 14 18:58:29.578639 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:29.578468 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f13884b7-d7a8-4c96-bb76-707d387d3c92" containerName="extract" Jul 14 18:58:29.578639 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:29.578517 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f13884b7-d7a8-4c96-bb76-707d387d3c92" containerName="extract" Jul 14 18:58:29.581468 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:29.581452 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkbnj" Jul 14 18:58:29.584098 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:29.584075 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 14 18:58:29.584230 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:29.584110 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 14 18:58:29.584964 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:29.584947 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mwsw6\"" Jul 14 18:58:29.592111 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:29.592088 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkbnj"] Jul 14 18:58:29.732262 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:29.732224 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-925ps\" (UniqueName: \"kubernetes.io/projected/a3dbe7e0-5471-418a-b945-54b5dabf3699-kube-api-access-925ps\") pod \"openshift-lws-operator-fd8ccff4c-pkbnj\" (UID: \"a3dbe7e0-5471-418a-b945-54b5dabf3699\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkbnj" Jul 14 18:58:29.732262 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:29.732276 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3dbe7e0-5471-418a-b945-54b5dabf3699-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pkbnj\" (UID: \"a3dbe7e0-5471-418a-b945-54b5dabf3699\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkbnj" Jul 14 18:58:29.833747 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:29.833666 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-925ps\" (UniqueName: \"kubernetes.io/projected/a3dbe7e0-5471-418a-b945-54b5dabf3699-kube-api-access-925ps\") pod \"openshift-lws-operator-fd8ccff4c-pkbnj\" (UID: \"a3dbe7e0-5471-418a-b945-54b5dabf3699\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkbnj" Jul 14 18:58:29.833747 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:29.833718 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3dbe7e0-5471-418a-b945-54b5dabf3699-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pkbnj\" (UID: \"a3dbe7e0-5471-418a-b945-54b5dabf3699\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkbnj" Jul 14 18:58:29.834082 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:29.834064 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3dbe7e0-5471-418a-b945-54b5dabf3699-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pkbnj\" (UID: \"a3dbe7e0-5471-418a-b945-54b5dabf3699\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkbnj" Jul 14 18:58:29.842899 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:29.842869 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-925ps\" (UniqueName: \"kubernetes.io/projected/a3dbe7e0-5471-418a-b945-54b5dabf3699-kube-api-access-925ps\") pod \"openshift-lws-operator-fd8ccff4c-pkbnj\" (UID: \"a3dbe7e0-5471-418a-b945-54b5dabf3699\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkbnj" Jul 14 18:58:29.890961 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:29.890925 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkbnj" Jul 14 18:58:30.024225 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:30.024199 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkbnj"] Jul 14 18:58:30.026839 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:58:30.026815 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3dbe7e0_5471_418a_b945_54b5dabf3699.slice/crio-488cea860230a92659d75c1ee4b677ab1d3604d5e4a1ae00f2a9763d48bd8f59 WatchSource:0}: Error finding container 488cea860230a92659d75c1ee4b677ab1d3604d5e4a1ae00f2a9763d48bd8f59: Status 404 returned error can't find the container with id 488cea860230a92659d75c1ee4b677ab1d3604d5e4a1ae00f2a9763d48bd8f59 Jul 14 18:58:30.676192 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:30.676160 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-kf779" Jul 14 18:58:30.698027 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:30.697995 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkbnj" event={"ID":"a3dbe7e0-5471-418a-b945-54b5dabf3699","Type":"ContainerStarted","Data":"488cea860230a92659d75c1ee4b677ab1d3604d5e4a1ae00f2a9763d48bd8f59"} Jul 14 18:58:33.713326 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:33.713288 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkbnj" event={"ID":"a3dbe7e0-5471-418a-b945-54b5dabf3699","Type":"ContainerStarted","Data":"68a7e53bdd77811cde039b102e42481bfa9cd5c53768fa7bef3bd3c168be0a1e"} Jul 14 18:58:33.734220 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:33.734168 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkbnj" podStartSLOduration=1.620366475 podStartE2EDuration="4.734153161s" totalImagesPullingTime="3.113786686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:58:33.731884902 +0000 UTC m=+237.730777721" watchObservedRunningTime="2026-07-14 18:58:33.734153161 +0000 UTC m=+237.733045979" Jul 14 18:58:36.037058 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:36.037023 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs"] Jul 14 18:58:36.063033 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:36.063006 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs"] Jul 14 18:58:36.063173 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:36.063108 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs" Jul 14 18:58:36.066749 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:36.066726 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 18:58:36.066846 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:36.066737 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 18:58:36.066846 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:36.066825 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-54lhf\"" Jul 14 18:58:36.185740 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:36.185703 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d24c26bb-0714-401b-a0cc-fe3c3b790a7e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs\" (UID: \"d24c26bb-0714-401b-a0cc-fe3c3b790a7e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs" Jul 14 18:58:36.185936 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:36.185754 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9dfd\" (UniqueName: \"kubernetes.io/projected/d24c26bb-0714-401b-a0cc-fe3c3b790a7e-kube-api-access-l9dfd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs\" (UID: \"d24c26bb-0714-401b-a0cc-fe3c3b790a7e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs" Jul 14 18:58:36.185936 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:36.185851 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d24c26bb-0714-401b-a0cc-fe3c3b790a7e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs\" (UID: \"d24c26bb-0714-401b-a0cc-fe3c3b790a7e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs" Jul 14 18:58:36.287387 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:36.287289 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d24c26bb-0714-401b-a0cc-fe3c3b790a7e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs\" (UID: \"d24c26bb-0714-401b-a0cc-fe3c3b790a7e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs" Jul 14 18:58:36.287387 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:36.287374 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d24c26bb-0714-401b-a0cc-fe3c3b790a7e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs\" (UID: \"d24c26bb-0714-401b-a0cc-fe3c3b790a7e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs" Jul 14 18:58:36.287628 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:36.287410 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9dfd\" (UniqueName: \"kubernetes.io/projected/d24c26bb-0714-401b-a0cc-fe3c3b790a7e-kube-api-access-l9dfd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs\" (UID: \"d24c26bb-0714-401b-a0cc-fe3c3b790a7e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs" Jul 14 18:58:36.287702 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:36.287661 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d24c26bb-0714-401b-a0cc-fe3c3b790a7e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs\" (UID: \"d24c26bb-0714-401b-a0cc-fe3c3b790a7e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs" Jul 14 18:58:36.287795 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:36.287775 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d24c26bb-0714-401b-a0cc-fe3c3b790a7e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs\" (UID: \"d24c26bb-0714-401b-a0cc-fe3c3b790a7e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs" Jul 14 18:58:36.297072 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:36.297039 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9dfd\" (UniqueName: \"kubernetes.io/projected/d24c26bb-0714-401b-a0cc-fe3c3b790a7e-kube-api-access-l9dfd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs\" (UID: \"d24c26bb-0714-401b-a0cc-fe3c3b790a7e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs" Jul 14 18:58:36.375815 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:36.375784 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-54lhf\"" Jul 14 18:58:36.383299 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:36.383278 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs" Jul 14 18:58:36.547806 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:36.547732 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs"] Jul 14 18:58:36.550880 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:58:36.550854 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd24c26bb_0714_401b_a0cc_fe3c3b790a7e.slice/crio-f0da443c6584efcc3501e96265f851793f7319d1f999c60e14eba600f7c025e4 WatchSource:0}: Error finding container f0da443c6584efcc3501e96265f851793f7319d1f999c60e14eba600f7c025e4: Status 404 returned error can't find the container with id f0da443c6584efcc3501e96265f851793f7319d1f999c60e14eba600f7c025e4 Jul 14 18:58:36.726211 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:36.726177 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs" event={"ID":"d24c26bb-0714-401b-a0cc-fe3c3b790a7e","Type":"ContainerStarted","Data":"0157e990b93548d55da8c82cf11b66829c35eea13dca5b5bffcb422b7d202ec1"} Jul 14 18:58:36.726367 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:36.726230 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs" event={"ID":"d24c26bb-0714-401b-a0cc-fe3c3b790a7e","Type":"ContainerStarted","Data":"f0da443c6584efcc3501e96265f851793f7319d1f999c60e14eba600f7c025e4"} Jul 14 18:58:37.732373 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:37.732276 2563 generic.go:356] "Generic (PLEG): container finished" podID="d24c26bb-0714-401b-a0cc-fe3c3b790a7e" containerID="0157e990b93548d55da8c82cf11b66829c35eea13dca5b5bffcb422b7d202ec1" exitCode=0 Jul 14 18:58:37.732373 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:37.732346 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs" event={"ID":"d24c26bb-0714-401b-a0cc-fe3c3b790a7e","Type":"ContainerDied","Data":"0157e990b93548d55da8c82cf11b66829c35eea13dca5b5bffcb422b7d202ec1"} Jul 14 18:58:39.742829 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:39.742794 2563 generic.go:356] "Generic (PLEG): container finished" podID="d24c26bb-0714-401b-a0cc-fe3c3b790a7e" containerID="a3ecef003958417d65290a7a4b53530b82d097e3e115d0403dc44f535efbf473" exitCode=0 Jul 14 18:58:39.743204 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:39.742879 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs" event={"ID":"d24c26bb-0714-401b-a0cc-fe3c3b790a7e","Type":"ContainerDied","Data":"a3ecef003958417d65290a7a4b53530b82d097e3e115d0403dc44f535efbf473"} Jul 14 18:58:40.749323 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:40.749284 2563 generic.go:356] "Generic (PLEG): container finished" podID="d24c26bb-0714-401b-a0cc-fe3c3b790a7e" containerID="6f3bff440a6ff5a4cfbb9b07097f2a0341f46fa81f7e0acdd62d9dd431a00357" exitCode=0 Jul 14 18:58:40.749817 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:40.749371 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs" event={"ID":"d24c26bb-0714-401b-a0cc-fe3c3b790a7e","Type":"ContainerDied","Data":"6f3bff440a6ff5a4cfbb9b07097f2a0341f46fa81f7e0acdd62d9dd431a00357"} Jul 14 18:58:41.886952 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:41.886923 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs" Jul 14 18:58:42.038681 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:42.038561 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d24c26bb-0714-401b-a0cc-fe3c3b790a7e-util\") pod \"d24c26bb-0714-401b-a0cc-fe3c3b790a7e\" (UID: \"d24c26bb-0714-401b-a0cc-fe3c3b790a7e\") " Jul 14 18:58:42.038681 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:42.038648 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9dfd\" (UniqueName: \"kubernetes.io/projected/d24c26bb-0714-401b-a0cc-fe3c3b790a7e-kube-api-access-l9dfd\") pod \"d24c26bb-0714-401b-a0cc-fe3c3b790a7e\" (UID: \"d24c26bb-0714-401b-a0cc-fe3c3b790a7e\") " Jul 14 18:58:42.038681 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:42.038680 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d24c26bb-0714-401b-a0cc-fe3c3b790a7e-bundle\") pod \"d24c26bb-0714-401b-a0cc-fe3c3b790a7e\" (UID: \"d24c26bb-0714-401b-a0cc-fe3c3b790a7e\") " Jul 14 18:58:42.039404 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:42.039370 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d24c26bb-0714-401b-a0cc-fe3c3b790a7e-bundle" (OuterVolumeSpecName: "bundle") pod "d24c26bb-0714-401b-a0cc-fe3c3b790a7e" (UID: "d24c26bb-0714-401b-a0cc-fe3c3b790a7e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:58:42.040900 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:42.040876 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d24c26bb-0714-401b-a0cc-fe3c3b790a7e-kube-api-access-l9dfd" (OuterVolumeSpecName: "kube-api-access-l9dfd") pod "d24c26bb-0714-401b-a0cc-fe3c3b790a7e" (UID: "d24c26bb-0714-401b-a0cc-fe3c3b790a7e"). InnerVolumeSpecName "kube-api-access-l9dfd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:58:42.044477 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:42.044454 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d24c26bb-0714-401b-a0cc-fe3c3b790a7e-util" (OuterVolumeSpecName: "util") pod "d24c26bb-0714-401b-a0cc-fe3c3b790a7e" (UID: "d24c26bb-0714-401b-a0cc-fe3c3b790a7e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:58:42.139611 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:42.139558 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d24c26bb-0714-401b-a0cc-fe3c3b790a7e-util\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:58:42.139611 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:42.139585 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9dfd\" (UniqueName: \"kubernetes.io/projected/d24c26bb-0714-401b-a0cc-fe3c3b790a7e-kube-api-access-l9dfd\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:58:42.139611 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:42.139616 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d24c26bb-0714-401b-a0cc-fe3c3b790a7e-bundle\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 18:58:42.760692 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:42.760652 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs" event={"ID":"d24c26bb-0714-401b-a0cc-fe3c3b790a7e","Type":"ContainerDied","Data":"f0da443c6584efcc3501e96265f851793f7319d1f999c60e14eba600f7c025e4"} Jul 14 18:58:42.760847 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:42.760711 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0da443c6584efcc3501e96265f851793f7319d1f999c60e14eba600f7c025e4" Jul 14 18:58:42.760847 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:42.760668 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af79zvs" Jul 14 18:58:49.450911 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.450876 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg"] Jul 14 18:58:49.451276 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.451149 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d24c26bb-0714-401b-a0cc-fe3c3b790a7e" containerName="extract" Jul 14 18:58:49.451276 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.451160 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d24c26bb-0714-401b-a0cc-fe3c3b790a7e" containerName="extract" Jul 14 18:58:49.451276 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.451172 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d24c26bb-0714-401b-a0cc-fe3c3b790a7e" containerName="pull" Jul 14 18:58:49.451276 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.451177 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d24c26bb-0714-401b-a0cc-fe3c3b790a7e" containerName="pull" Jul 14 18:58:49.451276 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.451186 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d24c26bb-0714-401b-a0cc-fe3c3b790a7e" containerName="util" Jul 14 18:58:49.451276 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.451191 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d24c26bb-0714-401b-a0cc-fe3c3b790a7e" containerName="util" Jul 14 18:58:49.451276 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.451258 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d24c26bb-0714-401b-a0cc-fe3c3b790a7e" containerName="extract" Jul 14 18:58:49.453932 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.453902 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" Jul 14 18:58:49.463766 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.463744 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dxtk8\"" Jul 14 18:58:49.464001 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.463986 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 18:58:49.464258 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.464242 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 18:58:49.464463 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.464445 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 18:58:49.465100 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.465087 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 18:58:49.475311 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.475291 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg"] Jul 14 18:58:49.493938 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.493901 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/71600064-e629-44f7-aa12-ed0fb6e35f17-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-wmvlg\" (UID: \"71600064-e629-44f7-aa12-ed0fb6e35f17\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" Jul 14 18:58:49.494092 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.493960 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/71600064-e629-44f7-aa12-ed0fb6e35f17-manifests\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-wmvlg\" (UID: \"71600064-e629-44f7-aa12-ed0fb6e35f17\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" Jul 14 18:58:49.494092 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.494010 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71600064-e629-44f7-aa12-ed0fb6e35f17-webhook-cert\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-wmvlg\" (UID: \"71600064-e629-44f7-aa12-ed0fb6e35f17\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" Jul 14 18:58:49.494092 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.494061 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71600064-e629-44f7-aa12-ed0fb6e35f17-tmp\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-wmvlg\" (UID: \"71600064-e629-44f7-aa12-ed0fb6e35f17\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" Jul 14 18:58:49.494244 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.494101 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gszgz\" (UniqueName: \"kubernetes.io/projected/71600064-e629-44f7-aa12-ed0fb6e35f17-kube-api-access-gszgz\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-wmvlg\" (UID: \"71600064-e629-44f7-aa12-ed0fb6e35f17\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" Jul 14 18:58:49.595007 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.594972 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/71600064-e629-44f7-aa12-ed0fb6e35f17-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-wmvlg\" (UID: \"71600064-e629-44f7-aa12-ed0fb6e35f17\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" Jul 14 18:58:49.595206 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.595015 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/71600064-e629-44f7-aa12-ed0fb6e35f17-manifests\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-wmvlg\" (UID: \"71600064-e629-44f7-aa12-ed0fb6e35f17\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" Jul 14 18:58:49.595206 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.595036 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71600064-e629-44f7-aa12-ed0fb6e35f17-webhook-cert\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-wmvlg\" (UID: \"71600064-e629-44f7-aa12-ed0fb6e35f17\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" Jul 14 18:58:49.595206 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.595167 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71600064-e629-44f7-aa12-ed0fb6e35f17-tmp\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-wmvlg\" (UID: \"71600064-e629-44f7-aa12-ed0fb6e35f17\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" Jul 14 18:58:49.595371 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.595257 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gszgz\" (UniqueName: \"kubernetes.io/projected/71600064-e629-44f7-aa12-ed0fb6e35f17-kube-api-access-gszgz\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-wmvlg\" (UID: \"71600064-e629-44f7-aa12-ed0fb6e35f17\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" Jul 14 18:58:49.595533 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.595512 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/71600064-e629-44f7-aa12-ed0fb6e35f17-manifests\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-wmvlg\" (UID: \"71600064-e629-44f7-aa12-ed0fb6e35f17\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" Jul 14 18:58:49.597491 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.597468 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71600064-e629-44f7-aa12-ed0fb6e35f17-tmp\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-wmvlg\" (UID: \"71600064-e629-44f7-aa12-ed0fb6e35f17\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" Jul 14 18:58:49.597847 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.597818 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71600064-e629-44f7-aa12-ed0fb6e35f17-webhook-cert\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-wmvlg\" (UID: \"71600064-e629-44f7-aa12-ed0fb6e35f17\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" Jul 14 18:58:49.597932 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.597868 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/71600064-e629-44f7-aa12-ed0fb6e35f17-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-wmvlg\" (UID: \"71600064-e629-44f7-aa12-ed0fb6e35f17\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" Jul 14 18:58:49.605007 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.604989 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gszgz\" (UniqueName: \"kubernetes.io/projected/71600064-e629-44f7-aa12-ed0fb6e35f17-kube-api-access-gszgz\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-wmvlg\" (UID: \"71600064-e629-44f7-aa12-ed0fb6e35f17\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" Jul 14 18:58:49.764053 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.764019 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" Jul 14 18:58:49.917990 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:49.917940 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg"] Jul 14 18:58:49.920133 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:58:49.920111 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71600064_e629_44f7_aa12_ed0fb6e35f17.slice/crio-d84d00709ae14293eb3cb6c24fb72b8a941b3fe802b2289995010da9238472fc WatchSource:0}: Error finding container d84d00709ae14293eb3cb6c24fb72b8a941b3fe802b2289995010da9238472fc: Status 404 returned error can't find the container with id d84d00709ae14293eb3cb6c24fb72b8a941b3fe802b2289995010da9238472fc Jul 14 18:58:50.797015 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:50.796932 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" event={"ID":"71600064-e629-44f7-aa12-ed0fb6e35f17","Type":"ContainerStarted","Data":"d84d00709ae14293eb3cb6c24fb72b8a941b3fe802b2289995010da9238472fc"} Jul 14 18:58:53.813532 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:53.813493 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" event={"ID":"71600064-e629-44f7-aa12-ed0fb6e35f17","Type":"ContainerStarted","Data":"234c6c733224b045728f5f5110cc5e592f40a5dff9d4dcfe362ef831a5cf58f5"} Jul 14 18:58:54.818927 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:54.818890 2563 generic.go:356] "Generic (PLEG): container finished" podID="71600064-e629-44f7-aa12-ed0fb6e35f17" containerID="234c6c733224b045728f5f5110cc5e592f40a5dff9d4dcfe362ef831a5cf58f5" exitCode=0 Jul 14 18:58:54.819298 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:54.818934 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" event={"ID":"71600064-e629-44f7-aa12-ed0fb6e35f17","Type":"ContainerDied","Data":"234c6c733224b045728f5f5110cc5e592f40a5dff9d4dcfe362ef831a5cf58f5"} Jul 14 18:58:56.829960 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:56.829868 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" event={"ID":"71600064-e629-44f7-aa12-ed0fb6e35f17","Type":"ContainerStarted","Data":"90acd369ebe9eef08df86bd78929cb0f4eb0b0b13851c09fb17ab27aacf5b44d"} Jul 14 18:58:56.829960 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:56.829953 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" Jul 14 18:58:56.854807 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:58:56.854751 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" podStartSLOduration=2.665815871 podStartE2EDuration="7.854732984s" totalImagesPullingTime="4.140000558s" totalInitContainerRuntime="1.048916555s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:58:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:58:56.854154692 +0000 UTC m=+260.853047509" watchObservedRunningTime="2026-07-14 18:58:56.854732984 +0000 UTC m=+260.853625805" Jul 14 18:59:07.836818 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:07.836789 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-wmvlg" Jul 14 18:59:09.240981 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:09.240942 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c74864f54-ts7rp"] Jul 14 18:59:09.245794 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:09.245766 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c74864f54-ts7rp" Jul 14 18:59:09.251853 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:09.251826 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 14 18:59:09.251994 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:09.251826 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 14 18:59:09.252069 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:09.251993 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 14 18:59:09.252768 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:09.252289 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rrmr9\"" Jul 14 18:59:09.262770 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:09.262738 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c74864f54-ts7rp"] Jul 14 18:59:09.373827 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:09.373787 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/546f1fee-bcb9-4a51-a22f-dadc7a7643ed-manager-config\") pod \"lws-controller-manager-6c74864f54-ts7rp\" (UID: \"546f1fee-bcb9-4a51-a22f-dadc7a7643ed\") " pod="openshift-lws-operator/lws-controller-manager-6c74864f54-ts7rp" Jul 14 18:59:09.373827 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:09.373833 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h77b\" (UniqueName: \"kubernetes.io/projected/546f1fee-bcb9-4a51-a22f-dadc7a7643ed-kube-api-access-6h77b\") pod \"lws-controller-manager-6c74864f54-ts7rp\" (UID: \"546f1fee-bcb9-4a51-a22f-dadc7a7643ed\") " pod="openshift-lws-operator/lws-controller-manager-6c74864f54-ts7rp" Jul 14 18:59:09.374040 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:09.373858 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/546f1fee-bcb9-4a51-a22f-dadc7a7643ed-cert\") pod \"lws-controller-manager-6c74864f54-ts7rp\" (UID: \"546f1fee-bcb9-4a51-a22f-dadc7a7643ed\") " pod="openshift-lws-operator/lws-controller-manager-6c74864f54-ts7rp" Jul 14 18:59:09.374040 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:09.373982 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/546f1fee-bcb9-4a51-a22f-dadc7a7643ed-metrics-cert\") pod \"lws-controller-manager-6c74864f54-ts7rp\" (UID: \"546f1fee-bcb9-4a51-a22f-dadc7a7643ed\") " pod="openshift-lws-operator/lws-controller-manager-6c74864f54-ts7rp" Jul 14 18:59:09.475250 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:09.475209 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/546f1fee-bcb9-4a51-a22f-dadc7a7643ed-metrics-cert\") pod \"lws-controller-manager-6c74864f54-ts7rp\" (UID: \"546f1fee-bcb9-4a51-a22f-dadc7a7643ed\") " pod="openshift-lws-operator/lws-controller-manager-6c74864f54-ts7rp" Jul 14 18:59:09.475455 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:09.475274 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/546f1fee-bcb9-4a51-a22f-dadc7a7643ed-manager-config\") pod \"lws-controller-manager-6c74864f54-ts7rp\" (UID: \"546f1fee-bcb9-4a51-a22f-dadc7a7643ed\") " pod="openshift-lws-operator/lws-controller-manager-6c74864f54-ts7rp" Jul 14 18:59:09.475455 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:09.475312 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h77b\" (UniqueName: \"kubernetes.io/projected/546f1fee-bcb9-4a51-a22f-dadc7a7643ed-kube-api-access-6h77b\") pod \"lws-controller-manager-6c74864f54-ts7rp\" (UID: \"546f1fee-bcb9-4a51-a22f-dadc7a7643ed\") " pod="openshift-lws-operator/lws-controller-manager-6c74864f54-ts7rp" Jul 14 18:59:09.475455 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:09.475346 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/546f1fee-bcb9-4a51-a22f-dadc7a7643ed-cert\") pod \"lws-controller-manager-6c74864f54-ts7rp\" (UID: \"546f1fee-bcb9-4a51-a22f-dadc7a7643ed\") " pod="openshift-lws-operator/lws-controller-manager-6c74864f54-ts7rp" Jul 14 18:59:09.475961 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:09.475941 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/546f1fee-bcb9-4a51-a22f-dadc7a7643ed-manager-config\") pod \"lws-controller-manager-6c74864f54-ts7rp\" (UID: \"546f1fee-bcb9-4a51-a22f-dadc7a7643ed\") " pod="openshift-lws-operator/lws-controller-manager-6c74864f54-ts7rp" Jul 14 18:59:09.477896 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:09.477875 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/546f1fee-bcb9-4a51-a22f-dadc7a7643ed-cert\") pod \"lws-controller-manager-6c74864f54-ts7rp\" (UID: \"546f1fee-bcb9-4a51-a22f-dadc7a7643ed\") " pod="openshift-lws-operator/lws-controller-manager-6c74864f54-ts7rp" Jul 14 18:59:09.477965 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:09.477924 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/546f1fee-bcb9-4a51-a22f-dadc7a7643ed-metrics-cert\") pod \"lws-controller-manager-6c74864f54-ts7rp\" (UID: \"546f1fee-bcb9-4a51-a22f-dadc7a7643ed\") " pod="openshift-lws-operator/lws-controller-manager-6c74864f54-ts7rp" Jul 14 18:59:09.495059 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:09.495032 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h77b\" (UniqueName: \"kubernetes.io/projected/546f1fee-bcb9-4a51-a22f-dadc7a7643ed-kube-api-access-6h77b\") pod \"lws-controller-manager-6c74864f54-ts7rp\" (UID: \"546f1fee-bcb9-4a51-a22f-dadc7a7643ed\") " pod="openshift-lws-operator/lws-controller-manager-6c74864f54-ts7rp" Jul 14 18:59:09.556015 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:09.555983 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c74864f54-ts7rp" Jul 14 18:59:09.710203 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:09.710053 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c74864f54-ts7rp"] Jul 14 18:59:09.712427 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:59:09.712402 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod546f1fee_bcb9_4a51_a22f_dadc7a7643ed.slice/crio-6bae24f4aff4a36c5cd227110213306ba54940e87d9a53a607d03c11a8e8d8bc WatchSource:0}: Error finding container 6bae24f4aff4a36c5cd227110213306ba54940e87d9a53a607d03c11a8e8d8bc: Status 404 returned error can't find the container with id 6bae24f4aff4a36c5cd227110213306ba54940e87d9a53a607d03c11a8e8d8bc Jul 14 18:59:09.892174 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:09.892080 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c74864f54-ts7rp" event={"ID":"546f1fee-bcb9-4a51-a22f-dadc7a7643ed","Type":"ContainerStarted","Data":"6bae24f4aff4a36c5cd227110213306ba54940e87d9a53a607d03c11a8e8d8bc"} Jul 14 18:59:10.800423 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:10.800381 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xccs4"] Jul 14 18:59:10.802950 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:10.802929 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xccs4" Jul 14 18:59:10.806607 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:10.806569 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2vsbg\"" Jul 14 18:59:10.806844 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:10.806820 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 14 18:59:10.814349 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:10.814318 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xccs4"] Jul 14 18:59:10.887819 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:10.887786 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5aaa1b4-de21-4e45-a3fc-cbf45e4166b1-cert\") pod \"odh-model-controller-7998c67dc4-xccs4\" (UID: \"c5aaa1b4-de21-4e45-a3fc-cbf45e4166b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-xccs4" Jul 14 18:59:10.888009 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:10.887844 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9whr\" (UniqueName: \"kubernetes.io/projected/c5aaa1b4-de21-4e45-a3fc-cbf45e4166b1-kube-api-access-f9whr\") pod \"odh-model-controller-7998c67dc4-xccs4\" (UID: \"c5aaa1b4-de21-4e45-a3fc-cbf45e4166b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-xccs4" Jul 14 18:59:10.989093 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:10.989058 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5aaa1b4-de21-4e45-a3fc-cbf45e4166b1-cert\") pod \"odh-model-controller-7998c67dc4-xccs4\" (UID: \"c5aaa1b4-de21-4e45-a3fc-cbf45e4166b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-xccs4" Jul 14 18:59:10.989289 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:10.989123 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9whr\" (UniqueName: \"kubernetes.io/projected/c5aaa1b4-de21-4e45-a3fc-cbf45e4166b1-kube-api-access-f9whr\") pod \"odh-model-controller-7998c67dc4-xccs4\" (UID: \"c5aaa1b4-de21-4e45-a3fc-cbf45e4166b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-xccs4" Jul 14 18:59:10.989289 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:59:10.989251 2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 14 18:59:10.989425 ip-10-0-143-130 kubenswrapper[2563]: E0714 18:59:10.989338 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5aaa1b4-de21-4e45-a3fc-cbf45e4166b1-cert podName:c5aaa1b4-de21-4e45-a3fc-cbf45e4166b1 nodeName:}" failed. No retries permitted until 2026-07-14 18:59:11.489319917 +0000 UTC m=+275.488212730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c5aaa1b4-de21-4e45-a3fc-cbf45e4166b1-cert") pod "odh-model-controller-7998c67dc4-xccs4" (UID: "c5aaa1b4-de21-4e45-a3fc-cbf45e4166b1") : secret "odh-model-controller-webhook-cert" not found Jul 14 18:59:11.003190 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:11.003154 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9whr\" (UniqueName: \"kubernetes.io/projected/c5aaa1b4-de21-4e45-a3fc-cbf45e4166b1-kube-api-access-f9whr\") pod \"odh-model-controller-7998c67dc4-xccs4\" (UID: \"c5aaa1b4-de21-4e45-a3fc-cbf45e4166b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-xccs4" Jul 14 18:59:11.493521 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:11.493479 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5aaa1b4-de21-4e45-a3fc-cbf45e4166b1-cert\") pod \"odh-model-controller-7998c67dc4-xccs4\" (UID: \"c5aaa1b4-de21-4e45-a3fc-cbf45e4166b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-xccs4" Jul 14 18:59:11.496035 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:11.496004 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5aaa1b4-de21-4e45-a3fc-cbf45e4166b1-cert\") pod \"odh-model-controller-7998c67dc4-xccs4\" (UID: \"c5aaa1b4-de21-4e45-a3fc-cbf45e4166b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-xccs4" Jul 14 18:59:11.717198 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:11.717165 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xccs4" Jul 14 18:59:11.889850 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:11.889822 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xccs4"] Jul 14 18:59:11.891729 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:59:11.891699 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5aaa1b4_de21_4e45_a3fc_cbf45e4166b1.slice/crio-7b0e3060b873ca0a16322806999b5cc2f3f26c5650d4d91535ecb7cbeade0332 WatchSource:0}: Error finding container 7b0e3060b873ca0a16322806999b5cc2f3f26c5650d4d91535ecb7cbeade0332: Status 404 returned error can't find the container with id 7b0e3060b873ca0a16322806999b5cc2f3f26c5650d4d91535ecb7cbeade0332 Jul 14 18:59:11.904222 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:11.904188 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c74864f54-ts7rp" event={"ID":"546f1fee-bcb9-4a51-a22f-dadc7a7643ed","Type":"ContainerStarted","Data":"73847fbe4c61be049bdb5788ad3ae6dd2ba1efe2bd620f44fd1cafffe6394a80"} Jul 14 18:59:11.904340 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:11.904265 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6c74864f54-ts7rp" Jul 14 18:59:11.905460 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:11.905437 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xccs4" event={"ID":"c5aaa1b4-de21-4e45-a3fc-cbf45e4166b1","Type":"ContainerStarted","Data":"7b0e3060b873ca0a16322806999b5cc2f3f26c5650d4d91535ecb7cbeade0332"} Jul 14 18:59:11.971006 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:11.970964 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6c74864f54-ts7rp" podStartSLOduration=1.783054617 podStartE2EDuration="2.970949522s" totalImagesPullingTime="1.187894905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:59:11.969894023 +0000 UTC m=+275.968786844" watchObservedRunningTime="2026-07-14 18:59:11.970949522 +0000 UTC m=+275.969842339" Jul 14 18:59:15.926983 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:15.926945 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xccs4" event={"ID":"c5aaa1b4-de21-4e45-a3fc-cbf45e4166b1","Type":"ContainerStarted","Data":"766f76349dbc03442fb1cbfa3cdf480aff2ef96aba3e425567e2b19dec5b43da"} Jul 14 18:59:15.927408 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:15.927100 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-xccs4" Jul 14 18:59:15.949278 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:15.949223 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-xccs4" podStartSLOduration=2.787122022 podStartE2EDuration="5.949206436s" totalImagesPullingTime="3.162084414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:59:15.947579613 +0000 UTC m=+279.946472425" watchObservedRunningTime="2026-07-14 18:59:15.949206436 +0000 UTC m=+279.948099273" Jul 14 18:59:18.523557 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.523512 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b"] Jul 14 18:59:18.526847 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.526825 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.530818 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.530791 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 14 18:59:18.531095 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.531079 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hbvkw\"" Jul 14 18:59:18.531243 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.531227 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 18:59:18.531283 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.531255 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 18:59:18.549796 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.549765 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b"] Jul 14 18:59:18.655076 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.655038 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73a2f49a-4e05-4516-bd50-3c76af3261a3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.655255 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.655093 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4sj5\" (UniqueName: \"kubernetes.io/projected/73a2f49a-4e05-4516-bd50-3c76af3261a3-kube-api-access-k4sj5\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.655255 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.655173 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73a2f49a-4e05-4516-bd50-3c76af3261a3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.655255 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.655200 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73a2f49a-4e05-4516-bd50-3c76af3261a3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.655255 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.655229 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73a2f49a-4e05-4516-bd50-3c76af3261a3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.655421 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.655262 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73a2f49a-4e05-4516-bd50-3c76af3261a3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.655421 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.655294 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73a2f49a-4e05-4516-bd50-3c76af3261a3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.655421 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.655309 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73a2f49a-4e05-4516-bd50-3c76af3261a3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.655421 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.655354 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73a2f49a-4e05-4516-bd50-3c76af3261a3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.756213 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.756179 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73a2f49a-4e05-4516-bd50-3c76af3261a3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.756374 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.756217 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73a2f49a-4e05-4516-bd50-3c76af3261a3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.756374 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.756261 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4sj5\" (UniqueName: \"kubernetes.io/projected/73a2f49a-4e05-4516-bd50-3c76af3261a3-kube-api-access-k4sj5\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.756374 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.756297 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73a2f49a-4e05-4516-bd50-3c76af3261a3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.756374 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.756315 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73a2f49a-4e05-4516-bd50-3c76af3261a3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.756374 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.756341 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73a2f49a-4e05-4516-bd50-3c76af3261a3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.756737 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.756705 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73a2f49a-4e05-4516-bd50-3c76af3261a3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.756855 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.756771 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73a2f49a-4e05-4516-bd50-3c76af3261a3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.756855 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.756777 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73a2f49a-4e05-4516-bd50-3c76af3261a3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.756855 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.756838 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73a2f49a-4e05-4516-bd50-3c76af3261a3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.756855 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.756846 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73a2f49a-4e05-4516-bd50-3c76af3261a3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.757000 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.756933 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73a2f49a-4e05-4516-bd50-3c76af3261a3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.757000 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.756965 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73a2f49a-4e05-4516-bd50-3c76af3261a3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.757074 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.757052 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73a2f49a-4e05-4516-bd50-3c76af3261a3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.758965 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.758941 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73a2f49a-4e05-4516-bd50-3c76af3261a3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.759060 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.758978 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73a2f49a-4e05-4516-bd50-3c76af3261a3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.777509 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.777447 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73a2f49a-4e05-4516-bd50-3c76af3261a3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.778124 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.778107 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4sj5\" (UniqueName: \"kubernetes.io/projected/73a2f49a-4e05-4516-bd50-3c76af3261a3-kube-api-access-k4sj5\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bgd5b\" (UID: \"73a2f49a-4e05-4516-bd50-3c76af3261a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.837956 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.837924 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:18.987240 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:18.987219 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b"] Jul 14 18:59:18.989033 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:59:18.989010 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73a2f49a_4e05_4516_bd50_3c76af3261a3.slice/crio-04e88cab8c0d9977f670a3849bc7a469b881f75dfe02e3f14a08e3ca6cfe6a65 WatchSource:0}: Error finding container 04e88cab8c0d9977f670a3849bc7a469b881f75dfe02e3f14a08e3ca6cfe6a65: Status 404 returned error can't find the container with id 04e88cab8c0d9977f670a3849bc7a469b881f75dfe02e3f14a08e3ca6cfe6a65 Jul 14 18:59:19.240438 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.240348 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf"] Jul 14 18:59:19.245627 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.244877 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.248723 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.248683 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 14 18:59:19.248723 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.248701 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 14 18:59:19.248895 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.248698 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 14 18:59:19.249256 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.249231 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qx2j6\"" Jul 14 18:59:19.260484 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.260450 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf"] Jul 14 18:59:19.362723 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.362686 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4225f40-5dba-44af-893f-d2ae520a30e7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-9vwdf\" (UID: \"f4225f40-5dba-44af-893f-d2ae520a30e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.362875 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.362727 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f4225f40-5dba-44af-893f-d2ae520a30e7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-9vwdf\" (UID: \"f4225f40-5dba-44af-893f-d2ae520a30e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.362875 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.362825 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw6bp\" (UniqueName: \"kubernetes.io/projected/f4225f40-5dba-44af-893f-d2ae520a30e7-kube-api-access-vw6bp\") pod \"istiod-openshift-gateway-94bb8fbfd-9vwdf\" (UID: \"f4225f40-5dba-44af-893f-d2ae520a30e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.362973 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.362885 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f4225f40-5dba-44af-893f-d2ae520a30e7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-9vwdf\" (UID: \"f4225f40-5dba-44af-893f-d2ae520a30e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.362973 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.362929 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f4225f40-5dba-44af-893f-d2ae520a30e7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-9vwdf\" (UID: \"f4225f40-5dba-44af-893f-d2ae520a30e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.362973 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.362954 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4225f40-5dba-44af-893f-d2ae520a30e7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-9vwdf\" (UID: \"f4225f40-5dba-44af-893f-d2ae520a30e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.363084 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.363025 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f4225f40-5dba-44af-893f-d2ae520a30e7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-9vwdf\" (UID: \"f4225f40-5dba-44af-893f-d2ae520a30e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.463732 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.463693 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw6bp\" (UniqueName: \"kubernetes.io/projected/f4225f40-5dba-44af-893f-d2ae520a30e7-kube-api-access-vw6bp\") pod \"istiod-openshift-gateway-94bb8fbfd-9vwdf\" (UID: \"f4225f40-5dba-44af-893f-d2ae520a30e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.463732 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.463738 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f4225f40-5dba-44af-893f-d2ae520a30e7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-9vwdf\" (UID: \"f4225f40-5dba-44af-893f-d2ae520a30e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.464015 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.463767 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f4225f40-5dba-44af-893f-d2ae520a30e7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-9vwdf\" (UID: \"f4225f40-5dba-44af-893f-d2ae520a30e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.464015 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.463793 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4225f40-5dba-44af-893f-d2ae520a30e7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-9vwdf\" (UID: \"f4225f40-5dba-44af-893f-d2ae520a30e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.464015 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.463842 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f4225f40-5dba-44af-893f-d2ae520a30e7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-9vwdf\" (UID: \"f4225f40-5dba-44af-893f-d2ae520a30e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.464015 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.463891 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4225f40-5dba-44af-893f-d2ae520a30e7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-9vwdf\" (UID: \"f4225f40-5dba-44af-893f-d2ae520a30e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.464207 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.464037 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f4225f40-5dba-44af-893f-d2ae520a30e7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-9vwdf\" (UID: \"f4225f40-5dba-44af-893f-d2ae520a30e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.464707 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.464679 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f4225f40-5dba-44af-893f-d2ae520a30e7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-9vwdf\" (UID: \"f4225f40-5dba-44af-893f-d2ae520a30e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.466331 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.466309 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f4225f40-5dba-44af-893f-d2ae520a30e7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-9vwdf\" (UID: \"f4225f40-5dba-44af-893f-d2ae520a30e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.466423 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.466391 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4225f40-5dba-44af-893f-d2ae520a30e7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-9vwdf\" (UID: \"f4225f40-5dba-44af-893f-d2ae520a30e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.466423 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.466402 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f4225f40-5dba-44af-893f-d2ae520a30e7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-9vwdf\" (UID: \"f4225f40-5dba-44af-893f-d2ae520a30e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.466497 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.466432 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f4225f40-5dba-44af-893f-d2ae520a30e7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-9vwdf\" (UID: \"f4225f40-5dba-44af-893f-d2ae520a30e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.485252 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.485219 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw6bp\" (UniqueName: \"kubernetes.io/projected/f4225f40-5dba-44af-893f-d2ae520a30e7-kube-api-access-vw6bp\") pod \"istiod-openshift-gateway-94bb8fbfd-9vwdf\" (UID: \"f4225f40-5dba-44af-893f-d2ae520a30e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.485354 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.485254 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4225f40-5dba-44af-893f-d2ae520a30e7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-9vwdf\" (UID: \"f4225f40-5dba-44af-893f-d2ae520a30e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.556307 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.556270 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:19.709960 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.709937 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf"] Jul 14 18:59:19.712127 ip-10-0-143-130 kubenswrapper[2563]: W0714 18:59:19.712089 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4225f40_5dba_44af_893f_d2ae520a30e7.slice/crio-d6d7080ef0c4481c91bf89c73f8a78f7fa6611f091d414e197b96a9b47025b60 WatchSource:0}: Error finding container d6d7080ef0c4481c91bf89c73f8a78f7fa6611f091d414e197b96a9b47025b60: Status 404 returned error can't find the container with id d6d7080ef0c4481c91bf89c73f8a78f7fa6611f091d414e197b96a9b47025b60 Jul 14 18:59:19.945102 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.945005 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" event={"ID":"73a2f49a-4e05-4516-bd50-3c76af3261a3","Type":"ContainerStarted","Data":"04e88cab8c0d9977f670a3849bc7a469b881f75dfe02e3f14a08e3ca6cfe6a65"} Jul 14 18:59:19.946248 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:19.946225 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" event={"ID":"f4225f40-5dba-44af-893f-d2ae520a30e7","Type":"ContainerStarted","Data":"d6d7080ef0c4481c91bf89c73f8a78f7fa6611f091d414e197b96a9b47025b60"} Jul 14 18:59:22.911394 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:22.911366 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6c74864f54-ts7rp" Jul 14 18:59:22.970460 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:22.970421 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 18:59:22.970546 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:22.970490 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 18:59:22.973712 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:22.973684 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 18:59:22.973792 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:22.973769 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 18:59:22.973830 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:22.973799 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 18:59:23.968877 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:23.968778 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" event={"ID":"73a2f49a-4e05-4516-bd50-3c76af3261a3","Type":"ContainerStarted","Data":"4e531235af0df93ef193bd1492f6ce6876486ab899335a7211e519f6218d77a6"} Jul 14 18:59:23.970239 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:23.970211 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" event={"ID":"f4225f40-5dba-44af-893f-d2ae520a30e7","Type":"ContainerStarted","Data":"133f669dd071c2016c8399ca5eb5a8f15faceba53974480e365d2f9d787f7f37"} Jul 14 18:59:23.970338 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:23.970331 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:23.994078 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:23.994026 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" podStartSLOduration=2.011623539 podStartE2EDuration="5.994011961s" totalImagesPullingTime="3.982388422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:59:23.99128108 +0000 UTC m=+287.990173901" watchObservedRunningTime="2026-07-14 18:59:23.994011961 +0000 UTC m=+287.992904779" Jul 14 18:59:24.014980 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:24.014927 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" podStartSLOduration=1.7590210179999999 podStartE2EDuration="5.014911353s" totalImagesPullingTime="3.255890335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:59:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:59:24.013181251 +0000 UTC m=+288.012074102" watchObservedRunningTime="2026-07-14 18:59:24.014911353 +0000 UTC m=+288.013804171" Jul 14 18:59:24.838512 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:24.838476 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:24.843569 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:24.843543 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:24.975113 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:24.975082 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:24.976142 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:24.976114 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bgd5b" Jul 14 18:59:24.976995 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:24.976974 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vwdf" Jul 14 18:59:26.933913 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:26.933884 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-xccs4" Jul 14 18:59:36.401903 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:36.401870 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trrs2_a5633a96-04d9-465c-ae2c-2b5d013f4381/ovn-acl-logging/0.log" Jul 14 18:59:36.402722 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:36.402700 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trrs2_a5633a96-04d9-465c-ae2c-2b5d013f4381/ovn-acl-logging/0.log" Jul 14 18:59:36.409982 ip-10-0-143-130 kubenswrapper[2563]: I0714 18:59:36.409959 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 19:00:26.933173 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:26.933090 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb"] Jul 14 19:00:26.936371 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:26.936354 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb" Jul 14 19:00:26.939375 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:26.939354 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 19:00:26.940494 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:26.940477 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 19:00:26.940571 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:26.940495 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zqq6j\"" Jul 14 19:00:26.946083 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:26.946060 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb"] Jul 14 19:00:27.044967 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.044921 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gwg8\" (UniqueName: \"kubernetes.io/projected/686beb3b-362c-40f0-b08a-502cb233b9dc-kube-api-access-8gwg8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb\" (UID: \"686beb3b-362c-40f0-b08a-502cb233b9dc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb" Jul 14 19:00:27.045136 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.044999 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/686beb3b-362c-40f0-b08a-502cb233b9dc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb\" (UID: \"686beb3b-362c-40f0-b08a-502cb233b9dc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb" Jul 14 19:00:27.045136 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.045063 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/686beb3b-362c-40f0-b08a-502cb233b9dc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb\" (UID: \"686beb3b-362c-40f0-b08a-502cb233b9dc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb" Jul 14 19:00:27.145769 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.145739 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/686beb3b-362c-40f0-b08a-502cb233b9dc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb\" (UID: \"686beb3b-362c-40f0-b08a-502cb233b9dc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb" Jul 14 19:00:27.145769 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.145778 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gwg8\" (UniqueName: \"kubernetes.io/projected/686beb3b-362c-40f0-b08a-502cb233b9dc-kube-api-access-8gwg8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb\" (UID: \"686beb3b-362c-40f0-b08a-502cb233b9dc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb" Jul 14 19:00:27.145973 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.145824 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/686beb3b-362c-40f0-b08a-502cb233b9dc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb\" (UID: \"686beb3b-362c-40f0-b08a-502cb233b9dc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb" Jul 14 19:00:27.146128 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.146110 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/686beb3b-362c-40f0-b08a-502cb233b9dc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb\" (UID: \"686beb3b-362c-40f0-b08a-502cb233b9dc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb" Jul 14 19:00:27.146185 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.146165 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/686beb3b-362c-40f0-b08a-502cb233b9dc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb\" (UID: \"686beb3b-362c-40f0-b08a-502cb233b9dc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb" Jul 14 19:00:27.155760 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.155742 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gwg8\" (UniqueName: \"kubernetes.io/projected/686beb3b-362c-40f0-b08a-502cb233b9dc-kube-api-access-8gwg8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb\" (UID: \"686beb3b-362c-40f0-b08a-502cb233b9dc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb" Jul 14 19:00:27.245686 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.245658 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb" Jul 14 19:00:27.389570 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.389535 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb"] Jul 14 19:00:27.528231 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.528191 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl"] Jul 14 19:00:27.531501 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.531483 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl" Jul 14 19:00:27.546917 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.546892 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl"] Jul 14 19:00:27.651020 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.650981 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2d30913-8226-4ff9-9044-15d2b7408bb9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl\" (UID: \"f2d30913-8226-4ff9-9044-15d2b7408bb9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl" Jul 14 19:00:27.651205 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.651030 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvfr7\" (UniqueName: \"kubernetes.io/projected/f2d30913-8226-4ff9-9044-15d2b7408bb9-kube-api-access-qvfr7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl\" (UID: \"f2d30913-8226-4ff9-9044-15d2b7408bb9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl" Jul 14 19:00:27.651205 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.651113 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2d30913-8226-4ff9-9044-15d2b7408bb9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl\" (UID: \"f2d30913-8226-4ff9-9044-15d2b7408bb9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl" Jul 14 19:00:27.752488 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.752387 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2d30913-8226-4ff9-9044-15d2b7408bb9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl\" (UID: \"f2d30913-8226-4ff9-9044-15d2b7408bb9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl" Jul 14 19:00:27.752488 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.752442 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvfr7\" (UniqueName: \"kubernetes.io/projected/f2d30913-8226-4ff9-9044-15d2b7408bb9-kube-api-access-qvfr7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl\" (UID: \"f2d30913-8226-4ff9-9044-15d2b7408bb9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl" Jul 14 19:00:27.752736 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.752494 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2d30913-8226-4ff9-9044-15d2b7408bb9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl\" (UID: \"f2d30913-8226-4ff9-9044-15d2b7408bb9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl" Jul 14 19:00:27.752855 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.752834 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2d30913-8226-4ff9-9044-15d2b7408bb9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl\" (UID: \"f2d30913-8226-4ff9-9044-15d2b7408bb9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl" Jul 14 19:00:27.752912 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.752891 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2d30913-8226-4ff9-9044-15d2b7408bb9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl\" (UID: \"f2d30913-8226-4ff9-9044-15d2b7408bb9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl" Jul 14 19:00:27.762765 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.762737 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvfr7\" (UniqueName: \"kubernetes.io/projected/f2d30913-8226-4ff9-9044-15d2b7408bb9-kube-api-access-qvfr7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl\" (UID: \"f2d30913-8226-4ff9-9044-15d2b7408bb9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl" Jul 14 19:00:27.853771 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.853732 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl" Jul 14 19:00:27.940676 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.940640 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx"] Jul 14 19:00:27.945161 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.945135 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx" Jul 14 19:00:27.956246 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.956217 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx"] Jul 14 19:00:27.997447 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:27.997419 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl"] Jul 14 19:00:27.999209 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:00:27.999175 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d30913_8226_4ff9_9044_15d2b7408bb9.slice/crio-19fa69738e80202ea9fdfd2637ed5a476d162bce19e83cc539995b2756dcc1cb WatchSource:0}: Error finding container 19fa69738e80202ea9fdfd2637ed5a476d162bce19e83cc539995b2756dcc1cb: Status 404 returned error can't find the container with id 19fa69738e80202ea9fdfd2637ed5a476d162bce19e83cc539995b2756dcc1cb Jul 14 19:00:28.055310 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.055277 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70ae89fd-7391-44df-87ff-4db05c0a0ff0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx\" (UID: \"70ae89fd-7391-44df-87ff-4db05c0a0ff0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx" Jul 14 19:00:28.055375 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.055325 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtxxm\" (UniqueName: \"kubernetes.io/projected/70ae89fd-7391-44df-87ff-4db05c0a0ff0-kube-api-access-gtxxm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx\" (UID: \"70ae89fd-7391-44df-87ff-4db05c0a0ff0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx" Jul 14 19:00:28.055410 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.055393 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70ae89fd-7391-44df-87ff-4db05c0a0ff0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx\" (UID: \"70ae89fd-7391-44df-87ff-4db05c0a0ff0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx" Jul 14 19:00:28.156698 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.156656 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70ae89fd-7391-44df-87ff-4db05c0a0ff0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx\" (UID: \"70ae89fd-7391-44df-87ff-4db05c0a0ff0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx" Jul 14 19:00:28.156845 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.156776 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70ae89fd-7391-44df-87ff-4db05c0a0ff0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx\" (UID: \"70ae89fd-7391-44df-87ff-4db05c0a0ff0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx" Jul 14 19:00:28.156845 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.156813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtxxm\" (UniqueName: \"kubernetes.io/projected/70ae89fd-7391-44df-87ff-4db05c0a0ff0-kube-api-access-gtxxm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx\" (UID: \"70ae89fd-7391-44df-87ff-4db05c0a0ff0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx" Jul 14 19:00:28.157138 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.157116 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70ae89fd-7391-44df-87ff-4db05c0a0ff0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx\" (UID: \"70ae89fd-7391-44df-87ff-4db05c0a0ff0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx" Jul 14 19:00:28.157184 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.157139 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70ae89fd-7391-44df-87ff-4db05c0a0ff0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx\" (UID: \"70ae89fd-7391-44df-87ff-4db05c0a0ff0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx" Jul 14 19:00:28.167419 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.167390 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtxxm\" (UniqueName: \"kubernetes.io/projected/70ae89fd-7391-44df-87ff-4db05c0a0ff0-kube-api-access-gtxxm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx\" (UID: \"70ae89fd-7391-44df-87ff-4db05c0a0ff0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx" Jul 14 19:00:28.256961 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.256862 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx" Jul 14 19:00:28.283245 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.283214 2563 generic.go:356] "Generic (PLEG): container finished" podID="f2d30913-8226-4ff9-9044-15d2b7408bb9" containerID="8e0cd6853e7c784be06cfec21257c20e2f307097ae28c92be63706e9c5142b22" exitCode=0 Jul 14 19:00:28.283419 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.283312 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl" event={"ID":"f2d30913-8226-4ff9-9044-15d2b7408bb9","Type":"ContainerDied","Data":"8e0cd6853e7c784be06cfec21257c20e2f307097ae28c92be63706e9c5142b22"} Jul 14 19:00:28.283419 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.283375 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl" event={"ID":"f2d30913-8226-4ff9-9044-15d2b7408bb9","Type":"ContainerStarted","Data":"19fa69738e80202ea9fdfd2637ed5a476d162bce19e83cc539995b2756dcc1cb"} Jul 14 19:00:28.283919 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.283899 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 19:00:28.285151 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.285126 2563 generic.go:356] "Generic (PLEG): container finished" podID="686beb3b-362c-40f0-b08a-502cb233b9dc" containerID="3426e319a6c9c58958385d0c7c7b7f97f1c07bb0c66d3e36d67edefa8a944ab8" exitCode=0 Jul 14 19:00:28.285254 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.285194 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb" event={"ID":"686beb3b-362c-40f0-b08a-502cb233b9dc","Type":"ContainerDied","Data":"3426e319a6c9c58958385d0c7c7b7f97f1c07bb0c66d3e36d67edefa8a944ab8"} Jul 14 19:00:28.285254 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.285238 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb" event={"ID":"686beb3b-362c-40f0-b08a-502cb233b9dc","Type":"ContainerStarted","Data":"2bb4a5331cf045cb7072e01a7244285cc812d0c8462aef2b74ae9ce6238e32ef"} Jul 14 19:00:28.403878 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.403839 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx"] Jul 14 19:00:28.404325 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:00:28.404295 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70ae89fd_7391_44df_87ff_4db05c0a0ff0.slice/crio-590564aafa39b3799ea11ba7ea744d2de0ab51dff8ab905a43457cdbb4b634bd WatchSource:0}: Error finding container 590564aafa39b3799ea11ba7ea744d2de0ab51dff8ab905a43457cdbb4b634bd: Status 404 returned error can't find the container with id 590564aafa39b3799ea11ba7ea744d2de0ab51dff8ab905a43457cdbb4b634bd Jul 14 19:00:28.533954 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.533877 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92"] Jul 14 19:00:28.537299 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.537281 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92" Jul 14 19:00:28.548506 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.548476 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92"] Jul 14 19:00:28.661423 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.661381 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c11eb008-2d21-4082-bbe2-a1268a667e2e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92\" (UID: \"c11eb008-2d21-4082-bbe2-a1268a667e2e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92" Jul 14 19:00:28.661644 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.661435 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk5m6\" (UniqueName: \"kubernetes.io/projected/c11eb008-2d21-4082-bbe2-a1268a667e2e-kube-api-access-kk5m6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92\" (UID: \"c11eb008-2d21-4082-bbe2-a1268a667e2e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92" Jul 14 19:00:28.661644 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.661463 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c11eb008-2d21-4082-bbe2-a1268a667e2e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92\" (UID: \"c11eb008-2d21-4082-bbe2-a1268a667e2e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92" Jul 14 19:00:28.762218 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.762180 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c11eb008-2d21-4082-bbe2-a1268a667e2e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92\" (UID: \"c11eb008-2d21-4082-bbe2-a1268a667e2e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92" Jul 14 19:00:28.762429 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.762282 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c11eb008-2d21-4082-bbe2-a1268a667e2e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92\" (UID: \"c11eb008-2d21-4082-bbe2-a1268a667e2e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92" Jul 14 19:00:28.762429 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.762320 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk5m6\" (UniqueName: \"kubernetes.io/projected/c11eb008-2d21-4082-bbe2-a1268a667e2e-kube-api-access-kk5m6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92\" (UID: \"c11eb008-2d21-4082-bbe2-a1268a667e2e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92" Jul 14 19:00:28.762706 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.762680 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c11eb008-2d21-4082-bbe2-a1268a667e2e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92\" (UID: \"c11eb008-2d21-4082-bbe2-a1268a667e2e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92" Jul 14 19:00:28.762791 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.762687 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c11eb008-2d21-4082-bbe2-a1268a667e2e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92\" (UID: \"c11eb008-2d21-4082-bbe2-a1268a667e2e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92" Jul 14 19:00:28.775567 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.775540 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk5m6\" (UniqueName: \"kubernetes.io/projected/c11eb008-2d21-4082-bbe2-a1268a667e2e-kube-api-access-kk5m6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92\" (UID: \"c11eb008-2d21-4082-bbe2-a1268a667e2e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92" Jul 14 19:00:28.868837 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:28.868745 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92" Jul 14 19:00:29.010583 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:29.010554 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92"] Jul 14 19:00:29.011970 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:00:29.011942 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc11eb008_2d21_4082_bbe2_a1268a667e2e.slice/crio-f3bba3de9a6642b5d2d1062d6a5986123d8bb6f0db1c1c2396648c514a392674 WatchSource:0}: Error finding container f3bba3de9a6642b5d2d1062d6a5986123d8bb6f0db1c1c2396648c514a392674: Status 404 returned error can't find the container with id f3bba3de9a6642b5d2d1062d6a5986123d8bb6f0db1c1c2396648c514a392674 Jul 14 19:00:29.294518 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:29.294493 2563 generic.go:356] "Generic (PLEG): container finished" podID="c11eb008-2d21-4082-bbe2-a1268a667e2e" containerID="7e73fe3aece6f2f6d8f4394d86509ec1e0eb8096eb2108eebdf9de3ad84bcf7c" exitCode=0 Jul 14 19:00:29.294655 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:29.294560 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92" event={"ID":"c11eb008-2d21-4082-bbe2-a1268a667e2e","Type":"ContainerDied","Data":"7e73fe3aece6f2f6d8f4394d86509ec1e0eb8096eb2108eebdf9de3ad84bcf7c"} Jul 14 19:00:29.294655 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:29.294623 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92" event={"ID":"c11eb008-2d21-4082-bbe2-a1268a667e2e","Type":"ContainerStarted","Data":"f3bba3de9a6642b5d2d1062d6a5986123d8bb6f0db1c1c2396648c514a392674"} Jul 14 19:00:29.296468 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:29.296438 2563 generic.go:356] "Generic (PLEG): container finished" podID="70ae89fd-7391-44df-87ff-4db05c0a0ff0" containerID="d561c6e0b328ddca01951528b291381b38a42caacd4a6ab7d45df4b628999e73" exitCode=0 Jul 14 19:00:29.296573 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:29.296548 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx" event={"ID":"70ae89fd-7391-44df-87ff-4db05c0a0ff0","Type":"ContainerDied","Data":"d561c6e0b328ddca01951528b291381b38a42caacd4a6ab7d45df4b628999e73"} Jul 14 19:00:29.296732 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:29.296608 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx" event={"ID":"70ae89fd-7391-44df-87ff-4db05c0a0ff0","Type":"ContainerStarted","Data":"590564aafa39b3799ea11ba7ea744d2de0ab51dff8ab905a43457cdbb4b634bd"} Jul 14 19:00:30.303842 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:30.303805 2563 generic.go:356] "Generic (PLEG): container finished" podID="686beb3b-362c-40f0-b08a-502cb233b9dc" containerID="15e8bc31aaa19b539a5ab79364e4e9b5ac5dddc867641af3eee86b420f5f81a9" exitCode=0 Jul 14 19:00:30.304306 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:30.303891 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb" event={"ID":"686beb3b-362c-40f0-b08a-502cb233b9dc","Type":"ContainerDied","Data":"15e8bc31aaa19b539a5ab79364e4e9b5ac5dddc867641af3eee86b420f5f81a9"} Jul 14 19:00:30.305884 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:30.305864 2563 generic.go:356] "Generic (PLEG): container finished" podID="f2d30913-8226-4ff9-9044-15d2b7408bb9" containerID="2aa94e72a6f1012a5cd71d152670294d92f47851da8a5793f1d08cd93144e5a7" exitCode=0 Jul 14 19:00:30.305988 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:30.305891 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl" event={"ID":"f2d30913-8226-4ff9-9044-15d2b7408bb9","Type":"ContainerDied","Data":"2aa94e72a6f1012a5cd71d152670294d92f47851da8a5793f1d08cd93144e5a7"} Jul 14 19:00:31.315993 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:31.315956 2563 generic.go:356] "Generic (PLEG): container finished" podID="f2d30913-8226-4ff9-9044-15d2b7408bb9" containerID="34c3ab96052e8c229b0fbcc7c102919b2f0dc4048b6a9826ab5b130355c2884d" exitCode=0 Jul 14 19:00:31.316483 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:31.316036 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl" event={"ID":"f2d30913-8226-4ff9-9044-15d2b7408bb9","Type":"ContainerDied","Data":"34c3ab96052e8c229b0fbcc7c102919b2f0dc4048b6a9826ab5b130355c2884d"} Jul 14 19:00:31.318146 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:31.318117 2563 generic.go:356] "Generic (PLEG): container finished" podID="686beb3b-362c-40f0-b08a-502cb233b9dc" containerID="73fe2fbb84bc0f4bde11e514c5d78b054dc7738d182ac393e08d8551ee5ffb4a" exitCode=0 Jul 14 19:00:31.318274 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:31.318175 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb" event={"ID":"686beb3b-362c-40f0-b08a-502cb233b9dc","Type":"ContainerDied","Data":"73fe2fbb84bc0f4bde11e514c5d78b054dc7738d182ac393e08d8551ee5ffb4a"} Jul 14 19:00:32.325246 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.325210 2563 generic.go:356] "Generic (PLEG): container finished" podID="c11eb008-2d21-4082-bbe2-a1268a667e2e" containerID="7d88066543ee4d4d44565a0d29f5d4487534d027c8d145eb4fb69613de336fce" exitCode=0 Jul 14 19:00:32.325702 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.325298 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92" event={"ID":"c11eb008-2d21-4082-bbe2-a1268a667e2e","Type":"ContainerDied","Data":"7d88066543ee4d4d44565a0d29f5d4487534d027c8d145eb4fb69613de336fce"} Jul 14 19:00:32.327246 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.327224 2563 generic.go:356] "Generic (PLEG): container finished" podID="70ae89fd-7391-44df-87ff-4db05c0a0ff0" containerID="170a63e6c89b9addfedf834ce36def3284fd1dc9fe558011dec80f3539ec1836" exitCode=0 Jul 14 19:00:32.327358 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.327313 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx" event={"ID":"70ae89fd-7391-44df-87ff-4db05c0a0ff0","Type":"ContainerDied","Data":"170a63e6c89b9addfedf834ce36def3284fd1dc9fe558011dec80f3539ec1836"} Jul 14 19:00:32.485243 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.485141 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb" Jul 14 19:00:32.494051 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.494025 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/686beb3b-362c-40f0-b08a-502cb233b9dc-bundle\") pod \"686beb3b-362c-40f0-b08a-502cb233b9dc\" (UID: \"686beb3b-362c-40f0-b08a-502cb233b9dc\") " Jul 14 19:00:32.494212 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.494091 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/686beb3b-362c-40f0-b08a-502cb233b9dc-util\") pod \"686beb3b-362c-40f0-b08a-502cb233b9dc\" (UID: \"686beb3b-362c-40f0-b08a-502cb233b9dc\") " Jul 14 19:00:32.494212 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.494124 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gwg8\" (UniqueName: \"kubernetes.io/projected/686beb3b-362c-40f0-b08a-502cb233b9dc-kube-api-access-8gwg8\") pod \"686beb3b-362c-40f0-b08a-502cb233b9dc\" (UID: \"686beb3b-362c-40f0-b08a-502cb233b9dc\") " Jul 14 19:00:32.494571 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.494544 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/686beb3b-362c-40f0-b08a-502cb233b9dc-bundle" (OuterVolumeSpecName: "bundle") pod "686beb3b-362c-40f0-b08a-502cb233b9dc" (UID: "686beb3b-362c-40f0-b08a-502cb233b9dc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:00:32.497374 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.497016 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/686beb3b-362c-40f0-b08a-502cb233b9dc-kube-api-access-8gwg8" (OuterVolumeSpecName: "kube-api-access-8gwg8") pod "686beb3b-362c-40f0-b08a-502cb233b9dc" (UID: "686beb3b-362c-40f0-b08a-502cb233b9dc"). InnerVolumeSpecName "kube-api-access-8gwg8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:00:32.500956 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.500917 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/686beb3b-362c-40f0-b08a-502cb233b9dc-util" (OuterVolumeSpecName: "util") pod "686beb3b-362c-40f0-b08a-502cb233b9dc" (UID: "686beb3b-362c-40f0-b08a-502cb233b9dc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:00:32.595827 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.595734 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/686beb3b-362c-40f0-b08a-502cb233b9dc-bundle\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:00:32.595827 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.595768 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/686beb3b-362c-40f0-b08a-502cb233b9dc-util\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:00:32.595827 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.595778 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gwg8\" (UniqueName: \"kubernetes.io/projected/686beb3b-362c-40f0-b08a-502cb233b9dc-kube-api-access-8gwg8\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:00:32.622275 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.622250 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl" Jul 14 19:00:32.696702 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.696668 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2d30913-8226-4ff9-9044-15d2b7408bb9-bundle\") pod \"f2d30913-8226-4ff9-9044-15d2b7408bb9\" (UID: \"f2d30913-8226-4ff9-9044-15d2b7408bb9\") " Jul 14 19:00:32.696702 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.696708 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvfr7\" (UniqueName: \"kubernetes.io/projected/f2d30913-8226-4ff9-9044-15d2b7408bb9-kube-api-access-qvfr7\") pod \"f2d30913-8226-4ff9-9044-15d2b7408bb9\" (UID: \"f2d30913-8226-4ff9-9044-15d2b7408bb9\") " Jul 14 19:00:32.696904 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.696729 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2d30913-8226-4ff9-9044-15d2b7408bb9-util\") pod \"f2d30913-8226-4ff9-9044-15d2b7408bb9\" (UID: \"f2d30913-8226-4ff9-9044-15d2b7408bb9\") " Jul 14 19:00:32.697166 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.697132 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2d30913-8226-4ff9-9044-15d2b7408bb9-bundle" (OuterVolumeSpecName: "bundle") pod "f2d30913-8226-4ff9-9044-15d2b7408bb9" (UID: "f2d30913-8226-4ff9-9044-15d2b7408bb9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:00:32.698978 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.698952 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2d30913-8226-4ff9-9044-15d2b7408bb9-kube-api-access-qvfr7" (OuterVolumeSpecName: "kube-api-access-qvfr7") pod "f2d30913-8226-4ff9-9044-15d2b7408bb9" (UID: "f2d30913-8226-4ff9-9044-15d2b7408bb9"). InnerVolumeSpecName "kube-api-access-qvfr7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:00:32.702617 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.702565 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2d30913-8226-4ff9-9044-15d2b7408bb9-util" (OuterVolumeSpecName: "util") pod "f2d30913-8226-4ff9-9044-15d2b7408bb9" (UID: "f2d30913-8226-4ff9-9044-15d2b7408bb9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:00:32.797936 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.797900 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2d30913-8226-4ff9-9044-15d2b7408bb9-bundle\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:00:32.797936 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.797929 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvfr7\" (UniqueName: \"kubernetes.io/projected/f2d30913-8226-4ff9-9044-15d2b7408bb9-kube-api-access-qvfr7\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:00:32.797936 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:32.797939 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2d30913-8226-4ff9-9044-15d2b7408bb9-util\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:00:33.334695 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:33.334658 2563 generic.go:356] "Generic (PLEG): container finished" podID="c11eb008-2d21-4082-bbe2-a1268a667e2e" containerID="312ca21a4212daa7cb0bd25ca3eb1750bcee9bd47cf295f8a578c2923ebd1dff" exitCode=0 Jul 14 19:00:33.335076 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:33.334735 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92" event={"ID":"c11eb008-2d21-4082-bbe2-a1268a667e2e","Type":"ContainerDied","Data":"312ca21a4212daa7cb0bd25ca3eb1750bcee9bd47cf295f8a578c2923ebd1dff"} Jul 14 19:00:33.336827 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:33.336802 2563 generic.go:356] "Generic (PLEG): container finished" podID="70ae89fd-7391-44df-87ff-4db05c0a0ff0" containerID="18fc7d0f2df1621db333fdc90fa28dc11d5c305147828a7a42e80eec7d387af3" exitCode=0 Jul 14 19:00:33.336929 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:33.336876 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx" event={"ID":"70ae89fd-7391-44df-87ff-4db05c0a0ff0","Type":"ContainerDied","Data":"18fc7d0f2df1621db333fdc90fa28dc11d5c305147828a7a42e80eec7d387af3"} Jul 14 19:00:33.338628 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:33.338612 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb" Jul 14 19:00:33.338628 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:33.338620 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb" event={"ID":"686beb3b-362c-40f0-b08a-502cb233b9dc","Type":"ContainerDied","Data":"2bb4a5331cf045cb7072e01a7244285cc812d0c8462aef2b74ae9ce6238e32ef"} Jul 14 19:00:33.338743 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:33.338651 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bb4a5331cf045cb7072e01a7244285cc812d0c8462aef2b74ae9ce6238e32ef" Jul 14 19:00:33.340611 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:33.340556 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl" event={"ID":"f2d30913-8226-4ff9-9044-15d2b7408bb9","Type":"ContainerDied","Data":"19fa69738e80202ea9fdfd2637ed5a476d162bce19e83cc539995b2756dcc1cb"} Jul 14 19:00:33.340726 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:33.340618 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19fa69738e80202ea9fdfd2637ed5a476d162bce19e83cc539995b2756dcc1cb" Jul 14 19:00:33.340726 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:33.340633 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl" Jul 14 19:00:34.511960 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:34.511935 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92" Jul 14 19:00:34.520860 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:34.520838 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx" Jul 14 19:00:34.612547 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:34.612477 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtxxm\" (UniqueName: \"kubernetes.io/projected/70ae89fd-7391-44df-87ff-4db05c0a0ff0-kube-api-access-gtxxm\") pod \"70ae89fd-7391-44df-87ff-4db05c0a0ff0\" (UID: \"70ae89fd-7391-44df-87ff-4db05c0a0ff0\") " Jul 14 19:00:34.612547 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:34.612512 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70ae89fd-7391-44df-87ff-4db05c0a0ff0-util\") pod \"70ae89fd-7391-44df-87ff-4db05c0a0ff0\" (UID: \"70ae89fd-7391-44df-87ff-4db05c0a0ff0\") " Jul 14 19:00:34.612547 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:34.612529 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c11eb008-2d21-4082-bbe2-a1268a667e2e-bundle\") pod \"c11eb008-2d21-4082-bbe2-a1268a667e2e\" (UID: \"c11eb008-2d21-4082-bbe2-a1268a667e2e\") " Jul 14 19:00:34.612920 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:34.612561 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70ae89fd-7391-44df-87ff-4db05c0a0ff0-bundle\") pod \"70ae89fd-7391-44df-87ff-4db05c0a0ff0\" (UID: \"70ae89fd-7391-44df-87ff-4db05c0a0ff0\") " Jul 14 19:00:34.612920 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:34.612620 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c11eb008-2d21-4082-bbe2-a1268a667e2e-util\") pod \"c11eb008-2d21-4082-bbe2-a1268a667e2e\" (UID: \"c11eb008-2d21-4082-bbe2-a1268a667e2e\") " Jul 14 19:00:34.612920 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:34.612670 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk5m6\" (UniqueName: \"kubernetes.io/projected/c11eb008-2d21-4082-bbe2-a1268a667e2e-kube-api-access-kk5m6\") pod \"c11eb008-2d21-4082-bbe2-a1268a667e2e\" (UID: \"c11eb008-2d21-4082-bbe2-a1268a667e2e\") " Jul 14 19:00:34.613282 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:34.613167 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c11eb008-2d21-4082-bbe2-a1268a667e2e-bundle" (OuterVolumeSpecName: "bundle") pod "c11eb008-2d21-4082-bbe2-a1268a667e2e" (UID: "c11eb008-2d21-4082-bbe2-a1268a667e2e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:00:34.613421 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:34.613357 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70ae89fd-7391-44df-87ff-4db05c0a0ff0-bundle" (OuterVolumeSpecName: "bundle") pod "70ae89fd-7391-44df-87ff-4db05c0a0ff0" (UID: "70ae89fd-7391-44df-87ff-4db05c0a0ff0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:00:34.615037 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:34.615008 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c11eb008-2d21-4082-bbe2-a1268a667e2e-kube-api-access-kk5m6" (OuterVolumeSpecName: "kube-api-access-kk5m6") pod "c11eb008-2d21-4082-bbe2-a1268a667e2e" (UID: "c11eb008-2d21-4082-bbe2-a1268a667e2e"). InnerVolumeSpecName "kube-api-access-kk5m6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:00:34.615144 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:34.615094 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70ae89fd-7391-44df-87ff-4db05c0a0ff0-kube-api-access-gtxxm" (OuterVolumeSpecName: "kube-api-access-gtxxm") pod "70ae89fd-7391-44df-87ff-4db05c0a0ff0" (UID: "70ae89fd-7391-44df-87ff-4db05c0a0ff0"). InnerVolumeSpecName "kube-api-access-gtxxm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:00:34.617796 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:34.617766 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c11eb008-2d21-4082-bbe2-a1268a667e2e-util" (OuterVolumeSpecName: "util") pod "c11eb008-2d21-4082-bbe2-a1268a667e2e" (UID: "c11eb008-2d21-4082-bbe2-a1268a667e2e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:00:34.618383 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:34.618365 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70ae89fd-7391-44df-87ff-4db05c0a0ff0-util" (OuterVolumeSpecName: "util") pod "70ae89fd-7391-44df-87ff-4db05c0a0ff0" (UID: "70ae89fd-7391-44df-87ff-4db05c0a0ff0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:00:34.713891 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:34.713866 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtxxm\" (UniqueName: \"kubernetes.io/projected/70ae89fd-7391-44df-87ff-4db05c0a0ff0-kube-api-access-gtxxm\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:00:34.713891 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:34.713891 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70ae89fd-7391-44df-87ff-4db05c0a0ff0-util\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:00:34.714066 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:34.713902 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c11eb008-2d21-4082-bbe2-a1268a667e2e-bundle\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:00:34.714066 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:34.713909 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70ae89fd-7391-44df-87ff-4db05c0a0ff0-bundle\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:00:34.714066 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:34.713917 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c11eb008-2d21-4082-bbe2-a1268a667e2e-util\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:00:34.714066 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:34.713924 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk5m6\" (UniqueName: \"kubernetes.io/projected/c11eb008-2d21-4082-bbe2-a1268a667e2e-kube-api-access-kk5m6\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:00:35.352513 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:35.352479 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92" Jul 14 19:00:35.352716 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:35.352474 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92" event={"ID":"c11eb008-2d21-4082-bbe2-a1268a667e2e","Type":"ContainerDied","Data":"f3bba3de9a6642b5d2d1062d6a5986123d8bb6f0db1c1c2396648c514a392674"} Jul 14 19:00:35.352716 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:35.352615 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3bba3de9a6642b5d2d1062d6a5986123d8bb6f0db1c1c2396648c514a392674" Jul 14 19:00:35.354204 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:35.354181 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx" event={"ID":"70ae89fd-7391-44df-87ff-4db05c0a0ff0","Type":"ContainerDied","Data":"590564aafa39b3799ea11ba7ea744d2de0ab51dff8ab905a43457cdbb4b634bd"} Jul 14 19:00:35.354303 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:35.354215 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="590564aafa39b3799ea11ba7ea744d2de0ab51dff8ab905a43457cdbb4b634bd" Jul 14 19:00:35.354303 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:00:35.354213 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx" Jul 14 19:01:53.119474 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119433 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h"] Jul 14 19:01:53.119902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119774 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="686beb3b-362c-40f0-b08a-502cb233b9dc" containerName="pull" Jul 14 19:01:53.119902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119784 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="686beb3b-362c-40f0-b08a-502cb233b9dc" containerName="pull" Jul 14 19:01:53.119902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119794 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70ae89fd-7391-44df-87ff-4db05c0a0ff0" containerName="util" Jul 14 19:01:53.119902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119800 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="70ae89fd-7391-44df-87ff-4db05c0a0ff0" containerName="util" Jul 14 19:01:53.119902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119807 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="686beb3b-362c-40f0-b08a-502cb233b9dc" containerName="extract" Jul 14 19:01:53.119902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119812 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="686beb3b-362c-40f0-b08a-502cb233b9dc" containerName="extract" Jul 14 19:01:53.119902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119818 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="686beb3b-362c-40f0-b08a-502cb233b9dc" containerName="util" Jul 14 19:01:53.119902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119823 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="686beb3b-362c-40f0-b08a-502cb233b9dc" containerName="util" Jul 14 19:01:53.119902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119832 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70ae89fd-7391-44df-87ff-4db05c0a0ff0" containerName="pull" Jul 14 19:01:53.119902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119837 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="70ae89fd-7391-44df-87ff-4db05c0a0ff0" containerName="pull" Jul 14 19:01:53.119902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119844 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2d30913-8226-4ff9-9044-15d2b7408bb9" containerName="util" Jul 14 19:01:53.119902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119850 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2d30913-8226-4ff9-9044-15d2b7408bb9" containerName="util" Jul 14 19:01:53.119902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119859 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70ae89fd-7391-44df-87ff-4db05c0a0ff0" containerName="extract" Jul 14 19:01:53.119902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119864 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="70ae89fd-7391-44df-87ff-4db05c0a0ff0" containerName="extract" Jul 14 19:01:53.119902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119872 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2d30913-8226-4ff9-9044-15d2b7408bb9" containerName="pull" Jul 14 19:01:53.119902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119877 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2d30913-8226-4ff9-9044-15d2b7408bb9" containerName="pull" Jul 14 19:01:53.119902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119886 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c11eb008-2d21-4082-bbe2-a1268a667e2e" containerName="extract" Jul 14 19:01:53.119902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119891 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c11eb008-2d21-4082-bbe2-a1268a667e2e" containerName="extract" Jul 14 19:01:53.119902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119897 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c11eb008-2d21-4082-bbe2-a1268a667e2e" containerName="pull" Jul 14 19:01:53.119902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119902 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c11eb008-2d21-4082-bbe2-a1268a667e2e" containerName="pull" Jul 14 19:01:53.119902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119910 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2d30913-8226-4ff9-9044-15d2b7408bb9" containerName="extract" Jul 14 19:01:53.119902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119915 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2d30913-8226-4ff9-9044-15d2b7408bb9" containerName="extract" Jul 14 19:01:53.120528 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119922 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c11eb008-2d21-4082-bbe2-a1268a667e2e" containerName="util" Jul 14 19:01:53.120528 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119927 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c11eb008-2d21-4082-bbe2-a1268a667e2e" containerName="util" Jul 14 19:01:53.120528 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119972 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2d30913-8226-4ff9-9044-15d2b7408bb9" containerName="extract" Jul 14 19:01:53.120528 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119978 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c11eb008-2d21-4082-bbe2-a1268a667e2e" containerName="extract" Jul 14 19:01:53.120528 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119986 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="686beb3b-362c-40f0-b08a-502cb233b9dc" containerName="extract" Jul 14 19:01:53.120528 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.119992 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="70ae89fd-7391-44df-87ff-4db05c0a0ff0" containerName="extract" Jul 14 19:01:53.122121 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.122106 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.124925 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.124904 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-cqfdk\"" Jul 14 19:01:53.136235 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.136202 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h"] Jul 14 19:01:53.191472 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.191440 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9058e011-7163-4ab4-b0e4-a1670135459f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.191705 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.191477 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9058e011-7163-4ab4-b0e4-a1670135459f-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.191705 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.191494 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9058e011-7163-4ab4-b0e4-a1670135459f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.191705 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.191557 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9058e011-7163-4ab4-b0e4-a1670135459f-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.191705 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.191639 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9058e011-7163-4ab4-b0e4-a1670135459f-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.191705 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.191693 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9058e011-7163-4ab4-b0e4-a1670135459f-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.191978 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.191757 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9058e011-7163-4ab4-b0e4-a1670135459f-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.191978 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.191845 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9058e011-7163-4ab4-b0e4-a1670135459f-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.191978 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.191880 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs5z5\" (UniqueName: \"kubernetes.io/projected/9058e011-7163-4ab4-b0e4-a1670135459f-kube-api-access-cs5z5\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.292735 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.292693 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9058e011-7163-4ab4-b0e4-a1670135459f-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.292735 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.292740 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9058e011-7163-4ab4-b0e4-a1670135459f-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.292980 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.292787 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9058e011-7163-4ab4-b0e4-a1670135459f-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.292980 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.292811 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs5z5\" (UniqueName: \"kubernetes.io/projected/9058e011-7163-4ab4-b0e4-a1670135459f-kube-api-access-cs5z5\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.292980 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.292837 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9058e011-7163-4ab4-b0e4-a1670135459f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.292980 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.292857 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9058e011-7163-4ab4-b0e4-a1670135459f-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.293174 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.293149 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9058e011-7163-4ab4-b0e4-a1670135459f-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.293228 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.293173 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9058e011-7163-4ab4-b0e4-a1670135459f-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.293278 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.293194 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9058e011-7163-4ab4-b0e4-a1670135459f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.293278 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.293239 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9058e011-7163-4ab4-b0e4-a1670135459f-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.293358 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.293302 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9058e011-7163-4ab4-b0e4-a1670135459f-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.293358 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.293323 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9058e011-7163-4ab4-b0e4-a1670135459f-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.293534 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.293513 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9058e011-7163-4ab4-b0e4-a1670135459f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.293669 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.293642 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9058e011-7163-4ab4-b0e4-a1670135459f-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.295239 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.295217 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9058e011-7163-4ab4-b0e4-a1670135459f-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.295782 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.295765 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9058e011-7163-4ab4-b0e4-a1670135459f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.304069 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.304046 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs5z5\" (UniqueName: \"kubernetes.io/projected/9058e011-7163-4ab4-b0e4-a1670135459f-kube-api-access-cs5z5\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.304749 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.304733 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9058e011-7163-4ab4-b0e4-a1670135459f-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zdm4h\" (UID: \"9058e011-7163-4ab4-b0e4-a1670135459f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.431652 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.431537 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:53.575213 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.575183 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h"] Jul 14 19:01:53.576729 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:01:53.576704 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9058e011_7163_4ab4_b0e4_a1670135459f.slice/crio-d4bb9bb7befbbab46c926fdcd6263d8b9e7b3b3b02cdab02e29243d3231b6eef WatchSource:0}: Error finding container d4bb9bb7befbbab46c926fdcd6263d8b9e7b3b3b02cdab02e29243d3231b6eef: Status 404 returned error can't find the container with id d4bb9bb7befbbab46c926fdcd6263d8b9e7b3b3b02cdab02e29243d3231b6eef Jul 14 19:01:53.578748 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.578708 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:01:53.578850 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.578796 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:01:53.578850 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.578844 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:01:53.741525 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.741432 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" event={"ID":"9058e011-7163-4ab4-b0e4-a1670135459f","Type":"ContainerStarted","Data":"1b48611d69ed6bb8bbd34170feb13fa24cb3ad41ba68d83e047e187625b865e5"} Jul 14 19:01:53.741525 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.741487 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" event={"ID":"9058e011-7163-4ab4-b0e4-a1670135459f","Type":"ContainerStarted","Data":"d4bb9bb7befbbab46c926fdcd6263d8b9e7b3b3b02cdab02e29243d3231b6eef"} Jul 14 19:01:53.770383 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:53.770336 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" podStartSLOduration=0.770317385 podStartE2EDuration="770.317385ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:01:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:01:53.766898349 +0000 UTC m=+437.765791167" watchObservedRunningTime="2026-07-14 19:01:53.770317385 +0000 UTC m=+437.769210202" Jul 14 19:01:54.432478 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:54.432441 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:54.437230 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:54.437205 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:54.747297 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:54.747260 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:01:54.748165 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:01:54.748147 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:02:37.166719 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.166679 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c6fd879cd-xk262"] Jul 14 19:02:37.169317 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.169293 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c6fd879cd-xk262" Jul 14 19:02:37.172356 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.172177 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c8ts2\"" Jul 14 19:02:37.172356 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.172249 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 14 19:02:37.172356 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.172289 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 14 19:02:37.184189 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.184164 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c6fd879cd-xk262"] Jul 14 19:02:37.269513 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.269478 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5215c05-c249-4baa-8ff2-4c6dab4cbc31-webhook-cert\") pod \"maas-controller-c6fd879cd-xk262\" (UID: \"f5215c05-c249-4baa-8ff2-4c6dab4cbc31\") " pod="opendatahub/maas-controller-c6fd879cd-xk262" Jul 14 19:02:37.269731 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.269535 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxs9f\" (UniqueName: \"kubernetes.io/projected/f5215c05-c249-4baa-8ff2-4c6dab4cbc31-kube-api-access-qxs9f\") pod \"maas-controller-c6fd879cd-xk262\" (UID: \"f5215c05-c249-4baa-8ff2-4c6dab4cbc31\") " pod="opendatahub/maas-controller-c6fd879cd-xk262" Jul 14 19:02:37.356055 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.356026 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c46888d8f-tk2dl"] Jul 14 19:02:37.358366 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.358349 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c46888d8f-tk2dl" Jul 14 19:02:37.370470 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.370440 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxs9f\" (UniqueName: \"kubernetes.io/projected/f5215c05-c249-4baa-8ff2-4c6dab4cbc31-kube-api-access-qxs9f\") pod \"maas-controller-c6fd879cd-xk262\" (UID: \"f5215c05-c249-4baa-8ff2-4c6dab4cbc31\") " pod="opendatahub/maas-controller-c6fd879cd-xk262" Jul 14 19:02:37.370621 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.370570 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5215c05-c249-4baa-8ff2-4c6dab4cbc31-webhook-cert\") pod \"maas-controller-c6fd879cd-xk262\" (UID: \"f5215c05-c249-4baa-8ff2-4c6dab4cbc31\") " pod="opendatahub/maas-controller-c6fd879cd-xk262" Jul 14 19:02:37.370721 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:02:37.370704 2563 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 14 19:02:37.370790 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:02:37.370777 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5215c05-c249-4baa-8ff2-4c6dab4cbc31-webhook-cert podName:f5215c05-c249-4baa-8ff2-4c6dab4cbc31 nodeName:}" failed. No retries permitted until 2026-07-14 19:02:37.870757141 +0000 UTC m=+481.869649950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/f5215c05-c249-4baa-8ff2-4c6dab4cbc31-webhook-cert") pod "maas-controller-c6fd879cd-xk262" (UID: "f5215c05-c249-4baa-8ff2-4c6dab4cbc31") : secret "maas-controller-webhook-cert" not found Jul 14 19:02:37.371835 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.371805 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c46888d8f-tk2dl"] Jul 14 19:02:37.383006 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.382981 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxs9f\" (UniqueName: \"kubernetes.io/projected/f5215c05-c249-4baa-8ff2-4c6dab4cbc31-kube-api-access-qxs9f\") pod \"maas-controller-c6fd879cd-xk262\" (UID: \"f5215c05-c249-4baa-8ff2-4c6dab4cbc31\") " pod="opendatahub/maas-controller-c6fd879cd-xk262" Jul 14 19:02:37.471118 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.471021 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/481732d2-f017-4d89-a60d-cb47695928c4-webhook-cert\") pod \"maas-controller-6c46888d8f-tk2dl\" (UID: \"481732d2-f017-4d89-a60d-cb47695928c4\") " pod="opendatahub/maas-controller-6c46888d8f-tk2dl" Jul 14 19:02:37.471118 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.471101 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjz74\" (UniqueName: \"kubernetes.io/projected/481732d2-f017-4d89-a60d-cb47695928c4-kube-api-access-tjz74\") pod \"maas-controller-6c46888d8f-tk2dl\" (UID: \"481732d2-f017-4d89-a60d-cb47695928c4\") " pod="opendatahub/maas-controller-6c46888d8f-tk2dl" Jul 14 19:02:37.571534 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.571504 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/481732d2-f017-4d89-a60d-cb47695928c4-webhook-cert\") pod \"maas-controller-6c46888d8f-tk2dl\" (UID: \"481732d2-f017-4d89-a60d-cb47695928c4\") " pod="opendatahub/maas-controller-6c46888d8f-tk2dl" Jul 14 19:02:37.571750 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.571561 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjz74\" (UniqueName: \"kubernetes.io/projected/481732d2-f017-4d89-a60d-cb47695928c4-kube-api-access-tjz74\") pod \"maas-controller-6c46888d8f-tk2dl\" (UID: \"481732d2-f017-4d89-a60d-cb47695928c4\") " pod="opendatahub/maas-controller-6c46888d8f-tk2dl" Jul 14 19:02:37.574143 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.574110 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/481732d2-f017-4d89-a60d-cb47695928c4-webhook-cert\") pod \"maas-controller-6c46888d8f-tk2dl\" (UID: \"481732d2-f017-4d89-a60d-cb47695928c4\") " pod="opendatahub/maas-controller-6c46888d8f-tk2dl" Jul 14 19:02:37.581475 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.581449 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjz74\" (UniqueName: \"kubernetes.io/projected/481732d2-f017-4d89-a60d-cb47695928c4-kube-api-access-tjz74\") pod \"maas-controller-6c46888d8f-tk2dl\" (UID: \"481732d2-f017-4d89-a60d-cb47695928c4\") " pod="opendatahub/maas-controller-6c46888d8f-tk2dl" Jul 14 19:02:37.668011 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.667981 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c46888d8f-tk2dl" Jul 14 19:02:37.809406 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.809375 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c46888d8f-tk2dl"] Jul 14 19:02:37.810542 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:02:37.810514 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod481732d2_f017_4d89_a60d_cb47695928c4.slice/crio-a3316c74d632f6c85bb776fca427b26012cd136544bb63e8e2d8b1257cb9dbc4 WatchSource:0}: Error finding container a3316c74d632f6c85bb776fca427b26012cd136544bb63e8e2d8b1257cb9dbc4: Status 404 returned error can't find the container with id a3316c74d632f6c85bb776fca427b26012cd136544bb63e8e2d8b1257cb9dbc4 Jul 14 19:02:37.874181 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.874140 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5215c05-c249-4baa-8ff2-4c6dab4cbc31-webhook-cert\") pod \"maas-controller-c6fd879cd-xk262\" (UID: \"f5215c05-c249-4baa-8ff2-4c6dab4cbc31\") " pod="opendatahub/maas-controller-c6fd879cd-xk262" Jul 14 19:02:37.876607 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.876575 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5215c05-c249-4baa-8ff2-4c6dab4cbc31-webhook-cert\") pod \"maas-controller-c6fd879cd-xk262\" (UID: \"f5215c05-c249-4baa-8ff2-4c6dab4cbc31\") " pod="opendatahub/maas-controller-c6fd879cd-xk262" Jul 14 19:02:37.967968 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:37.967931 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c46888d8f-tk2dl" event={"ID":"481732d2-f017-4d89-a60d-cb47695928c4","Type":"ContainerStarted","Data":"a3316c74d632f6c85bb776fca427b26012cd136544bb63e8e2d8b1257cb9dbc4"} Jul 14 19:02:38.079578 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:38.079545 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c6fd879cd-xk262" Jul 14 19:02:38.219852 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:38.219826 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c6fd879cd-xk262"] Jul 14 19:02:38.221106 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:02:38.221079 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5215c05_c249_4baa_8ff2_4c6dab4cbc31.slice/crio-1af4c2da20ff8f65b5313e5c79e2823c210a129b03357c5d228264550ff2d7f0 WatchSource:0}: Error finding container 1af4c2da20ff8f65b5313e5c79e2823c210a129b03357c5d228264550ff2d7f0: Status 404 returned error can't find the container with id 1af4c2da20ff8f65b5313e5c79e2823c210a129b03357c5d228264550ff2d7f0 Jul 14 19:02:38.976673 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:38.976634 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c6fd879cd-xk262" event={"ID":"f5215c05-c249-4baa-8ff2-4c6dab4cbc31","Type":"ContainerStarted","Data":"1af4c2da20ff8f65b5313e5c79e2823c210a129b03357c5d228264550ff2d7f0"} Jul 14 19:02:40.997060 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:40.997013 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c46888d8f-tk2dl" event={"ID":"481732d2-f017-4d89-a60d-cb47695928c4","Type":"ContainerStarted","Data":"e6edc91ee0f44dae1773c8dfe41e8be0c0e5a8b48614ab284f843ee16e712fc5"} Jul 14 19:02:40.997522 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:40.997207 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c46888d8f-tk2dl" Jul 14 19:02:40.998406 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:40.998375 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c6fd879cd-xk262" event={"ID":"f5215c05-c249-4baa-8ff2-4c6dab4cbc31","Type":"ContainerStarted","Data":"90f1b3336295f7bf84679aa1b3010d85bd987efdd744f9e924cbfeab18a3660b"} Jul 14 19:02:40.998507 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:40.998497 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c6fd879cd-xk262" Jul 14 19:02:41.027618 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:41.027543 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c46888d8f-tk2dl" podStartSLOduration=1.683298437 podStartE2EDuration="4.027530932s" totalImagesPullingTime="2.344232495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:02:41.025543827 +0000 UTC m=+485.024436645" watchObservedRunningTime="2026-07-14 19:02:41.027530932 +0000 UTC m=+485.026423750" Jul 14 19:02:41.052025 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:41.051977 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c6fd879cd-xk262" podStartSLOduration=2.127691486 podStartE2EDuration="4.051963674s" totalImagesPullingTime="1.924272188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:02:41.05010779 +0000 UTC m=+485.049000606" watchObservedRunningTime="2026-07-14 19:02:41.051963674 +0000 UTC m=+485.050856499" Jul 14 19:02:52.006795 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:52.006763 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c6fd879cd-xk262" Jul 14 19:02:52.007246 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:52.006951 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c46888d8f-tk2dl" Jul 14 19:02:52.081980 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:52.081948 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c6fd879cd-xk262"] Jul 14 19:02:52.082178 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:52.082155 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-c6fd879cd-xk262" podUID="f5215c05-c249-4baa-8ff2-4c6dab4cbc31" containerName="manager" containerID="cri-o://90f1b3336295f7bf84679aa1b3010d85bd987efdd744f9e924cbfeab18a3660b" gracePeriod=30 Jul 14 19:02:52.321469 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:52.321441 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c6fd879cd-xk262" Jul 14 19:02:52.405478 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:52.405444 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxs9f\" (UniqueName: \"kubernetes.io/projected/f5215c05-c249-4baa-8ff2-4c6dab4cbc31-kube-api-access-qxs9f\") pod \"f5215c05-c249-4baa-8ff2-4c6dab4cbc31\" (UID: \"f5215c05-c249-4baa-8ff2-4c6dab4cbc31\") " Jul 14 19:02:52.405699 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:52.405495 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5215c05-c249-4baa-8ff2-4c6dab4cbc31-webhook-cert\") pod \"f5215c05-c249-4baa-8ff2-4c6dab4cbc31\" (UID: \"f5215c05-c249-4baa-8ff2-4c6dab4cbc31\") " Jul 14 19:02:52.407786 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:52.407764 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5215c05-c249-4baa-8ff2-4c6dab4cbc31-kube-api-access-qxs9f" (OuterVolumeSpecName: "kube-api-access-qxs9f") pod "f5215c05-c249-4baa-8ff2-4c6dab4cbc31" (UID: "f5215c05-c249-4baa-8ff2-4c6dab4cbc31"). InnerVolumeSpecName "kube-api-access-qxs9f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:02:52.407945 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:52.407923 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5215c05-c249-4baa-8ff2-4c6dab4cbc31-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f5215c05-c249-4baa-8ff2-4c6dab4cbc31" (UID: "f5215c05-c249-4baa-8ff2-4c6dab4cbc31"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 19:02:52.506959 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:52.506930 2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5215c05-c249-4baa-8ff2-4c6dab4cbc31-webhook-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:02:52.506959 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:52.506958 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxs9f\" (UniqueName: \"kubernetes.io/projected/f5215c05-c249-4baa-8ff2-4c6dab4cbc31-kube-api-access-qxs9f\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:02:53.059190 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:53.059160 2563 generic.go:356] "Generic (PLEG): container finished" podID="f5215c05-c249-4baa-8ff2-4c6dab4cbc31" containerID="90f1b3336295f7bf84679aa1b3010d85bd987efdd744f9e924cbfeab18a3660b" exitCode=0 Jul 14 19:02:53.059695 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:53.059219 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c6fd879cd-xk262" Jul 14 19:02:53.059695 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:53.059253 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c6fd879cd-xk262" event={"ID":"f5215c05-c249-4baa-8ff2-4c6dab4cbc31","Type":"ContainerDied","Data":"90f1b3336295f7bf84679aa1b3010d85bd987efdd744f9e924cbfeab18a3660b"} Jul 14 19:02:53.059695 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:53.059356 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c6fd879cd-xk262" event={"ID":"f5215c05-c249-4baa-8ff2-4c6dab4cbc31","Type":"ContainerDied","Data":"1af4c2da20ff8f65b5313e5c79e2823c210a129b03357c5d228264550ff2d7f0"} Jul 14 19:02:53.059695 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:53.059392 2563 scope.go:117] "RemoveContainer" containerID="90f1b3336295f7bf84679aa1b3010d85bd987efdd744f9e924cbfeab18a3660b" Jul 14 19:02:53.068387 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:53.068369 2563 scope.go:117] "RemoveContainer" containerID="90f1b3336295f7bf84679aa1b3010d85bd987efdd744f9e924cbfeab18a3660b" Jul 14 19:02:53.068693 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:02:53.068676 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90f1b3336295f7bf84679aa1b3010d85bd987efdd744f9e924cbfeab18a3660b\": container with ID starting with 90f1b3336295f7bf84679aa1b3010d85bd987efdd744f9e924cbfeab18a3660b not found: ID does not exist" containerID="90f1b3336295f7bf84679aa1b3010d85bd987efdd744f9e924cbfeab18a3660b" Jul 14 19:02:53.068744 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:53.068703 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90f1b3336295f7bf84679aa1b3010d85bd987efdd744f9e924cbfeab18a3660b"} err="failed to get container status \"90f1b3336295f7bf84679aa1b3010d85bd987efdd744f9e924cbfeab18a3660b\": rpc error: code = NotFound desc = could not find container \"90f1b3336295f7bf84679aa1b3010d85bd987efdd744f9e924cbfeab18a3660b\": container with ID starting with 90f1b3336295f7bf84679aa1b3010d85bd987efdd744f9e924cbfeab18a3660b not found: ID does not exist" Jul 14 19:02:53.081488 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:53.081467 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c6fd879cd-xk262"] Jul 14 19:02:53.083402 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:53.083385 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c6fd879cd-xk262"] Jul 14 19:02:54.565919 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:02:54.565891 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5215c05-c249-4baa-8ff2-4c6dab4cbc31" path="/var/lib/kubelet/pods/f5215c05-c249-4baa-8ff2-4c6dab4cbc31/volumes" Jul 14 19:03:14.750450 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:14.750414 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-74597dff59-8ztfl"] Jul 14 19:03:14.751072 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:14.750926 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5215c05-c249-4baa-8ff2-4c6dab4cbc31" containerName="manager" Jul 14 19:03:14.751072 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:14.750948 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5215c05-c249-4baa-8ff2-4c6dab4cbc31" containerName="manager" Jul 14 19:03:14.751072 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:14.751055 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5215c05-c249-4baa-8ff2-4c6dab4cbc31" containerName="manager" Jul 14 19:03:14.753747 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:14.753728 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74597dff59-8ztfl" Jul 14 19:03:14.756509 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:14.756484 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 14 19:03:14.757452 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:14.757436 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-82sfz\"" Jul 14 19:03:14.757541 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:14.757458 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 14 19:03:14.757541 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:14.757459 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 14 19:03:14.767985 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:14.767962 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-74597dff59-8ztfl"] Jul 14 19:03:14.800078 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:14.800041 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9e3863d-6fcd-4f19-b986-1db6976bf550-maas-api-tls\") pod \"maas-api-74597dff59-8ztfl\" (UID: \"d9e3863d-6fcd-4f19-b986-1db6976bf550\") " pod="odh-ai-gateway-infra/maas-api-74597dff59-8ztfl" Jul 14 19:03:14.800416 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:14.800395 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9e3863d-6fcd-4f19-b986-1db6976bf550-openshift-service-ca\") pod \"maas-api-74597dff59-8ztfl\" (UID: \"d9e3863d-6fcd-4f19-b986-1db6976bf550\") " pod="odh-ai-gateway-infra/maas-api-74597dff59-8ztfl" Jul 14 19:03:14.800579 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:14.800552 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl6lx\" (UniqueName: \"kubernetes.io/projected/d9e3863d-6fcd-4f19-b986-1db6976bf550-kube-api-access-tl6lx\") pod \"maas-api-74597dff59-8ztfl\" (UID: \"d9e3863d-6fcd-4f19-b986-1db6976bf550\") " pod="odh-ai-gateway-infra/maas-api-74597dff59-8ztfl" Jul 14 19:03:14.901527 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:14.901486 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9e3863d-6fcd-4f19-b986-1db6976bf550-maas-api-tls\") pod \"maas-api-74597dff59-8ztfl\" (UID: \"d9e3863d-6fcd-4f19-b986-1db6976bf550\") " pod="odh-ai-gateway-infra/maas-api-74597dff59-8ztfl" Jul 14 19:03:14.901527 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:14.901531 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9e3863d-6fcd-4f19-b986-1db6976bf550-openshift-service-ca\") pod \"maas-api-74597dff59-8ztfl\" (UID: \"d9e3863d-6fcd-4f19-b986-1db6976bf550\") " pod="odh-ai-gateway-infra/maas-api-74597dff59-8ztfl" Jul 14 19:03:14.901802 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:14.901640 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl6lx\" (UniqueName: \"kubernetes.io/projected/d9e3863d-6fcd-4f19-b986-1db6976bf550-kube-api-access-tl6lx\") pod \"maas-api-74597dff59-8ztfl\" (UID: \"d9e3863d-6fcd-4f19-b986-1db6976bf550\") " pod="odh-ai-gateway-infra/maas-api-74597dff59-8ztfl" Jul 14 19:03:14.901802 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:03:14.901687 2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 14 19:03:14.901802 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:03:14.901790 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9e3863d-6fcd-4f19-b986-1db6976bf550-maas-api-tls podName:d9e3863d-6fcd-4f19-b986-1db6976bf550 nodeName:}" failed. No retries permitted until 2026-07-14 19:03:15.401766596 +0000 UTC m=+519.400659393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d9e3863d-6fcd-4f19-b986-1db6976bf550-maas-api-tls") pod "maas-api-74597dff59-8ztfl" (UID: "d9e3863d-6fcd-4f19-b986-1db6976bf550") : secret "maas-api-serving-cert" not found Jul 14 19:03:14.902168 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:14.902150 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9e3863d-6fcd-4f19-b986-1db6976bf550-openshift-service-ca\") pod \"maas-api-74597dff59-8ztfl\" (UID: \"d9e3863d-6fcd-4f19-b986-1db6976bf550\") " pod="odh-ai-gateway-infra/maas-api-74597dff59-8ztfl" Jul 14 19:03:14.911472 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:14.911453 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl6lx\" (UniqueName: \"kubernetes.io/projected/d9e3863d-6fcd-4f19-b986-1db6976bf550-kube-api-access-tl6lx\") pod \"maas-api-74597dff59-8ztfl\" (UID: \"d9e3863d-6fcd-4f19-b986-1db6976bf550\") " pod="odh-ai-gateway-infra/maas-api-74597dff59-8ztfl" Jul 14 19:03:15.406223 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:15.406181 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9e3863d-6fcd-4f19-b986-1db6976bf550-maas-api-tls\") pod \"maas-api-74597dff59-8ztfl\" (UID: \"d9e3863d-6fcd-4f19-b986-1db6976bf550\") " pod="odh-ai-gateway-infra/maas-api-74597dff59-8ztfl" Jul 14 19:03:15.408737 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:15.408707 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9e3863d-6fcd-4f19-b986-1db6976bf550-maas-api-tls\") pod \"maas-api-74597dff59-8ztfl\" (UID: \"d9e3863d-6fcd-4f19-b986-1db6976bf550\") " pod="odh-ai-gateway-infra/maas-api-74597dff59-8ztfl" Jul 14 19:03:15.663971 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:15.663882 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74597dff59-8ztfl" Jul 14 19:03:15.816254 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:15.816223 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-74597dff59-8ztfl"] Jul 14 19:03:15.817193 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:03:15.817165 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e3863d_6fcd_4f19_b986_1db6976bf550.slice/crio-ae244bff396e8b29cdf24b55a7e0fe3df5ca5229a23a5c1911404bfcd59f78c1 WatchSource:0}: Error finding container ae244bff396e8b29cdf24b55a7e0fe3df5ca5229a23a5c1911404bfcd59f78c1: Status 404 returned error can't find the container with id ae244bff396e8b29cdf24b55a7e0fe3df5ca5229a23a5c1911404bfcd59f78c1 Jul 14 19:03:16.178557 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:16.178522 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74597dff59-8ztfl" event={"ID":"d9e3863d-6fcd-4f19-b986-1db6976bf550","Type":"ContainerStarted","Data":"ae244bff396e8b29cdf24b55a7e0fe3df5ca5229a23a5c1911404bfcd59f78c1"} Jul 14 19:03:18.189431 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:18.189403 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74597dff59-8ztfl" event={"ID":"d9e3863d-6fcd-4f19-b986-1db6976bf550","Type":"ContainerStarted","Data":"bcf2a8141971e9a9263031f5ba65e0e18bb8ea6fb755ebe8f53d88d5dcd45c51"} Jul 14 19:03:18.189749 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:18.189502 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-74597dff59-8ztfl" Jul 14 19:03:18.219291 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:18.219240 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-74597dff59-8ztfl" podStartSLOduration=1.95764645 podStartE2EDuration="4.219223284s" totalImagesPullingTime="2.261576834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:03:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:03:18.217939923 +0000 UTC m=+522.216832744" watchObservedRunningTime="2026-07-14 19:03:18.219223284 +0000 UTC m=+522.218116102" Jul 14 19:03:23.217123 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:23.217032 2563 generic.go:356] "Generic (PLEG): container finished" podID="9058e011-7163-4ab4-b0e4-a1670135459f" containerID="1b48611d69ed6bb8bbd34170feb13fa24cb3ad41ba68d83e047e187625b865e5" exitCode=0 Jul 14 19:03:23.217123 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:23.217104 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" event={"ID":"9058e011-7163-4ab4-b0e4-a1670135459f","Type":"ContainerDied","Data":"1b48611d69ed6bb8bbd34170feb13fa24cb3ad41ba68d83e047e187625b865e5"} Jul 14 19:03:23.217558 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:23.217479 2563 scope.go:117] "RemoveContainer" containerID="1b48611d69ed6bb8bbd34170feb13fa24cb3ad41ba68d83e047e187625b865e5" Jul 14 19:03:23.218466 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:23.218437 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:03:23.218574 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:23.218512 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:03:23.218574 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:23.218545 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:03:24.200409 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:24.200381 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-74597dff59-8ztfl" Jul 14 19:03:24.231666 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:24.231619 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" event={"ID":"9058e011-7163-4ab4-b0e4-a1670135459f","Type":"ContainerStarted","Data":"6cbfec43351f0ee5284215b43a4fd6000a1329721275596425b3ee90089ef05a"} Jul 14 19:03:24.432489 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:24.432437 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:03:24.433974 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:24.433929 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zdm4h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 14 19:03:24.434092 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:24.434003 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" podUID="9058e011-7163-4ab4-b0e4-a1670135459f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 14 19:03:24.747497 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:24.747452 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:03:25.432281 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:25.432237 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zdm4h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 14 19:03:25.433281 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:25.432858 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" podUID="9058e011-7163-4ab4-b0e4-a1670135459f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 14 19:03:26.432473 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:26.432435 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zdm4h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 14 19:03:26.433078 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:26.433042 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" podUID="9058e011-7163-4ab4-b0e4-a1670135459f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 14 19:03:27.433019 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:27.432962 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zdm4h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 14 19:03:27.433712 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:27.433667 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" podUID="9058e011-7163-4ab4-b0e4-a1670135459f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 14 19:03:28.435842 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:28.435809 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:03:28.436848 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:28.436827 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zdm4h" Jul 14 19:03:31.567438 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.567394 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr"] Jul 14 19:03:31.569946 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.569926 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:31.573856 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.573828 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 19:03:31.574853 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.574828 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 19:03:31.574853 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.574847 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 14 19:03:31.575016 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.574895 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fx8vd\"" Jul 14 19:03:31.588616 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.586175 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr"] Jul 14 19:03:31.688394 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.688357 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r74g\" (UniqueName: \"kubernetes.io/projected/72916379-ede0-4cbb-997d-65ed522d0fe1-kube-api-access-4r74g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr\" (UID: \"72916379-ede0-4cbb-997d-65ed522d0fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:31.688549 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.688410 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72916379-ede0-4cbb-997d-65ed522d0fe1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr\" (UID: \"72916379-ede0-4cbb-997d-65ed522d0fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:31.688549 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.688427 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72916379-ede0-4cbb-997d-65ed522d0fe1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr\" (UID: \"72916379-ede0-4cbb-997d-65ed522d0fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:31.688549 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.688499 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72916379-ede0-4cbb-997d-65ed522d0fe1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr\" (UID: \"72916379-ede0-4cbb-997d-65ed522d0fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:31.688687 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.688623 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72916379-ede0-4cbb-997d-65ed522d0fe1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr\" (UID: \"72916379-ede0-4cbb-997d-65ed522d0fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:31.688764 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.688746 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72916379-ede0-4cbb-997d-65ed522d0fe1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr\" (UID: \"72916379-ede0-4cbb-997d-65ed522d0fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:31.790217 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.790182 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72916379-ede0-4cbb-997d-65ed522d0fe1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr\" (UID: \"72916379-ede0-4cbb-997d-65ed522d0fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:31.790383 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.790224 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r74g\" (UniqueName: \"kubernetes.io/projected/72916379-ede0-4cbb-997d-65ed522d0fe1-kube-api-access-4r74g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr\" (UID: \"72916379-ede0-4cbb-997d-65ed522d0fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:31.790383 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.790354 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72916379-ede0-4cbb-997d-65ed522d0fe1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr\" (UID: \"72916379-ede0-4cbb-997d-65ed522d0fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:31.790467 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.790387 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72916379-ede0-4cbb-997d-65ed522d0fe1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr\" (UID: \"72916379-ede0-4cbb-997d-65ed522d0fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:31.790467 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.790412 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72916379-ede0-4cbb-997d-65ed522d0fe1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr\" (UID: \"72916379-ede0-4cbb-997d-65ed522d0fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:31.790583 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.790471 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72916379-ede0-4cbb-997d-65ed522d0fe1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr\" (UID: \"72916379-ede0-4cbb-997d-65ed522d0fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:31.790851 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.790821 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72916379-ede0-4cbb-997d-65ed522d0fe1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr\" (UID: \"72916379-ede0-4cbb-997d-65ed522d0fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:31.791074 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.791052 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72916379-ede0-4cbb-997d-65ed522d0fe1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr\" (UID: \"72916379-ede0-4cbb-997d-65ed522d0fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:31.791186 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.791028 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72916379-ede0-4cbb-997d-65ed522d0fe1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr\" (UID: \"72916379-ede0-4cbb-997d-65ed522d0fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:31.792837 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.792819 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72916379-ede0-4cbb-997d-65ed522d0fe1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr\" (UID: \"72916379-ede0-4cbb-997d-65ed522d0fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:31.793098 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.793077 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72916379-ede0-4cbb-997d-65ed522d0fe1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr\" (UID: \"72916379-ede0-4cbb-997d-65ed522d0fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:31.801131 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.801109 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r74g\" (UniqueName: \"kubernetes.io/projected/72916379-ede0-4cbb-997d-65ed522d0fe1-kube-api-access-4r74g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr\" (UID: \"72916379-ede0-4cbb-997d-65ed522d0fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:31.881290 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:31.881205 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:32.023321 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:32.023108 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr"] Jul 14 19:03:32.025664 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:03:32.025577 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72916379_ede0_4cbb_997d_65ed522d0fe1.slice/crio-f50f4fab46ea88d4a1b977adcfc00c2edea07956130058bc07dcd60035779f37 WatchSource:0}: Error finding container f50f4fab46ea88d4a1b977adcfc00c2edea07956130058bc07dcd60035779f37: Status 404 returned error can't find the container with id f50f4fab46ea88d4a1b977adcfc00c2edea07956130058bc07dcd60035779f37 Jul 14 19:03:32.285660 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:32.285624 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" event={"ID":"72916379-ede0-4cbb-997d-65ed522d0fe1","Type":"ContainerStarted","Data":"f50f4fab46ea88d4a1b977adcfc00c2edea07956130058bc07dcd60035779f37"} Jul 14 19:03:36.312672 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:36.312632 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" event={"ID":"72916379-ede0-4cbb-997d-65ed522d0fe1","Type":"ContainerStarted","Data":"b846cab59ba4a6afa3278cc7338dfc9a78e9a5671bc567d5ed2daa09511486aa"} Jul 14 19:03:36.334427 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:36.334359 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" podStartSLOduration=1.892664205 podStartE2EDuration="5.334330782s" totalImagesPullingTime="3.441666577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:03:36.333398153 +0000 UTC m=+540.332290974" watchObservedRunningTime="2026-07-14 19:03:36.334330782 +0000 UTC m=+540.333223805" Jul 14 19:03:41.882247 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:41.882204 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:41.882659 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:41.882292 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:41.894913 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:41.894886 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:42.354815 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:42.354785 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr" Jul 14 19:03:55.070823 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.070787 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm"] Jul 14 19:03:55.074992 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.074967 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:03:55.077795 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.077771 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 14 19:03:55.087232 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.087212 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm"] Jul 14 19:03:55.210302 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.210266 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e06c893-37d7-4599-b1ae-176f29060ce7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm\" (UID: \"9e06c893-37d7-4599-b1ae-176f29060ce7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:03:55.210497 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.210324 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e06c893-37d7-4599-b1ae-176f29060ce7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm\" (UID: \"9e06c893-37d7-4599-b1ae-176f29060ce7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:03:55.210497 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.210342 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e06c893-37d7-4599-b1ae-176f29060ce7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm\" (UID: \"9e06c893-37d7-4599-b1ae-176f29060ce7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:03:55.210497 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.210445 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e06c893-37d7-4599-b1ae-176f29060ce7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm\" (UID: \"9e06c893-37d7-4599-b1ae-176f29060ce7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:03:55.210497 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.210482 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm9rg\" (UniqueName: \"kubernetes.io/projected/9e06c893-37d7-4599-b1ae-176f29060ce7-kube-api-access-gm9rg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm\" (UID: \"9e06c893-37d7-4599-b1ae-176f29060ce7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:03:55.210727 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.210513 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e06c893-37d7-4599-b1ae-176f29060ce7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm\" (UID: \"9e06c893-37d7-4599-b1ae-176f29060ce7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:03:55.311915 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.311879 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e06c893-37d7-4599-b1ae-176f29060ce7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm\" (UID: \"9e06c893-37d7-4599-b1ae-176f29060ce7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:03:55.312125 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.311922 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm9rg\" (UniqueName: \"kubernetes.io/projected/9e06c893-37d7-4599-b1ae-176f29060ce7-kube-api-access-gm9rg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm\" (UID: \"9e06c893-37d7-4599-b1ae-176f29060ce7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:03:55.312125 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.311952 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e06c893-37d7-4599-b1ae-176f29060ce7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm\" (UID: \"9e06c893-37d7-4599-b1ae-176f29060ce7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:03:55.312125 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.312018 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e06c893-37d7-4599-b1ae-176f29060ce7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm\" (UID: \"9e06c893-37d7-4599-b1ae-176f29060ce7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:03:55.312125 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.312079 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e06c893-37d7-4599-b1ae-176f29060ce7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm\" (UID: \"9e06c893-37d7-4599-b1ae-176f29060ce7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:03:55.312125 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.312105 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e06c893-37d7-4599-b1ae-176f29060ce7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm\" (UID: \"9e06c893-37d7-4599-b1ae-176f29060ce7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:03:55.312397 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.312340 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e06c893-37d7-4599-b1ae-176f29060ce7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm\" (UID: \"9e06c893-37d7-4599-b1ae-176f29060ce7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:03:55.312451 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.312427 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e06c893-37d7-4599-b1ae-176f29060ce7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm\" (UID: \"9e06c893-37d7-4599-b1ae-176f29060ce7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:03:55.312489 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.312451 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e06c893-37d7-4599-b1ae-176f29060ce7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm\" (UID: \"9e06c893-37d7-4599-b1ae-176f29060ce7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:03:55.314484 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.314462 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e06c893-37d7-4599-b1ae-176f29060ce7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm\" (UID: \"9e06c893-37d7-4599-b1ae-176f29060ce7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:03:55.314727 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.314710 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e06c893-37d7-4599-b1ae-176f29060ce7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm\" (UID: \"9e06c893-37d7-4599-b1ae-176f29060ce7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:03:55.320968 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.320910 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm9rg\" (UniqueName: \"kubernetes.io/projected/9e06c893-37d7-4599-b1ae-176f29060ce7-kube-api-access-gm9rg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm\" (UID: \"9e06c893-37d7-4599-b1ae-176f29060ce7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:03:55.386420 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.386378 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:03:55.529547 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:55.529519 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm"] Jul 14 19:03:55.530724 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:03:55.530697 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e06c893_37d7_4599_b1ae_176f29060ce7.slice/crio-7ca43b0043d390a63f549117d3eb24e8da73a6a90469c3e5f1d9ad2a643c3389 WatchSource:0}: Error finding container 7ca43b0043d390a63f549117d3eb24e8da73a6a90469c3e5f1d9ad2a643c3389: Status 404 returned error can't find the container with id 7ca43b0043d390a63f549117d3eb24e8da73a6a90469c3e5f1d9ad2a643c3389 Jul 14 19:03:56.417480 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:56.417442 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" event={"ID":"9e06c893-37d7-4599-b1ae-176f29060ce7","Type":"ContainerStarted","Data":"e8afb851202ded72f4c06a336c16d5762a3ac508ed7bf6e6d7015c1fc4e4d48d"} Jul 14 19:03:56.417906 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:56.417494 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" event={"ID":"9e06c893-37d7-4599-b1ae-176f29060ce7","Type":"ContainerStarted","Data":"7ca43b0043d390a63f549117d3eb24e8da73a6a90469c3e5f1d9ad2a643c3389"} Jul 14 19:03:56.439071 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:03:56.439017 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" podStartSLOduration=1.028490972 podStartE2EDuration="1.4390018s" totalImagesPullingTime="410.510828ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:03:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:03:56.438018563 +0000 UTC m=+560.436911382" watchObservedRunningTime="2026-07-14 19:03:56.4390018 +0000 UTC m=+560.437894616" Jul 14 19:04:03.800127 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:03.800090 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7"] Jul 14 19:04:03.802611 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:03.802578 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:03.806780 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:03.806755 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 14 19:04:03.828742 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:03.828709 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7"] Jul 14 19:04:03.904029 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:03.903994 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6fde3871-324d-4e14-9069-74b862bbea59-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lx7t7\" (UID: \"6fde3871-324d-4e14-9069-74b862bbea59\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:03.904190 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:03.904036 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6fde3871-324d-4e14-9069-74b862bbea59-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lx7t7\" (UID: \"6fde3871-324d-4e14-9069-74b862bbea59\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:03.904190 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:03.904079 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6fde3871-324d-4e14-9069-74b862bbea59-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lx7t7\" (UID: \"6fde3871-324d-4e14-9069-74b862bbea59\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:03.904190 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:03.904163 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fde3871-324d-4e14-9069-74b862bbea59-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lx7t7\" (UID: \"6fde3871-324d-4e14-9069-74b862bbea59\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:03.904317 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:03.904192 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m5wc\" (UniqueName: \"kubernetes.io/projected/6fde3871-324d-4e14-9069-74b862bbea59-kube-api-access-5m5wc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lx7t7\" (UID: \"6fde3871-324d-4e14-9069-74b862bbea59\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:03.904317 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:03.904238 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fde3871-324d-4e14-9069-74b862bbea59-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lx7t7\" (UID: \"6fde3871-324d-4e14-9069-74b862bbea59\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:04.004996 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:04.004957 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fde3871-324d-4e14-9069-74b862bbea59-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lx7t7\" (UID: \"6fde3871-324d-4e14-9069-74b862bbea59\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:04.005174 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:04.005016 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6fde3871-324d-4e14-9069-74b862bbea59-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lx7t7\" (UID: \"6fde3871-324d-4e14-9069-74b862bbea59\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:04.005174 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:04.005136 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6fde3871-324d-4e14-9069-74b862bbea59-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lx7t7\" (UID: \"6fde3871-324d-4e14-9069-74b862bbea59\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:04.005248 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:04.005218 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6fde3871-324d-4e14-9069-74b862bbea59-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lx7t7\" (UID: \"6fde3871-324d-4e14-9069-74b862bbea59\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:04.005298 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:04.005282 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fde3871-324d-4e14-9069-74b862bbea59-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lx7t7\" (UID: \"6fde3871-324d-4e14-9069-74b862bbea59\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:04.005339 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:04.005315 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m5wc\" (UniqueName: \"kubernetes.io/projected/6fde3871-324d-4e14-9069-74b862bbea59-kube-api-access-5m5wc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lx7t7\" (UID: \"6fde3871-324d-4e14-9069-74b862bbea59\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:04.005510 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:04.005491 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6fde3871-324d-4e14-9069-74b862bbea59-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lx7t7\" (UID: \"6fde3871-324d-4e14-9069-74b862bbea59\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:04.005588 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:04.005546 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6fde3871-324d-4e14-9069-74b862bbea59-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lx7t7\" (UID: \"6fde3871-324d-4e14-9069-74b862bbea59\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:04.005691 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:04.005666 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fde3871-324d-4e14-9069-74b862bbea59-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lx7t7\" (UID: \"6fde3871-324d-4e14-9069-74b862bbea59\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:04.007376 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:04.007359 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6fde3871-324d-4e14-9069-74b862bbea59-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lx7t7\" (UID: \"6fde3871-324d-4e14-9069-74b862bbea59\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:04.007662 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:04.007644 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fde3871-324d-4e14-9069-74b862bbea59-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lx7t7\" (UID: \"6fde3871-324d-4e14-9069-74b862bbea59\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:04.015146 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:04.015127 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m5wc\" (UniqueName: \"kubernetes.io/projected/6fde3871-324d-4e14-9069-74b862bbea59-kube-api-access-5m5wc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lx7t7\" (UID: \"6fde3871-324d-4e14-9069-74b862bbea59\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:04.113043 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:04.112946 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:04.253660 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:04:04.253627 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fde3871_324d_4e14_9069_74b862bbea59.slice/crio-de968651626ec76fb4ae881d7448c847a2b70d7764aef5ad30bca41079ef6c27 WatchSource:0}: Error finding container de968651626ec76fb4ae881d7448c847a2b70d7764aef5ad30bca41079ef6c27: Status 404 returned error can't find the container with id de968651626ec76fb4ae881d7448c847a2b70d7764aef5ad30bca41079ef6c27 Jul 14 19:04:04.258983 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:04.258959 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7"] Jul 14 19:04:04.461510 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:04.461481 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" event={"ID":"6fde3871-324d-4e14-9069-74b862bbea59","Type":"ContainerStarted","Data":"de968651626ec76fb4ae881d7448c847a2b70d7764aef5ad30bca41079ef6c27"} Jul 14 19:04:05.386547 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:05.386499 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:04:05.387006 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:05.386569 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:04:05.399199 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:05.399168 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:04:05.468612 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:05.468564 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" event={"ID":"6fde3871-324d-4e14-9069-74b862bbea59","Type":"ContainerStarted","Data":"102e7edf83d41819f27fc05792427eeba1e7b1e52a10cde191cac6b95d7803ce"} Jul 14 19:04:05.480149 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:05.480120 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm" Jul 14 19:04:05.490779 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:05.490728 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" podStartSLOduration=2.30819387 podStartE2EDuration="2.490713183s" totalImagesPullingTime="182.519313ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:04:05.4881816 +0000 UTC m=+569.487074417" watchObservedRunningTime="2026-07-14 19:04:05.490713183 +0000 UTC m=+569.489606001" Jul 14 19:04:14.113662 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:14.113588 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:14.114148 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:14.113690 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:14.125911 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:14.125885 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:14.525767 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:14.525735 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lx7t7" Jul 14 19:04:36.435940 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:36.435907 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trrs2_a5633a96-04d9-465c-ae2c-2b5d013f4381/ovn-acl-logging/0.log" Jul 14 19:04:36.439045 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:04:36.439023 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trrs2_a5633a96-04d9-465c-ae2c-2b5d013f4381/ovn-acl-logging/0.log" Jul 14 19:06:44.281933 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:44.281849 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c46888d8f-tk2dl"] Jul 14 19:06:44.282411 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:44.282061 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6c46888d8f-tk2dl" podUID="481732d2-f017-4d89-a60d-cb47695928c4" containerName="manager" containerID="cri-o://e6edc91ee0f44dae1773c8dfe41e8be0c0e5a8b48614ab284f843ee16e712fc5" gracePeriod=30 Jul 14 19:06:44.529754 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:44.529730 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c46888d8f-tk2dl" Jul 14 19:06:44.582417 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:44.582344 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjz74\" (UniqueName: \"kubernetes.io/projected/481732d2-f017-4d89-a60d-cb47695928c4-kube-api-access-tjz74\") pod \"481732d2-f017-4d89-a60d-cb47695928c4\" (UID: \"481732d2-f017-4d89-a60d-cb47695928c4\") " Jul 14 19:06:44.582417 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:44.582396 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/481732d2-f017-4d89-a60d-cb47695928c4-webhook-cert\") pod \"481732d2-f017-4d89-a60d-cb47695928c4\" (UID: \"481732d2-f017-4d89-a60d-cb47695928c4\") " Jul 14 19:06:44.584676 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:44.584641 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/481732d2-f017-4d89-a60d-cb47695928c4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "481732d2-f017-4d89-a60d-cb47695928c4" (UID: "481732d2-f017-4d89-a60d-cb47695928c4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 19:06:44.584797 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:44.584779 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/481732d2-f017-4d89-a60d-cb47695928c4-kube-api-access-tjz74" (OuterVolumeSpecName: "kube-api-access-tjz74") pod "481732d2-f017-4d89-a60d-cb47695928c4" (UID: "481732d2-f017-4d89-a60d-cb47695928c4"). InnerVolumeSpecName "kube-api-access-tjz74". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:06:44.683865 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:44.683824 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjz74\" (UniqueName: \"kubernetes.io/projected/481732d2-f017-4d89-a60d-cb47695928c4-kube-api-access-tjz74\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:06:44.683865 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:44.683862 2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/481732d2-f017-4d89-a60d-cb47695928c4-webhook-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:06:45.286517 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:45.286479 2563 generic.go:356] "Generic (PLEG): container finished" podID="481732d2-f017-4d89-a60d-cb47695928c4" containerID="e6edc91ee0f44dae1773c8dfe41e8be0c0e5a8b48614ab284f843ee16e712fc5" exitCode=0 Jul 14 19:06:45.286960 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:45.286524 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c46888d8f-tk2dl" Jul 14 19:06:45.286960 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:45.286557 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c46888d8f-tk2dl" event={"ID":"481732d2-f017-4d89-a60d-cb47695928c4","Type":"ContainerDied","Data":"e6edc91ee0f44dae1773c8dfe41e8be0c0e5a8b48614ab284f843ee16e712fc5"} Jul 14 19:06:45.286960 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:45.286631 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c46888d8f-tk2dl" event={"ID":"481732d2-f017-4d89-a60d-cb47695928c4","Type":"ContainerDied","Data":"a3316c74d632f6c85bb776fca427b26012cd136544bb63e8e2d8b1257cb9dbc4"} Jul 14 19:06:45.286960 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:45.286658 2563 scope.go:117] "RemoveContainer" containerID="e6edc91ee0f44dae1773c8dfe41e8be0c0e5a8b48614ab284f843ee16e712fc5" Jul 14 19:06:45.296545 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:45.296529 2563 scope.go:117] "RemoveContainer" containerID="e6edc91ee0f44dae1773c8dfe41e8be0c0e5a8b48614ab284f843ee16e712fc5" Jul 14 19:06:45.296793 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:06:45.296777 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6edc91ee0f44dae1773c8dfe41e8be0c0e5a8b48614ab284f843ee16e712fc5\": container with ID starting with e6edc91ee0f44dae1773c8dfe41e8be0c0e5a8b48614ab284f843ee16e712fc5 not found: ID does not exist" containerID="e6edc91ee0f44dae1773c8dfe41e8be0c0e5a8b48614ab284f843ee16e712fc5" Jul 14 19:06:45.296840 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:45.296803 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6edc91ee0f44dae1773c8dfe41e8be0c0e5a8b48614ab284f843ee16e712fc5"} err="failed to get container status \"e6edc91ee0f44dae1773c8dfe41e8be0c0e5a8b48614ab284f843ee16e712fc5\": rpc error: code = NotFound desc = could not find container \"e6edc91ee0f44dae1773c8dfe41e8be0c0e5a8b48614ab284f843ee16e712fc5\": container with ID starting with e6edc91ee0f44dae1773c8dfe41e8be0c0e5a8b48614ab284f843ee16e712fc5 not found: ID does not exist" Jul 14 19:06:45.310185 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:45.310157 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c46888d8f-tk2dl"] Jul 14 19:06:45.312332 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:45.312312 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c46888d8f-tk2dl"] Jul 14 19:06:46.146197 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:46.146162 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c46888d8f-24nwq"] Jul 14 19:06:46.146538 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:46.146526 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="481732d2-f017-4d89-a60d-cb47695928c4" containerName="manager" Jul 14 19:06:46.146581 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:46.146540 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="481732d2-f017-4d89-a60d-cb47695928c4" containerName="manager" Jul 14 19:06:46.146644 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:46.146609 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="481732d2-f017-4d89-a60d-cb47695928c4" containerName="manager" Jul 14 19:06:46.150766 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:46.150749 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c46888d8f-24nwq" Jul 14 19:06:46.154851 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:46.154831 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 14 19:06:46.154957 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:46.154883 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 14 19:06:46.155045 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:46.155023 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c8ts2\"" Jul 14 19:06:46.162794 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:46.162773 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c46888d8f-24nwq"] Jul 14 19:06:46.301661 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:46.301625 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1669d992-3b70-4470-9649-c254b5f978af-webhook-cert\") pod \"maas-controller-6c46888d8f-24nwq\" (UID: \"1669d992-3b70-4470-9649-c254b5f978af\") " pod="opendatahub/maas-controller-6c46888d8f-24nwq" Jul 14 19:06:46.302060 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:46.301690 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhn8w\" (UniqueName: \"kubernetes.io/projected/1669d992-3b70-4470-9649-c254b5f978af-kube-api-access-lhn8w\") pod \"maas-controller-6c46888d8f-24nwq\" (UID: \"1669d992-3b70-4470-9649-c254b5f978af\") " pod="opendatahub/maas-controller-6c46888d8f-24nwq" Jul 14 19:06:46.402538 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:46.402453 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1669d992-3b70-4470-9649-c254b5f978af-webhook-cert\") pod \"maas-controller-6c46888d8f-24nwq\" (UID: \"1669d992-3b70-4470-9649-c254b5f978af\") " pod="opendatahub/maas-controller-6c46888d8f-24nwq" Jul 14 19:06:46.402538 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:46.402513 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhn8w\" (UniqueName: \"kubernetes.io/projected/1669d992-3b70-4470-9649-c254b5f978af-kube-api-access-lhn8w\") pod \"maas-controller-6c46888d8f-24nwq\" (UID: \"1669d992-3b70-4470-9649-c254b5f978af\") " pod="opendatahub/maas-controller-6c46888d8f-24nwq" Jul 14 19:06:46.405025 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:46.405006 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1669d992-3b70-4470-9649-c254b5f978af-webhook-cert\") pod \"maas-controller-6c46888d8f-24nwq\" (UID: \"1669d992-3b70-4470-9649-c254b5f978af\") " pod="opendatahub/maas-controller-6c46888d8f-24nwq" Jul 14 19:06:46.413380 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:46.413355 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhn8w\" (UniqueName: \"kubernetes.io/projected/1669d992-3b70-4470-9649-c254b5f978af-kube-api-access-lhn8w\") pod \"maas-controller-6c46888d8f-24nwq\" (UID: \"1669d992-3b70-4470-9649-c254b5f978af\") " pod="opendatahub/maas-controller-6c46888d8f-24nwq" Jul 14 19:06:46.461194 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:46.461170 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c46888d8f-24nwq" Jul 14 19:06:46.569366 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:46.569322 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="481732d2-f017-4d89-a60d-cb47695928c4" path="/var/lib/kubelet/pods/481732d2-f017-4d89-a60d-cb47695928c4/volumes" Jul 14 19:06:46.593942 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:46.593918 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c46888d8f-24nwq"] Jul 14 19:06:46.595261 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:06:46.595235 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1669d992_3b70_4470_9649_c254b5f978af.slice/crio-764e17ad9444faabcc37a3e71522b0bde107557e25e0701c6adece2405af7052 WatchSource:0}: Error finding container 764e17ad9444faabcc37a3e71522b0bde107557e25e0701c6adece2405af7052: Status 404 returned error can't find the container with id 764e17ad9444faabcc37a3e71522b0bde107557e25e0701c6adece2405af7052 Jul 14 19:06:46.596735 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:46.596716 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 19:06:47.299773 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:47.299730 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c46888d8f-24nwq" event={"ID":"1669d992-3b70-4470-9649-c254b5f978af","Type":"ContainerStarted","Data":"441b55812260a3592e147ce988ef2d1ff46e66b25a0eaf0b732f6d4122d1379c"} Jul 14 19:06:47.299943 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:47.299823 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c46888d8f-24nwq" event={"ID":"1669d992-3b70-4470-9649-c254b5f978af","Type":"ContainerStarted","Data":"764e17ad9444faabcc37a3e71522b0bde107557e25e0701c6adece2405af7052"} Jul 14 19:06:47.299943 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:47.299926 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c46888d8f-24nwq" Jul 14 19:06:47.325801 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:47.325755 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c46888d8f-24nwq" podStartSLOduration=0.79209584 podStartE2EDuration="1.32574111s" totalImagesPullingTime="533.64527ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:06:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:06:47.323136829 +0000 UTC m=+731.322029647" watchObservedRunningTime="2026-07-14 19:06:47.32574111 +0000 UTC m=+731.324633926" Jul 14 19:06:58.307654 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:06:58.307619 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c46888d8f-24nwq" Jul 14 19:09:36.470134 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:09:36.470051 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trrs2_a5633a96-04d9-465c-ae2c-2b5d013f4381/ovn-acl-logging/0.log" Jul 14 19:09:36.472893 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:09:36.472868 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trrs2_a5633a96-04d9-465c-ae2c-2b5d013f4381/ovn-acl-logging/0.log" Jul 14 19:11:00.135175 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.135094 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d9d757f55-c7xt2"] Jul 14 19:11:00.138227 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.138208 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.175427 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.175400 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d9d757f55-c7xt2"] Jul 14 19:11:00.253001 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.252968 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e596202-7cbe-490d-8f16-44b542c03e0a-trusted-ca-bundle\") pod \"console-5d9d757f55-c7xt2\" (UID: \"7e596202-7cbe-490d-8f16-44b542c03e0a\") " pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.253001 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.253003 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ltbb\" (UniqueName: \"kubernetes.io/projected/7e596202-7cbe-490d-8f16-44b542c03e0a-kube-api-access-8ltbb\") pod \"console-5d9d757f55-c7xt2\" (UID: \"7e596202-7cbe-490d-8f16-44b542c03e0a\") " pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.253223 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.253068 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e596202-7cbe-490d-8f16-44b542c03e0a-console-config\") pod \"console-5d9d757f55-c7xt2\" (UID: \"7e596202-7cbe-490d-8f16-44b542c03e0a\") " pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.253223 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.253086 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e596202-7cbe-490d-8f16-44b542c03e0a-service-ca\") pod \"console-5d9d757f55-c7xt2\" (UID: \"7e596202-7cbe-490d-8f16-44b542c03e0a\") " pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.253223 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.253185 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e596202-7cbe-490d-8f16-44b542c03e0a-console-oauth-config\") pod \"console-5d9d757f55-c7xt2\" (UID: \"7e596202-7cbe-490d-8f16-44b542c03e0a\") " pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.253223 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.253216 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e596202-7cbe-490d-8f16-44b542c03e0a-console-serving-cert\") pod \"console-5d9d757f55-c7xt2\" (UID: \"7e596202-7cbe-490d-8f16-44b542c03e0a\") " pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.253372 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.253232 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e596202-7cbe-490d-8f16-44b542c03e0a-oauth-serving-cert\") pod \"console-5d9d757f55-c7xt2\" (UID: \"7e596202-7cbe-490d-8f16-44b542c03e0a\") " pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.353893 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.353850 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e596202-7cbe-490d-8f16-44b542c03e0a-console-config\") pod \"console-5d9d757f55-c7xt2\" (UID: \"7e596202-7cbe-490d-8f16-44b542c03e0a\") " pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.353893 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.353894 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e596202-7cbe-490d-8f16-44b542c03e0a-service-ca\") pod \"console-5d9d757f55-c7xt2\" (UID: \"7e596202-7cbe-490d-8f16-44b542c03e0a\") " pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.354140 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.353965 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e596202-7cbe-490d-8f16-44b542c03e0a-console-oauth-config\") pod \"console-5d9d757f55-c7xt2\" (UID: \"7e596202-7cbe-490d-8f16-44b542c03e0a\") " pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.354140 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.353995 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e596202-7cbe-490d-8f16-44b542c03e0a-console-serving-cert\") pod \"console-5d9d757f55-c7xt2\" (UID: \"7e596202-7cbe-490d-8f16-44b542c03e0a\") " pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.354140 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.354016 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e596202-7cbe-490d-8f16-44b542c03e0a-oauth-serving-cert\") pod \"console-5d9d757f55-c7xt2\" (UID: \"7e596202-7cbe-490d-8f16-44b542c03e0a\") " pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.354140 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.354055 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e596202-7cbe-490d-8f16-44b542c03e0a-trusted-ca-bundle\") pod \"console-5d9d757f55-c7xt2\" (UID: \"7e596202-7cbe-490d-8f16-44b542c03e0a\") " pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.354140 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.354085 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ltbb\" (UniqueName: \"kubernetes.io/projected/7e596202-7cbe-490d-8f16-44b542c03e0a-kube-api-access-8ltbb\") pod \"console-5d9d757f55-c7xt2\" (UID: \"7e596202-7cbe-490d-8f16-44b542c03e0a\") " pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.354748 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.354717 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e596202-7cbe-490d-8f16-44b542c03e0a-console-config\") pod \"console-5d9d757f55-c7xt2\" (UID: \"7e596202-7cbe-490d-8f16-44b542c03e0a\") " pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.354748 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.354740 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e596202-7cbe-490d-8f16-44b542c03e0a-oauth-serving-cert\") pod \"console-5d9d757f55-c7xt2\" (UID: \"7e596202-7cbe-490d-8f16-44b542c03e0a\") " pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.355012 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.354989 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e596202-7cbe-490d-8f16-44b542c03e0a-trusted-ca-bundle\") pod \"console-5d9d757f55-c7xt2\" (UID: \"7e596202-7cbe-490d-8f16-44b542c03e0a\") " pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.355077 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.355008 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e596202-7cbe-490d-8f16-44b542c03e0a-service-ca\") pod \"console-5d9d757f55-c7xt2\" (UID: \"7e596202-7cbe-490d-8f16-44b542c03e0a\") " pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.356669 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.356647 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e596202-7cbe-490d-8f16-44b542c03e0a-console-serving-cert\") pod \"console-5d9d757f55-c7xt2\" (UID: \"7e596202-7cbe-490d-8f16-44b542c03e0a\") " pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.356732 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.356675 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e596202-7cbe-490d-8f16-44b542c03e0a-console-oauth-config\") pod \"console-5d9d757f55-c7xt2\" (UID: \"7e596202-7cbe-490d-8f16-44b542c03e0a\") " pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.365230 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.365207 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ltbb\" (UniqueName: \"kubernetes.io/projected/7e596202-7cbe-490d-8f16-44b542c03e0a-kube-api-access-8ltbb\") pod \"console-5d9d757f55-c7xt2\" (UID: \"7e596202-7cbe-490d-8f16-44b542c03e0a\") " pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.454770 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.454679 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:00.601117 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:00.601088 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d9d757f55-c7xt2"] Jul 14 19:11:00.603127 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:11:00.603097 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e596202_7cbe_490d_8f16_44b542c03e0a.slice/crio-4694d4f44cadbf5f88d2cd7e3ebacdae79b05a681a2a432c3da488c50aa38b87 WatchSource:0}: Error finding container 4694d4f44cadbf5f88d2cd7e3ebacdae79b05a681a2a432c3da488c50aa38b87: Status 404 returned error can't find the container with id 4694d4f44cadbf5f88d2cd7e3ebacdae79b05a681a2a432c3da488c50aa38b87 Jul 14 19:11:01.610374 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:01.610335 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9d757f55-c7xt2" event={"ID":"7e596202-7cbe-490d-8f16-44b542c03e0a","Type":"ContainerStarted","Data":"b9d783c1f6fbf268637707129c3c1e19a67c376e78d827e624973fef488a1e80"} Jul 14 19:11:01.610782 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:01.610397 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9d757f55-c7xt2" event={"ID":"7e596202-7cbe-490d-8f16-44b542c03e0a","Type":"ContainerStarted","Data":"4694d4f44cadbf5f88d2cd7e3ebacdae79b05a681a2a432c3da488c50aa38b87"} Jul 14 19:11:01.631313 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:01.631251 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d9d757f55-c7xt2" podStartSLOduration=1.631236725 podStartE2EDuration="1.631236725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:11:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:11:01.629412251 +0000 UTC m=+985.628305067" watchObservedRunningTime="2026-07-14 19:11:01.631236725 +0000 UTC m=+985.630129592" Jul 14 19:11:10.455331 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:10.455233 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:10.455331 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:10.455324 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:10.460085 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:10.460061 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:10.658780 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:10.658753 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d9d757f55-c7xt2" Jul 14 19:11:10.718282 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:10.718196 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fb95c757c-vx5s5"] Jul 14 19:11:35.742613 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:35.742532 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7fb95c757c-vx5s5" podUID="4394ffb6-e34b-4624-a076-e05444319f08" containerName="console" containerID="cri-o://88477a642b82d676ae94e315b24f85a6db1ab98aadfc53dc5311c3c42810ce2c" gracePeriod=15 Jul 14 19:11:35.987131 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:35.987106 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 19:11:36.084975 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.084875 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-console-config\") pod \"4394ffb6-e34b-4624-a076-e05444319f08\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " Jul 14 19:11:36.084975 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.084943 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-trusted-ca-bundle\") pod \"4394ffb6-e34b-4624-a076-e05444319f08\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " Jul 14 19:11:36.084975 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.084960 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-service-ca\") pod \"4394ffb6-e34b-4624-a076-e05444319f08\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " Jul 14 19:11:36.085260 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.084994 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4394ffb6-e34b-4624-a076-e05444319f08-console-oauth-config\") pod \"4394ffb6-e34b-4624-a076-e05444319f08\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " Jul 14 19:11:36.085260 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.085022 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rz68j\" (UniqueName: \"kubernetes.io/projected/4394ffb6-e34b-4624-a076-e05444319f08-kube-api-access-rz68j\") pod \"4394ffb6-e34b-4624-a076-e05444319f08\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " Jul 14 19:11:36.085260 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.085077 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4394ffb6-e34b-4624-a076-e05444319f08-console-serving-cert\") pod \"4394ffb6-e34b-4624-a076-e05444319f08\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " Jul 14 19:11:36.085260 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.085104 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-oauth-serving-cert\") pod \"4394ffb6-e34b-4624-a076-e05444319f08\" (UID: \"4394ffb6-e34b-4624-a076-e05444319f08\") " Jul 14 19:11:36.085469 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.085388 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-service-ca" (OuterVolumeSpecName: "service-ca") pod "4394ffb6-e34b-4624-a076-e05444319f08" (UID: "4394ffb6-e34b-4624-a076-e05444319f08"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 19:11:36.085525 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.085490 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4394ffb6-e34b-4624-a076-e05444319f08" (UID: "4394ffb6-e34b-4624-a076-e05444319f08"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 19:11:36.085525 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.085478 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-console-config" (OuterVolumeSpecName: "console-config") pod "4394ffb6-e34b-4624-a076-e05444319f08" (UID: "4394ffb6-e34b-4624-a076-e05444319f08"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 19:11:36.085750 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.085725 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4394ffb6-e34b-4624-a076-e05444319f08" (UID: "4394ffb6-e34b-4624-a076-e05444319f08"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 19:11:36.087378 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.087347 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4394ffb6-e34b-4624-a076-e05444319f08-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4394ffb6-e34b-4624-a076-e05444319f08" (UID: "4394ffb6-e34b-4624-a076-e05444319f08"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 19:11:36.087478 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.087397 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4394ffb6-e34b-4624-a076-e05444319f08-kube-api-access-rz68j" (OuterVolumeSpecName: "kube-api-access-rz68j") pod "4394ffb6-e34b-4624-a076-e05444319f08" (UID: "4394ffb6-e34b-4624-a076-e05444319f08"). InnerVolumeSpecName "kube-api-access-rz68j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:11:36.087478 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.087412 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4394ffb6-e34b-4624-a076-e05444319f08-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4394ffb6-e34b-4624-a076-e05444319f08" (UID: "4394ffb6-e34b-4624-a076-e05444319f08"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 19:11:36.186036 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.185983 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4394ffb6-e34b-4624-a076-e05444319f08-console-serving-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:11:36.186036 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.186032 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-oauth-serving-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:11:36.186036 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.186042 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-console-config\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:11:36.186036 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.186050 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-trusted-ca-bundle\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:11:36.186316 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.186059 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4394ffb6-e34b-4624-a076-e05444319f08-service-ca\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:11:36.186316 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.186067 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4394ffb6-e34b-4624-a076-e05444319f08-console-oauth-config\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:11:36.186316 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.186076 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rz68j\" (UniqueName: \"kubernetes.io/projected/4394ffb6-e34b-4624-a076-e05444319f08-kube-api-access-rz68j\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:11:36.525551 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.525518 2563 scope.go:117] "RemoveContainer" containerID="88477a642b82d676ae94e315b24f85a6db1ab98aadfc53dc5311c3c42810ce2c" Jul 14 19:11:36.790373 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.790286 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fb95c757c-vx5s5" Jul 14 19:11:36.790816 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.790287 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fb95c757c-vx5s5" event={"ID":"4394ffb6-e34b-4624-a076-e05444319f08","Type":"ContainerDied","Data":"88477a642b82d676ae94e315b24f85a6db1ab98aadfc53dc5311c3c42810ce2c"} Jul 14 19:11:36.790816 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.790428 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fb95c757c-vx5s5" event={"ID":"4394ffb6-e34b-4624-a076-e05444319f08","Type":"ContainerDied","Data":"693a08faeed547c040bcd72d7d3c838210396105ef99c52fbaf1560f478f3f85"} Jul 14 19:11:36.827947 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.827907 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fb95c757c-vx5s5"] Jul 14 19:11:36.831213 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:36.831183 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7fb95c757c-vx5s5"] Jul 14 19:11:38.567311 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:11:38.567257 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4394ffb6-e34b-4624-a076-e05444319f08" path="/var/lib/kubelet/pods/4394ffb6-e34b-4624-a076-e05444319f08/volumes" Jul 14 19:14:36.507283 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:14:36.507251 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trrs2_a5633a96-04d9-465c-ae2c-2b5d013f4381/ovn-acl-logging/0.log" Jul 14 19:14:36.510999 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:14:36.510975 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trrs2_a5633a96-04d9-465c-ae2c-2b5d013f4381/ovn-acl-logging/0.log" Jul 14 19:19:12.490901 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.490866 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q"] Jul 14 19:19:12.491660 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.491470 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4394ffb6-e34b-4624-a076-e05444319f08" containerName="console" Jul 14 19:19:12.491660 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.491488 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4394ffb6-e34b-4624-a076-e05444319f08" containerName="console" Jul 14 19:19:12.491660 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.491607 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4394ffb6-e34b-4624-a076-e05444319f08" containerName="console" Jul 14 19:19:12.494998 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.494975 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.498001 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.497974 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-61c60be8-openshift-default-dockercfg-p6xvp\"" Jul 14 19:19:12.520814 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.520785 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q"] Jul 14 19:19:12.560951 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.560910 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-podinfo\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.561124 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.560960 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-envoy\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.561124 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.561033 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-token\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.561124 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.561091 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-workload-certs\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.561292 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.561127 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-credential-socket\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.561292 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.561231 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-workload-socket\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.561292 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.561278 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-data\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.561400 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.561297 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9d56195-29d0-4c8c-b385-bae32520d8da-istiod-ca-cert\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.561400 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.561327 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkc9j\" (UniqueName: \"kubernetes.io/projected/b9d56195-29d0-4c8c-b385-bae32520d8da-kube-api-access-bkc9j\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.662821 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.662786 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-podinfo\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.662821 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.662828 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-envoy\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.663096 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.662853 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-token\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.663096 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.662889 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-workload-certs\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.663096 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.662907 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-credential-socket\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.663096 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.662932 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-workload-socket\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.663096 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.662963 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-data\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.663096 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.662991 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9d56195-29d0-4c8c-b385-bae32520d8da-istiod-ca-cert\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.663096 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.663033 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkc9j\" (UniqueName: \"kubernetes.io/projected/b9d56195-29d0-4c8c-b385-bae32520d8da-kube-api-access-bkc9j\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.663477 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.663335 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-credential-socket\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.663557 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.663530 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-workload-certs\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.663665 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.663643 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-data\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.663831 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.663811 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-workload-socket\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.663888 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.663842 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9d56195-29d0-4c8c-b385-bae32520d8da-istiod-ca-cert\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.665792 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.665773 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-envoy\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.665990 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.665976 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-podinfo\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.671122 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.671097 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-token\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.671248 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.671232 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkc9j\" (UniqueName: \"kubernetes.io/projected/b9d56195-29d0-4c8c-b385-bae32520d8da-kube-api-access-bkc9j\") pod \"e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.806272 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.806231 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:12.947885 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.947854 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q"] Jul 14 19:19:12.949187 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:19:12.949162 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9d56195_29d0_4c8c_b385_bae32520d8da.slice/crio-db519692e95272f693f594cbd52bf13ecb461cbfb5527ab3e0ce598c7859aff4 WatchSource:0}: Error finding container db519692e95272f693f594cbd52bf13ecb461cbfb5527ab3e0ce598c7859aff4: Status 404 returned error can't find the container with id db519692e95272f693f594cbd52bf13ecb461cbfb5527ab3e0ce598c7859aff4 Jul 14 19:19:12.951232 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.951197 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:19:12.951297 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.951268 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:19:12.951343 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:12.951301 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:19:13.160521 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:13.160422 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" event={"ID":"b9d56195-29d0-4c8c-b385-bae32520d8da","Type":"ContainerStarted","Data":"a4f862a58ff44934d788cb28cdb2b9149835f86f62a26cdccdcd6e97b11e6908"} Jul 14 19:19:13.160521 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:13.160487 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" event={"ID":"b9d56195-29d0-4c8c-b385-bae32520d8da","Type":"ContainerStarted","Data":"db519692e95272f693f594cbd52bf13ecb461cbfb5527ab3e0ce598c7859aff4"} Jul 14 19:19:13.185244 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:13.185183 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" podStartSLOduration=1.185161404 podStartE2EDuration="1.185161404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:19:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:19:13.181869813 +0000 UTC m=+1477.180762667" watchObservedRunningTime="2026-07-14 19:19:13.185161404 +0000 UTC m=+1477.184054223" Jul 14 19:19:13.806928 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:13.806894 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:14.812667 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:14.812629 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:15.171207 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:15.171106 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:15.171963 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:15.171945 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:25.222732 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:25.222643 2563 generic.go:356] "Generic (PLEG): container finished" podID="b9d56195-29d0-4c8c-b385-bae32520d8da" containerID="a4f862a58ff44934d788cb28cdb2b9149835f86f62a26cdccdcd6e97b11e6908" exitCode=0 Jul 14 19:19:25.223101 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:25.222724 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" event={"ID":"b9d56195-29d0-4c8c-b385-bae32520d8da","Type":"ContainerDied","Data":"a4f862a58ff44934d788cb28cdb2b9149835f86f62a26cdccdcd6e97b11e6908"} Jul 14 19:19:25.223141 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:25.223103 2563 scope.go:117] "RemoveContainer" containerID="a4f862a58ff44934d788cb28cdb2b9149835f86f62a26cdccdcd6e97b11e6908" Jul 14 19:19:25.224110 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:25.224084 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:19:25.224168 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:25.224154 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:19:25.224205 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:25.224197 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:19:26.234688 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:26.234643 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" event={"ID":"b9d56195-29d0-4c8c-b385-bae32520d8da","Type":"ContainerStarted","Data":"c467ca13e5675b04e364b72af4631be023b5bdad2744509460482b17bd6f71cd"} Jul 14 19:19:26.807244 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:26.807214 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:26.808347 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:26.808317 2563 patch_prober.go:28] interesting pod/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 14 19:19:26.808490 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:26.808365 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" podUID="b9d56195-29d0-4c8c-b385-bae32520d8da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 14 19:19:27.807432 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:27.807399 2563 patch_prober.go:28] interesting pod/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 14 19:19:27.807882 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:27.807452 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" podUID="b9d56195-29d0-4c8c-b385-bae32520d8da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 14 19:19:28.807011 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:28.806977 2563 patch_prober.go:28] interesting pod/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 14 19:19:28.807199 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:28.807030 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" podUID="b9d56195-29d0-4c8c-b385-bae32520d8da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 14 19:19:29.807058 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:29.807020 2563 patch_prober.go:28] interesting pod/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 14 19:19:29.807448 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:29.807086 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" podUID="b9d56195-29d0-4c8c-b385-bae32520d8da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 14 19:19:30.171974 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:30.171886 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:30.811070 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:30.811042 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:30.812071 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:30.812049 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:19:36.541615 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:36.541568 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trrs2_a5633a96-04d9-465c-ae2c-2b5d013f4381/ovn-acl-logging/0.log" Jul 14 19:19:36.546977 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:19:36.546957 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trrs2_a5633a96-04d9-465c-ae2c-2b5d013f4381/ovn-acl-logging/0.log" Jul 14 19:20:44.074741 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.074702 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q"] Jul 14 19:20:44.075279 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.074973 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" podUID="b9d56195-29d0-4c8c-b385-bae32520d8da" containerName="istio-proxy" containerID="cri-o://c467ca13e5675b04e364b72af4631be023b5bdad2744509460482b17bd6f71cd" gracePeriod=30 Jul 14 19:20:44.607988 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.607952 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg"] Jul 14 19:20:44.610962 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.610941 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.613522 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.613499 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-040d121d-gw-openshift-default-dockercfg-td96n\"" Jul 14 19:20:44.624208 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.624179 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg"] Jul 14 19:20:44.658098 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.658059 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-data\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.658275 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.658105 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c00b6c5f-cade-4713-b5eb-fc446774043b-istiod-ca-cert\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.658275 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.658204 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-envoy\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.658418 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.658401 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxmwg\" (UniqueName: \"kubernetes.io/projected/c00b6c5f-cade-4713-b5eb-fc446774043b-kube-api-access-nxmwg\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.658480 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.658448 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-credential-socket\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.658546 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.658525 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-workload-socket\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.658591 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.658571 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-podinfo\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.658657 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.658611 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-workload-certs\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.658693 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.658654 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-token\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.760018 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.759968 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxmwg\" (UniqueName: \"kubernetes.io/projected/c00b6c5f-cade-4713-b5eb-fc446774043b-kube-api-access-nxmwg\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.760018 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.760016 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-credential-socket\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.760261 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.760067 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-workload-socket\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.760261 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.760101 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-podinfo\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.760261 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.760162 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-workload-certs\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.760261 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.760192 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-token\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.760261 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.760228 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-data\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.760261 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.760255 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c00b6c5f-cade-4713-b5eb-fc446774043b-istiod-ca-cert\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.760569 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.760301 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-envoy\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.760569 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.760530 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-credential-socket\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.760569 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.760541 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-workload-socket\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.760767 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.760631 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-data\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.760872 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.760841 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-workload-certs\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.761145 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.761126 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c00b6c5f-cade-4713-b5eb-fc446774043b-istiod-ca-cert\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.762681 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.762656 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-envoy\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.762926 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.762907 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-podinfo\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.769297 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.769271 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-token\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.769409 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.769399 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxmwg\" (UniqueName: \"kubernetes.io/projected/c00b6c5f-cade-4713-b5eb-fc446774043b-kube-api-access-nxmwg\") pod \"e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:44.924667 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:44.924568 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:45.065209 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:45.065169 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg"] Jul 14 19:20:45.066567 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:20:45.066542 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc00b6c5f_cade_4713_b5eb_fc446774043b.slice/crio-452088decba2bce5283b79332d99565326aec377bbd3648dd4fb80dc2d82ce20 WatchSource:0}: Error finding container 452088decba2bce5283b79332d99565326aec377bbd3648dd4fb80dc2d82ce20: Status 404 returned error can't find the container with id 452088decba2bce5283b79332d99565326aec377bbd3648dd4fb80dc2d82ce20 Jul 14 19:20:45.068774 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:45.068738 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:20:45.068872 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:45.068820 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:20:45.068872 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:45.068855 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:20:45.647315 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:45.647270 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" event={"ID":"c00b6c5f-cade-4713-b5eb-fc446774043b","Type":"ContainerStarted","Data":"5c258d3d871e9b75264d0369c12503e5f1a26dca2f0e1e5931448399de419204"} Jul 14 19:20:45.647735 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:45.647337 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" event={"ID":"c00b6c5f-cade-4713-b5eb-fc446774043b","Type":"ContainerStarted","Data":"452088decba2bce5283b79332d99565326aec377bbd3648dd4fb80dc2d82ce20"} Jul 14 19:20:45.674793 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:45.674732 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" podStartSLOduration=1.674716043 podStartE2EDuration="1.674716043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:20:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:20:45.6729496 +0000 UTC m=+1569.671842420" watchObservedRunningTime="2026-07-14 19:20:45.674716043 +0000 UTC m=+1569.673608851" Jul 14 19:20:45.814363 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:45.814327 2563 patch_prober.go:28] interesting pod/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 19:20:45.814520 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:45.814387 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" podUID="b9d56195-29d0-4c8c-b385-bae32520d8da" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 19:20:45.925655 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:45.925552 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:46.931081 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:46.931048 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:47.660327 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:47.660300 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:47.661207 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:47.661186 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:20:49.327794 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.327769 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:20:49.403481 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.403443 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkc9j\" (UniqueName: \"kubernetes.io/projected/b9d56195-29d0-4c8c-b385-bae32520d8da-kube-api-access-bkc9j\") pod \"b9d56195-29d0-4c8c-b385-bae32520d8da\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " Jul 14 19:20:49.403658 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.403504 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-workload-certs\") pod \"b9d56195-29d0-4c8c-b385-bae32520d8da\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " Jul 14 19:20:49.403658 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.403542 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-envoy\") pod \"b9d56195-29d0-4c8c-b385-bae32520d8da\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " Jul 14 19:20:49.403785 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.403654 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-credential-socket\") pod \"b9d56195-29d0-4c8c-b385-bae32520d8da\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " Jul 14 19:20:49.403785 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.403688 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-token\") pod \"b9d56195-29d0-4c8c-b385-bae32520d8da\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " Jul 14 19:20:49.403785 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.403773 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9d56195-29d0-4c8c-b385-bae32520d8da-istiod-ca-cert\") pod \"b9d56195-29d0-4c8c-b385-bae32520d8da\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " Jul 14 19:20:49.403944 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.403773 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b9d56195-29d0-4c8c-b385-bae32520d8da" (UID: "b9d56195-29d0-4c8c-b385-bae32520d8da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:20:49.403944 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.403828 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-workload-socket\") pod \"b9d56195-29d0-4c8c-b385-bae32520d8da\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " Jul 14 19:20:49.403944 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.403859 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-podinfo\") pod \"b9d56195-29d0-4c8c-b385-bae32520d8da\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " Jul 14 19:20:49.403944 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.403891 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-data\") pod \"b9d56195-29d0-4c8c-b385-bae32520d8da\" (UID: \"b9d56195-29d0-4c8c-b385-bae32520d8da\") " Jul 14 19:20:49.404154 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.404007 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b9d56195-29d0-4c8c-b385-bae32520d8da" (UID: "b9d56195-29d0-4c8c-b385-bae32520d8da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:20:49.404256 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.404237 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-workload-certs\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:20:49.404419 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.404263 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-credential-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:20:49.404959 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.404903 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9d56195-29d0-4c8c-b385-bae32520d8da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b9d56195-29d0-4c8c-b385-bae32520d8da" (UID: "b9d56195-29d0-4c8c-b385-bae32520d8da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 19:20:49.405167 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.405140 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-data" (OuterVolumeSpecName: "istio-data") pod "b9d56195-29d0-4c8c-b385-bae32520d8da" (UID: "b9d56195-29d0-4c8c-b385-bae32520d8da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:20:49.405336 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.405318 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b9d56195-29d0-4c8c-b385-bae32520d8da" (UID: "b9d56195-29d0-4c8c-b385-bae32520d8da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:20:49.406381 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.406340 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b9d56195-29d0-4c8c-b385-bae32520d8da" (UID: "b9d56195-29d0-4c8c-b385-bae32520d8da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:20:49.406381 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.406371 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-token" (OuterVolumeSpecName: "istio-token") pod "b9d56195-29d0-4c8c-b385-bae32520d8da" (UID: "b9d56195-29d0-4c8c-b385-bae32520d8da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:20:49.406508 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.406430 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9d56195-29d0-4c8c-b385-bae32520d8da-kube-api-access-bkc9j" (OuterVolumeSpecName: "kube-api-access-bkc9j") pod "b9d56195-29d0-4c8c-b385-bae32520d8da" (UID: "b9d56195-29d0-4c8c-b385-bae32520d8da"). InnerVolumeSpecName "kube-api-access-bkc9j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:20:49.406823 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.406798 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b9d56195-29d0-4c8c-b385-bae32520d8da" (UID: "b9d56195-29d0-4c8c-b385-bae32520d8da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 19:20:49.505122 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.505082 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-workload-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:20:49.505122 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.505117 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-podinfo\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:20:49.505122 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.505125 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-data\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:20:49.505354 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.505134 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkc9j\" (UniqueName: \"kubernetes.io/projected/b9d56195-29d0-4c8c-b385-bae32520d8da-kube-api-access-bkc9j\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:20:49.505354 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.505143 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-envoy\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:20:49.505354 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.505151 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9d56195-29d0-4c8c-b385-bae32520d8da-istio-token\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:20:49.505354 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.505158 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9d56195-29d0-4c8c-b385-bae32520d8da-istiod-ca-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:20:49.671728 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.671640 2563 generic.go:356] "Generic (PLEG): container finished" podID="b9d56195-29d0-4c8c-b385-bae32520d8da" containerID="c467ca13e5675b04e364b72af4631be023b5bdad2744509460482b17bd6f71cd" exitCode=0 Jul 14 19:20:49.671728 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.671686 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" Jul 14 19:20:49.671898 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.671730 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" event={"ID":"b9d56195-29d0-4c8c-b385-bae32520d8da","Type":"ContainerDied","Data":"c467ca13e5675b04e364b72af4631be023b5bdad2744509460482b17bd6f71cd"} Jul 14 19:20:49.671898 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.671785 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q" event={"ID":"b9d56195-29d0-4c8c-b385-bae32520d8da","Type":"ContainerDied","Data":"db519692e95272f693f594cbd52bf13ecb461cbfb5527ab3e0ce598c7859aff4"} Jul 14 19:20:49.671898 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.671808 2563 scope.go:117] "RemoveContainer" containerID="c467ca13e5675b04e364b72af4631be023b5bdad2744509460482b17bd6f71cd" Jul 14 19:20:49.681362 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.681346 2563 scope.go:117] "RemoveContainer" containerID="a4f862a58ff44934d788cb28cdb2b9149835f86f62a26cdccdcd6e97b11e6908" Jul 14 19:20:49.689400 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.689381 2563 scope.go:117] "RemoveContainer" containerID="c467ca13e5675b04e364b72af4631be023b5bdad2744509460482b17bd6f71cd" Jul 14 19:20:49.689697 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:20:49.689678 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c467ca13e5675b04e364b72af4631be023b5bdad2744509460482b17bd6f71cd\": container with ID starting with c467ca13e5675b04e364b72af4631be023b5bdad2744509460482b17bd6f71cd not found: ID does not exist" containerID="c467ca13e5675b04e364b72af4631be023b5bdad2744509460482b17bd6f71cd" Jul 14 19:20:49.689752 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.689707 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c467ca13e5675b04e364b72af4631be023b5bdad2744509460482b17bd6f71cd"} err="failed to get container status \"c467ca13e5675b04e364b72af4631be023b5bdad2744509460482b17bd6f71cd\": rpc error: code = NotFound desc = could not find container \"c467ca13e5675b04e364b72af4631be023b5bdad2744509460482b17bd6f71cd\": container with ID starting with c467ca13e5675b04e364b72af4631be023b5bdad2744509460482b17bd6f71cd not found: ID does not exist" Jul 14 19:20:49.689752 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.689724 2563 scope.go:117] "RemoveContainer" containerID="a4f862a58ff44934d788cb28cdb2b9149835f86f62a26cdccdcd6e97b11e6908" Jul 14 19:20:49.689984 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:20:49.689967 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4f862a58ff44934d788cb28cdb2b9149835f86f62a26cdccdcd6e97b11e6908\": container with ID starting with a4f862a58ff44934d788cb28cdb2b9149835f86f62a26cdccdcd6e97b11e6908 not found: ID does not exist" containerID="a4f862a58ff44934d788cb28cdb2b9149835f86f62a26cdccdcd6e97b11e6908" Jul 14 19:20:49.690033 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.689990 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4f862a58ff44934d788cb28cdb2b9149835f86f62a26cdccdcd6e97b11e6908"} err="failed to get container status \"a4f862a58ff44934d788cb28cdb2b9149835f86f62a26cdccdcd6e97b11e6908\": rpc error: code = NotFound desc = could not find container \"a4f862a58ff44934d788cb28cdb2b9149835f86f62a26cdccdcd6e97b11e6908\": container with ID starting with a4f862a58ff44934d788cb28cdb2b9149835f86f62a26cdccdcd6e97b11e6908 not found: ID does not exist" Jul 14 19:20:49.694001 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.693979 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q"] Jul 14 19:20:49.698106 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:49.698086 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-61c60be8-openshift-default-6ccc798bb9-fr22q"] Jul 14 19:20:50.567391 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:20:50.567357 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9d56195-29d0-4c8c-b385-bae32520d8da" path="/var/lib/kubelet/pods/b9d56195-29d0-4c8c-b385-bae32520d8da/volumes" Jul 14 19:21:01.742534 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:01.742433 2563 generic.go:356] "Generic (PLEG): container finished" podID="c00b6c5f-cade-4713-b5eb-fc446774043b" containerID="5c258d3d871e9b75264d0369c12503e5f1a26dca2f0e1e5931448399de419204" exitCode=0 Jul 14 19:21:01.742534 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:01.742474 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" event={"ID":"c00b6c5f-cade-4713-b5eb-fc446774043b","Type":"ContainerDied","Data":"5c258d3d871e9b75264d0369c12503e5f1a26dca2f0e1e5931448399de419204"} Jul 14 19:21:01.743015 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:01.742869 2563 scope.go:117] "RemoveContainer" containerID="5c258d3d871e9b75264d0369c12503e5f1a26dca2f0e1e5931448399de419204" Jul 14 19:21:01.743912 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:01.743880 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:21:01.743973 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:01.743950 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:21:01.744009 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:01.743980 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:21:02.660873 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:02.660843 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:21:02.752218 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:02.752179 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" event={"ID":"c00b6c5f-cade-4713-b5eb-fc446774043b","Type":"ContainerStarted","Data":"01b320932a84b2f0f55b3bcef33f6b4ac83902e509f5679588d2ea7691144459"} Jul 14 19:21:02.926375 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:02.926279 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:21:02.926551 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:02.926452 2563 patch_prober.go:28] interesting pod/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 14 19:21:02.926551 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:02.926506 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" podUID="c00b6c5f-cade-4713-b5eb-fc446774043b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 14 19:21:03.926041 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:03.926001 2563 patch_prober.go:28] interesting pod/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 14 19:21:03.926665 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:03.926630 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" podUID="c00b6c5f-cade-4713-b5eb-fc446774043b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 14 19:21:04.925996 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:04.925948 2563 patch_prober.go:28] interesting pod/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 14 19:21:04.926216 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:04.926034 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" podUID="c00b6c5f-cade-4713-b5eb-fc446774043b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 14 19:21:05.925989 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:05.925947 2563 patch_prober.go:28] interesting pod/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 14 19:21:05.926259 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:05.926036 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" podUID="c00b6c5f-cade-4713-b5eb-fc446774043b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 14 19:21:06.929366 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:06.929331 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:21:06.929752 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:06.929702 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:21:06.930317 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:06.930295 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:21:50.497563 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:50.497525 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg"] Jul 14 19:21:50.498087 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:50.497757 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" podUID="c00b6c5f-cade-4713-b5eb-fc446774043b" containerName="istio-proxy" containerID="cri-o://01b320932a84b2f0f55b3bcef33f6b4ac83902e509f5679588d2ea7691144459" gracePeriod=30 Jul 14 19:21:51.932487 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:51.932448 2563 patch_prober.go:28] interesting pod/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 19:21:51.932877 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:51.932510 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" podUID="c00b6c5f-cade-4713-b5eb-fc446774043b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 19:21:55.759251 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.759222 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:21:55.848313 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.848284 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxmwg\" (UniqueName: \"kubernetes.io/projected/c00b6c5f-cade-4713-b5eb-fc446774043b-kube-api-access-nxmwg\") pod \"c00b6c5f-cade-4713-b5eb-fc446774043b\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " Jul 14 19:21:55.848483 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.848344 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-token\") pod \"c00b6c5f-cade-4713-b5eb-fc446774043b\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " Jul 14 19:21:55.848483 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.848405 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-workload-socket\") pod \"c00b6c5f-cade-4713-b5eb-fc446774043b\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " Jul 14 19:21:55.848483 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.848441 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-podinfo\") pod \"c00b6c5f-cade-4713-b5eb-fc446774043b\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " Jul 14 19:21:55.848659 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.848500 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-envoy\") pod \"c00b6c5f-cade-4713-b5eb-fc446774043b\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " Jul 14 19:21:55.848659 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.848535 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-credential-socket\") pod \"c00b6c5f-cade-4713-b5eb-fc446774043b\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " Jul 14 19:21:55.848659 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.848563 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-workload-certs\") pod \"c00b6c5f-cade-4713-b5eb-fc446774043b\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " Jul 14 19:21:55.848659 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.848645 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-data\") pod \"c00b6c5f-cade-4713-b5eb-fc446774043b\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " Jul 14 19:21:55.848860 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.848711 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c00b6c5f-cade-4713-b5eb-fc446774043b-istiod-ca-cert\") pod \"c00b6c5f-cade-4713-b5eb-fc446774043b\" (UID: \"c00b6c5f-cade-4713-b5eb-fc446774043b\") " Jul 14 19:21:55.848860 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.848741 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c00b6c5f-cade-4713-b5eb-fc446774043b" (UID: "c00b6c5f-cade-4713-b5eb-fc446774043b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:21:55.849037 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.849003 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c00b6c5f-cade-4713-b5eb-fc446774043b" (UID: "c00b6c5f-cade-4713-b5eb-fc446774043b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:21:55.849037 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.849021 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-workload-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:21:55.849711 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.849528 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c00b6c5f-cade-4713-b5eb-fc446774043b" (UID: "c00b6c5f-cade-4713-b5eb-fc446774043b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:21:55.849711 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.849631 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c00b6c5f-cade-4713-b5eb-fc446774043b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c00b6c5f-cade-4713-b5eb-fc446774043b" (UID: "c00b6c5f-cade-4713-b5eb-fc446774043b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 19:21:55.850304 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.850274 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-data" (OuterVolumeSpecName: "istio-data") pod "c00b6c5f-cade-4713-b5eb-fc446774043b" (UID: "c00b6c5f-cade-4713-b5eb-fc446774043b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:21:55.850768 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.850739 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-token" (OuterVolumeSpecName: "istio-token") pod "c00b6c5f-cade-4713-b5eb-fc446774043b" (UID: "c00b6c5f-cade-4713-b5eb-fc446774043b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:21:55.850996 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.850967 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c00b6c5f-cade-4713-b5eb-fc446774043b" (UID: "c00b6c5f-cade-4713-b5eb-fc446774043b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 19:21:55.850996 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.850989 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c00b6c5f-cade-4713-b5eb-fc446774043b" (UID: "c00b6c5f-cade-4713-b5eb-fc446774043b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:21:55.851091 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.851050 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c00b6c5f-cade-4713-b5eb-fc446774043b-kube-api-access-nxmwg" (OuterVolumeSpecName: "kube-api-access-nxmwg") pod "c00b6c5f-cade-4713-b5eb-fc446774043b" (UID: "c00b6c5f-cade-4713-b5eb-fc446774043b"). InnerVolumeSpecName "kube-api-access-nxmwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:21:55.949887 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.949852 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c00b6c5f-cade-4713-b5eb-fc446774043b-istiod-ca-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:21:55.949887 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.949881 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxmwg\" (UniqueName: \"kubernetes.io/projected/c00b6c5f-cade-4713-b5eb-fc446774043b-kube-api-access-nxmwg\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:21:55.949887 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.949894 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-token\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:21:55.950118 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.949905 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-podinfo\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:21:55.950118 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.949917 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-envoy\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:21:55.950118 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.949927 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-credential-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:21:55.950118 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.949939 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-workload-certs\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:21:55.950118 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:55.949949 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c00b6c5f-cade-4713-b5eb-fc446774043b-istio-data\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:21:56.022801 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:56.022769 2563 generic.go:356] "Generic (PLEG): container finished" podID="c00b6c5f-cade-4713-b5eb-fc446774043b" containerID="01b320932a84b2f0f55b3bcef33f6b4ac83902e509f5679588d2ea7691144459" exitCode=0 Jul 14 19:21:56.022957 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:56.022817 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" event={"ID":"c00b6c5f-cade-4713-b5eb-fc446774043b","Type":"ContainerDied","Data":"01b320932a84b2f0f55b3bcef33f6b4ac83902e509f5679588d2ea7691144459"} Jul 14 19:21:56.022957 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:56.022820 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" Jul 14 19:21:56.022957 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:56.022861 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg" event={"ID":"c00b6c5f-cade-4713-b5eb-fc446774043b","Type":"ContainerDied","Data":"452088decba2bce5283b79332d99565326aec377bbd3648dd4fb80dc2d82ce20"} Jul 14 19:21:56.022957 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:56.022882 2563 scope.go:117] "RemoveContainer" containerID="01b320932a84b2f0f55b3bcef33f6b4ac83902e509f5679588d2ea7691144459" Jul 14 19:21:56.032135 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:56.032113 2563 scope.go:117] "RemoveContainer" containerID="5c258d3d871e9b75264d0369c12503e5f1a26dca2f0e1e5931448399de419204" Jul 14 19:21:56.040364 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:56.040348 2563 scope.go:117] "RemoveContainer" containerID="01b320932a84b2f0f55b3bcef33f6b4ac83902e509f5679588d2ea7691144459" Jul 14 19:21:56.040624 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:21:56.040589 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01b320932a84b2f0f55b3bcef33f6b4ac83902e509f5679588d2ea7691144459\": container with ID starting with 01b320932a84b2f0f55b3bcef33f6b4ac83902e509f5679588d2ea7691144459 not found: ID does not exist" containerID="01b320932a84b2f0f55b3bcef33f6b4ac83902e509f5679588d2ea7691144459" Jul 14 19:21:56.040689 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:56.040631 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01b320932a84b2f0f55b3bcef33f6b4ac83902e509f5679588d2ea7691144459"} err="failed to get container status \"01b320932a84b2f0f55b3bcef33f6b4ac83902e509f5679588d2ea7691144459\": rpc error: code = NotFound desc = could not find container \"01b320932a84b2f0f55b3bcef33f6b4ac83902e509f5679588d2ea7691144459\": container with ID starting with 01b320932a84b2f0f55b3bcef33f6b4ac83902e509f5679588d2ea7691144459 not found: ID does not exist" Jul 14 19:21:56.040689 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:56.040645 2563 scope.go:117] "RemoveContainer" containerID="5c258d3d871e9b75264d0369c12503e5f1a26dca2f0e1e5931448399de419204" Jul 14 19:21:56.040845 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:21:56.040832 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c258d3d871e9b75264d0369c12503e5f1a26dca2f0e1e5931448399de419204\": container with ID starting with 5c258d3d871e9b75264d0369c12503e5f1a26dca2f0e1e5931448399de419204 not found: ID does not exist" containerID="5c258d3d871e9b75264d0369c12503e5f1a26dca2f0e1e5931448399de419204" Jul 14 19:21:56.040884 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:56.040848 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c258d3d871e9b75264d0369c12503e5f1a26dca2f0e1e5931448399de419204"} err="failed to get container status \"5c258d3d871e9b75264d0369c12503e5f1a26dca2f0e1e5931448399de419204\": rpc error: code = NotFound desc = could not find container \"5c258d3d871e9b75264d0369c12503e5f1a26dca2f0e1e5931448399de419204\": container with ID starting with 5c258d3d871e9b75264d0369c12503e5f1a26dca2f0e1e5931448399de419204 not found: ID does not exist" Jul 14 19:21:56.044385 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:56.044365 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg"] Jul 14 19:21:56.048727 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:56.048705 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-040d121d-gw-openshift-default-5bc594467-gxgzg"] Jul 14 19:21:56.569460 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:21:56.569428 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c00b6c5f-cade-4713-b5eb-fc446774043b" path="/var/lib/kubelet/pods/c00b6c5f-cade-4713-b5eb-fc446774043b/volumes" Jul 14 19:22:02.859136 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.859103 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7"] Jul 14 19:22:02.859537 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.859474 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9d56195-29d0-4c8c-b385-bae32520d8da" containerName="istio-proxy" Jul 14 19:22:02.859537 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.859487 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9d56195-29d0-4c8c-b385-bae32520d8da" containerName="istio-proxy" Jul 14 19:22:02.859537 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.859496 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9d56195-29d0-4c8c-b385-bae32520d8da" containerName="istio-proxy" Jul 14 19:22:02.859537 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.859501 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9d56195-29d0-4c8c-b385-bae32520d8da" containerName="istio-proxy" Jul 14 19:22:02.859537 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.859506 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c00b6c5f-cade-4713-b5eb-fc446774043b" containerName="istio-proxy" Jul 14 19:22:02.859537 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.859513 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c00b6c5f-cade-4713-b5eb-fc446774043b" containerName="istio-proxy" Jul 14 19:22:02.859537 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.859533 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c00b6c5f-cade-4713-b5eb-fc446774043b" containerName="istio-proxy" Jul 14 19:22:02.859537 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.859539 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c00b6c5f-cade-4713-b5eb-fc446774043b" containerName="istio-proxy" Jul 14 19:22:02.859819 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.859589 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c00b6c5f-cade-4713-b5eb-fc446774043b" containerName="istio-proxy" Jul 14 19:22:02.859819 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.859619 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9d56195-29d0-4c8c-b385-bae32520d8da" containerName="istio-proxy" Jul 14 19:22:02.859819 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.859630 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c00b6c5f-cade-4713-b5eb-fc446774043b" containerName="istio-proxy" Jul 14 19:22:02.859819 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.859637 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9d56195-29d0-4c8c-b385-bae32520d8da" containerName="istio-proxy" Jul 14 19:22:02.864256 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.864231 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:02.866948 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.866927 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1877882c-openshift-default-dockercfg-dfgbt\"" Jul 14 19:22:02.887649 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.887624 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7"] Jul 14 19:22:02.912577 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.912551 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-workload-socket\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:02.912746 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.912623 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnbkk\" (UniqueName: \"kubernetes.io/projected/006137b7-700e-42f7-a342-a098cad0bf1e-kube-api-access-jnbkk\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:02.912746 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.912651 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-istio-envoy\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:02.912839 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.912776 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-workload-certs\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:02.912839 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.912811 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-credential-socket\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:02.912839 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.912833 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/006137b7-700e-42f7-a342-a098cad0bf1e-istio-podinfo\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:02.912989 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.912971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-istio-data\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:02.913027 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.912999 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/006137b7-700e-42f7-a342-a098cad0bf1e-istio-token\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:02.913069 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:02.913030 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/006137b7-700e-42f7-a342-a098cad0bf1e-istiod-ca-cert\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:03.014263 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.014231 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-istio-data\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:03.014263 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.014266 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/006137b7-700e-42f7-a342-a098cad0bf1e-istio-token\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:03.014515 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.014290 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/006137b7-700e-42f7-a342-a098cad0bf1e-istiod-ca-cert\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:03.014515 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.014322 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-workload-socket\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:03.014515 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.014349 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnbkk\" (UniqueName: \"kubernetes.io/projected/006137b7-700e-42f7-a342-a098cad0bf1e-kube-api-access-jnbkk\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:03.014515 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.014366 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-istio-envoy\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:03.014515 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.014428 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-workload-certs\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:03.014814 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.014573 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-credential-socket\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:03.014814 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.014650 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/006137b7-700e-42f7-a342-a098cad0bf1e-istio-podinfo\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:03.014814 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.014700 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-istio-data\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:03.014934 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.014823 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-workload-socket\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:03.014934 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.014886 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-credential-socket\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:03.015013 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.014961 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-workload-certs\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:03.015135 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.015114 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/006137b7-700e-42f7-a342-a098cad0bf1e-istiod-ca-cert\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:03.016842 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.016824 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-istio-envoy\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:03.017125 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.017109 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/006137b7-700e-42f7-a342-a098cad0bf1e-istio-podinfo\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:03.022387 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.022360 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/006137b7-700e-42f7-a342-a098cad0bf1e-istio-token\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:03.022545 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.022527 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnbkk\" (UniqueName: \"kubernetes.io/projected/006137b7-700e-42f7-a342-a098cad0bf1e-kube-api-access-jnbkk\") pod \"e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:03.175032 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.174940 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:03.317995 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.317964 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7"] Jul 14 19:22:03.319759 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:22:03.319734 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod006137b7_700e_42f7_a342_a098cad0bf1e.slice/crio-9834405dce0929317d5808f569c60f1e3e4363e59f3143159407bcde35d2de73 WatchSource:0}: Error finding container 9834405dce0929317d5808f569c60f1e3e4363e59f3143159407bcde35d2de73: Status 404 returned error can't find the container with id 9834405dce0929317d5808f569c60f1e3e4363e59f3143159407bcde35d2de73 Jul 14 19:22:03.322017 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.321977 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:22:03.322109 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.322062 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:22:03.322150 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:03.322107 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:22:04.067681 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:04.067558 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" event={"ID":"006137b7-700e-42f7-a342-a098cad0bf1e","Type":"ContainerStarted","Data":"7ad7ac473e612b4861a3fffd0b2f89b776a73e3a31759cf9f3183ca392b553d4"} Jul 14 19:22:04.067681 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:04.067661 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" event={"ID":"006137b7-700e-42f7-a342-a098cad0bf1e","Type":"ContainerStarted","Data":"9834405dce0929317d5808f569c60f1e3e4363e59f3143159407bcde35d2de73"} Jul 14 19:22:04.098950 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:04.098898 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" podStartSLOduration=2.098881097 podStartE2EDuration="2.098881097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:22:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:22:04.096869825 +0000 UTC m=+1648.095762643" watchObservedRunningTime="2026-07-14 19:22:04.098881097 +0000 UTC m=+1648.097773914" Jul 14 19:22:04.176056 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:04.176016 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:04.181078 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:04.181036 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:05.073378 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:05.073346 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:05.074385 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:05.074365 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:16.134467 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:16.134428 2563 generic.go:356] "Generic (PLEG): container finished" podID="006137b7-700e-42f7-a342-a098cad0bf1e" containerID="7ad7ac473e612b4861a3fffd0b2f89b776a73e3a31759cf9f3183ca392b553d4" exitCode=0 Jul 14 19:22:16.134934 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:16.134501 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" event={"ID":"006137b7-700e-42f7-a342-a098cad0bf1e","Type":"ContainerDied","Data":"7ad7ac473e612b4861a3fffd0b2f89b776a73e3a31759cf9f3183ca392b553d4"} Jul 14 19:22:16.134934 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:16.134924 2563 scope.go:117] "RemoveContainer" containerID="7ad7ac473e612b4861a3fffd0b2f89b776a73e3a31759cf9f3183ca392b553d4" Jul 14 19:22:16.135948 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:16.135916 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:22:16.136053 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:16.136003 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:22:16.136110 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:16.136049 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:22:17.146449 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:17.146399 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" event={"ID":"006137b7-700e-42f7-a342-a098cad0bf1e","Type":"ContainerStarted","Data":"72a812f0cb778adb342950a3f9715717962e2199adc3d12fb6ef35b849080efe"} Jul 14 19:22:17.175321 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:17.175271 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:17.176689 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:17.176662 2563 patch_prober.go:28] interesting pod/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 14 19:22:17.176808 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:17.176721 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" podUID="006137b7-700e-42f7-a342-a098cad0bf1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 14 19:22:18.175782 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:18.175746 2563 patch_prober.go:28] interesting pod/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 14 19:22:18.176173 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:18.175803 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" podUID="006137b7-700e-42f7-a342-a098cad0bf1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 14 19:22:19.175276 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:19.175243 2563 patch_prober.go:28] interesting pod/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 14 19:22:19.175463 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:19.175301 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" podUID="006137b7-700e-42f7-a342-a098cad0bf1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 14 19:22:20.074287 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:20.074237 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:20.175781 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:20.175745 2563 patch_prober.go:28] interesting pod/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 14 19:22:20.175959 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:20.175813 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" podUID="006137b7-700e-42f7-a342-a098cad0bf1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 14 19:22:21.179236 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:21.179208 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:22:21.180271 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:22:21.180250 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:23:25.355412 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.355376 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7"] Jul 14 19:23:25.355975 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.355688 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" podUID="006137b7-700e-42f7-a342-a098cad0bf1e" containerName="istio-proxy" containerID="cri-o://72a812f0cb778adb342950a3f9715717962e2199adc3d12fb6ef35b849080efe" gracePeriod=30 Jul 14 19:23:25.677013 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.676981 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v"] Jul 14 19:23:25.679617 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.679574 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.687033 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.687011 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-4961650e-openshift-default-dockercfg-mqwp4\"" Jul 14 19:23:25.696715 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.696690 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v"] Jul 14 19:23:25.703217 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.703183 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-istio-data\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.703329 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.703228 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-workload-certs\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.703329 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.703250 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95bc5014-4754-4739-a86c-53eaccccaac8-istiod-ca-cert\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.703329 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.703317 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95bc5014-4754-4739-a86c-53eaccccaac8-istio-token\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.703457 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.703365 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-workload-socket\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.703457 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.703417 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95bc5014-4754-4739-a86c-53eaccccaac8-istio-podinfo\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.703541 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.703472 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-credential-socket\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.703541 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.703493 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-istio-envoy\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.703541 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.703520 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xj5t\" (UniqueName: \"kubernetes.io/projected/95bc5014-4754-4739-a86c-53eaccccaac8-kube-api-access-8xj5t\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.804986 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.804951 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-credential-socket\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.805162 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.804992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-istio-envoy\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.805162 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.805021 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xj5t\" (UniqueName: \"kubernetes.io/projected/95bc5014-4754-4739-a86c-53eaccccaac8-kube-api-access-8xj5t\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.805162 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.805073 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-istio-data\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.805162 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.805091 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-workload-certs\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.805162 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.805115 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95bc5014-4754-4739-a86c-53eaccccaac8-istiod-ca-cert\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.805162 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.805148 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95bc5014-4754-4739-a86c-53eaccccaac8-istio-token\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.805525 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.805179 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-workload-socket\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.805525 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.805227 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95bc5014-4754-4739-a86c-53eaccccaac8-istio-podinfo\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.805525 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.805412 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-credential-socket\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.805747 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.805718 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-workload-socket\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.805979 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.805764 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-workload-certs\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.805979 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.805769 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-istio-data\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.806129 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.806102 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95bc5014-4754-4739-a86c-53eaccccaac8-istiod-ca-cert\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.807457 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.807432 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-istio-envoy\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.807945 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.807923 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95bc5014-4754-4739-a86c-53eaccccaac8-istio-podinfo\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.814921 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.814900 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95bc5014-4754-4739-a86c-53eaccccaac8-istio-token\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.815943 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.815925 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xj5t\" (UniqueName: \"kubernetes.io/projected/95bc5014-4754-4739-a86c-53eaccccaac8-kube-api-access-8xj5t\") pod \"e2e-derive-4961650e-openshift-default-5558d8647-vlc4v\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:25.989372 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:25.989270 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:26.134649 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:26.134620 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v"] Jul 14 19:23:26.135975 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:23:26.135950 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95bc5014_4754_4739_a86c_53eaccccaac8.slice/crio-32d9644355ead73b7f7ecf8a5d8f7e2da94d34b45500246f9a16be45d09c7619 WatchSource:0}: Error finding container 32d9644355ead73b7f7ecf8a5d8f7e2da94d34b45500246f9a16be45d09c7619: Status 404 returned error can't find the container with id 32d9644355ead73b7f7ecf8a5d8f7e2da94d34b45500246f9a16be45d09c7619 Jul 14 19:23:26.138334 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:26.138303 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:23:26.138402 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:26.138368 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:23:26.138402 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:26.138397 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:23:26.518137 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:26.518099 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" event={"ID":"95bc5014-4754-4739-a86c-53eaccccaac8","Type":"ContainerStarted","Data":"f7a25fecd45b78bba904bfad964632fa3fefd08732abd92954d6c75c3c66e5c5"} Jul 14 19:23:26.518562 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:26.518155 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" event={"ID":"95bc5014-4754-4739-a86c-53eaccccaac8","Type":"ContainerStarted","Data":"32d9644355ead73b7f7ecf8a5d8f7e2da94d34b45500246f9a16be45d09c7619"} Jul 14 19:23:26.540435 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:26.540376 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" podStartSLOduration=1.540361125 podStartE2EDuration="1.540361125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:23:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:23:26.539952055 +0000 UTC m=+1730.538844873" watchObservedRunningTime="2026-07-14 19:23:26.540361125 +0000 UTC m=+1730.539253942" Jul 14 19:23:26.989562 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:26.989484 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:27.994492 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:27.994466 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:28.528826 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:28.528791 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:28.529709 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:28.529691 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:30.544012 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.543972 2563 generic.go:356] "Generic (PLEG): container finished" podID="006137b7-700e-42f7-a342-a098cad0bf1e" containerID="72a812f0cb778adb342950a3f9715717962e2199adc3d12fb6ef35b849080efe" exitCode=0 Jul 14 19:23:30.544865 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.544820 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" event={"ID":"006137b7-700e-42f7-a342-a098cad0bf1e","Type":"ContainerDied","Data":"72a812f0cb778adb342950a3f9715717962e2199adc3d12fb6ef35b849080efe"} Jul 14 19:23:30.544999 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.544944 2563 scope.go:117] "RemoveContainer" containerID="7ad7ac473e612b4861a3fffd0b2f89b776a73e3a31759cf9f3183ca392b553d4" Jul 14 19:23:30.611853 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.611830 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:23:30.653711 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.653634 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-workload-socket\") pod \"006137b7-700e-42f7-a342-a098cad0bf1e\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " Jul 14 19:23:30.653711 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.653690 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-workload-certs\") pod \"006137b7-700e-42f7-a342-a098cad0bf1e\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " Jul 14 19:23:30.653930 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.653713 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-istio-envoy\") pod \"006137b7-700e-42f7-a342-a098cad0bf1e\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " Jul 14 19:23:30.653930 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.653730 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/006137b7-700e-42f7-a342-a098cad0bf1e-istio-token\") pod \"006137b7-700e-42f7-a342-a098cad0bf1e\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " Jul 14 19:23:30.653930 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.653778 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/006137b7-700e-42f7-a342-a098cad0bf1e-istio-podinfo\") pod \"006137b7-700e-42f7-a342-a098cad0bf1e\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " Jul 14 19:23:30.653930 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.653802 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-credential-socket\") pod \"006137b7-700e-42f7-a342-a098cad0bf1e\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " Jul 14 19:23:30.653930 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.653845 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-istio-data\") pod \"006137b7-700e-42f7-a342-a098cad0bf1e\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " Jul 14 19:23:30.654206 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.653928 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "006137b7-700e-42f7-a342-a098cad0bf1e" (UID: "006137b7-700e-42f7-a342-a098cad0bf1e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:23:30.654206 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.653946 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnbkk\" (UniqueName: \"kubernetes.io/projected/006137b7-700e-42f7-a342-a098cad0bf1e-kube-api-access-jnbkk\") pod \"006137b7-700e-42f7-a342-a098cad0bf1e\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " Jul 14 19:23:30.654206 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.653979 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/006137b7-700e-42f7-a342-a098cad0bf1e-istiod-ca-cert\") pod \"006137b7-700e-42f7-a342-a098cad0bf1e\" (UID: \"006137b7-700e-42f7-a342-a098cad0bf1e\") " Jul 14 19:23:30.654206 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.654018 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "006137b7-700e-42f7-a342-a098cad0bf1e" (UID: "006137b7-700e-42f7-a342-a098cad0bf1e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:23:30.654423 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.654344 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "006137b7-700e-42f7-a342-a098cad0bf1e" (UID: "006137b7-700e-42f7-a342-a098cad0bf1e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:23:30.654956 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.654633 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-workload-certs\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:23:30.654956 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.654732 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-istio-data" (OuterVolumeSpecName: "istio-data") pod "006137b7-700e-42f7-a342-a098cad0bf1e" (UID: "006137b7-700e-42f7-a342-a098cad0bf1e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:23:30.654956 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.654776 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-workload-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:23:30.654956 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.654843 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/006137b7-700e-42f7-a342-a098cad0bf1e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "006137b7-700e-42f7-a342-a098cad0bf1e" (UID: "006137b7-700e-42f7-a342-a098cad0bf1e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 19:23:30.656482 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.656447 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/006137b7-700e-42f7-a342-a098cad0bf1e-kube-api-access-jnbkk" (OuterVolumeSpecName: "kube-api-access-jnbkk") pod "006137b7-700e-42f7-a342-a098cad0bf1e" (UID: "006137b7-700e-42f7-a342-a098cad0bf1e"). InnerVolumeSpecName "kube-api-access-jnbkk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:23:30.656977 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.656950 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/006137b7-700e-42f7-a342-a098cad0bf1e-istio-token" (OuterVolumeSpecName: "istio-token") pod "006137b7-700e-42f7-a342-a098cad0bf1e" (UID: "006137b7-700e-42f7-a342-a098cad0bf1e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:23:30.657555 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.657450 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "006137b7-700e-42f7-a342-a098cad0bf1e" (UID: "006137b7-700e-42f7-a342-a098cad0bf1e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:23:30.657555 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.657525 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/006137b7-700e-42f7-a342-a098cad0bf1e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "006137b7-700e-42f7-a342-a098cad0bf1e" (UID: "006137b7-700e-42f7-a342-a098cad0bf1e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 19:23:30.755405 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.755377 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnbkk\" (UniqueName: \"kubernetes.io/projected/006137b7-700e-42f7-a342-a098cad0bf1e-kube-api-access-jnbkk\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:23:30.755405 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.755403 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/006137b7-700e-42f7-a342-a098cad0bf1e-istiod-ca-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:23:30.755405 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.755414 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-istio-envoy\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:23:30.755679 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.755422 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/006137b7-700e-42f7-a342-a098cad0bf1e-istio-token\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:23:30.755679 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.755431 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/006137b7-700e-42f7-a342-a098cad0bf1e-istio-podinfo\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:23:30.755679 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.755438 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-credential-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:23:30.755679 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:30.755446 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/006137b7-700e-42f7-a342-a098cad0bf1e-istio-data\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:23:31.550437 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:31.550402 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" Jul 14 19:23:31.550900 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:31.550437 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7" event={"ID":"006137b7-700e-42f7-a342-a098cad0bf1e","Type":"ContainerDied","Data":"9834405dce0929317d5808f569c60f1e3e4363e59f3143159407bcde35d2de73"} Jul 14 19:23:31.550900 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:31.550497 2563 scope.go:117] "RemoveContainer" containerID="72a812f0cb778adb342950a3f9715717962e2199adc3d12fb6ef35b849080efe" Jul 14 19:23:31.578521 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:31.578489 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7"] Jul 14 19:23:31.584718 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:31.584694 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1877882c-openshift-default-6d7874ddff-8rpn7"] Jul 14 19:23:32.567141 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:32.567101 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="006137b7-700e-42f7-a342-a098cad0bf1e" path="/var/lib/kubelet/pods/006137b7-700e-42f7-a342-a098cad0bf1e/volumes" Jul 14 19:23:42.614438 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:42.614401 2563 generic.go:356] "Generic (PLEG): container finished" podID="95bc5014-4754-4739-a86c-53eaccccaac8" containerID="f7a25fecd45b78bba904bfad964632fa3fefd08732abd92954d6c75c3c66e5c5" exitCode=0 Jul 14 19:23:42.614911 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:42.614474 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" event={"ID":"95bc5014-4754-4739-a86c-53eaccccaac8","Type":"ContainerDied","Data":"f7a25fecd45b78bba904bfad964632fa3fefd08732abd92954d6c75c3c66e5c5"} Jul 14 19:23:42.615003 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:42.614990 2563 scope.go:117] "RemoveContainer" containerID="f7a25fecd45b78bba904bfad964632fa3fefd08732abd92954d6c75c3c66e5c5" Jul 14 19:23:42.616070 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:42.616021 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:23:42.616176 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:42.616127 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:23:42.616237 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:42.616175 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:23:43.528796 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:43.528752 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:43.621898 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:43.621867 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" event={"ID":"95bc5014-4754-4739-a86c-53eaccccaac8","Type":"ContainerStarted","Data":"6d04cc558e8a65f8f176e3394a528c6c4d0340718a3f2bcd16772182146584f5"} Jul 14 19:23:43.990524 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:43.990435 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:43.991701 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:43.991676 2563 patch_prober.go:28] interesting pod/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 14 19:23:43.991811 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:43.991724 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" podUID="95bc5014-4754-4739-a86c-53eaccccaac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 14 19:23:44.990805 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:44.990768 2563 patch_prober.go:28] interesting pod/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 14 19:23:44.991219 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:44.990832 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" podUID="95bc5014-4754-4739-a86c-53eaccccaac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 14 19:23:45.989696 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:45.989656 2563 patch_prober.go:28] interesting pod/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 14 19:23:45.989881 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:45.989718 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" podUID="95bc5014-4754-4739-a86c-53eaccccaac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 14 19:23:46.990669 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:46.990623 2563 patch_prober.go:28] interesting pod/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 14 19:23:46.991076 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:46.990678 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" podUID="95bc5014-4754-4739-a86c-53eaccccaac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 14 19:23:47.994072 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:47.994034 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:47.994569 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:47.994317 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:23:47.995160 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:23:47.995143 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:24:36.576830 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:24:36.576802 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trrs2_a5633a96-04d9-465c-ae2c-2b5d013f4381/ovn-acl-logging/0.log" Jul 14 19:24:36.582780 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:24:36.582751 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trrs2_a5633a96-04d9-465c-ae2c-2b5d013f4381/ovn-acl-logging/0.log" Jul 14 19:24:56.569490 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:24:56.569462 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v"] Jul 14 19:24:56.570304 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:24:56.569659 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" podUID="95bc5014-4754-4739-a86c-53eaccccaac8" containerName="istio-proxy" containerID="cri-o://6d04cc558e8a65f8f176e3394a528c6c4d0340718a3f2bcd16772182146584f5" gracePeriod=30 Jul 14 19:25:01.813794 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:01.813761 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:25:01.928709 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:01.928669 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-istio-envoy\") pod \"95bc5014-4754-4739-a86c-53eaccccaac8\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " Jul 14 19:25:01.928875 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:01.928730 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-istio-data\") pod \"95bc5014-4754-4739-a86c-53eaccccaac8\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " Jul 14 19:25:01.928875 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:01.928754 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95bc5014-4754-4739-a86c-53eaccccaac8-istiod-ca-cert\") pod \"95bc5014-4754-4739-a86c-53eaccccaac8\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " Jul 14 19:25:01.928875 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:01.928793 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-credential-socket\") pod \"95bc5014-4754-4739-a86c-53eaccccaac8\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " Jul 14 19:25:01.928875 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:01.928837 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-workload-certs\") pod \"95bc5014-4754-4739-a86c-53eaccccaac8\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " Jul 14 19:25:01.929117 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:01.928883 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-workload-socket\") pod \"95bc5014-4754-4739-a86c-53eaccccaac8\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " Jul 14 19:25:01.929117 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:01.928927 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95bc5014-4754-4739-a86c-53eaccccaac8-istio-token\") pod \"95bc5014-4754-4739-a86c-53eaccccaac8\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " Jul 14 19:25:01.929117 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:01.928956 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xj5t\" (UniqueName: \"kubernetes.io/projected/95bc5014-4754-4739-a86c-53eaccccaac8-kube-api-access-8xj5t\") pod \"95bc5014-4754-4739-a86c-53eaccccaac8\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " Jul 14 19:25:01.929117 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:01.928985 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95bc5014-4754-4739-a86c-53eaccccaac8-istio-podinfo\") pod \"95bc5014-4754-4739-a86c-53eaccccaac8\" (UID: \"95bc5014-4754-4739-a86c-53eaccccaac8\") " Jul 14 19:25:01.929321 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:01.929140 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "95bc5014-4754-4739-a86c-53eaccccaac8" (UID: "95bc5014-4754-4739-a86c-53eaccccaac8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:25:01.929321 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:01.929234 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95bc5014-4754-4739-a86c-53eaccccaac8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "95bc5014-4754-4739-a86c-53eaccccaac8" (UID: "95bc5014-4754-4739-a86c-53eaccccaac8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 19:25:01.929437 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:01.929336 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "95bc5014-4754-4739-a86c-53eaccccaac8" (UID: "95bc5014-4754-4739-a86c-53eaccccaac8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:25:01.929437 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:01.929363 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-credential-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:25:01.929535 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:01.929502 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "95bc5014-4754-4739-a86c-53eaccccaac8" (UID: "95bc5014-4754-4739-a86c-53eaccccaac8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:25:01.929635 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:01.929579 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-istio-data" (OuterVolumeSpecName: "istio-data") pod "95bc5014-4754-4739-a86c-53eaccccaac8" (UID: "95bc5014-4754-4739-a86c-53eaccccaac8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:25:01.931296 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:01.931257 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95bc5014-4754-4739-a86c-53eaccccaac8-istio-token" (OuterVolumeSpecName: "istio-token") pod "95bc5014-4754-4739-a86c-53eaccccaac8" (UID: "95bc5014-4754-4739-a86c-53eaccccaac8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:25:01.931613 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:01.931578 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "95bc5014-4754-4739-a86c-53eaccccaac8" (UID: "95bc5014-4754-4739-a86c-53eaccccaac8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:25:01.931763 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:01.931743 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95bc5014-4754-4739-a86c-53eaccccaac8-kube-api-access-8xj5t" (OuterVolumeSpecName: "kube-api-access-8xj5t") pod "95bc5014-4754-4739-a86c-53eaccccaac8" (UID: "95bc5014-4754-4739-a86c-53eaccccaac8"). InnerVolumeSpecName "kube-api-access-8xj5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:25:01.931835 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:01.931757 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/95bc5014-4754-4739-a86c-53eaccccaac8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "95bc5014-4754-4739-a86c-53eaccccaac8" (UID: "95bc5014-4754-4739-a86c-53eaccccaac8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 19:25:02.030141 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:02.030094 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-istio-data\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:25:02.030141 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:02.030136 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95bc5014-4754-4739-a86c-53eaccccaac8-istiod-ca-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:25:02.030141 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:02.030146 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-workload-certs\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:25:02.030141 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:02.030154 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-workload-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:25:02.030410 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:02.030164 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95bc5014-4754-4739-a86c-53eaccccaac8-istio-token\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:25:02.030410 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:02.030174 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xj5t\" (UniqueName: \"kubernetes.io/projected/95bc5014-4754-4739-a86c-53eaccccaac8-kube-api-access-8xj5t\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:25:02.030410 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:02.030182 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95bc5014-4754-4739-a86c-53eaccccaac8-istio-podinfo\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:25:02.030410 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:02.030190 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95bc5014-4754-4739-a86c-53eaccccaac8-istio-envoy\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:25:02.049864 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:02.049823 2563 generic.go:356] "Generic (PLEG): container finished" podID="95bc5014-4754-4739-a86c-53eaccccaac8" containerID="6d04cc558e8a65f8f176e3394a528c6c4d0340718a3f2bcd16772182146584f5" exitCode=0 Jul 14 19:25:02.050050 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:02.049894 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" Jul 14 19:25:02.050050 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:02.049915 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" event={"ID":"95bc5014-4754-4739-a86c-53eaccccaac8","Type":"ContainerDied","Data":"6d04cc558e8a65f8f176e3394a528c6c4d0340718a3f2bcd16772182146584f5"} Jul 14 19:25:02.050050 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:02.050014 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v" event={"ID":"95bc5014-4754-4739-a86c-53eaccccaac8","Type":"ContainerDied","Data":"32d9644355ead73b7f7ecf8a5d8f7e2da94d34b45500246f9a16be45d09c7619"} Jul 14 19:25:02.050050 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:02.050043 2563 scope.go:117] "RemoveContainer" containerID="6d04cc558e8a65f8f176e3394a528c6c4d0340718a3f2bcd16772182146584f5" Jul 14 19:25:02.059559 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:02.059539 2563 scope.go:117] "RemoveContainer" containerID="f7a25fecd45b78bba904bfad964632fa3fefd08732abd92954d6c75c3c66e5c5" Jul 14 19:25:02.067773 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:02.067755 2563 scope.go:117] "RemoveContainer" containerID="6d04cc558e8a65f8f176e3394a528c6c4d0340718a3f2bcd16772182146584f5" Jul 14 19:25:02.068029 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:25:02.068010 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d04cc558e8a65f8f176e3394a528c6c4d0340718a3f2bcd16772182146584f5\": container with ID starting with 6d04cc558e8a65f8f176e3394a528c6c4d0340718a3f2bcd16772182146584f5 not found: ID does not exist" containerID="6d04cc558e8a65f8f176e3394a528c6c4d0340718a3f2bcd16772182146584f5" Jul 14 19:25:02.068075 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:02.068037 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d04cc558e8a65f8f176e3394a528c6c4d0340718a3f2bcd16772182146584f5"} err="failed to get container status \"6d04cc558e8a65f8f176e3394a528c6c4d0340718a3f2bcd16772182146584f5\": rpc error: code = NotFound desc = could not find container \"6d04cc558e8a65f8f176e3394a528c6c4d0340718a3f2bcd16772182146584f5\": container with ID starting with 6d04cc558e8a65f8f176e3394a528c6c4d0340718a3f2bcd16772182146584f5 not found: ID does not exist" Jul 14 19:25:02.068075 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:02.068053 2563 scope.go:117] "RemoveContainer" containerID="f7a25fecd45b78bba904bfad964632fa3fefd08732abd92954d6c75c3c66e5c5" Jul 14 19:25:02.068302 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:25:02.068283 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7a25fecd45b78bba904bfad964632fa3fefd08732abd92954d6c75c3c66e5c5\": container with ID starting with f7a25fecd45b78bba904bfad964632fa3fefd08732abd92954d6c75c3c66e5c5 not found: ID does not exist" containerID="f7a25fecd45b78bba904bfad964632fa3fefd08732abd92954d6c75c3c66e5c5" Jul 14 19:25:02.068357 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:02.068309 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7a25fecd45b78bba904bfad964632fa3fefd08732abd92954d6c75c3c66e5c5"} err="failed to get container status \"f7a25fecd45b78bba904bfad964632fa3fefd08732abd92954d6c75c3c66e5c5\": rpc error: code = NotFound desc = could not find container \"f7a25fecd45b78bba904bfad964632fa3fefd08732abd92954d6c75c3c66e5c5\": container with ID starting with f7a25fecd45b78bba904bfad964632fa3fefd08732abd92954d6c75c3c66e5c5 not found: ID does not exist" Jul 14 19:25:02.073357 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:02.073338 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v"] Jul 14 19:25:02.081059 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:02.081037 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-4961650e-openshift-default-5558d8647-vlc4v"] Jul 14 19:25:02.567734 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:25:02.567702 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95bc5014-4754-4739-a86c-53eaccccaac8" path="/var/lib/kubelet/pods/95bc5014-4754-4739-a86c-53eaccccaac8/volumes" Jul 14 19:26:34.188135 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.188044 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq"] Jul 14 19:26:34.188739 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.188579 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95bc5014-4754-4739-a86c-53eaccccaac8" containerName="istio-proxy" Jul 14 19:26:34.188739 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.188633 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="95bc5014-4754-4739-a86c-53eaccccaac8" containerName="istio-proxy" Jul 14 19:26:34.188739 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.188652 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="006137b7-700e-42f7-a342-a098cad0bf1e" containerName="istio-proxy" Jul 14 19:26:34.188739 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.188661 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="006137b7-700e-42f7-a342-a098cad0bf1e" containerName="istio-proxy" Jul 14 19:26:34.188966 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.188779 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="95bc5014-4754-4739-a86c-53eaccccaac8" containerName="istio-proxy" Jul 14 19:26:34.188966 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.188792 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="95bc5014-4754-4739-a86c-53eaccccaac8" containerName="istio-proxy" Jul 14 19:26:34.188966 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.188805 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="006137b7-700e-42f7-a342-a098cad0bf1e" containerName="istio-proxy" Jul 14 19:26:34.190991 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.190971 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.193708 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.193687 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-393716c6-openshift-default-dockercfg-lwn9h\"" Jul 14 19:26:34.219565 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.219529 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq"] Jul 14 19:26:34.309444 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.309396 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istiod-ca-cert\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.309444 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.309443 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-data\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.309744 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.309487 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-workload-socket\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.309744 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.309531 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-token\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.309744 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.309653 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-workload-certs\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.309744 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.309704 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-podinfo\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.309916 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.309767 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btsfm\" (UniqueName: \"kubernetes.io/projected/3a3b7721-e466-4091-b7cd-9b540a7b77e5-kube-api-access-btsfm\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.309916 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.309809 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-credential-socket\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.309916 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.309846 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-envoy\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.410749 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.410703 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btsfm\" (UniqueName: \"kubernetes.io/projected/3a3b7721-e466-4091-b7cd-9b540a7b77e5-kube-api-access-btsfm\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.410749 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.410757 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-credential-socket\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.410988 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.410797 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-envoy\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.410988 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.410823 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istiod-ca-cert\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.410988 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.410842 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-data\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.410988 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.410865 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-workload-socket\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.410988 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.410927 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-token\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.410988 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.410980 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-workload-certs\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.411322 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.411012 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-podinfo\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.411322 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.411292 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-data\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.411439 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.411347 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-credential-socket\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.411439 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.411397 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-workload-socket\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.411439 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.411423 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-workload-certs\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.411946 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.411923 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istiod-ca-cert\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.413292 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.413273 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-envoy\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.413502 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.413486 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-podinfo\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.419639 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.419612 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-token\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.419731 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.419720 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btsfm\" (UniqueName: \"kubernetes.io/projected/3a3b7721-e466-4091-b7cd-9b540a7b77e5-kube-api-access-btsfm\") pod \"e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.501837 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.501808 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:34.648978 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.648951 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq"] Jul 14 19:26:34.650411 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:26:34.650385 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a3b7721_e466_4091_b7cd_9b540a7b77e5.slice/crio-8dd4dbf5917525452c375fa5a68ba5aab2ef754dd528d7a766a08d9938beaf1d WatchSource:0}: Error finding container 8dd4dbf5917525452c375fa5a68ba5aab2ef754dd528d7a766a08d9938beaf1d: Status 404 returned error can't find the container with id 8dd4dbf5917525452c375fa5a68ba5aab2ef754dd528d7a766a08d9938beaf1d Jul 14 19:26:34.652707 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.652674 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:26:34.652780 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.652747 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:26:34.652780 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:34.652774 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:26:35.531668 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:35.531630 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" event={"ID":"3a3b7721-e466-4091-b7cd-9b540a7b77e5","Type":"ContainerStarted","Data":"be6ff66a96d413c3f87467ca515a9b8646ffbfd38f5ab2c10b1f1c5f10e84f50"} Jul 14 19:26:35.532057 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:35.531684 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" event={"ID":"3a3b7721-e466-4091-b7cd-9b540a7b77e5","Type":"ContainerStarted","Data":"8dd4dbf5917525452c375fa5a68ba5aab2ef754dd528d7a766a08d9938beaf1d"} Jul 14 19:26:35.558354 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:35.558304 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" podStartSLOduration=1.558286803 podStartE2EDuration="1.558286803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:26:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:26:35.555258948 +0000 UTC m=+1919.554151770" watchObservedRunningTime="2026-07-14 19:26:35.558286803 +0000 UTC m=+1919.557179621" Jul 14 19:26:36.502662 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:36.502623 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:36.507496 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:36.507466 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:36.536918 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:36.536890 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:36.538030 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:36.538011 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:50.611020 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:50.610937 2563 generic.go:356] "Generic (PLEG): container finished" podID="3a3b7721-e466-4091-b7cd-9b540a7b77e5" containerID="be6ff66a96d413c3f87467ca515a9b8646ffbfd38f5ab2c10b1f1c5f10e84f50" exitCode=0 Jul 14 19:26:50.611020 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:50.611001 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" event={"ID":"3a3b7721-e466-4091-b7cd-9b540a7b77e5","Type":"ContainerDied","Data":"be6ff66a96d413c3f87467ca515a9b8646ffbfd38f5ab2c10b1f1c5f10e84f50"} Jul 14 19:26:50.611512 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:50.611417 2563 scope.go:117] "RemoveContainer" containerID="be6ff66a96d413c3f87467ca515a9b8646ffbfd38f5ab2c10b1f1c5f10e84f50" Jul 14 19:26:50.612518 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:50.612485 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:26:50.612618 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:50.612573 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:26:50.612669 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:50.612650 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:26:51.537232 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:51.537179 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:51.618221 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:51.618186 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" event={"ID":"3a3b7721-e466-4091-b7cd-9b540a7b77e5","Type":"ContainerStarted","Data":"cdc4457e347a9eb34543382c57b61d3c769845987e5ba987cad40b79d67ac4fe"} Jul 14 19:26:52.502375 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:52.502331 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:52.503568 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:52.503539 2563 patch_prober.go:28] interesting pod/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 14 19:26:52.503704 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:52.503631 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" podUID="3a3b7721-e466-4091-b7cd-9b540a7b77e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 14 19:26:53.502969 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:53.502923 2563 patch_prober.go:28] interesting pod/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 14 19:26:53.503467 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:53.503006 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" podUID="3a3b7721-e466-4091-b7cd-9b540a7b77e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 14 19:26:54.502426 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:54.502387 2563 patch_prober.go:28] interesting pod/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 14 19:26:54.502642 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:54.502473 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" podUID="3a3b7721-e466-4091-b7cd-9b540a7b77e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 14 19:26:55.506775 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:55.506737 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:55.507238 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:55.507024 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:26:55.507710 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:26:55.507691 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:27:15.659509 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:15.659470 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq"] Jul 14 19:27:15.660091 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:15.659754 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" podUID="3a3b7721-e466-4091-b7cd-9b540a7b77e5" containerName="istio-proxy" containerID="cri-o://cdc4457e347a9eb34543382c57b61d3c769845987e5ba987cad40b79d67ac4fe" gracePeriod=30 Jul 14 19:27:20.791361 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.791329 2563 generic.go:356] "Generic (PLEG): container finished" podID="3a3b7721-e466-4091-b7cd-9b540a7b77e5" containerID="cdc4457e347a9eb34543382c57b61d3c769845987e5ba987cad40b79d67ac4fe" exitCode=0 Jul 14 19:27:20.791772 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.791381 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" event={"ID":"3a3b7721-e466-4091-b7cd-9b540a7b77e5","Type":"ContainerDied","Data":"cdc4457e347a9eb34543382c57b61d3c769845987e5ba987cad40b79d67ac4fe"} Jul 14 19:27:20.791772 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.791433 2563 scope.go:117] "RemoveContainer" containerID="be6ff66a96d413c3f87467ca515a9b8646ffbfd38f5ab2c10b1f1c5f10e84f50" Jul 14 19:27:20.914176 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.914144 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:27:20.985547 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.985445 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btsfm\" (UniqueName: \"kubernetes.io/projected/3a3b7721-e466-4091-b7cd-9b540a7b77e5-kube-api-access-btsfm\") pod \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " Jul 14 19:27:20.985547 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.985504 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-token\") pod \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " Jul 14 19:27:20.985547 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.985545 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-data\") pod \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " Jul 14 19:27:20.985868 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.985624 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-credential-socket\") pod \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " Jul 14 19:27:20.985868 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.985653 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-workload-certs\") pod \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " Jul 14 19:27:20.985868 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.985686 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istiod-ca-cert\") pod \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " Jul 14 19:27:20.985868 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.985711 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-envoy\") pod \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " Jul 14 19:27:20.985868 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.985742 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-workload-socket\") pod \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " Jul 14 19:27:20.985868 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.985773 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-podinfo\") pod \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\" (UID: \"3a3b7721-e466-4091-b7cd-9b540a7b77e5\") " Jul 14 19:27:20.986159 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.985913 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3a3b7721-e466-4091-b7cd-9b540a7b77e5" (UID: "3a3b7721-e466-4091-b7cd-9b540a7b77e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:27:20.986159 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.985929 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3a3b7721-e466-4091-b7cd-9b540a7b77e5" (UID: "3a3b7721-e466-4091-b7cd-9b540a7b77e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:27:20.986159 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.986079 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-credential-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:27:20.986159 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.986097 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-workload-certs\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:27:20.986159 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.986121 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3a3b7721-e466-4091-b7cd-9b540a7b77e5" (UID: "3a3b7721-e466-4091-b7cd-9b540a7b77e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 19:27:20.986159 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.986138 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3a3b7721-e466-4091-b7cd-9b540a7b77e5" (UID: "3a3b7721-e466-4091-b7cd-9b540a7b77e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:27:20.986726 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.986698 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-data" (OuterVolumeSpecName: "istio-data") pod "3a3b7721-e466-4091-b7cd-9b540a7b77e5" (UID: "3a3b7721-e466-4091-b7cd-9b540a7b77e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:27:20.987974 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.987948 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a3b7721-e466-4091-b7cd-9b540a7b77e5-kube-api-access-btsfm" (OuterVolumeSpecName: "kube-api-access-btsfm") pod "3a3b7721-e466-4091-b7cd-9b540a7b77e5" (UID: "3a3b7721-e466-4091-b7cd-9b540a7b77e5"). InnerVolumeSpecName "kube-api-access-btsfm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:27:20.988069 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.987990 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3a3b7721-e466-4091-b7cd-9b540a7b77e5" (UID: "3a3b7721-e466-4091-b7cd-9b540a7b77e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 19:27:20.988069 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.988013 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "3a3b7721-e466-4091-b7cd-9b540a7b77e5" (UID: "3a3b7721-e466-4091-b7cd-9b540a7b77e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:27:20.988153 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:20.988125 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3a3b7721-e466-4091-b7cd-9b540a7b77e5" (UID: "3a3b7721-e466-4091-b7cd-9b540a7b77e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:27:21.087282 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:21.087242 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istiod-ca-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:27:21.087282 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:21.087276 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-envoy\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:27:21.087282 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:21.087285 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-workload-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:27:21.087282 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:21.087293 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-podinfo\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:27:21.087571 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:21.087309 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btsfm\" (UniqueName: \"kubernetes.io/projected/3a3b7721-e466-4091-b7cd-9b540a7b77e5-kube-api-access-btsfm\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:27:21.087571 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:21.087319 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-token\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:27:21.087571 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:21.087329 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a3b7721-e466-4091-b7cd-9b540a7b77e5-istio-data\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:27:21.797616 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:21.797577 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" Jul 14 19:27:21.798077 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:21.797627 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq" event={"ID":"3a3b7721-e466-4091-b7cd-9b540a7b77e5","Type":"ContainerDied","Data":"8dd4dbf5917525452c375fa5a68ba5aab2ef754dd528d7a766a08d9938beaf1d"} Jul 14 19:27:21.798077 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:21.797693 2563 scope.go:117] "RemoveContainer" containerID="cdc4457e347a9eb34543382c57b61d3c769845987e5ba987cad40b79d67ac4fe" Jul 14 19:27:21.821973 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:21.821939 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq"] Jul 14 19:27:21.827911 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:21.827882 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-393716c6-openshift-default-5b9c555df5-shxgq"] Jul 14 19:27:22.566726 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:22.566681 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a3b7721-e466-4091-b7cd-9b540a7b77e5" path="/var/lib/kubelet/pods/3a3b7721-e466-4091-b7cd-9b540a7b77e5/volumes" Jul 14 19:27:35.692510 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.692436 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc"] Jul 14 19:27:35.693018 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.692887 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="006137b7-700e-42f7-a342-a098cad0bf1e" containerName="istio-proxy" Jul 14 19:27:35.693018 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.692902 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="006137b7-700e-42f7-a342-a098cad0bf1e" containerName="istio-proxy" Jul 14 19:27:35.693018 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.692919 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a3b7721-e466-4091-b7cd-9b540a7b77e5" containerName="istio-proxy" Jul 14 19:27:35.693018 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.692926 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a3b7721-e466-4091-b7cd-9b540a7b77e5" containerName="istio-proxy" Jul 14 19:27:35.693018 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.692939 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a3b7721-e466-4091-b7cd-9b540a7b77e5" containerName="istio-proxy" Jul 14 19:27:35.693018 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.692945 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a3b7721-e466-4091-b7cd-9b540a7b77e5" containerName="istio-proxy" Jul 14 19:27:35.693018 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.692956 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95bc5014-4754-4739-a86c-53eaccccaac8" containerName="istio-proxy" Jul 14 19:27:35.693018 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.692962 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="95bc5014-4754-4739-a86c-53eaccccaac8" containerName="istio-proxy" Jul 14 19:27:35.693018 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.693025 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a3b7721-e466-4091-b7cd-9b540a7b77e5" containerName="istio-proxy" Jul 14 19:27:35.693437 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.693035 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a3b7721-e466-4091-b7cd-9b540a7b77e5" containerName="istio-proxy" Jul 14 19:27:35.693437 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.693047 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="006137b7-700e-42f7-a342-a098cad0bf1e" containerName="istio-proxy" Jul 14 19:27:35.696402 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.696379 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.699175 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.699154 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-618aef4e-openshift-default-dockercfg-gccmg\"" Jul 14 19:27:35.712311 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.712281 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc"] Jul 14 19:27:35.824654 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.824586 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65853849-7d9e-447f-8845-49fad14d2d2d-istiod-ca-cert\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.824654 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.824642 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-workload-socket\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.824872 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.824693 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgcq9\" (UniqueName: \"kubernetes.io/projected/65853849-7d9e-447f-8845-49fad14d2d2d-kube-api-access-kgcq9\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.824872 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.824745 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65853849-7d9e-447f-8845-49fad14d2d2d-istio-podinfo\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.824872 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.824831 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65853849-7d9e-447f-8845-49fad14d2d2d-istio-token\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.824996 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.824869 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-workload-certs\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.824996 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.824890 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-credential-socket\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.824996 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.824932 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-istio-envoy\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.824996 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.824953 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-istio-data\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.926188 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.926147 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-workload-certs\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.926188 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.926187 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-credential-socket\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.926430 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.926208 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-istio-envoy\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.926430 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.926242 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-istio-data\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.926430 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.926278 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65853849-7d9e-447f-8845-49fad14d2d2d-istiod-ca-cert\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.926430 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.926303 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-workload-socket\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.926430 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.926376 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgcq9\" (UniqueName: \"kubernetes.io/projected/65853849-7d9e-447f-8845-49fad14d2d2d-kube-api-access-kgcq9\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.926430 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.926410 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65853849-7d9e-447f-8845-49fad14d2d2d-istio-podinfo\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.926766 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.926463 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65853849-7d9e-447f-8845-49fad14d2d2d-istio-token\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.926766 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.926645 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-workload-certs\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.926766 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.926711 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-credential-socket\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.926920 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.926806 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-workload-socket\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.926920 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.926830 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-istio-data\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.927092 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.927068 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65853849-7d9e-447f-8845-49fad14d2d2d-istiod-ca-cert\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.928696 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.928681 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-istio-envoy\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.929152 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.929136 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65853849-7d9e-447f-8845-49fad14d2d2d-istio-podinfo\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.942382 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.942352 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65853849-7d9e-447f-8845-49fad14d2d2d-istio-token\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:35.945900 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:35.945852 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgcq9\" (UniqueName: \"kubernetes.io/projected/65853849-7d9e-447f-8845-49fad14d2d2d-kube-api-access-kgcq9\") pod \"e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:36.006918 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:36.006888 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:36.148502 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:36.148472 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc"] Jul 14 19:27:36.149589 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:27:36.149562 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65853849_7d9e_447f_8845_49fad14d2d2d.slice/crio-707a0ae751d502af9db4f33df1eac8ea90a94452bb8ea7402d42ecc9816f67d4 WatchSource:0}: Error finding container 707a0ae751d502af9db4f33df1eac8ea90a94452bb8ea7402d42ecc9816f67d4: Status 404 returned error can't find the container with id 707a0ae751d502af9db4f33df1eac8ea90a94452bb8ea7402d42ecc9816f67d4 Jul 14 19:27:36.154654 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:36.154618 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:27:36.154759 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:36.154701 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:27:36.154759 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:36.154736 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:27:36.879740 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:36.879695 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" event={"ID":"65853849-7d9e-447f-8845-49fad14d2d2d","Type":"ContainerStarted","Data":"1f5552d79dd56ca27a64db15636571ebcce2b4f5c37efdd8ed20f07a36511f46"} Jul 14 19:27:36.880170 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:36.879762 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" event={"ID":"65853849-7d9e-447f-8845-49fad14d2d2d","Type":"ContainerStarted","Data":"707a0ae751d502af9db4f33df1eac8ea90a94452bb8ea7402d42ecc9816f67d4"} Jul 14 19:27:36.905581 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:36.905512 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" podStartSLOduration=1.905470049 podStartE2EDuration="1.905470049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:27:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:27:36.904533513 +0000 UTC m=+1980.903426332" watchObservedRunningTime="2026-07-14 19:27:36.905470049 +0000 UTC m=+1980.904362867" Jul 14 19:27:37.007764 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:37.007735 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:37.013363 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:37.013333 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:37.884559 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:37.884527 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:37.885457 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:37.885440 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:53.065880 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:53.065844 2563 patch_prober.go:28] interesting pod/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": read tcp 10.134.0.2:59400->10.134.0.50:15021: read: connection reset by peer" start-of-body= Jul 14 19:27:53.066302 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:53.065933 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" podUID="65853849-7d9e-447f-8845-49fad14d2d2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": read tcp 10.134.0.2:59400->10.134.0.50:15021: read: connection reset by peer" Jul 14 19:27:53.982536 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:53.982499 2563 generic.go:356] "Generic (PLEG): container finished" podID="65853849-7d9e-447f-8845-49fad14d2d2d" containerID="1f5552d79dd56ca27a64db15636571ebcce2b4f5c37efdd8ed20f07a36511f46" exitCode=0 Jul 14 19:27:53.982748 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:53.982577 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" event={"ID":"65853849-7d9e-447f-8845-49fad14d2d2d","Type":"ContainerDied","Data":"1f5552d79dd56ca27a64db15636571ebcce2b4f5c37efdd8ed20f07a36511f46"} Jul 14 19:27:53.983048 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:53.983034 2563 scope.go:117] "RemoveContainer" containerID="1f5552d79dd56ca27a64db15636571ebcce2b4f5c37efdd8ed20f07a36511f46" Jul 14 19:27:53.984165 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:53.984134 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:27:53.984275 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:53.984199 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:27:53.984275 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:53.984229 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:27:54.989665 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:54.989627 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" event={"ID":"65853849-7d9e-447f-8845-49fad14d2d2d","Type":"ContainerStarted","Data":"1ceed0cd77ac53cf82bb5aa82c621ddeca814d2b1ec9134e7c68cdcd45551714"} Jul 14 19:27:55.007905 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:55.007884 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:27:55.008098 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:55.008078 2563 patch_prober.go:28] interesting pod/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 14 19:27:55.008144 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:55.008128 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" podUID="65853849-7d9e-447f-8845-49fad14d2d2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 14 19:27:56.007822 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:56.007787 2563 patch_prober.go:28] interesting pod/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 14 19:27:56.008206 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:56.007842 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" podUID="65853849-7d9e-447f-8845-49fad14d2d2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 14 19:27:57.007521 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:57.007485 2563 patch_prober.go:28] interesting pod/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 14 19:27:57.007730 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:57.007551 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" podUID="65853849-7d9e-447f-8845-49fad14d2d2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 14 19:27:58.007211 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:58.007178 2563 patch_prober.go:28] interesting pod/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 14 19:27:58.007619 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:58.007246 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" podUID="65853849-7d9e-447f-8845-49fad14d2d2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 14 19:27:59.008182 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:59.008145 2563 patch_prober.go:28] interesting pod/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 14 19:27:59.008624 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:27:59.008213 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" podUID="65853849-7d9e-447f-8845-49fad14d2d2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 14 19:28:00.007771 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:28:00.007734 2563 patch_prober.go:28] interesting pod/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 14 19:28:00.007954 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:28:00.007791 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" podUID="65853849-7d9e-447f-8845-49fad14d2d2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 14 19:28:01.007322 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:28:01.007285 2563 patch_prober.go:28] interesting pod/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 14 19:28:01.007784 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:28:01.007354 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" podUID="65853849-7d9e-447f-8845-49fad14d2d2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 14 19:28:02.011606 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:28:02.011567 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:28:02.011984 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:28:02.011849 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:28:02.012496 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:28:02.012480 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:29:28.897673 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:28.897575 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc"] Jul 14 19:29:28.898218 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:28.897852 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" podUID="65853849-7d9e-447f-8845-49fad14d2d2d" containerName="istio-proxy" containerID="cri-o://1ceed0cd77ac53cf82bb5aa82c621ddeca814d2b1ec9134e7c68cdcd45551714" gracePeriod=30 Jul 14 19:29:32.014869 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:32.014823 2563 patch_prober.go:28] interesting pod/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 19:29:32.015241 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:32.014913 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" podUID="65853849-7d9e-447f-8845-49fad14d2d2d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 19:29:34.148279 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.148255 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:29:34.264123 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.264099 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65853849-7d9e-447f-8845-49fad14d2d2d-istio-token\") pod \"65853849-7d9e-447f-8845-49fad14d2d2d\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " Jul 14 19:29:34.264310 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.264135 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgcq9\" (UniqueName: \"kubernetes.io/projected/65853849-7d9e-447f-8845-49fad14d2d2d-kube-api-access-kgcq9\") pod \"65853849-7d9e-447f-8845-49fad14d2d2d\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " Jul 14 19:29:34.264310 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.264156 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65853849-7d9e-447f-8845-49fad14d2d2d-istiod-ca-cert\") pod \"65853849-7d9e-447f-8845-49fad14d2d2d\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " Jul 14 19:29:34.264310 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.264282 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-istio-data\") pod \"65853849-7d9e-447f-8845-49fad14d2d2d\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " Jul 14 19:29:34.264482 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.264338 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65853849-7d9e-447f-8845-49fad14d2d2d-istio-podinfo\") pod \"65853849-7d9e-447f-8845-49fad14d2d2d\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " Jul 14 19:29:34.264482 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.264388 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-credential-socket\") pod \"65853849-7d9e-447f-8845-49fad14d2d2d\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " Jul 14 19:29:34.264482 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.264425 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-istio-envoy\") pod \"65853849-7d9e-447f-8845-49fad14d2d2d\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " Jul 14 19:29:34.264482 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.264463 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-workload-socket\") pod \"65853849-7d9e-447f-8845-49fad14d2d2d\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " Jul 14 19:29:34.264736 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.264511 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-workload-certs\") pod \"65853849-7d9e-447f-8845-49fad14d2d2d\" (UID: \"65853849-7d9e-447f-8845-49fad14d2d2d\") " Jul 14 19:29:34.264736 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.264704 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65853849-7d9e-447f-8845-49fad14d2d2d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "65853849-7d9e-447f-8845-49fad14d2d2d" (UID: "65853849-7d9e-447f-8845-49fad14d2d2d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 19:29:34.264962 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.264892 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "65853849-7d9e-447f-8845-49fad14d2d2d" (UID: "65853849-7d9e-447f-8845-49fad14d2d2d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:29:34.264962 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.264903 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65853849-7d9e-447f-8845-49fad14d2d2d-istiod-ca-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:29:34.264962 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.264913 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "65853849-7d9e-447f-8845-49fad14d2d2d" (UID: "65853849-7d9e-447f-8845-49fad14d2d2d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:29:34.265249 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.265026 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "65853849-7d9e-447f-8845-49fad14d2d2d" (UID: "65853849-7d9e-447f-8845-49fad14d2d2d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:29:34.265506 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.265479 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-istio-data" (OuterVolumeSpecName: "istio-data") pod "65853849-7d9e-447f-8845-49fad14d2d2d" (UID: "65853849-7d9e-447f-8845-49fad14d2d2d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:29:34.266528 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.266502 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65853849-7d9e-447f-8845-49fad14d2d2d-istio-token" (OuterVolumeSpecName: "istio-token") pod "65853849-7d9e-447f-8845-49fad14d2d2d" (UID: "65853849-7d9e-447f-8845-49fad14d2d2d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:29:34.266660 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.266643 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65853849-7d9e-447f-8845-49fad14d2d2d-kube-api-access-kgcq9" (OuterVolumeSpecName: "kube-api-access-kgcq9") pod "65853849-7d9e-447f-8845-49fad14d2d2d" (UID: "65853849-7d9e-447f-8845-49fad14d2d2d"). InnerVolumeSpecName "kube-api-access-kgcq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:29:34.266825 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.266793 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "65853849-7d9e-447f-8845-49fad14d2d2d" (UID: "65853849-7d9e-447f-8845-49fad14d2d2d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:29:34.266897 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.266850 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/65853849-7d9e-447f-8845-49fad14d2d2d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "65853849-7d9e-447f-8845-49fad14d2d2d" (UID: "65853849-7d9e-447f-8845-49fad14d2d2d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 19:29:34.365744 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.365707 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-workload-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:29:34.365744 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.365737 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-workload-certs\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:29:34.365744 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.365749 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65853849-7d9e-447f-8845-49fad14d2d2d-istio-token\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:29:34.365954 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.365761 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgcq9\" (UniqueName: \"kubernetes.io/projected/65853849-7d9e-447f-8845-49fad14d2d2d-kube-api-access-kgcq9\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:29:34.365954 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.365775 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-istio-data\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:29:34.365954 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.365786 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65853849-7d9e-447f-8845-49fad14d2d2d-istio-podinfo\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:29:34.365954 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.365797 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-credential-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:29:34.365954 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.365808 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65853849-7d9e-447f-8845-49fad14d2d2d-istio-envoy\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:29:34.518160 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.518058 2563 generic.go:356] "Generic (PLEG): container finished" podID="65853849-7d9e-447f-8845-49fad14d2d2d" containerID="1ceed0cd77ac53cf82bb5aa82c621ddeca814d2b1ec9134e7c68cdcd45551714" exitCode=0 Jul 14 19:29:34.518160 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.518106 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" Jul 14 19:29:34.518160 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.518149 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" event={"ID":"65853849-7d9e-447f-8845-49fad14d2d2d","Type":"ContainerDied","Data":"1ceed0cd77ac53cf82bb5aa82c621ddeca814d2b1ec9134e7c68cdcd45551714"} Jul 14 19:29:34.518438 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.518212 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc" event={"ID":"65853849-7d9e-447f-8845-49fad14d2d2d","Type":"ContainerDied","Data":"707a0ae751d502af9db4f33df1eac8ea90a94452bb8ea7402d42ecc9816f67d4"} Jul 14 19:29:34.518438 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.518244 2563 scope.go:117] "RemoveContainer" containerID="1ceed0cd77ac53cf82bb5aa82c621ddeca814d2b1ec9134e7c68cdcd45551714" Jul 14 19:29:34.528465 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.528451 2563 scope.go:117] "RemoveContainer" containerID="1f5552d79dd56ca27a64db15636571ebcce2b4f5c37efdd8ed20f07a36511f46" Jul 14 19:29:34.536698 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.536681 2563 scope.go:117] "RemoveContainer" containerID="1ceed0cd77ac53cf82bb5aa82c621ddeca814d2b1ec9134e7c68cdcd45551714" Jul 14 19:29:34.536949 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:29:34.536931 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ceed0cd77ac53cf82bb5aa82c621ddeca814d2b1ec9134e7c68cdcd45551714\": container with ID starting with 1ceed0cd77ac53cf82bb5aa82c621ddeca814d2b1ec9134e7c68cdcd45551714 not found: ID does not exist" containerID="1ceed0cd77ac53cf82bb5aa82c621ddeca814d2b1ec9134e7c68cdcd45551714" Jul 14 19:29:34.536997 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.536958 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ceed0cd77ac53cf82bb5aa82c621ddeca814d2b1ec9134e7c68cdcd45551714"} err="failed to get container status \"1ceed0cd77ac53cf82bb5aa82c621ddeca814d2b1ec9134e7c68cdcd45551714\": rpc error: code = NotFound desc = could not find container \"1ceed0cd77ac53cf82bb5aa82c621ddeca814d2b1ec9134e7c68cdcd45551714\": container with ID starting with 1ceed0cd77ac53cf82bb5aa82c621ddeca814d2b1ec9134e7c68cdcd45551714 not found: ID does not exist" Jul 14 19:29:34.536997 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.536975 2563 scope.go:117] "RemoveContainer" containerID="1f5552d79dd56ca27a64db15636571ebcce2b4f5c37efdd8ed20f07a36511f46" Jul 14 19:29:34.537196 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:29:34.537181 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f5552d79dd56ca27a64db15636571ebcce2b4f5c37efdd8ed20f07a36511f46\": container with ID starting with 1f5552d79dd56ca27a64db15636571ebcce2b4f5c37efdd8ed20f07a36511f46 not found: ID does not exist" containerID="1f5552d79dd56ca27a64db15636571ebcce2b4f5c37efdd8ed20f07a36511f46" Jul 14 19:29:34.537238 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.537201 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f5552d79dd56ca27a64db15636571ebcce2b4f5c37efdd8ed20f07a36511f46"} err="failed to get container status \"1f5552d79dd56ca27a64db15636571ebcce2b4f5c37efdd8ed20f07a36511f46\": rpc error: code = NotFound desc = could not find container \"1f5552d79dd56ca27a64db15636571ebcce2b4f5c37efdd8ed20f07a36511f46\": container with ID starting with 1f5552d79dd56ca27a64db15636571ebcce2b4f5c37efdd8ed20f07a36511f46 not found: ID does not exist" Jul 14 19:29:34.543504 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.543481 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc"] Jul 14 19:29:34.547364 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.547339 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-618aef4e-openshift-default-7d5659d75-xncsc"] Jul 14 19:29:34.566878 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:34.566858 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65853849-7d9e-447f-8845-49fad14d2d2d" path="/var/lib/kubelet/pods/65853849-7d9e-447f-8845-49fad14d2d2d/volumes" Jul 14 19:29:36.617661 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:36.617634 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trrs2_a5633a96-04d9-465c-ae2c-2b5d013f4381/ovn-acl-logging/0.log" Jul 14 19:29:36.624006 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:29:36.623983 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trrs2_a5633a96-04d9-465c-ae2c-2b5d013f4381/ovn-acl-logging/0.log" Jul 14 19:30:24.885398 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:24.885361 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb"] Jul 14 19:30:24.885940 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:24.885740 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65853849-7d9e-447f-8845-49fad14d2d2d" containerName="istio-proxy" Jul 14 19:30:24.885940 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:24.885755 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="65853849-7d9e-447f-8845-49fad14d2d2d" containerName="istio-proxy" Jul 14 19:30:24.885940 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:24.885837 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="65853849-7d9e-447f-8845-49fad14d2d2d" containerName="istio-proxy" Jul 14 19:30:24.885940 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:24.885847 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="65853849-7d9e-447f-8845-49fad14d2d2d" containerName="istio-proxy" Jul 14 19:30:24.887933 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:24.887916 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:24.892021 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:24.892002 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-76d82b-openshift-default-dockercfg-tfbpq\"" Jul 14 19:30:24.913221 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:24.913193 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb"] Jul 14 19:30:25.041964 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.041927 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53731a6c-d82c-4402-b1cc-44e4d87167a8-istiod-ca-cert\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.042146 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.041989 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbff2\" (UniqueName: \"kubernetes.io/projected/53731a6c-d82c-4402-b1cc-44e4d87167a8-kube-api-access-wbff2\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.042146 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.042034 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-envoy\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.042146 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.042054 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-workload-socket\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.042146 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.042124 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-podinfo\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.042307 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.042183 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-data\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.042307 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.042202 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-workload-certs\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.042307 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.042219 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-token\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.042307 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.042240 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-credential-socket\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.143663 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.143557 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53731a6c-d82c-4402-b1cc-44e4d87167a8-istiod-ca-cert\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.143663 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.143662 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbff2\" (UniqueName: \"kubernetes.io/projected/53731a6c-d82c-4402-b1cc-44e4d87167a8-kube-api-access-wbff2\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.143874 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.143694 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-envoy\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.143874 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.143715 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-workload-socket\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.143874 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.143745 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-podinfo\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.143874 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.143781 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-data\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.143874 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.143813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-workload-certs\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.143874 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.143840 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-token\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.143874 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.143866 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-credential-socket\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.144299 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.144170 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-workload-socket\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.144299 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.144254 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-credential-socket\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.144373 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.144308 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-data\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.144373 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.144350 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53731a6c-d82c-4402-b1cc-44e4d87167a8-istiod-ca-cert\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.144476 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.144437 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-workload-certs\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.146068 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.146049 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-envoy\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.146401 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.146382 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-podinfo\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.154153 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.154130 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbff2\" (UniqueName: \"kubernetes.io/projected/53731a6c-d82c-4402-b1cc-44e4d87167a8-kube-api-access-wbff2\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.154371 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.154325 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-token\") pod \"e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.198385 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.198348 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:25.343980 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.343949 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb"] Jul 14 19:30:25.344944 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:30:25.344916 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53731a6c_d82c_4402_b1cc_44e4d87167a8.slice/crio-37501df76b0c710dea2f0ffe2f7d09aada41eb220397e13f0413703e2fe4627b WatchSource:0}: Error finding container 37501df76b0c710dea2f0ffe2f7d09aada41eb220397e13f0413703e2fe4627b: Status 404 returned error can't find the container with id 37501df76b0c710dea2f0ffe2f7d09aada41eb220397e13f0413703e2fe4627b Jul 14 19:30:25.347011 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.346971 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:30:25.347080 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.347063 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:30:25.347128 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.347116 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:30:25.790212 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.790181 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" event={"ID":"53731a6c-d82c-4402-b1cc-44e4d87167a8","Type":"ContainerStarted","Data":"8f8d7626b06df707ff5613d2db03586a9f07c4e2f5f5150602cbbf0910debfd1"} Jul 14 19:30:25.790400 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.790241 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" event={"ID":"53731a6c-d82c-4402-b1cc-44e4d87167a8","Type":"ContainerStarted","Data":"37501df76b0c710dea2f0ffe2f7d09aada41eb220397e13f0413703e2fe4627b"} Jul 14 19:30:25.814076 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:25.814009 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" podStartSLOduration=1.81398981 podStartE2EDuration="1.81398981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:30:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:30:25.81144882 +0000 UTC m=+2149.810341640" watchObservedRunningTime="2026-07-14 19:30:25.81398981 +0000 UTC m=+2149.812882629" Jul 14 19:30:26.198948 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:26.198852 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:26.203769 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:26.203741 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:26.795828 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:26.795738 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:26.796759 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:26.796737 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:32.903308 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:32.903275 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df"] Jul 14 19:30:32.903830 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:32.903678 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65853849-7d9e-447f-8845-49fad14d2d2d" containerName="istio-proxy" Jul 14 19:30:32.903830 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:32.903692 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="65853849-7d9e-447f-8845-49fad14d2d2d" containerName="istio-proxy" Jul 14 19:30:32.906185 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:32.906164 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:32.909931 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:32.909894 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-feadd1-openshift-default-dockercfg-vssj7\"" Jul 14 19:30:32.920636 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:32.920609 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-istio-data\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:32.920758 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:32.920654 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqr29\" (UniqueName: \"kubernetes.io/projected/9414d14d-66be-429b-8aae-507635d338ed-kube-api-access-sqr29\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:32.920758 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:32.920704 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-istio-envoy\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:32.920878 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:32.920763 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-workload-certs\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:32.920878 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:32.920819 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9414d14d-66be-429b-8aae-507635d338ed-istio-podinfo\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:32.920878 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:32.920851 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-credential-socket\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:32.921045 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:32.920887 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-workload-socket\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:32.921045 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:32.920941 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df"] Jul 14 19:30:32.921045 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:32.920960 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9414d14d-66be-429b-8aae-507635d338ed-istiod-ca-cert\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:32.921045 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:32.920988 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9414d14d-66be-429b-8aae-507635d338ed-istio-token\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:33.022359 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.022314 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-credential-socket\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:33.022570 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.022399 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-workload-socket\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:33.022570 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.022475 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9414d14d-66be-429b-8aae-507635d338ed-istiod-ca-cert\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:33.022570 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.022506 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9414d14d-66be-429b-8aae-507635d338ed-istio-token\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:33.022570 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.022568 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-istio-data\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:33.022840 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.022620 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqr29\" (UniqueName: \"kubernetes.io/projected/9414d14d-66be-429b-8aae-507635d338ed-kube-api-access-sqr29\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:33.022840 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.022673 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-istio-envoy\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:33.022840 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.022782 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-workload-certs\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:33.022840 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.022813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9414d14d-66be-429b-8aae-507635d338ed-istio-podinfo\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:33.023049 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.022894 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-workload-socket\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:33.023201 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.023175 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-istio-data\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:33.023885 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.023851 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-workload-certs\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:33.024035 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.023931 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9414d14d-66be-429b-8aae-507635d338ed-istiod-ca-cert\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:33.024035 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.024001 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-credential-socket\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:33.025563 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.025544 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9414d14d-66be-429b-8aae-507635d338ed-istio-podinfo\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:33.025940 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.025918 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-istio-envoy\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:33.031927 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.031896 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9414d14d-66be-429b-8aae-507635d338ed-istio-token\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:33.032129 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.032112 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqr29\" (UniqueName: \"kubernetes.io/projected/9414d14d-66be-429b-8aae-507635d338ed-kube-api-access-sqr29\") pod \"e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:33.217160 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.217072 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:33.356087 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.356054 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df"] Jul 14 19:30:33.358040 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:30:33.358016 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9414d14d_66be_429b_8aae_507635d338ed.slice/crio-4c43853d0fe884d241829e49e5ef9edff97b90cc63e05d45eb7e8afbeb37357a WatchSource:0}: Error finding container 4c43853d0fe884d241829e49e5ef9edff97b90cc63e05d45eb7e8afbeb37357a: Status 404 returned error can't find the container with id 4c43853d0fe884d241829e49e5ef9edff97b90cc63e05d45eb7e8afbeb37357a Jul 14 19:30:33.360273 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.360242 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:30:33.360348 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.360325 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:30:33.360386 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.360358 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:30:33.840830 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.840793 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" event={"ID":"9414d14d-66be-429b-8aae-507635d338ed","Type":"ContainerStarted","Data":"cc12197b19958c3f71ac0ddef784926ba87c8495cc648e588125c36fb21c82a8"} Jul 14 19:30:33.841036 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.840846 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" event={"ID":"9414d14d-66be-429b-8aae-507635d338ed","Type":"ContainerStarted","Data":"4c43853d0fe884d241829e49e5ef9edff97b90cc63e05d45eb7e8afbeb37357a"} Jul 14 19:30:33.865761 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:33.865713 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" podStartSLOduration=1.865696462 podStartE2EDuration="1.865696462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:30:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:30:33.863333878 +0000 UTC m=+2157.862226689" watchObservedRunningTime="2026-07-14 19:30:33.865696462 +0000 UTC m=+2157.864589279" Jul 14 19:30:34.217463 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:34.217374 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:34.222276 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:34.222249 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:34.846079 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:34.846048 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:34.847038 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:34.847019 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:42.837824 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:42.837777 2563 patch_prober.go:28] interesting pod/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 14 19:30:42.838234 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:42.837869 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" podUID="53731a6c-d82c-4402-b1cc-44e4d87167a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 14 19:30:44.900000 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:44.899966 2563 generic.go:356] "Generic (PLEG): container finished" podID="53731a6c-d82c-4402-b1cc-44e4d87167a8" containerID="8f8d7626b06df707ff5613d2db03586a9f07c4e2f5f5150602cbbf0910debfd1" exitCode=0 Jul 14 19:30:44.900410 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:44.900038 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" event={"ID":"53731a6c-d82c-4402-b1cc-44e4d87167a8","Type":"ContainerDied","Data":"8f8d7626b06df707ff5613d2db03586a9f07c4e2f5f5150602cbbf0910debfd1"} Jul 14 19:30:44.900454 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:44.900441 2563 scope.go:117] "RemoveContainer" containerID="8f8d7626b06df707ff5613d2db03586a9f07c4e2f5f5150602cbbf0910debfd1" Jul 14 19:30:44.901462 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:44.901435 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:30:44.901516 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:44.901499 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:30:44.901556 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:44.901535 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:30:45.907349 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:45.907314 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" event={"ID":"53731a6c-d82c-4402-b1cc-44e4d87167a8","Type":"ContainerStarted","Data":"25c3fd312ba961029e064f9046cf956ea022a1d93941711baf24ff3860e63643"} Jul 14 19:30:46.198845 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:46.198742 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:46.199014 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:46.198992 2563 patch_prober.go:28] interesting pod/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Jul 14 19:30:46.199059 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:46.199043 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" podUID="53731a6c-d82c-4402-b1cc-44e4d87167a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Jul 14 19:30:47.199120 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:47.199082 2563 patch_prober.go:28] interesting pod/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Jul 14 19:30:47.199521 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:47.199142 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" podUID="53731a6c-d82c-4402-b1cc-44e4d87167a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Jul 14 19:30:48.199578 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:48.199541 2563 patch_prober.go:28] interesting pod/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Jul 14 19:30:48.199988 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:48.199630 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" podUID="53731a6c-d82c-4402-b1cc-44e4d87167a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Jul 14 19:30:49.199499 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:49.199457 2563 patch_prober.go:28] interesting pod/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Jul 14 19:30:49.199710 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:49.199521 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" podUID="53731a6c-d82c-4402-b1cc-44e4d87167a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Jul 14 19:30:50.202005 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:50.201974 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:50.202413 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:50.202391 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:50.203304 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:50.203274 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:30:50.887774 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:50.887732 2563 patch_prober.go:28] interesting pod/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 14 19:30:50.889327 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:50.887827 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" podUID="9414d14d-66be-429b-8aae-507635d338ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 14 19:30:51.946855 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:51.946823 2563 generic.go:356] "Generic (PLEG): container finished" podID="9414d14d-66be-429b-8aae-507635d338ed" containerID="cc12197b19958c3f71ac0ddef784926ba87c8495cc648e588125c36fb21c82a8" exitCode=0 Jul 14 19:30:51.947340 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:51.946900 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" event={"ID":"9414d14d-66be-429b-8aae-507635d338ed","Type":"ContainerDied","Data":"cc12197b19958c3f71ac0ddef784926ba87c8495cc648e588125c36fb21c82a8"} Jul 14 19:30:51.947497 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:51.947479 2563 scope.go:117] "RemoveContainer" containerID="cc12197b19958c3f71ac0ddef784926ba87c8495cc648e588125c36fb21c82a8" Jul 14 19:30:51.948526 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:51.948496 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:30:51.948619 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:51.948581 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:30:51.948668 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:51.948653 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:30:52.956292 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:52.956256 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" event={"ID":"9414d14d-66be-429b-8aae-507635d338ed","Type":"ContainerStarted","Data":"091e71ba3cefda23221756bb5759ff356f97e4e6df96ffdd7c1c44f1f173ef79"} Jul 14 19:30:53.217753 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:53.217653 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:53.217943 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:53.217921 2563 patch_prober.go:28] interesting pod/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Jul 14 19:30:53.218005 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:53.217980 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" podUID="9414d14d-66be-429b-8aae-507635d338ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Jul 14 19:30:54.218256 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:54.218220 2563 patch_prober.go:28] interesting pod/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Jul 14 19:30:54.218679 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:54.218273 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" podUID="9414d14d-66be-429b-8aae-507635d338ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Jul 14 19:30:55.217860 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:55.217827 2563 patch_prober.go:28] interesting pod/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Jul 14 19:30:55.218068 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:55.217912 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" podUID="9414d14d-66be-429b-8aae-507635d338ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Jul 14 19:30:56.217734 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:56.217694 2563 patch_prober.go:28] interesting pod/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Jul 14 19:30:56.218128 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:56.217771 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" podUID="9414d14d-66be-429b-8aae-507635d338ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Jul 14 19:30:57.222041 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:57.222010 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:57.222449 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:57.222276 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:30:57.223080 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:30:57.223060 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:32:06.054236 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:06.054156 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb"] Jul 14 19:32:06.054671 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:06.054369 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" podUID="53731a6c-d82c-4402-b1cc-44e4d87167a8" containerName="istio-proxy" containerID="cri-o://25c3fd312ba961029e064f9046cf956ea022a1d93941711baf24ff3860e63643" gracePeriod=30 Jul 14 19:32:11.319225 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.319163 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:32:11.380584 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.380552 2563 generic.go:356] "Generic (PLEG): container finished" podID="53731a6c-d82c-4402-b1cc-44e4d87167a8" containerID="25c3fd312ba961029e064f9046cf956ea022a1d93941711baf24ff3860e63643" exitCode=0 Jul 14 19:32:11.380764 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.380625 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" Jul 14 19:32:11.380764 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.380641 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" event={"ID":"53731a6c-d82c-4402-b1cc-44e4d87167a8","Type":"ContainerDied","Data":"25c3fd312ba961029e064f9046cf956ea022a1d93941711baf24ff3860e63643"} Jul 14 19:32:11.380764 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.380698 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb" event={"ID":"53731a6c-d82c-4402-b1cc-44e4d87167a8","Type":"ContainerDied","Data":"37501df76b0c710dea2f0ffe2f7d09aada41eb220397e13f0413703e2fe4627b"} Jul 14 19:32:11.380764 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.380713 2563 scope.go:117] "RemoveContainer" containerID="25c3fd312ba961029e064f9046cf956ea022a1d93941711baf24ff3860e63643" Jul 14 19:32:11.389476 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.389459 2563 scope.go:117] "RemoveContainer" containerID="8f8d7626b06df707ff5613d2db03586a9f07c4e2f5f5150602cbbf0910debfd1" Jul 14 19:32:11.397476 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.397455 2563 scope.go:117] "RemoveContainer" containerID="25c3fd312ba961029e064f9046cf956ea022a1d93941711baf24ff3860e63643" Jul 14 19:32:11.397752 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:32:11.397736 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25c3fd312ba961029e064f9046cf956ea022a1d93941711baf24ff3860e63643\": container with ID starting with 25c3fd312ba961029e064f9046cf956ea022a1d93941711baf24ff3860e63643 not found: ID does not exist" containerID="25c3fd312ba961029e064f9046cf956ea022a1d93941711baf24ff3860e63643" Jul 14 19:32:11.397833 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.397760 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25c3fd312ba961029e064f9046cf956ea022a1d93941711baf24ff3860e63643"} err="failed to get container status \"25c3fd312ba961029e064f9046cf956ea022a1d93941711baf24ff3860e63643\": rpc error: code = NotFound desc = could not find container \"25c3fd312ba961029e064f9046cf956ea022a1d93941711baf24ff3860e63643\": container with ID starting with 25c3fd312ba961029e064f9046cf956ea022a1d93941711baf24ff3860e63643 not found: ID does not exist" Jul 14 19:32:11.397833 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.397781 2563 scope.go:117] "RemoveContainer" containerID="8f8d7626b06df707ff5613d2db03586a9f07c4e2f5f5150602cbbf0910debfd1" Jul 14 19:32:11.398005 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:32:11.397992 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f8d7626b06df707ff5613d2db03586a9f07c4e2f5f5150602cbbf0910debfd1\": container with ID starting with 8f8d7626b06df707ff5613d2db03586a9f07c4e2f5f5150602cbbf0910debfd1 not found: ID does not exist" containerID="8f8d7626b06df707ff5613d2db03586a9f07c4e2f5f5150602cbbf0910debfd1" Jul 14 19:32:11.398047 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.398009 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f8d7626b06df707ff5613d2db03586a9f07c4e2f5f5150602cbbf0910debfd1"} err="failed to get container status \"8f8d7626b06df707ff5613d2db03586a9f07c4e2f5f5150602cbbf0910debfd1\": rpc error: code = NotFound desc = could not find container \"8f8d7626b06df707ff5613d2db03586a9f07c4e2f5f5150602cbbf0910debfd1\": container with ID starting with 8f8d7626b06df707ff5613d2db03586a9f07c4e2f5f5150602cbbf0910debfd1 not found: ID does not exist" Jul 14 19:32:11.410344 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.410325 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-data\") pod \"53731a6c-d82c-4402-b1cc-44e4d87167a8\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " Jul 14 19:32:11.410422 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.410381 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-token\") pod \"53731a6c-d82c-4402-b1cc-44e4d87167a8\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " Jul 14 19:32:11.410422 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.410398 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-credential-socket\") pod \"53731a6c-d82c-4402-b1cc-44e4d87167a8\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " Jul 14 19:32:11.410580 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.410561 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-podinfo\") pod \"53731a6c-d82c-4402-b1cc-44e4d87167a8\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " Jul 14 19:32:11.410659 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.410650 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-workload-socket\") pod \"53731a6c-d82c-4402-b1cc-44e4d87167a8\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " Jul 14 19:32:11.410698 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.410685 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-envoy\") pod \"53731a6c-d82c-4402-b1cc-44e4d87167a8\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " Jul 14 19:32:11.410754 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.410649 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "53731a6c-d82c-4402-b1cc-44e4d87167a8" (UID: "53731a6c-d82c-4402-b1cc-44e4d87167a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:32:11.410754 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.410722 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53731a6c-d82c-4402-b1cc-44e4d87167a8-istiod-ca-cert\") pod \"53731a6c-d82c-4402-b1cc-44e4d87167a8\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " Jul 14 19:32:11.410858 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.410750 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbff2\" (UniqueName: \"kubernetes.io/projected/53731a6c-d82c-4402-b1cc-44e4d87167a8-kube-api-access-wbff2\") pod \"53731a6c-d82c-4402-b1cc-44e4d87167a8\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " Jul 14 19:32:11.410858 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.410825 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "53731a6c-d82c-4402-b1cc-44e4d87167a8" (UID: "53731a6c-d82c-4402-b1cc-44e4d87167a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:32:11.410858 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.410843 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-workload-certs\") pod \"53731a6c-d82c-4402-b1cc-44e4d87167a8\" (UID: \"53731a6c-d82c-4402-b1cc-44e4d87167a8\") " Jul 14 19:32:11.411195 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.411175 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-credential-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:32:11.411301 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.411199 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-workload-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:32:11.411301 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.411278 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53731a6c-d82c-4402-b1cc-44e4d87167a8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "53731a6c-d82c-4402-b1cc-44e4d87167a8" (UID: "53731a6c-d82c-4402-b1cc-44e4d87167a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 19:32:11.411428 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.411406 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "53731a6c-d82c-4402-b1cc-44e4d87167a8" (UID: "53731a6c-d82c-4402-b1cc-44e4d87167a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:32:11.411490 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.411443 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-data" (OuterVolumeSpecName: "istio-data") pod "53731a6c-d82c-4402-b1cc-44e4d87167a8" (UID: "53731a6c-d82c-4402-b1cc-44e4d87167a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:32:11.412769 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.412742 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-token" (OuterVolumeSpecName: "istio-token") pod "53731a6c-d82c-4402-b1cc-44e4d87167a8" (UID: "53731a6c-d82c-4402-b1cc-44e4d87167a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:32:11.412855 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.412785 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "53731a6c-d82c-4402-b1cc-44e4d87167a8" (UID: "53731a6c-d82c-4402-b1cc-44e4d87167a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 19:32:11.413254 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.413228 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "53731a6c-d82c-4402-b1cc-44e4d87167a8" (UID: "53731a6c-d82c-4402-b1cc-44e4d87167a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:32:11.413340 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.413270 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53731a6c-d82c-4402-b1cc-44e4d87167a8-kube-api-access-wbff2" (OuterVolumeSpecName: "kube-api-access-wbff2") pod "53731a6c-d82c-4402-b1cc-44e4d87167a8" (UID: "53731a6c-d82c-4402-b1cc-44e4d87167a8"). InnerVolumeSpecName "kube-api-access-wbff2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:32:11.512330 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.512298 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-data\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:32:11.512489 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.512345 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-token\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:32:11.512489 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.512355 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-podinfo\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:32:11.512489 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.512363 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-istio-envoy\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:32:11.512489 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.512372 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53731a6c-d82c-4402-b1cc-44e4d87167a8-istiod-ca-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:32:11.512489 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.512381 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbff2\" (UniqueName: \"kubernetes.io/projected/53731a6c-d82c-4402-b1cc-44e4d87167a8-kube-api-access-wbff2\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:32:11.512489 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.512390 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53731a6c-d82c-4402-b1cc-44e4d87167a8-workload-certs\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:32:11.706159 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.706125 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb"] Jul 14 19:32:11.711361 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:11.711316 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-76d82b-openshift-default-66894f9b55-4r6kb"] Jul 14 19:32:12.566761 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:12.566726 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53731a6c-d82c-4402-b1cc-44e4d87167a8" path="/var/lib/kubelet/pods/53731a6c-d82c-4402-b1cc-44e4d87167a8/volumes" Jul 14 19:32:32.411456 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:32.411415 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df"] Jul 14 19:32:32.412133 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:32.411640 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" podUID="9414d14d-66be-429b-8aae-507635d338ed" containerName="istio-proxy" containerID="cri-o://091e71ba3cefda23221756bb5759ff356f97e4e6df96ffdd7c1c44f1f173ef79" gracePeriod=30 Jul 14 19:32:33.460656 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.460613 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw"] Jul 14 19:32:33.461159 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.461136 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53731a6c-d82c-4402-b1cc-44e4d87167a8" containerName="istio-proxy" Jul 14 19:32:33.461278 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.461163 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="53731a6c-d82c-4402-b1cc-44e4d87167a8" containerName="istio-proxy" Jul 14 19:32:33.461365 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.461282 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="53731a6c-d82c-4402-b1cc-44e4d87167a8" containerName="istio-proxy" Jul 14 19:32:33.464208 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.464185 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.475319 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.475299 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-de8e7b-openshift-default-dockercfg-zhm9s\"" Jul 14 19:32:33.488928 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.488904 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw"] Jul 14 19:32:33.516401 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.516374 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c35b4434-536e-4289-a11d-e739f1d27be8-istio-podinfo\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.516541 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.516413 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-credential-socket\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.516541 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.516441 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c35b4434-536e-4289-a11d-e739f1d27be8-istiod-ca-cert\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.516541 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.516499 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c35b4434-536e-4289-a11d-e739f1d27be8-istio-token\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.516541 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.516531 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-istio-envoy\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.516697 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.516562 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-workload-socket\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.516697 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.516619 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-workload-certs\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.516697 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.516661 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skrcn\" (UniqueName: \"kubernetes.io/projected/c35b4434-536e-4289-a11d-e739f1d27be8-kube-api-access-skrcn\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.516697 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.516682 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-istio-data\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.618140 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.618098 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skrcn\" (UniqueName: \"kubernetes.io/projected/c35b4434-536e-4289-a11d-e739f1d27be8-kube-api-access-skrcn\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.618309 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.618144 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-istio-data\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.618309 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.618247 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c35b4434-536e-4289-a11d-e739f1d27be8-istio-podinfo\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.618309 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.618281 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-credential-socket\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.618484 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.618313 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c35b4434-536e-4289-a11d-e739f1d27be8-istiod-ca-cert\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.618484 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.618424 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c35b4434-536e-4289-a11d-e739f1d27be8-istio-token\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.618484 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.618471 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-istio-envoy\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.618676 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.618588 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-workload-socket\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.618676 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.618647 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-istio-data\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.618785 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.618682 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-workload-certs\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.619063 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.619040 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-credential-socket\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.619178 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.619157 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-workload-socket\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.619232 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.619197 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-workload-certs\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.619276 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.619267 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c35b4434-536e-4289-a11d-e739f1d27be8-istiod-ca-cert\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.620956 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.620933 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-istio-envoy\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.621112 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.621093 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c35b4434-536e-4289-a11d-e739f1d27be8-istio-podinfo\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.635842 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.635811 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c35b4434-536e-4289-a11d-e739f1d27be8-istio-token\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.635969 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.635936 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skrcn\" (UniqueName: \"kubernetes.io/projected/c35b4434-536e-4289-a11d-e739f1d27be8-kube-api-access-skrcn\") pod \"e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.774420 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.774386 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:33.917614 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.917570 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw"] Jul 14 19:32:33.918360 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:32:33.918336 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc35b4434_536e_4289_a11d_e739f1d27be8.slice/crio-46405590778cbb3081f8132cf8219cd1804aaf8fd3cd4fb8031e66d785d5fd83 WatchSource:0}: Error finding container 46405590778cbb3081f8132cf8219cd1804aaf8fd3cd4fb8031e66d785d5fd83: Status 404 returned error can't find the container with id 46405590778cbb3081f8132cf8219cd1804aaf8fd3cd4fb8031e66d785d5fd83 Jul 14 19:32:33.920543 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.920507 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:32:33.920672 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.920585 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:32:33.920672 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:33.920649 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:32:34.510005 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:34.509964 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" event={"ID":"c35b4434-536e-4289-a11d-e739f1d27be8","Type":"ContainerStarted","Data":"073396f30be5a99780c694f14b453e3fef55fe713700e676ce4021015dab2920"} Jul 14 19:32:34.510411 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:34.510049 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" event={"ID":"c35b4434-536e-4289-a11d-e739f1d27be8","Type":"ContainerStarted","Data":"46405590778cbb3081f8132cf8219cd1804aaf8fd3cd4fb8031e66d785d5fd83"} Jul 14 19:32:34.554136 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:34.554080 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" podStartSLOduration=1.554061961 podStartE2EDuration="1.554061961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:32:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:32:34.550621301 +0000 UTC m=+2278.549514110" watchObservedRunningTime="2026-07-14 19:32:34.554061961 +0000 UTC m=+2278.552954851" Jul 14 19:32:34.775471 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:34.775377 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:34.780266 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:34.780242 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:35.515306 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:35.515274 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:35.516481 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:35.516458 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:37.528126 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.528098 2563 generic.go:356] "Generic (PLEG): container finished" podID="9414d14d-66be-429b-8aae-507635d338ed" containerID="091e71ba3cefda23221756bb5759ff356f97e4e6df96ffdd7c1c44f1f173ef79" exitCode=0 Jul 14 19:32:37.528537 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.528166 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" event={"ID":"9414d14d-66be-429b-8aae-507635d338ed","Type":"ContainerDied","Data":"091e71ba3cefda23221756bb5759ff356f97e4e6df96ffdd7c1c44f1f173ef79"} Jul 14 19:32:37.528537 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.528219 2563 scope.go:117] "RemoveContainer" containerID="cc12197b19958c3f71ac0ddef784926ba87c8495cc648e588125c36fb21c82a8" Jul 14 19:32:37.662838 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.662808 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:32:37.767063 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.767027 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9414d14d-66be-429b-8aae-507635d338ed-istiod-ca-cert\") pod \"9414d14d-66be-429b-8aae-507635d338ed\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " Jul 14 19:32:37.767285 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.767102 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-workload-certs\") pod \"9414d14d-66be-429b-8aae-507635d338ed\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " Jul 14 19:32:37.767285 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.767152 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqr29\" (UniqueName: \"kubernetes.io/projected/9414d14d-66be-429b-8aae-507635d338ed-kube-api-access-sqr29\") pod \"9414d14d-66be-429b-8aae-507635d338ed\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " Jul 14 19:32:37.767285 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.767240 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-istio-data\") pod \"9414d14d-66be-429b-8aae-507635d338ed\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " Jul 14 19:32:37.767466 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.767284 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-credential-socket\") pod \"9414d14d-66be-429b-8aae-507635d338ed\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " Jul 14 19:32:37.767466 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.767310 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-istio-envoy\") pod \"9414d14d-66be-429b-8aae-507635d338ed\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " Jul 14 19:32:37.767466 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.767369 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9414d14d-66be-429b-8aae-507635d338ed-istio-podinfo\") pod \"9414d14d-66be-429b-8aae-507635d338ed\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " Jul 14 19:32:37.767466 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.767396 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-workload-socket\") pod \"9414d14d-66be-429b-8aae-507635d338ed\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " Jul 14 19:32:37.767466 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.767434 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9414d14d-66be-429b-8aae-507635d338ed-istio-token\") pod \"9414d14d-66be-429b-8aae-507635d338ed\" (UID: \"9414d14d-66be-429b-8aae-507635d338ed\") " Jul 14 19:32:37.767762 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.767515 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9414d14d-66be-429b-8aae-507635d338ed-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9414d14d-66be-429b-8aae-507635d338ed" (UID: "9414d14d-66be-429b-8aae-507635d338ed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 19:32:37.767843 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.767816 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9414d14d-66be-429b-8aae-507635d338ed-istiod-ca-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:32:37.768260 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.768139 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9414d14d-66be-429b-8aae-507635d338ed" (UID: "9414d14d-66be-429b-8aae-507635d338ed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:32:37.768569 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.768515 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9414d14d-66be-429b-8aae-507635d338ed" (UID: "9414d14d-66be-429b-8aae-507635d338ed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:32:37.768711 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.768637 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9414d14d-66be-429b-8aae-507635d338ed" (UID: "9414d14d-66be-429b-8aae-507635d338ed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:32:37.769396 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.769368 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-istio-data" (OuterVolumeSpecName: "istio-data") pod "9414d14d-66be-429b-8aae-507635d338ed" (UID: "9414d14d-66be-429b-8aae-507635d338ed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:32:37.771034 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.770311 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9414d14d-66be-429b-8aae-507635d338ed" (UID: "9414d14d-66be-429b-8aae-507635d338ed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:32:37.771034 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.770466 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9414d14d-66be-429b-8aae-507635d338ed-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9414d14d-66be-429b-8aae-507635d338ed" (UID: "9414d14d-66be-429b-8aae-507635d338ed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 19:32:37.771471 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.771442 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9414d14d-66be-429b-8aae-507635d338ed-kube-api-access-sqr29" (OuterVolumeSpecName: "kube-api-access-sqr29") pod "9414d14d-66be-429b-8aae-507635d338ed" (UID: "9414d14d-66be-429b-8aae-507635d338ed"). InnerVolumeSpecName "kube-api-access-sqr29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:32:37.773018 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.772986 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9414d14d-66be-429b-8aae-507635d338ed-istio-token" (OuterVolumeSpecName: "istio-token") pod "9414d14d-66be-429b-8aae-507635d338ed" (UID: "9414d14d-66be-429b-8aae-507635d338ed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:32:37.869004 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.868964 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-workload-certs\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:32:37.869004 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.868999 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqr29\" (UniqueName: \"kubernetes.io/projected/9414d14d-66be-429b-8aae-507635d338ed-kube-api-access-sqr29\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:32:37.869004 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.869008 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-istio-data\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:32:37.869256 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.869017 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-credential-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:32:37.869256 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.869025 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-istio-envoy\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:32:37.869256 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.869033 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9414d14d-66be-429b-8aae-507635d338ed-istio-podinfo\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:32:37.869256 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.869042 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9414d14d-66be-429b-8aae-507635d338ed-workload-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:32:37.869256 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:37.869052 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9414d14d-66be-429b-8aae-507635d338ed-istio-token\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:32:38.534140 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:38.534104 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" event={"ID":"9414d14d-66be-429b-8aae-507635d338ed","Type":"ContainerDied","Data":"4c43853d0fe884d241829e49e5ef9edff97b90cc63e05d45eb7e8afbeb37357a"} Jul 14 19:32:38.534582 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:38.534158 2563 scope.go:117] "RemoveContainer" containerID="091e71ba3cefda23221756bb5759ff356f97e4e6df96ffdd7c1c44f1f173ef79" Jul 14 19:32:38.534582 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:38.534119 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df" Jul 14 19:32:38.571826 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:38.571794 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df"] Jul 14 19:32:38.580934 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:38.580906 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-feadd1-openshift-default-859b8cc47c-w42df"] Jul 14 19:32:40.566122 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:40.566089 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9414d14d-66be-429b-8aae-507635d338ed" path="/var/lib/kubelet/pods/9414d14d-66be-429b-8aae-507635d338ed/volumes" Jul 14 19:32:42.099851 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.099814 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86"] Jul 14 19:32:42.100432 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.100412 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9414d14d-66be-429b-8aae-507635d338ed" containerName="istio-proxy" Jul 14 19:32:42.100473 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.100437 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9414d14d-66be-429b-8aae-507635d338ed" containerName="istio-proxy" Jul 14 19:32:42.100473 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.100454 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53731a6c-d82c-4402-b1cc-44e4d87167a8" containerName="istio-proxy" Jul 14 19:32:42.100473 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.100464 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="53731a6c-d82c-4402-b1cc-44e4d87167a8" containerName="istio-proxy" Jul 14 19:32:42.100577 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.100489 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9414d14d-66be-429b-8aae-507635d338ed" containerName="istio-proxy" Jul 14 19:32:42.100577 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.100498 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9414d14d-66be-429b-8aae-507635d338ed" containerName="istio-proxy" Jul 14 19:32:42.100660 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.100582 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9414d14d-66be-429b-8aae-507635d338ed" containerName="istio-proxy" Jul 14 19:32:42.100660 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.100619 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="53731a6c-d82c-4402-b1cc-44e4d87167a8" containerName="istio-proxy" Jul 14 19:32:42.103255 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.103236 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.107921 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.107897 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-8a10a8-openshift-default-dockercfg-qmt69\"" Jul 14 19:32:42.136026 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.135986 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86"] Jul 14 19:32:42.214902 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.214868 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/698da276-71aa-4747-8283-4bf3a25e865c-istiod-ca-cert\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.215091 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.215005 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzmkv\" (UniqueName: \"kubernetes.io/projected/698da276-71aa-4747-8283-4bf3a25e865c-kube-api-access-hzmkv\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.215091 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.215042 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-credential-socket\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.215091 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.215070 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-workload-certs\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.215274 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.215175 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/698da276-71aa-4747-8283-4bf3a25e865c-istio-token\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.215274 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.215217 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/698da276-71aa-4747-8283-4bf3a25e865c-istio-podinfo\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.215369 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.215285 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-workload-socket\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.215369 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.215308 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-istio-data\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.215369 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.215356 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-istio-envoy\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.316037 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.315998 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-workload-certs\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.316037 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.316041 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/698da276-71aa-4747-8283-4bf3a25e865c-istio-token\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.316287 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.316061 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/698da276-71aa-4747-8283-4bf3a25e865c-istio-podinfo\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.316287 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.316257 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-workload-socket\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.316419 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.316300 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-istio-data\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.316419 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.316344 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-istio-envoy\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.316419 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.316406 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-workload-certs\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.316577 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.316483 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/698da276-71aa-4747-8283-4bf3a25e865c-istiod-ca-cert\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.316577 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.316532 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzmkv\" (UniqueName: \"kubernetes.io/projected/698da276-71aa-4747-8283-4bf3a25e865c-kube-api-access-hzmkv\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.316577 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.316549 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-workload-socket\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.316577 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.316560 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-credential-socket\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.316797 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.316642 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-istio-data\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.316845 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.316811 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-credential-socket\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.317113 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.317093 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/698da276-71aa-4747-8283-4bf3a25e865c-istiod-ca-cert\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.318805 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.318781 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-istio-envoy\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.318998 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.318981 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/698da276-71aa-4747-8283-4bf3a25e865c-istio-podinfo\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.329854 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.329789 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzmkv\" (UniqueName: \"kubernetes.io/projected/698da276-71aa-4747-8283-4bf3a25e865c-kube-api-access-hzmkv\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.338304 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.338273 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/698da276-71aa-4747-8283-4bf3a25e865c-istio-token\") pod \"e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.414465 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.414381 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:42.651026 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.650907 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86"] Jul 14 19:32:42.654318 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:32:42.654291 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod698da276_71aa_4747_8283_4bf3a25e865c.slice/crio-1bb4a213fc7cdb7789bcbe7c8bdb3dc5eb7674825b700225b1e6ea2b6c4050f7 WatchSource:0}: Error finding container 1bb4a213fc7cdb7789bcbe7c8bdb3dc5eb7674825b700225b1e6ea2b6c4050f7: Status 404 returned error can't find the container with id 1bb4a213fc7cdb7789bcbe7c8bdb3dc5eb7674825b700225b1e6ea2b6c4050f7 Jul 14 19:32:42.656432 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.656401 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:32:42.656510 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.656469 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:32:42.656510 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:42.656501 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:32:43.563361 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:43.563315 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" event={"ID":"698da276-71aa-4747-8283-4bf3a25e865c","Type":"ContainerStarted","Data":"25b3e1921de634b58f730750bfe296c33920538f91c834e55c2a70e916bc0cea"} Jul 14 19:32:43.563765 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:43.563387 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" event={"ID":"698da276-71aa-4747-8283-4bf3a25e865c","Type":"ContainerStarted","Data":"1bb4a213fc7cdb7789bcbe7c8bdb3dc5eb7674825b700225b1e6ea2b6c4050f7"} Jul 14 19:32:43.619224 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:43.619175 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" podStartSLOduration=1.6191531700000001 podStartE2EDuration="1.61915317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:32:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:32:43.617565659 +0000 UTC m=+2287.616458477" watchObservedRunningTime="2026-07-14 19:32:43.61915317 +0000 UTC m=+2287.618045989" Jul 14 19:32:44.414966 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:44.414878 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:44.420068 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:44.420046 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:44.568363 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:44.568331 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:44.569369 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:44.569353 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:32:48.590634 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:48.590578 2563 generic.go:356] "Generic (PLEG): container finished" podID="c35b4434-536e-4289-a11d-e739f1d27be8" containerID="073396f30be5a99780c694f14b453e3fef55fe713700e676ce4021015dab2920" exitCode=0 Jul 14 19:32:48.590979 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:48.590654 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" event={"ID":"c35b4434-536e-4289-a11d-e739f1d27be8","Type":"ContainerDied","Data":"073396f30be5a99780c694f14b453e3fef55fe713700e676ce4021015dab2920"} Jul 14 19:32:48.591085 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:48.591070 2563 scope.go:117] "RemoveContainer" containerID="073396f30be5a99780c694f14b453e3fef55fe713700e676ce4021015dab2920" Jul 14 19:32:48.592113 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:48.592085 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:32:48.592207 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:48.592188 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:32:48.592256 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:48.592243 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:32:49.598668 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:49.598632 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" event={"ID":"c35b4434-536e-4289-a11d-e739f1d27be8","Type":"ContainerStarted","Data":"34242f2c25c51c282ba5093d2f3d1688500ceeae58f3dd692c5e89f523d729ec"} Jul 14 19:32:49.774851 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:49.774814 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:49.776029 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:49.775993 2563 patch_prober.go:28] interesting pod/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Jul 14 19:32:49.776168 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:49.776049 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" podUID="c35b4434-536e-4289-a11d-e739f1d27be8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Jul 14 19:32:50.515352 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:50.515310 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:50.774920 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:50.774829 2563 patch_prober.go:28] interesting pod/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Jul 14 19:32:50.774920 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:50.774898 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" podUID="c35b4434-536e-4289-a11d-e739f1d27be8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Jul 14 19:32:51.775456 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:51.775419 2563 patch_prober.go:28] interesting pod/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Jul 14 19:32:51.775890 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:51.775488 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" podUID="c35b4434-536e-4289-a11d-e739f1d27be8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Jul 14 19:32:52.775524 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:52.775483 2563 patch_prober.go:28] interesting pod/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Jul 14 19:32:52.775957 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:52.775545 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" podUID="c35b4434-536e-4289-a11d-e739f1d27be8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Jul 14 19:32:53.779050 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:53.779020 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:32:53.780106 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:32:53.780087 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:33:00.610860 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:00.610817 2563 patch_prober.go:28] interesting pod/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 14 19:33:00.611312 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:00.610903 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" podUID="698da276-71aa-4747-8283-4bf3a25e865c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 14 19:33:01.674540 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:01.674505 2563 generic.go:356] "Generic (PLEG): container finished" podID="698da276-71aa-4747-8283-4bf3a25e865c" containerID="25b3e1921de634b58f730750bfe296c33920538f91c834e55c2a70e916bc0cea" exitCode=0 Jul 14 19:33:01.675029 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:01.674574 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" event={"ID":"698da276-71aa-4747-8283-4bf3a25e865c","Type":"ContainerDied","Data":"25b3e1921de634b58f730750bfe296c33920538f91c834e55c2a70e916bc0cea"} Jul 14 19:33:01.675029 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:01.675019 2563 scope.go:117] "RemoveContainer" containerID="25b3e1921de634b58f730750bfe296c33920538f91c834e55c2a70e916bc0cea" Jul 14 19:33:01.676050 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:01.676021 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:33:01.676112 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:01.676092 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:33:01.676148 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:01.676134 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:33:02.685283 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:02.685238 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" event={"ID":"698da276-71aa-4747-8283-4bf3a25e865c","Type":"ContainerStarted","Data":"65a76dbf17e61ffabbe5f32c735e138a5de7857a198f61ab019162ba90de7a82"} Jul 14 19:33:03.414856 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:03.414815 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:33:03.415076 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:03.415053 2563 patch_prober.go:28] interesting pod/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Jul 14 19:33:03.415123 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:03.415103 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" podUID="698da276-71aa-4747-8283-4bf3a25e865c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Jul 14 19:33:04.415505 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:04.415468 2563 patch_prober.go:28] interesting pod/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Jul 14 19:33:04.416015 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:04.415530 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" podUID="698da276-71aa-4747-8283-4bf3a25e865c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Jul 14 19:33:05.415207 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:05.415165 2563 patch_prober.go:28] interesting pod/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Jul 14 19:33:05.415441 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:05.415227 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" podUID="698da276-71aa-4747-8283-4bf3a25e865c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Jul 14 19:33:06.415855 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:06.415818 2563 patch_prober.go:28] interesting pod/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Jul 14 19:33:06.416235 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:06.415876 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" podUID="698da276-71aa-4747-8283-4bf3a25e865c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Jul 14 19:33:07.418913 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:07.418868 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:33:07.419385 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:07.419276 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:33:07.420088 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:07.420069 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:33:24.319019 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:24.318974 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw"] Jul 14 19:33:24.319552 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:24.319231 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" podUID="c35b4434-536e-4289-a11d-e739f1d27be8" containerName="istio-proxy" containerID="cri-o://34242f2c25c51c282ba5093d2f3d1688500ceeae58f3dd692c5e89f523d729ec" gracePeriod=30 Jul 14 19:33:29.578796 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.578766 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:33:29.702844 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.702749 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skrcn\" (UniqueName: \"kubernetes.io/projected/c35b4434-536e-4289-a11d-e739f1d27be8-kube-api-access-skrcn\") pod \"c35b4434-536e-4289-a11d-e739f1d27be8\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " Jul 14 19:33:29.702844 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.702789 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-istio-data\") pod \"c35b4434-536e-4289-a11d-e739f1d27be8\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " Jul 14 19:33:29.702844 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.702816 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-credential-socket\") pod \"c35b4434-536e-4289-a11d-e739f1d27be8\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " Jul 14 19:33:29.703123 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.702853 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c35b4434-536e-4289-a11d-e739f1d27be8-istio-podinfo\") pod \"c35b4434-536e-4289-a11d-e739f1d27be8\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " Jul 14 19:33:29.703123 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.702878 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c35b4434-536e-4289-a11d-e739f1d27be8-istiod-ca-cert\") pod \"c35b4434-536e-4289-a11d-e739f1d27be8\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " Jul 14 19:33:29.703123 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.702933 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-workload-certs\") pod \"c35b4434-536e-4289-a11d-e739f1d27be8\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " Jul 14 19:33:29.703123 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.702977 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c35b4434-536e-4289-a11d-e739f1d27be8-istio-token\") pod \"c35b4434-536e-4289-a11d-e739f1d27be8\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " Jul 14 19:33:29.703123 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.703001 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-workload-socket\") pod \"c35b4434-536e-4289-a11d-e739f1d27be8\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " Jul 14 19:33:29.703123 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.703100 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-istio-envoy\") pod \"c35b4434-536e-4289-a11d-e739f1d27be8\" (UID: \"c35b4434-536e-4289-a11d-e739f1d27be8\") " Jul 14 19:33:29.703454 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.703345 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c35b4434-536e-4289-a11d-e739f1d27be8" (UID: "c35b4434-536e-4289-a11d-e739f1d27be8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:33:29.703518 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.703464 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c35b4434-536e-4289-a11d-e739f1d27be8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c35b4434-536e-4289-a11d-e739f1d27be8" (UID: "c35b4434-536e-4289-a11d-e739f1d27be8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 19:33:29.703518 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.703484 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-workload-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:33:29.703742 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.703693 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-istio-data" (OuterVolumeSpecName: "istio-data") pod "c35b4434-536e-4289-a11d-e739f1d27be8" (UID: "c35b4434-536e-4289-a11d-e739f1d27be8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:33:29.703943 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.703894 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c35b4434-536e-4289-a11d-e739f1d27be8" (UID: "c35b4434-536e-4289-a11d-e739f1d27be8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:33:29.704078 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.703945 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c35b4434-536e-4289-a11d-e739f1d27be8" (UID: "c35b4434-536e-4289-a11d-e739f1d27be8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:33:29.705339 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.705314 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c35b4434-536e-4289-a11d-e739f1d27be8-istio-token" (OuterVolumeSpecName: "istio-token") pod "c35b4434-536e-4289-a11d-e739f1d27be8" (UID: "c35b4434-536e-4289-a11d-e739f1d27be8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:33:29.705438 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.705360 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c35b4434-536e-4289-a11d-e739f1d27be8-kube-api-access-skrcn" (OuterVolumeSpecName: "kube-api-access-skrcn") pod "c35b4434-536e-4289-a11d-e739f1d27be8" (UID: "c35b4434-536e-4289-a11d-e739f1d27be8"). InnerVolumeSpecName "kube-api-access-skrcn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:33:29.705483 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.705448 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c35b4434-536e-4289-a11d-e739f1d27be8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c35b4434-536e-4289-a11d-e739f1d27be8" (UID: "c35b4434-536e-4289-a11d-e739f1d27be8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 19:33:29.705483 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.705464 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c35b4434-536e-4289-a11d-e739f1d27be8" (UID: "c35b4434-536e-4289-a11d-e739f1d27be8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:33:29.804841 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.804801 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-istio-envoy\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:33:29.804841 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.804836 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skrcn\" (UniqueName: \"kubernetes.io/projected/c35b4434-536e-4289-a11d-e739f1d27be8-kube-api-access-skrcn\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:33:29.804841 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.804846 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-istio-data\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:33:29.805078 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.804854 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-credential-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:33:29.805078 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.804862 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c35b4434-536e-4289-a11d-e739f1d27be8-istio-podinfo\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:33:29.805078 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.804870 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c35b4434-536e-4289-a11d-e739f1d27be8-istiod-ca-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:33:29.805078 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.804878 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c35b4434-536e-4289-a11d-e739f1d27be8-workload-certs\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:33:29.805078 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.804885 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c35b4434-536e-4289-a11d-e739f1d27be8-istio-token\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:33:29.836243 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.836201 2563 generic.go:356] "Generic (PLEG): container finished" podID="c35b4434-536e-4289-a11d-e739f1d27be8" containerID="34242f2c25c51c282ba5093d2f3d1688500ceeae58f3dd692c5e89f523d729ec" exitCode=0 Jul 14 19:33:29.836404 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.836256 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" Jul 14 19:33:29.836404 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.836288 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" event={"ID":"c35b4434-536e-4289-a11d-e739f1d27be8","Type":"ContainerDied","Data":"34242f2c25c51c282ba5093d2f3d1688500ceeae58f3dd692c5e89f523d729ec"} Jul 14 19:33:29.836404 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.836372 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw" event={"ID":"c35b4434-536e-4289-a11d-e739f1d27be8","Type":"ContainerDied","Data":"46405590778cbb3081f8132cf8219cd1804aaf8fd3cd4fb8031e66d785d5fd83"} Jul 14 19:33:29.836404 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.836394 2563 scope.go:117] "RemoveContainer" containerID="34242f2c25c51c282ba5093d2f3d1688500ceeae58f3dd692c5e89f523d729ec" Jul 14 19:33:29.846050 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.846028 2563 scope.go:117] "RemoveContainer" containerID="073396f30be5a99780c694f14b453e3fef55fe713700e676ce4021015dab2920" Jul 14 19:33:29.854766 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.854745 2563 scope.go:117] "RemoveContainer" containerID="34242f2c25c51c282ba5093d2f3d1688500ceeae58f3dd692c5e89f523d729ec" Jul 14 19:33:29.855044 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:33:29.855026 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34242f2c25c51c282ba5093d2f3d1688500ceeae58f3dd692c5e89f523d729ec\": container with ID starting with 34242f2c25c51c282ba5093d2f3d1688500ceeae58f3dd692c5e89f523d729ec not found: ID does not exist" containerID="34242f2c25c51c282ba5093d2f3d1688500ceeae58f3dd692c5e89f523d729ec" Jul 14 19:33:29.855098 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.855054 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34242f2c25c51c282ba5093d2f3d1688500ceeae58f3dd692c5e89f523d729ec"} err="failed to get container status \"34242f2c25c51c282ba5093d2f3d1688500ceeae58f3dd692c5e89f523d729ec\": rpc error: code = NotFound desc = could not find container \"34242f2c25c51c282ba5093d2f3d1688500ceeae58f3dd692c5e89f523d729ec\": container with ID starting with 34242f2c25c51c282ba5093d2f3d1688500ceeae58f3dd692c5e89f523d729ec not found: ID does not exist" Jul 14 19:33:29.855098 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.855071 2563 scope.go:117] "RemoveContainer" containerID="073396f30be5a99780c694f14b453e3fef55fe713700e676ce4021015dab2920" Jul 14 19:33:29.858029 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:33:29.857998 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"073396f30be5a99780c694f14b453e3fef55fe713700e676ce4021015dab2920\": container with ID starting with 073396f30be5a99780c694f14b453e3fef55fe713700e676ce4021015dab2920 not found: ID does not exist" containerID="073396f30be5a99780c694f14b453e3fef55fe713700e676ce4021015dab2920" Jul 14 19:33:29.858135 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.858037 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"073396f30be5a99780c694f14b453e3fef55fe713700e676ce4021015dab2920"} err="failed to get container status \"073396f30be5a99780c694f14b453e3fef55fe713700e676ce4021015dab2920\": rpc error: code = NotFound desc = could not find container \"073396f30be5a99780c694f14b453e3fef55fe713700e676ce4021015dab2920\": container with ID starting with 073396f30be5a99780c694f14b453e3fef55fe713700e676ce4021015dab2920 not found: ID does not exist" Jul 14 19:33:29.873421 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.873394 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw"] Jul 14 19:33:29.879271 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:29.879246 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-de8e7b-openshift-default-5b57c54b5-7b4xw"] Jul 14 19:33:30.567206 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:30.567173 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c35b4434-536e-4289-a11d-e739f1d27be8" path="/var/lib/kubelet/pods/c35b4434-536e-4289-a11d-e739f1d27be8/volumes" Jul 14 19:33:50.505091 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:50.505057 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86"] Jul 14 19:33:50.505578 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:50.505299 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" podUID="698da276-71aa-4747-8283-4bf3a25e865c" containerName="istio-proxy" containerID="cri-o://65a76dbf17e61ffabbe5f32c735e138a5de7857a198f61ab019162ba90de7a82" gracePeriod=30 Jul 14 19:33:51.375903 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.375867 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww"] Jul 14 19:33:51.376239 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.376227 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c35b4434-536e-4289-a11d-e739f1d27be8" containerName="istio-proxy" Jul 14 19:33:51.376287 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.376241 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c35b4434-536e-4289-a11d-e739f1d27be8" containerName="istio-proxy" Jul 14 19:33:51.376287 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.376258 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c35b4434-536e-4289-a11d-e739f1d27be8" containerName="istio-proxy" Jul 14 19:33:51.376287 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.376263 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c35b4434-536e-4289-a11d-e739f1d27be8" containerName="istio-proxy" Jul 14 19:33:51.376383 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.376327 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c35b4434-536e-4289-a11d-e739f1d27be8" containerName="istio-proxy" Jul 14 19:33:51.376383 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.376334 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c35b4434-536e-4289-a11d-e739f1d27be8" containerName="istio-proxy" Jul 14 19:33:51.376383 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.376342 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9414d14d-66be-429b-8aae-507635d338ed" containerName="istio-proxy" Jul 14 19:33:51.378535 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.378519 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.381492 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.381469 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-755a0b-openshift-default-dockercfg-svsnz\"" Jul 14 19:33:51.396297 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.396272 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww"] Jul 14 19:33:51.507096 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.507063 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-data\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.507493 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.507103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-credential-socket\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.507493 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.507141 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-workload-certs\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.507493 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.507157 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-podinfo\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.507493 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.507218 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-envoy\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.507493 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.507269 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq6zg\" (UniqueName: \"kubernetes.io/projected/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-kube-api-access-xq6zg\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.507493 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.507317 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istiod-ca-cert\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.507493 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.507350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-workload-socket\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.507493 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.507387 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-token\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.608495 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.608440 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq6zg\" (UniqueName: \"kubernetes.io/projected/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-kube-api-access-xq6zg\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.608713 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.608508 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istiod-ca-cert\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.608713 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.608548 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-workload-socket\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.608713 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.608577 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-token\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.608713 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.608678 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-data\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.608713 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.608713 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-credential-socket\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.608993 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.608856 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-workload-certs\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.608993 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.608893 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-podinfo\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.608993 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.608956 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-envoy\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.609149 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.609038 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-workload-socket\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.609149 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.609111 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-data\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.609239 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.609169 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-credential-socket\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.609239 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.609223 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-workload-certs\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.609509 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.609491 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istiod-ca-cert\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.611303 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.611281 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-envoy\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.611535 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.611516 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-podinfo\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.617930 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.617909 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-token\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.618347 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.618327 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq6zg\" (UniqueName: \"kubernetes.io/projected/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-kube-api-access-xq6zg\") pod \"e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.689216 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.689122 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:51.828252 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.828227 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww"] Jul 14 19:33:51.830001 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:33:51.829970 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bf4f6e6_681d_4a42_9f1f_2a50afdcb9ad.slice/crio-92785eaffc9a59200296da60bf354d525b91cd71b1b6d317d0bb4b217dcc870f WatchSource:0}: Error finding container 92785eaffc9a59200296da60bf354d525b91cd71b1b6d317d0bb4b217dcc870f: Status 404 returned error can't find the container with id 92785eaffc9a59200296da60bf354d525b91cd71b1b6d317d0bb4b217dcc870f Jul 14 19:33:51.832078 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.832045 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:33:51.832180 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.832111 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:33:51.832180 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.832138 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:33:51.950323 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.950228 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" event={"ID":"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad","Type":"ContainerStarted","Data":"1fac6d5eee84e1cd7890a792da4328da0d8f95ff65605493fa750208214d0ea9"} Jul 14 19:33:51.950323 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.950281 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" event={"ID":"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad","Type":"ContainerStarted","Data":"92785eaffc9a59200296da60bf354d525b91cd71b1b6d317d0bb4b217dcc870f"} Jul 14 19:33:51.972746 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:51.972689 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" podStartSLOduration=0.972652804 podStartE2EDuration="972.652804ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:33:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:33:51.970745185 +0000 UTC m=+2355.969638006" watchObservedRunningTime="2026-07-14 19:33:51.972652804 +0000 UTC m=+2355.971545620" Jul 14 19:33:52.421901 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:52.421867 2563 patch_prober.go:28] interesting pod/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 19:33:52.422093 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:52.421927 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" podUID="698da276-71aa-4747-8283-4bf3a25e865c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 19:33:52.690237 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:52.690146 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:52.695010 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:52.694986 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:52.959672 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:52.959560 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:52.960532 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:52.960515 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:33:55.758074 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.758049 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:33:55.851972 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.851886 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzmkv\" (UniqueName: \"kubernetes.io/projected/698da276-71aa-4747-8283-4bf3a25e865c-kube-api-access-hzmkv\") pod \"698da276-71aa-4747-8283-4bf3a25e865c\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " Jul 14 19:33:55.851972 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.851960 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-credential-socket\") pod \"698da276-71aa-4747-8283-4bf3a25e865c\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " Jul 14 19:33:55.852209 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.851986 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/698da276-71aa-4747-8283-4bf3a25e865c-istio-podinfo\") pod \"698da276-71aa-4747-8283-4bf3a25e865c\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " Jul 14 19:33:55.852209 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.852086 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-workload-certs\") pod \"698da276-71aa-4747-8283-4bf3a25e865c\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " Jul 14 19:33:55.852209 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.852122 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/698da276-71aa-4747-8283-4bf3a25e865c-istio-token\") pod \"698da276-71aa-4747-8283-4bf3a25e865c\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " Jul 14 19:33:55.852209 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.852143 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/698da276-71aa-4747-8283-4bf3a25e865c-istiod-ca-cert\") pod \"698da276-71aa-4747-8283-4bf3a25e865c\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " Jul 14 19:33:55.852209 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.852162 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-workload-socket\") pod \"698da276-71aa-4747-8283-4bf3a25e865c\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " Jul 14 19:33:55.852209 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.852194 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-istio-envoy\") pod \"698da276-71aa-4747-8283-4bf3a25e865c\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " Jul 14 19:33:55.852532 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.852224 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "698da276-71aa-4747-8283-4bf3a25e865c" (UID: "698da276-71aa-4747-8283-4bf3a25e865c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:33:55.852532 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.852282 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-istio-data\") pod \"698da276-71aa-4747-8283-4bf3a25e865c\" (UID: \"698da276-71aa-4747-8283-4bf3a25e865c\") " Jul 14 19:33:55.852532 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.852331 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "698da276-71aa-4747-8283-4bf3a25e865c" (UID: "698da276-71aa-4747-8283-4bf3a25e865c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:33:55.852532 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.852449 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "698da276-71aa-4747-8283-4bf3a25e865c" (UID: "698da276-71aa-4747-8283-4bf3a25e865c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:33:55.852930 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.852550 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/698da276-71aa-4747-8283-4bf3a25e865c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "698da276-71aa-4747-8283-4bf3a25e865c" (UID: "698da276-71aa-4747-8283-4bf3a25e865c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 19:33:55.852930 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.852687 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-workload-certs\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:33:55.852930 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.852709 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/698da276-71aa-4747-8283-4bf3a25e865c-istiod-ca-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:33:55.852930 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.852722 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-workload-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:33:55.852930 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.852735 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-credential-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:33:55.853616 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.853565 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-istio-data" (OuterVolumeSpecName: "istio-data") pod "698da276-71aa-4747-8283-4bf3a25e865c" (UID: "698da276-71aa-4747-8283-4bf3a25e865c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:33:55.854398 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.854375 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/698da276-71aa-4747-8283-4bf3a25e865c-kube-api-access-hzmkv" (OuterVolumeSpecName: "kube-api-access-hzmkv") pod "698da276-71aa-4747-8283-4bf3a25e865c" (UID: "698da276-71aa-4747-8283-4bf3a25e865c"). InnerVolumeSpecName "kube-api-access-hzmkv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:33:55.854532 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.854515 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/698da276-71aa-4747-8283-4bf3a25e865c-istio-token" (OuterVolumeSpecName: "istio-token") pod "698da276-71aa-4747-8283-4bf3a25e865c" (UID: "698da276-71aa-4747-8283-4bf3a25e865c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:33:55.854768 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.854745 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/698da276-71aa-4747-8283-4bf3a25e865c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "698da276-71aa-4747-8283-4bf3a25e865c" (UID: "698da276-71aa-4747-8283-4bf3a25e865c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 19:33:55.854838 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.854820 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "698da276-71aa-4747-8283-4bf3a25e865c" (UID: "698da276-71aa-4747-8283-4bf3a25e865c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:33:55.953542 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.953492 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-istio-data\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:33:55.953542 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.953538 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzmkv\" (UniqueName: \"kubernetes.io/projected/698da276-71aa-4747-8283-4bf3a25e865c-kube-api-access-hzmkv\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:33:55.953542 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.953549 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/698da276-71aa-4747-8283-4bf3a25e865c-istio-podinfo\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:33:55.953542 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.953557 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/698da276-71aa-4747-8283-4bf3a25e865c-istio-token\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:33:55.953542 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.953565 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/698da276-71aa-4747-8283-4bf3a25e865c-istio-envoy\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:33:55.977177 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.977144 2563 generic.go:356] "Generic (PLEG): container finished" podID="698da276-71aa-4747-8283-4bf3a25e865c" containerID="65a76dbf17e61ffabbe5f32c735e138a5de7857a198f61ab019162ba90de7a82" exitCode=0 Jul 14 19:33:55.977318 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.977187 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" Jul 14 19:33:55.977318 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.977222 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" event={"ID":"698da276-71aa-4747-8283-4bf3a25e865c","Type":"ContainerDied","Data":"65a76dbf17e61ffabbe5f32c735e138a5de7857a198f61ab019162ba90de7a82"} Jul 14 19:33:55.977318 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.977272 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86" event={"ID":"698da276-71aa-4747-8283-4bf3a25e865c","Type":"ContainerDied","Data":"1bb4a213fc7cdb7789bcbe7c8bdb3dc5eb7674825b700225b1e6ea2b6c4050f7"} Jul 14 19:33:55.977318 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.977294 2563 scope.go:117] "RemoveContainer" containerID="65a76dbf17e61ffabbe5f32c735e138a5de7857a198f61ab019162ba90de7a82" Jul 14 19:33:55.987004 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.986988 2563 scope.go:117] "RemoveContainer" containerID="25b3e1921de634b58f730750bfe296c33920538f91c834e55c2a70e916bc0cea" Jul 14 19:33:55.995074 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.995055 2563 scope.go:117] "RemoveContainer" containerID="65a76dbf17e61ffabbe5f32c735e138a5de7857a198f61ab019162ba90de7a82" Jul 14 19:33:55.995307 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:33:55.995287 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65a76dbf17e61ffabbe5f32c735e138a5de7857a198f61ab019162ba90de7a82\": container with ID starting with 65a76dbf17e61ffabbe5f32c735e138a5de7857a198f61ab019162ba90de7a82 not found: ID does not exist" containerID="65a76dbf17e61ffabbe5f32c735e138a5de7857a198f61ab019162ba90de7a82" Jul 14 19:33:55.995355 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.995317 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a76dbf17e61ffabbe5f32c735e138a5de7857a198f61ab019162ba90de7a82"} err="failed to get container status \"65a76dbf17e61ffabbe5f32c735e138a5de7857a198f61ab019162ba90de7a82\": rpc error: code = NotFound desc = could not find container \"65a76dbf17e61ffabbe5f32c735e138a5de7857a198f61ab019162ba90de7a82\": container with ID starting with 65a76dbf17e61ffabbe5f32c735e138a5de7857a198f61ab019162ba90de7a82 not found: ID does not exist" Jul 14 19:33:55.995355 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.995332 2563 scope.go:117] "RemoveContainer" containerID="25b3e1921de634b58f730750bfe296c33920538f91c834e55c2a70e916bc0cea" Jul 14 19:33:55.995607 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:33:55.995575 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25b3e1921de634b58f730750bfe296c33920538f91c834e55c2a70e916bc0cea\": container with ID starting with 25b3e1921de634b58f730750bfe296c33920538f91c834e55c2a70e916bc0cea not found: ID does not exist" containerID="25b3e1921de634b58f730750bfe296c33920538f91c834e55c2a70e916bc0cea" Jul 14 19:33:55.995650 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:55.995620 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25b3e1921de634b58f730750bfe296c33920538f91c834e55c2a70e916bc0cea"} err="failed to get container status \"25b3e1921de634b58f730750bfe296c33920538f91c834e55c2a70e916bc0cea\": rpc error: code = NotFound desc = could not find container \"25b3e1921de634b58f730750bfe296c33920538f91c834e55c2a70e916bc0cea\": container with ID starting with 25b3e1921de634b58f730750bfe296c33920538f91c834e55c2a70e916bc0cea not found: ID does not exist" Jul 14 19:33:56.001759 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:56.001738 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86"] Jul 14 19:33:56.005713 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:56.005694 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-8a10a8-openshift-default-85b5468ddc-g6w86"] Jul 14 19:33:56.566904 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:56.566871 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="698da276-71aa-4747-8283-4bf3a25e865c" path="/var/lib/kubelet/pods/698da276-71aa-4747-8283-4bf3a25e865c/volumes" Jul 14 19:33:59.029627 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.029565 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b"] Jul 14 19:33:59.030064 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.030045 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="698da276-71aa-4747-8283-4bf3a25e865c" containerName="istio-proxy" Jul 14 19:33:59.030109 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.030066 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="698da276-71aa-4747-8283-4bf3a25e865c" containerName="istio-proxy" Jul 14 19:33:59.030109 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.030074 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="698da276-71aa-4747-8283-4bf3a25e865c" containerName="istio-proxy" Jul 14 19:33:59.030109 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.030079 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="698da276-71aa-4747-8283-4bf3a25e865c" containerName="istio-proxy" Jul 14 19:33:59.030207 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.030143 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="698da276-71aa-4747-8283-4bf3a25e865c" containerName="istio-proxy" Jul 14 19:33:59.030207 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.030154 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="698da276-71aa-4747-8283-4bf3a25e865c" containerName="istio-proxy" Jul 14 19:33:59.033247 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.033225 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.037353 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.037330 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-7c2fbe-openshift-default-dockercfg-bpsb6\"" Jul 14 19:33:59.051623 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.051565 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b"] Jul 14 19:33:59.186237 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.186202 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19b494c4-1d31-4105-891d-c1da7b122277-istio-token\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.186411 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.186243 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19b494c4-1d31-4105-891d-c1da7b122277-istio-podinfo\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.186411 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.186290 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq8sq\" (UniqueName: \"kubernetes.io/projected/19b494c4-1d31-4105-891d-c1da7b122277-kube-api-access-jq8sq\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.186411 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.186378 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-istio-envoy\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.186521 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.186417 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-credential-socket\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.186521 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.186437 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-istio-data\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.186521 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.186505 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19b494c4-1d31-4105-891d-c1da7b122277-istiod-ca-cert\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.186630 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.186533 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-workload-certs\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.186630 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.186555 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-workload-socket\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.287954 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.287854 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-istio-envoy\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.287954 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.287899 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-credential-socket\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.287954 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.287918 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-istio-data\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.287954 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.287954 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19b494c4-1d31-4105-891d-c1da7b122277-istiod-ca-cert\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.288282 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.287984 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-workload-certs\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.288282 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.288016 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-workload-socket\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.288282 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.288057 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19b494c4-1d31-4105-891d-c1da7b122277-istio-token\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.288282 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.288102 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19b494c4-1d31-4105-891d-c1da7b122277-istio-podinfo\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.288282 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.288144 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq8sq\" (UniqueName: \"kubernetes.io/projected/19b494c4-1d31-4105-891d-c1da7b122277-kube-api-access-jq8sq\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.288518 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.288353 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-istio-data\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.288518 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.288432 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-credential-socket\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.288776 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.288679 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-workload-socket\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.288888 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.288751 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19b494c4-1d31-4105-891d-c1da7b122277-istiod-ca-cert\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.289006 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.288985 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-workload-certs\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.290288 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.290269 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-istio-envoy\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.290785 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.290769 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19b494c4-1d31-4105-891d-c1da7b122277-istio-podinfo\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.297359 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.297327 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq8sq\" (UniqueName: \"kubernetes.io/projected/19b494c4-1d31-4105-891d-c1da7b122277-kube-api-access-jq8sq\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.297484 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.297461 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19b494c4-1d31-4105-891d-c1da7b122277-istio-token\") pod \"e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.343281 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.343248 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:33:59.489276 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.489248 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b"] Jul 14 19:33:59.491350 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:33:59.491315 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b494c4_1d31_4105_891d_c1da7b122277.slice/crio-dfd37b9ab0d969885e2fa9a6728b274c5736e9f063af1398b8f08bbbc5e9bfc7 WatchSource:0}: Error finding container dfd37b9ab0d969885e2fa9a6728b274c5736e9f063af1398b8f08bbbc5e9bfc7: Status 404 returned error can't find the container with id dfd37b9ab0d969885e2fa9a6728b274c5736e9f063af1398b8f08bbbc5e9bfc7 Jul 14 19:33:59.494008 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.493970 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:33:59.494100 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.494039 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:33:59.494100 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:33:59.494086 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:34:00.003098 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:00.003065 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" event={"ID":"19b494c4-1d31-4105-891d-c1da7b122277","Type":"ContainerStarted","Data":"b80aff5651fca9b526e940b5e3d6f8b90d3e3d59cd417353f498b6d984e69a0b"} Jul 14 19:34:00.003278 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:00.003122 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" event={"ID":"19b494c4-1d31-4105-891d-c1da7b122277","Type":"ContainerStarted","Data":"dfd37b9ab0d969885e2fa9a6728b274c5736e9f063af1398b8f08bbbc5e9bfc7"} Jul 14 19:34:00.034238 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:00.034156 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" podStartSLOduration=2.034135621 podStartE2EDuration="2.034135621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:33:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:34:00.0316834 +0000 UTC m=+2364.030576220" watchObservedRunningTime="2026-07-14 19:34:00.034135621 +0000 UTC m=+2364.033028441" Jul 14 19:34:00.344266 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:00.344185 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:34:00.349748 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:00.349719 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:34:01.008356 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:01.008321 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:34:01.009427 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:01.009407 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:34:07.961345 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:07.961228 2563 patch_prober.go:28] interesting pod/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Jul 14 19:34:07.961345 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:07.961310 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" podUID="4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Jul 14 19:34:08.047901 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:08.047864 2563 generic.go:356] "Generic (PLEG): container finished" podID="4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad" containerID="1fac6d5eee84e1cd7890a792da4328da0d8f95ff65605493fa750208214d0ea9" exitCode=0 Jul 14 19:34:08.048068 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:08.047910 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" event={"ID":"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad","Type":"ContainerDied","Data":"1fac6d5eee84e1cd7890a792da4328da0d8f95ff65605493fa750208214d0ea9"} Jul 14 19:34:08.048341 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:08.048326 2563 scope.go:117] "RemoveContainer" containerID="1fac6d5eee84e1cd7890a792da4328da0d8f95ff65605493fa750208214d0ea9" Jul 14 19:34:08.049411 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:08.049378 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:34:08.049490 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:08.049471 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:34:08.049529 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:08.049516 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:34:09.055918 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:09.055877 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" event={"ID":"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad","Type":"ContainerStarted","Data":"dc2bcec1bdc068d7bfec1e11f4d3c38af47017ff69e0a0658a94a84d488940ec"} Jul 14 19:34:09.690256 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:09.690215 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:34:09.690447 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:09.690422 2563 patch_prober.go:28] interesting pod/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Jul 14 19:34:09.690502 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:09.690482 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" podUID="4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Jul 14 19:34:10.690193 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:10.690159 2563 patch_prober.go:28] interesting pod/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Jul 14 19:34:10.690692 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:10.690660 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" podUID="4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Jul 14 19:34:11.689866 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:11.689828 2563 patch_prober.go:28] interesting pod/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Jul 14 19:34:11.690053 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:11.689888 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" podUID="4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Jul 14 19:34:12.690546 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:12.690507 2563 patch_prober.go:28] interesting pod/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Jul 14 19:34:12.690968 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:12.690565 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" podUID="4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Jul 14 19:34:13.693988 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:13.693893 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:34:13.694427 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:13.694165 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:34:13.694904 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:13.694885 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:34:16.009726 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:16.009629 2563 patch_prober.go:28] interesting pod/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Jul 14 19:34:16.010204 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:16.009716 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" podUID="19b494c4-1d31-4105-891d-c1da7b122277" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Jul 14 19:34:16.104872 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:16.104772 2563 generic.go:356] "Generic (PLEG): container finished" podID="19b494c4-1d31-4105-891d-c1da7b122277" containerID="b80aff5651fca9b526e940b5e3d6f8b90d3e3d59cd417353f498b6d984e69a0b" exitCode=0 Jul 14 19:34:16.104872 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:16.104806 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" event={"ID":"19b494c4-1d31-4105-891d-c1da7b122277","Type":"ContainerDied","Data":"b80aff5651fca9b526e940b5e3d6f8b90d3e3d59cd417353f498b6d984e69a0b"} Jul 14 19:34:16.105291 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:16.105275 2563 scope.go:117] "RemoveContainer" containerID="b80aff5651fca9b526e940b5e3d6f8b90d3e3d59cd417353f498b6d984e69a0b" Jul 14 19:34:16.106355 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:16.106324 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:34:16.106420 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:16.106396 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:34:16.106456 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:16.106428 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 19:34:17.111896 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:17.111853 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" event={"ID":"19b494c4-1d31-4105-891d-c1da7b122277","Type":"ContainerStarted","Data":"25e7c01fc5b28c471f283141bba2c6b264b3f400a985432afc3da6b39c2a53fa"} Jul 14 19:34:17.344319 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:17.344284 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:34:17.344745 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:17.344654 2563 patch_prober.go:28] interesting pod/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Jul 14 19:34:17.344924 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:17.344901 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" podUID="19b494c4-1d31-4105-891d-c1da7b122277" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Jul 14 19:34:18.344688 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:18.344650 2563 patch_prober.go:28] interesting pod/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Jul 14 19:34:18.345294 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:18.345262 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" podUID="19b494c4-1d31-4105-891d-c1da7b122277" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Jul 14 19:34:19.344245 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:19.344208 2563 patch_prober.go:28] interesting pod/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Jul 14 19:34:19.344543 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:19.344515 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" podUID="19b494c4-1d31-4105-891d-c1da7b122277" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Jul 14 19:34:20.344208 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:20.344164 2563 patch_prober.go:28] interesting pod/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Jul 14 19:34:20.344835 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:20.344795 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" podUID="19b494c4-1d31-4105-891d-c1da7b122277" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Jul 14 19:34:21.347557 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:21.347528 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:34:21.348039 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:21.348015 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:34:21.348750 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:21.348732 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:34:36.663671 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:36.663639 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trrs2_a5633a96-04d9-465c-ae2c-2b5d013f4381/ovn-acl-logging/0.log" Jul 14 19:34:36.667908 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:34:36.667886 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trrs2_a5633a96-04d9-465c-ae2c-2b5d013f4381/ovn-acl-logging/0.log" Jul 14 19:39:36.697761 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:39:36.697685 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trrs2_a5633a96-04d9-465c-ae2c-2b5d013f4381/ovn-acl-logging/0.log" Jul 14 19:39:36.703337 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:39:36.703307 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trrs2_a5633a96-04d9-465c-ae2c-2b5d013f4381/ovn-acl-logging/0.log" Jul 14 19:41:13.006892 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:13.006855 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww"] Jul 14 19:41:13.007424 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:13.007169 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" podUID="4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad" containerName="istio-proxy" containerID="cri-o://dc2bcec1bdc068d7bfec1e11f4d3c38af47017ff69e0a0658a94a84d488940ec" gracePeriod=30 Jul 14 19:41:13.696410 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:13.696371 2563 patch_prober.go:28] interesting pod/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 19:41:13.696582 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:13.696439 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" podUID="4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 19:41:18.269899 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.269874 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:41:18.352243 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.352145 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xq6zg\" (UniqueName: \"kubernetes.io/projected/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-kube-api-access-xq6zg\") pod \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " Jul 14 19:41:18.352243 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.352220 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-data\") pod \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " Jul 14 19:41:18.352470 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.352257 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-envoy\") pod \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " Jul 14 19:41:18.352470 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.352283 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-token\") pod \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " Jul 14 19:41:18.352470 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.352324 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istiod-ca-cert\") pod \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " Jul 14 19:41:18.352470 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.352358 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-workload-certs\") pod \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " Jul 14 19:41:18.352470 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.352420 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-workload-socket\") pod \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " Jul 14 19:41:18.352470 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.352466 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-credential-socket\") pod \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " Jul 14 19:41:18.352806 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.352495 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-podinfo\") pod \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\" (UID: \"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad\") " Jul 14 19:41:18.352876 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.352850 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad" (UID: "4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:41:18.352998 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.352951 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad" (UID: "4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:41:18.353319 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.353039 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad" (UID: "4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 19:41:18.353319 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.353293 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad" (UID: "4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:41:18.353509 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.353478 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-data" (OuterVolumeSpecName: "istio-data") pod "4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad" (UID: "4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:41:18.354697 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.354669 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-token" (OuterVolumeSpecName: "istio-token") pod "4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad" (UID: "4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:41:18.354697 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.354691 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-kube-api-access-xq6zg" (OuterVolumeSpecName: "kube-api-access-xq6zg") pod "4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad" (UID: "4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad"). InnerVolumeSpecName "kube-api-access-xq6zg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:41:18.354867 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.354750 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad" (UID: "4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:41:18.355080 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.355065 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad" (UID: "4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 19:41:18.389202 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.389172 2563 generic.go:356] "Generic (PLEG): container finished" podID="4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad" containerID="dc2bcec1bdc068d7bfec1e11f4d3c38af47017ff69e0a0658a94a84d488940ec" exitCode=0 Jul 14 19:41:18.389319 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.389206 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" event={"ID":"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad","Type":"ContainerDied","Data":"dc2bcec1bdc068d7bfec1e11f4d3c38af47017ff69e0a0658a94a84d488940ec"} Jul 14 19:41:18.389319 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.389266 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" event={"ID":"4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad","Type":"ContainerDied","Data":"92785eaffc9a59200296da60bf354d525b91cd71b1b6d317d0bb4b217dcc870f"} Jul 14 19:41:18.389319 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.389289 2563 scope.go:117] "RemoveContainer" containerID="dc2bcec1bdc068d7bfec1e11f4d3c38af47017ff69e0a0658a94a84d488940ec" Jul 14 19:41:18.389319 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.389221 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww" Jul 14 19:41:18.398662 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.398647 2563 scope.go:117] "RemoveContainer" containerID="1fac6d5eee84e1cd7890a792da4328da0d8f95ff65605493fa750208214d0ea9" Jul 14 19:41:18.406852 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.406834 2563 scope.go:117] "RemoveContainer" containerID="dc2bcec1bdc068d7bfec1e11f4d3c38af47017ff69e0a0658a94a84d488940ec" Jul 14 19:41:18.407111 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:41:18.407094 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc2bcec1bdc068d7bfec1e11f4d3c38af47017ff69e0a0658a94a84d488940ec\": container with ID starting with dc2bcec1bdc068d7bfec1e11f4d3c38af47017ff69e0a0658a94a84d488940ec not found: ID does not exist" containerID="dc2bcec1bdc068d7bfec1e11f4d3c38af47017ff69e0a0658a94a84d488940ec" Jul 14 19:41:18.407154 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.407120 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc2bcec1bdc068d7bfec1e11f4d3c38af47017ff69e0a0658a94a84d488940ec"} err="failed to get container status \"dc2bcec1bdc068d7bfec1e11f4d3c38af47017ff69e0a0658a94a84d488940ec\": rpc error: code = NotFound desc = could not find container \"dc2bcec1bdc068d7bfec1e11f4d3c38af47017ff69e0a0658a94a84d488940ec\": container with ID starting with dc2bcec1bdc068d7bfec1e11f4d3c38af47017ff69e0a0658a94a84d488940ec not found: ID does not exist" Jul 14 19:41:18.407154 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.407136 2563 scope.go:117] "RemoveContainer" containerID="1fac6d5eee84e1cd7890a792da4328da0d8f95ff65605493fa750208214d0ea9" Jul 14 19:41:18.407378 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:41:18.407360 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fac6d5eee84e1cd7890a792da4328da0d8f95ff65605493fa750208214d0ea9\": container with ID starting with 1fac6d5eee84e1cd7890a792da4328da0d8f95ff65605493fa750208214d0ea9 not found: ID does not exist" containerID="1fac6d5eee84e1cd7890a792da4328da0d8f95ff65605493fa750208214d0ea9" Jul 14 19:41:18.407417 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.407385 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fac6d5eee84e1cd7890a792da4328da0d8f95ff65605493fa750208214d0ea9"} err="failed to get container status \"1fac6d5eee84e1cd7890a792da4328da0d8f95ff65605493fa750208214d0ea9\": rpc error: code = NotFound desc = could not find container \"1fac6d5eee84e1cd7890a792da4328da0d8f95ff65605493fa750208214d0ea9\": container with ID starting with 1fac6d5eee84e1cd7890a792da4328da0d8f95ff65605493fa750208214d0ea9 not found: ID does not exist" Jul 14 19:41:18.415772 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.415743 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww"] Jul 14 19:41:18.420678 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.420657 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-755a0b-openshift-default-7c578778ff-wxvww"] Jul 14 19:41:18.454123 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.454095 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-data\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:41:18.454123 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.454120 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-envoy\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:41:18.454123 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.454128 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-token\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:41:18.454299 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.454136 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istiod-ca-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:41:18.454299 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.454144 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-workload-certs\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:41:18.454299 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.454151 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-workload-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:41:18.454299 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.454160 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-credential-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:41:18.454299 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.454170 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-istio-podinfo\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:41:18.454299 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.454178 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xq6zg\" (UniqueName: \"kubernetes.io/projected/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad-kube-api-access-xq6zg\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:41:18.566605 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:18.566571 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad" path="/var/lib/kubelet/pods/4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad/volumes" Jul 14 19:41:39.170031 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:39.169993 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b"] Jul 14 19:41:39.170434 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:39.170270 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" podUID="19b494c4-1d31-4105-891d-c1da7b122277" containerName="istio-proxy" containerID="cri-o://25e7c01fc5b28c471f283141bba2c6b264b3f400a985432afc3da6b39c2a53fa" gracePeriod=30 Jul 14 19:41:44.428162 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.428129 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:41:44.494688 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.494663 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-workload-certs\") pod \"19b494c4-1d31-4105-891d-c1da7b122277\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " Jul 14 19:41:44.494856 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.494698 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-workload-socket\") pod \"19b494c4-1d31-4105-891d-c1da7b122277\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " Jul 14 19:41:44.494856 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.494729 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jq8sq\" (UniqueName: \"kubernetes.io/projected/19b494c4-1d31-4105-891d-c1da7b122277-kube-api-access-jq8sq\") pod \"19b494c4-1d31-4105-891d-c1da7b122277\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " Jul 14 19:41:44.494856 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.494748 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19b494c4-1d31-4105-891d-c1da7b122277-istiod-ca-cert\") pod \"19b494c4-1d31-4105-891d-c1da7b122277\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " Jul 14 19:41:44.494856 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.494778 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-istio-envoy\") pod \"19b494c4-1d31-4105-891d-c1da7b122277\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " Jul 14 19:41:44.494856 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.494835 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19b494c4-1d31-4105-891d-c1da7b122277-istio-token\") pod \"19b494c4-1d31-4105-891d-c1da7b122277\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " Jul 14 19:41:44.495114 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.494871 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-istio-data\") pod \"19b494c4-1d31-4105-891d-c1da7b122277\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " Jul 14 19:41:44.495114 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.494903 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-credential-socket\") pod \"19b494c4-1d31-4105-891d-c1da7b122277\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " Jul 14 19:41:44.495114 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.494982 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "19b494c4-1d31-4105-891d-c1da7b122277" (UID: "19b494c4-1d31-4105-891d-c1da7b122277"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:41:44.495114 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.495003 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "19b494c4-1d31-4105-891d-c1da7b122277" (UID: "19b494c4-1d31-4105-891d-c1da7b122277"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:41:44.495114 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.495066 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19b494c4-1d31-4105-891d-c1da7b122277-istio-podinfo\") pod \"19b494c4-1d31-4105-891d-c1da7b122277\" (UID: \"19b494c4-1d31-4105-891d-c1da7b122277\") " Jul 14 19:41:44.495388 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.495114 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "19b494c4-1d31-4105-891d-c1da7b122277" (UID: "19b494c4-1d31-4105-891d-c1da7b122277"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:41:44.495388 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.495200 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19b494c4-1d31-4105-891d-c1da7b122277-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "19b494c4-1d31-4105-891d-c1da7b122277" (UID: "19b494c4-1d31-4105-891d-c1da7b122277"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 19:41:44.495543 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.495473 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-workload-certs\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:41:44.495543 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.495507 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-workload-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:41:44.495543 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.495521 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19b494c4-1d31-4105-891d-c1da7b122277-istiod-ca-cert\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:41:44.495543 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.495534 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-credential-socket\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:41:44.495981 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.495878 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-istio-data" (OuterVolumeSpecName: "istio-data") pod "19b494c4-1d31-4105-891d-c1da7b122277" (UID: "19b494c4-1d31-4105-891d-c1da7b122277"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:41:44.497269 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.497234 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19b494c4-1d31-4105-891d-c1da7b122277-kube-api-access-jq8sq" (OuterVolumeSpecName: "kube-api-access-jq8sq") pod "19b494c4-1d31-4105-891d-c1da7b122277" (UID: "19b494c4-1d31-4105-891d-c1da7b122277"). InnerVolumeSpecName "kube-api-access-jq8sq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:41:44.497398 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.497236 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19b494c4-1d31-4105-891d-c1da7b122277-istio-token" (OuterVolumeSpecName: "istio-token") pod "19b494c4-1d31-4105-891d-c1da7b122277" (UID: "19b494c4-1d31-4105-891d-c1da7b122277"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:41:44.497398 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.497271 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "19b494c4-1d31-4105-891d-c1da7b122277" (UID: "19b494c4-1d31-4105-891d-c1da7b122277"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:41:44.497398 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.497315 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19b494c4-1d31-4105-891d-c1da7b122277-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "19b494c4-1d31-4105-891d-c1da7b122277" (UID: "19b494c4-1d31-4105-891d-c1da7b122277"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 19:41:44.528300 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.528275 2563 generic.go:356] "Generic (PLEG): container finished" podID="19b494c4-1d31-4105-891d-c1da7b122277" containerID="25e7c01fc5b28c471f283141bba2c6b264b3f400a985432afc3da6b39c2a53fa" exitCode=0 Jul 14 19:41:44.528396 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.528321 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" Jul 14 19:41:44.528396 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.528336 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" event={"ID":"19b494c4-1d31-4105-891d-c1da7b122277","Type":"ContainerDied","Data":"25e7c01fc5b28c471f283141bba2c6b264b3f400a985432afc3da6b39c2a53fa"} Jul 14 19:41:44.528396 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.528378 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b" event={"ID":"19b494c4-1d31-4105-891d-c1da7b122277","Type":"ContainerDied","Data":"dfd37b9ab0d969885e2fa9a6728b274c5736e9f063af1398b8f08bbbc5e9bfc7"} Jul 14 19:41:44.528511 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.528400 2563 scope.go:117] "RemoveContainer" containerID="25e7c01fc5b28c471f283141bba2c6b264b3f400a985432afc3da6b39c2a53fa" Jul 14 19:41:44.537457 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.537442 2563 scope.go:117] "RemoveContainer" containerID="b80aff5651fca9b526e940b5e3d6f8b90d3e3d59cd417353f498b6d984e69a0b" Jul 14 19:41:44.546102 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.546083 2563 scope.go:117] "RemoveContainer" containerID="25e7c01fc5b28c471f283141bba2c6b264b3f400a985432afc3da6b39c2a53fa" Jul 14 19:41:44.546350 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:41:44.546322 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25e7c01fc5b28c471f283141bba2c6b264b3f400a985432afc3da6b39c2a53fa\": container with ID starting with 25e7c01fc5b28c471f283141bba2c6b264b3f400a985432afc3da6b39c2a53fa not found: ID does not exist" containerID="25e7c01fc5b28c471f283141bba2c6b264b3f400a985432afc3da6b39c2a53fa" Jul 14 19:41:44.546410 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.546349 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25e7c01fc5b28c471f283141bba2c6b264b3f400a985432afc3da6b39c2a53fa"} err="failed to get container status \"25e7c01fc5b28c471f283141bba2c6b264b3f400a985432afc3da6b39c2a53fa\": rpc error: code = NotFound desc = could not find container \"25e7c01fc5b28c471f283141bba2c6b264b3f400a985432afc3da6b39c2a53fa\": container with ID starting with 25e7c01fc5b28c471f283141bba2c6b264b3f400a985432afc3da6b39c2a53fa not found: ID does not exist" Jul 14 19:41:44.546410 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.546365 2563 scope.go:117] "RemoveContainer" containerID="b80aff5651fca9b526e940b5e3d6f8b90d3e3d59cd417353f498b6d984e69a0b" Jul 14 19:41:44.546649 ip-10-0-143-130 kubenswrapper[2563]: E0714 19:41:44.546633 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b80aff5651fca9b526e940b5e3d6f8b90d3e3d59cd417353f498b6d984e69a0b\": container with ID starting with b80aff5651fca9b526e940b5e3d6f8b90d3e3d59cd417353f498b6d984e69a0b not found: ID does not exist" containerID="b80aff5651fca9b526e940b5e3d6f8b90d3e3d59cd417353f498b6d984e69a0b" Jul 14 19:41:44.546698 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.546656 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b80aff5651fca9b526e940b5e3d6f8b90d3e3d59cd417353f498b6d984e69a0b"} err="failed to get container status \"b80aff5651fca9b526e940b5e3d6f8b90d3e3d59cd417353f498b6d984e69a0b\": rpc error: code = NotFound desc = could not find container \"b80aff5651fca9b526e940b5e3d6f8b90d3e3d59cd417353f498b6d984e69a0b\": container with ID starting with b80aff5651fca9b526e940b5e3d6f8b90d3e3d59cd417353f498b6d984e69a0b not found: ID does not exist" Jul 14 19:41:44.553322 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.553302 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b"] Jul 14 19:41:44.559050 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.559024 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-7c2fbe-openshift-default-6674cf56dc-9ns6b"] Jul 14 19:41:44.571101 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.571073 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19b494c4-1d31-4105-891d-c1da7b122277" path="/var/lib/kubelet/pods/19b494c4-1d31-4105-891d-c1da7b122277/volumes" Jul 14 19:41:44.596169 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.596142 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq8sq\" (UniqueName: \"kubernetes.io/projected/19b494c4-1d31-4105-891d-c1da7b122277-kube-api-access-jq8sq\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:41:44.596169 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.596165 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-istio-envoy\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:41:44.596300 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.596175 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19b494c4-1d31-4105-891d-c1da7b122277-istio-token\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:41:44.596300 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.596183 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19b494c4-1d31-4105-891d-c1da7b122277-istio-data\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:41:44.596300 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:44.596190 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19b494c4-1d31-4105-891d-c1da7b122277-istio-podinfo\") on node \"ip-10-0-143-130.ec2.internal\" DevicePath \"\"" Jul 14 19:41:45.572338 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:45.572297 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6c46888d8f-24nwq_1669d992-3b70-4470-9649-c254b5f978af/manager/0.log" Jul 14 19:41:45.824468 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:45.824387 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xccs4_c5aaa1b4-de21-4e45-a3fc-cbf45e4166b1/manager/0.log" Jul 14 19:41:46.265118 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:46.265091 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ff67ccb56-wmvlg_71600064-e629-44f7-aa12-ed0fb6e35f17/copy-manifests/0.log" Jul 14 19:41:46.275711 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:46.275684 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ff67ccb56-wmvlg_71600064-e629-44f7-aa12-ed0fb6e35f17/manager/0.log" Jul 14 19:41:46.655881 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:46.655797 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-74597dff59-8ztfl_d9e3863d-6fcd-4f19-b986-1db6976bf550/maas-api/0.log" Jul 14 19:41:49.238642 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:49.238587 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl_f2d30913-8226-4ff9-9044-15d2b7408bb9/pull/0.log" Jul 14 19:41:49.248861 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:49.248826 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl_f2d30913-8226-4ff9-9044-15d2b7408bb9/extract/0.log" Jul 14 19:41:49.259248 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:49.259218 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl_f2d30913-8226-4ff9-9044-15d2b7408bb9/util/0.log" Jul 14 19:41:49.370460 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:49.370431 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb_686beb3b-362c-40f0-b08a-502cb233b9dc/util/0.log" Jul 14 19:41:49.377642 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:49.377589 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb_686beb3b-362c-40f0-b08a-502cb233b9dc/pull/0.log" Jul 14 19:41:49.390485 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:49.390462 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb_686beb3b-362c-40f0-b08a-502cb233b9dc/extract/0.log" Jul 14 19:41:49.510098 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:49.510068 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx_70ae89fd-7391-44df-87ff-4db05c0a0ff0/util/0.log" Jul 14 19:41:49.519029 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:49.519007 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx_70ae89fd-7391-44df-87ff-4db05c0a0ff0/pull/0.log" Jul 14 19:41:49.530739 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:49.530712 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx_70ae89fd-7391-44df-87ff-4db05c0a0ff0/extract/0.log" Jul 14 19:41:49.647635 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:49.647585 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92_c11eb008-2d21-4082-bbe2-a1268a667e2e/util/0.log" Jul 14 19:41:49.655389 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:49.655364 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92_c11eb008-2d21-4082-bbe2-a1268a667e2e/pull/0.log" Jul 14 19:41:49.662845 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:49.662822 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92_c11eb008-2d21-4082-bbe2-a1268a667e2e/extract/0.log" Jul 14 19:41:51.087512 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:51.087475 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4bgd5b_73a2f49a-4e05-4516-bd50-3c76af3261a3/istio-proxy/0.log" Jul 14 19:41:51.218472 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:51.218441 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9vwdf_f4225f40-5dba-44af-893f-d2ae520a30e7/discovery/0.log" Jul 14 19:41:51.591802 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:51.591766 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zdm4h_9058e011-7163-4ab4-b0e4-a1670135459f/istio-proxy/1.log" Jul 14 19:41:52.319702 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:52.319641 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-psrmr_72916379-ede0-4cbb-997d-65ed522d0fe1/main/0.log" Jul 14 19:41:52.677519 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:52.677443 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdd9pm_9e06c893-37d7-4599-b1ae-176f29060ce7/main/0.log" Jul 14 19:41:52.803424 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:41:52.803393 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-lx7t7_6fde3871-324d-4e14-9069-74b862bbea59/main/0.log" Jul 14 19:42:01.777439 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:01.777406 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4vl24_b14d3ec3-b9f4-405e-b759-56a512688c5f/global-pull-secret-syncer/0.log" Jul 14 19:42:02.023573 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:02.023466 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7mhm7_f8f754bf-1c44-4f17-bda8-5e1708679f80/konnectivity-agent/0.log" Jul 14 19:42:02.156348 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:02.156300 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-130.ec2.internal_a9f761aa7d4495c36ad2e38608410c31/haproxy/0.log" Jul 14 19:42:06.470973 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:06.470942 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl_f2d30913-8226-4ff9-9044-15d2b7408bb9/extract/0.log" Jul 14 19:42:06.500927 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:06.500843 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl_f2d30913-8226-4ff9-9044-15d2b7408bb9/util/0.log" Jul 14 19:42:06.543513 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:06.543483 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rrdrl_f2d30913-8226-4ff9-9044-15d2b7408bb9/pull/0.log" Jul 14 19:42:06.579025 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:06.579001 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb_686beb3b-362c-40f0-b08a-502cb233b9dc/extract/0.log" Jul 14 19:42:06.608651 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:06.608620 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb_686beb3b-362c-40f0-b08a-502cb233b9dc/util/0.log" Jul 14 19:42:06.636040 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:06.636006 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mxdpb_686beb3b-362c-40f0-b08a-502cb233b9dc/pull/0.log" Jul 14 19:42:06.694354 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:06.694323 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx_70ae89fd-7391-44df-87ff-4db05c0a0ff0/extract/0.log" Jul 14 19:42:06.752797 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:06.752767 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx_70ae89fd-7391-44df-87ff-4db05c0a0ff0/util/0.log" Jul 14 19:42:06.813824 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:06.813796 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xvnlx_70ae89fd-7391-44df-87ff-4db05c0a0ff0/pull/0.log" Jul 14 19:42:06.870820 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:06.870789 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92_c11eb008-2d21-4082-bbe2-a1268a667e2e/extract/0.log" Jul 14 19:42:06.940860 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:06.940835 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92_c11eb008-2d21-4082-bbe2-a1268a667e2e/util/0.log" Jul 14 19:42:06.966962 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:06.966928 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvr92_c11eb008-2d21-4082-bbe2-a1268a667e2e/pull/0.log" Jul 14 19:42:09.507713 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:09.503706 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_445ec7ac-618e-4734-a4a4-bb56c299714f/alertmanager/0.log" Jul 14 19:42:09.537907 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:09.537880 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_445ec7ac-618e-4734-a4a4-bb56c299714f/config-reloader/0.log" Jul 14 19:42:09.566099 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:09.566071 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_445ec7ac-618e-4734-a4a4-bb56c299714f/kube-rbac-proxy-web/0.log" Jul 14 19:42:09.593052 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:09.593027 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_445ec7ac-618e-4734-a4a4-bb56c299714f/kube-rbac-proxy/0.log" Jul 14 19:42:09.623487 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:09.623461 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_445ec7ac-618e-4734-a4a4-bb56c299714f/kube-rbac-proxy-metric/0.log" Jul 14 19:42:09.652869 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:09.652843 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_445ec7ac-618e-4734-a4a4-bb56c299714f/prom-label-proxy/0.log" Jul 14 19:42:09.689433 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:09.689403 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_445ec7ac-618e-4734-a4a4-bb56c299714f/init-config-reloader/0.log" Jul 14 19:42:09.898480 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:09.898390 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7f88cb85f6-8wplj_3dd6ef3d-dce9-4d47-b361-f32e9e49691d/metrics-server/0.log" Jul 14 19:42:09.930289 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:09.930253 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-h5j4g_dd200391-5737-4aa0-81ae-e51f8ee75ae5/monitoring-plugin/0.log" Jul 14 19:42:09.965408 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:09.965382 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2fpxw_e8d48bb3-2437-4ba1-bf7c-8f87aace84d4/node-exporter/0.log" Jul 14 19:42:09.990913 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:09.990882 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2fpxw_e8d48bb3-2437-4ba1-bf7c-8f87aace84d4/kube-rbac-proxy/0.log" Jul 14 19:42:10.016416 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:10.016385 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2fpxw_e8d48bb3-2437-4ba1-bf7c-8f87aace84d4/init-textfile/0.log" Jul 14 19:42:10.577326 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:10.577290 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-2jbpg_8321681e-5428-4412-b965-1c0f785b327b/prometheus-operator/0.log" Jul 14 19:42:10.606865 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:10.606831 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-2jbpg_8321681e-5428-4412-b965-1c0f785b327b/kube-rbac-proxy/0.log" Jul 14 19:42:10.686971 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:10.686941 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fbf95ddd6-qcxpc_75797e11-5179-402a-9677-2df960fd1782/telemeter-client/0.log" Jul 14 19:42:10.713504 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:10.713474 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fbf95ddd6-qcxpc_75797e11-5179-402a-9677-2df960fd1782/reload/0.log" Jul 14 19:42:10.741779 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:10.741748 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fbf95ddd6-qcxpc_75797e11-5179-402a-9677-2df960fd1782/kube-rbac-proxy/0.log" Jul 14 19:42:11.587017 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.586984 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7"] Jul 14 19:42:11.587407 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.587345 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad" containerName="istio-proxy" Jul 14 19:42:11.587407 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.587357 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad" containerName="istio-proxy" Jul 14 19:42:11.587407 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.587374 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19b494c4-1d31-4105-891d-c1da7b122277" containerName="istio-proxy" Jul 14 19:42:11.587407 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.587380 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b494c4-1d31-4105-891d-c1da7b122277" containerName="istio-proxy" Jul 14 19:42:11.587542 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.587447 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bf4f6e6-681d-4a42-9f1f-2a50afdcb9ad" containerName="istio-proxy" Jul 14 19:42:11.587542 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.587457 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="19b494c4-1d31-4105-891d-c1da7b122277" containerName="istio-proxy" Jul 14 19:42:11.587542 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.587464 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="19b494c4-1d31-4105-891d-c1da7b122277" containerName="istio-proxy" Jul 14 19:42:11.590535 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.590514 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7" Jul 14 19:42:11.594761 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.594744 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pkg8j\"/\"kube-root-ca.crt\"" Jul 14 19:42:11.595028 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.595014 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pkg8j\"/\"openshift-service-ca.crt\"" Jul 14 19:42:11.596061 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.596041 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pkg8j\"/\"default-dockercfg-bdtdn\"" Jul 14 19:42:11.606744 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.606717 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7"] Jul 14 19:42:11.654814 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.654774 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdd58033-5694-4e48-b2d1-e8913cc6ed32-sys\") pod \"perf-node-gather-daemonset-grtd7\" (UID: \"fdd58033-5694-4e48-b2d1-e8913cc6ed32\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7" Jul 14 19:42:11.654995 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.654821 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z657j\" (UniqueName: \"kubernetes.io/projected/fdd58033-5694-4e48-b2d1-e8913cc6ed32-kube-api-access-z657j\") pod \"perf-node-gather-daemonset-grtd7\" (UID: \"fdd58033-5694-4e48-b2d1-e8913cc6ed32\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7" Jul 14 19:42:11.654995 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.654896 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdd58033-5694-4e48-b2d1-e8913cc6ed32-lib-modules\") pod \"perf-node-gather-daemonset-grtd7\" (UID: \"fdd58033-5694-4e48-b2d1-e8913cc6ed32\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7" Jul 14 19:42:11.654995 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.654949 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fdd58033-5694-4e48-b2d1-e8913cc6ed32-proc\") pod \"perf-node-gather-daemonset-grtd7\" (UID: \"fdd58033-5694-4e48-b2d1-e8913cc6ed32\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7" Jul 14 19:42:11.654995 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.654984 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fdd58033-5694-4e48-b2d1-e8913cc6ed32-podres\") pod \"perf-node-gather-daemonset-grtd7\" (UID: \"fdd58033-5694-4e48-b2d1-e8913cc6ed32\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7" Jul 14 19:42:11.755474 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.755437 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fdd58033-5694-4e48-b2d1-e8913cc6ed32-proc\") pod \"perf-node-gather-daemonset-grtd7\" (UID: \"fdd58033-5694-4e48-b2d1-e8913cc6ed32\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7" Jul 14 19:42:11.755474 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.755477 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fdd58033-5694-4e48-b2d1-e8913cc6ed32-podres\") pod \"perf-node-gather-daemonset-grtd7\" (UID: \"fdd58033-5694-4e48-b2d1-e8913cc6ed32\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7" Jul 14 19:42:11.755761 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.755570 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fdd58033-5694-4e48-b2d1-e8913cc6ed32-proc\") pod \"perf-node-gather-daemonset-grtd7\" (UID: \"fdd58033-5694-4e48-b2d1-e8913cc6ed32\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7" Jul 14 19:42:11.755761 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.755624 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdd58033-5694-4e48-b2d1-e8913cc6ed32-sys\") pod \"perf-node-gather-daemonset-grtd7\" (UID: \"fdd58033-5694-4e48-b2d1-e8913cc6ed32\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7" Jul 14 19:42:11.755761 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.755652 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z657j\" (UniqueName: \"kubernetes.io/projected/fdd58033-5694-4e48-b2d1-e8913cc6ed32-kube-api-access-z657j\") pod \"perf-node-gather-daemonset-grtd7\" (UID: \"fdd58033-5694-4e48-b2d1-e8913cc6ed32\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7" Jul 14 19:42:11.755761 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.755676 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fdd58033-5694-4e48-b2d1-e8913cc6ed32-podres\") pod \"perf-node-gather-daemonset-grtd7\" (UID: \"fdd58033-5694-4e48-b2d1-e8913cc6ed32\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7" Jul 14 19:42:11.755761 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.755689 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdd58033-5694-4e48-b2d1-e8913cc6ed32-lib-modules\") pod \"perf-node-gather-daemonset-grtd7\" (UID: \"fdd58033-5694-4e48-b2d1-e8913cc6ed32\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7" Jul 14 19:42:11.755761 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.755725 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdd58033-5694-4e48-b2d1-e8913cc6ed32-sys\") pod \"perf-node-gather-daemonset-grtd7\" (UID: \"fdd58033-5694-4e48-b2d1-e8913cc6ed32\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7" Jul 14 19:42:11.755968 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.755799 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdd58033-5694-4e48-b2d1-e8913cc6ed32-lib-modules\") pod \"perf-node-gather-daemonset-grtd7\" (UID: \"fdd58033-5694-4e48-b2d1-e8913cc6ed32\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7" Jul 14 19:42:11.765948 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.765914 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z657j\" (UniqueName: \"kubernetes.io/projected/fdd58033-5694-4e48-b2d1-e8913cc6ed32-kube-api-access-z657j\") pod \"perf-node-gather-daemonset-grtd7\" (UID: \"fdd58033-5694-4e48-b2d1-e8913cc6ed32\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7" Jul 14 19:42:11.900350 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:11.900255 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7" Jul 14 19:42:12.047880 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:12.047853 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7"] Jul 14 19:42:12.049676 ip-10-0-143-130 kubenswrapper[2563]: W0714 19:42:12.049645 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfdd58033_5694_4e48_b2d1_e8913cc6ed32.slice/crio-1e7ccdf8bd1bae4ab2a49bac7635dc40c05f650947276a004f445c6c8ebe047d WatchSource:0}: Error finding container 1e7ccdf8bd1bae4ab2a49bac7635dc40c05f650947276a004f445c6c8ebe047d: Status 404 returned error can't find the container with id 1e7ccdf8bd1bae4ab2a49bac7635dc40c05f650947276a004f445c6c8ebe047d Jul 14 19:42:12.678440 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:12.678403 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7" event={"ID":"fdd58033-5694-4e48-b2d1-e8913cc6ed32","Type":"ContainerStarted","Data":"d1e461bff191c936601a0dc05f37b03db8062b8be325faa6969978552d5aca41"} Jul 14 19:42:12.678881 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:12.678463 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7" Jul 14 19:42:12.678881 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:12.678482 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7" event={"ID":"fdd58033-5694-4e48-b2d1-e8913cc6ed32","Type":"ContainerStarted","Data":"1e7ccdf8bd1bae4ab2a49bac7635dc40c05f650947276a004f445c6c8ebe047d"} Jul 14 19:42:12.704229 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:12.704175 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7" podStartSLOduration=1.704156298 podStartE2EDuration="1.704156298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:42:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:42:12.701374017 +0000 UTC m=+2856.700266836" watchObservedRunningTime="2026-07-14 19:42:12.704156298 +0000 UTC m=+2856.703049115" Jul 14 19:42:13.391977 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:13.391944 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d9d757f55-c7xt2_7e596202-7cbe-490d-8f16-44b542c03e0a/console/0.log" Jul 14 19:42:15.593181 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:15.593137 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nx6dq_fd9264b1-5a02-44c1-ba41-6eeeb3702ac8/dns/0.log" Jul 14 19:42:15.637134 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:15.637103 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nx6dq_fd9264b1-5a02-44c1-ba41-6eeeb3702ac8/kube-rbac-proxy/0.log" Jul 14 19:42:15.682691 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:15.682667 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gmbvx_0ac30b61-e7a1-4c20-9d7d-937806a945ff/dns-node-resolver/0.log" Jul 14 19:42:16.509303 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:16.509266 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ddrwt_5fbbc18a-4a27-4e86-8c87-902868a08e08/node-ca/0.log" Jul 14 19:42:17.712837 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:17.712794 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4bgd5b_73a2f49a-4e05-4516-bd50-3c76af3261a3/istio-proxy/0.log" Jul 14 19:42:17.926468 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:17.926434 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9vwdf_f4225f40-5dba-44af-893f-d2ae520a30e7/discovery/0.log" Jul 14 19:42:18.026369 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:18.026340 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zdm4h_9058e011-7163-4ab4-b0e4-a1670135459f/istio-proxy/0.log" Jul 14 19:42:18.083129 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:18.083095 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zdm4h_9058e011-7163-4ab4-b0e4-a1670135459f/istio-proxy/1.log" Jul 14 19:42:18.694438 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:18.694411 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-grtd7" Jul 14 19:42:18.936784 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:18.936749 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cjtpk_ecbd7240-6b76-4441-8ee6-dac75955e64a/serve-healthcheck-canary/0.log" Jul 14 19:42:19.638955 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:19.638884 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w4v8d_cad8769b-f4a9-4b04-b024-3ee76145439e/kube-rbac-proxy/0.log" Jul 14 19:42:19.671700 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:19.671670 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w4v8d_cad8769b-f4a9-4b04-b024-3ee76145439e/exporter/0.log" Jul 14 19:42:19.702056 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:19.702027 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w4v8d_cad8769b-f4a9-4b04-b024-3ee76145439e/extractor/0.log" Jul 14 19:42:21.968135 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:21.968047 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4bgd5b_73a2f49a-4e05-4516-bd50-3c76af3261a3/istio-proxy/0.log" Jul 14 19:42:22.170377 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:22.170334 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9vwdf_f4225f40-5dba-44af-893f-d2ae520a30e7/discovery/0.log" Jul 14 19:42:22.220906 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:22.220801 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zdm4h_9058e011-7163-4ab4-b0e4-a1670135459f/istio-proxy/0.log" Jul 14 19:42:22.278521 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:22.278483 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zdm4h_9058e011-7163-4ab4-b0e4-a1670135459f/istio-proxy/1.log" Jul 14 19:42:22.596785 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:22.596752 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6c46888d8f-24nwq_1669d992-3b70-4470-9649-c254b5f978af/manager/0.log" Jul 14 19:42:22.734058 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:22.734028 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xccs4_c5aaa1b4-de21-4e45-a3fc-cbf45e4166b1/manager/0.log" Jul 14 19:42:23.019039 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:23.019003 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ff67ccb56-wmvlg_71600064-e629-44f7-aa12-ed0fb6e35f17/manager/0.log" Jul 14 19:42:23.077839 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:23.077805 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ff67ccb56-wmvlg_71600064-e629-44f7-aa12-ed0fb6e35f17/copy-manifests/0.log" Jul 14 19:42:23.611959 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:23.611925 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4bgd5b_73a2f49a-4e05-4516-bd50-3c76af3261a3/istio-proxy/0.log" Jul 14 19:42:23.816141 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:23.816101 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9vwdf_f4225f40-5dba-44af-893f-d2ae520a30e7/discovery/0.log" Jul 14 19:42:23.874298 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:23.874250 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zdm4h_9058e011-7163-4ab4-b0e4-a1670135459f/istio-proxy/0.log" Jul 14 19:42:23.933409 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:23.933363 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zdm4h_9058e011-7163-4ab4-b0e4-a1670135459f/istio-proxy/1.log" Jul 14 19:42:24.361218 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:24.361185 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6c74864f54-ts7rp_546f1fee-bcb9-4a51-a22f-dadc7a7643ed/manager/0.log" Jul 14 19:42:24.428339 ip-10-0-143-130 kubenswrapper[2563]: I0714 19:42:24.428305 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-pkbnj_a3dbe7e0-5471-418a-b945-54b5dabf3699/openshift-lws-operator/0.log"