Jul 02 16:54:44.451458 ip-10-0-136-0 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 02 16:54:44.451467 ip-10-0-136-0 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 02 16:54:44.451474 ip-10-0-136-0 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 02 16:54:44.451718 ip-10-0-136-0 systemd[1]: Failed to start Kubernetes Kubelet. Jul 02 16:54:54.527277 ip-10-0-136-0 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 02 16:54:54.527297 ip-10-0-136-0 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 47794b9b7c11489e8c2751775cebfd2b -- Jul 02 16:56:59.522509 ip-10-0-136-0 systemd[1]: Starting Kubernetes Kubelet... Jul 02 16:56:59.919266 ip-10-0-136-0 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 16:56:59.919266 ip-10-0-136-0 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 16:56:59.919266 ip-10-0-136-0 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 16:56:59.919266 ip-10-0-136-0 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 16:56:59.919266 ip-10-0-136-0 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 16:56:59.920141 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.920076 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 16:56:59.925641 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925626 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:56:59.925641 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925641 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:56:59.925703 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925644 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:56:59.925703 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925650 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:56:59.925703 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925654 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:56:59.925703 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925657 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:56:59.925703 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925660 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:56:59.925703 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925664 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:56:59.925703 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925667 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:56:59.925703 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925670 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:56:59.925703 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925673 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:56:59.925703 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925676 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:56:59.925703 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925679 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:56:59.925703 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925682 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:56:59.925703 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925684 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:56:59.925703 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925687 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:56:59.925703 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925689 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:56:59.925703 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925692 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:56:59.925703 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925695 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:56:59.925703 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925702 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:56:59.925703 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925705 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:56:59.926159 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925708 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:56:59.926159 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925711 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:56:59.926159 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925714 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:56:59.926159 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925717 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:56:59.926159 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925719 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:56:59.926159 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925722 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:56:59.926159 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925725 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:56:59.926159 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925727 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:56:59.926159 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925730 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:56:59.926159 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925733 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:56:59.926159 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925735 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:56:59.926159 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925738 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:56:59.926159 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925740 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:56:59.926159 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925743 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:56:59.926159 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925745 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:56:59.926159 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925747 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:56:59.926159 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925750 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:56:59.926159 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925752 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:56:59.926159 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925755 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:56:59.926159 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925758 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:56:59.926658 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925760 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:56:59.926658 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925763 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:56:59.926658 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925766 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:56:59.926658 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925769 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:56:59.926658 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925772 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:56:59.926658 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925774 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:56:59.926658 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925777 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:56:59.926658 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925779 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:56:59.926658 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925782 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:56:59.926658 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925785 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:56:59.926658 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925788 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:56:59.926658 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925791 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:56:59.926658 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925793 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:56:59.926658 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925796 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:56:59.926658 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925799 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:56:59.926658 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925801 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:56:59.926658 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925804 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:56:59.926658 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925807 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:56:59.926658 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925809 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:56:59.926658 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925812 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:56:59.927137 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925814 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:56:59.927137 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925817 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:56:59.927137 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925819 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:56:59.927137 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925822 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:56:59.927137 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925824 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:56:59.927137 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925827 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:56:59.927137 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925829 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:56:59.927137 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925831 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:56:59.927137 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925834 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:56:59.927137 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925836 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:56:59.927137 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925839 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:56:59.927137 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925842 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:56:59.927137 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925845 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:56:59.927137 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925849 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:56:59.927137 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925853 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:56:59.927137 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925856 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:56:59.927137 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925859 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:56:59.927137 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925862 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:56:59.927137 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925864 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:56:59.927612 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925867 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:56:59.927612 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925869 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:56:59.927612 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925872 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:56:59.927612 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925875 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:56:59.927612 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925878 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:56:59.927612 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925880 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:56:59.927612 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925883 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:56:59.927612 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925886 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:56:59.927612 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925888 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:56:59.927612 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925891 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:56:59.927612 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925894 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:56:59.927612 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925898 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:56:59.927612 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925901 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:56:59.927612 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925903 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:56:59.927612 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925906 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:56:59.927612 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925909 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:56:59.927612 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925911 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:56:59.927612 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925914 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:56:59.927612 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.925916 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:56:59.928470 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928457 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:56:59.928470 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928469 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:56:59.928530 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928472 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:56:59.928530 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928475 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:56:59.928530 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928478 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:56:59.928530 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928481 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:56:59.928530 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928484 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:56:59.928530 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928486 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:56:59.928530 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928489 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:56:59.928530 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928492 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:56:59.928530 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928495 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:56:59.928530 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928497 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:56:59.928530 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928500 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:56:59.928530 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928502 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:56:59.928530 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928505 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:56:59.928530 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928508 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:56:59.928530 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928510 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:56:59.928530 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928513 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:56:59.928530 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928515 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:56:59.928530 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928518 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:56:59.928530 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928522 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:56:59.928530 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928525 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:56:59.929055 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928528 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:56:59.929055 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928531 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:56:59.929055 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928534 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:56:59.929055 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928537 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:56:59.929055 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928540 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:56:59.929055 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928543 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:56:59.929055 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928546 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:56:59.929055 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928548 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:56:59.929055 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928550 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:56:59.929055 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928553 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:56:59.929055 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928555 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:56:59.929055 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928558 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:56:59.929055 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928560 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:56:59.929055 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928563 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:56:59.929055 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928565 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:56:59.929055 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928568 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:56:59.929055 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928570 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:56:59.929055 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928573 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:56:59.929055 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928575 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:56:59.929055 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928578 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:56:59.929554 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928581 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:56:59.929554 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928583 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:56:59.929554 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928587 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:56:59.929554 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928589 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:56:59.929554 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928592 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:56:59.929554 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928595 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:56:59.929554 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928597 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:56:59.929554 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928600 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:56:59.929554 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928602 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:56:59.929554 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928604 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:56:59.929554 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928607 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:56:59.929554 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928609 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:56:59.929554 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928612 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:56:59.929554 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928616 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:56:59.929554 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928619 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:56:59.929554 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928622 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:56:59.929554 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928624 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:56:59.929554 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928627 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:56:59.929554 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928630 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:56:59.929554 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928632 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:56:59.930056 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928635 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:56:59.930056 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928637 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:56:59.930056 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928640 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:56:59.930056 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928642 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:56:59.930056 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928644 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:56:59.930056 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928647 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:56:59.930056 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928649 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:56:59.930056 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928652 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:56:59.930056 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928654 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:56:59.930056 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928657 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:56:59.930056 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928659 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:56:59.930056 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928662 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:56:59.930056 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928665 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:56:59.930056 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928670 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:56:59.930056 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928672 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:56:59.930056 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928675 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:56:59.930056 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928678 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:56:59.930056 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928680 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:56:59.930056 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928683 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:56:59.930531 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928685 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:56:59.930531 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928690 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:56:59.930531 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928693 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:56:59.930531 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928696 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:56:59.930531 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928699 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:56:59.930531 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928702 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:56:59.930531 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928705 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:56:59.930531 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928708 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:56:59.930531 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928711 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:56:59.930531 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928714 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:56:59.930531 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928716 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:56:59.930531 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928718 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:56:59.930531 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928721 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:56:59.930531 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928723 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:56:59.930531 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928726 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:56:59.930531 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928728 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:56:59.930531 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928731 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:56:59.930531 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.928733 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:56:59.930531 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929093 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:56:59.930997 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929097 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:56:59.930997 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929100 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:56:59.930997 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929103 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:56:59.930997 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929106 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:56:59.930997 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929109 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:56:59.930997 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929111 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:56:59.930997 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929114 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:56:59.930997 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929117 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:56:59.930997 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929120 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:56:59.930997 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929122 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:56:59.930997 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929125 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:56:59.930997 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929127 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:56:59.930997 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929130 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:56:59.930997 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929132 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:56:59.930997 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929135 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:56:59.930997 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929137 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:56:59.930997 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929140 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:56:59.930997 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929142 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:56:59.930997 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929145 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:56:59.931468 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929148 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:56:59.931468 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929151 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:56:59.931468 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929153 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:56:59.931468 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929156 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:56:59.931468 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929159 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:56:59.931468 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929162 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:56:59.931468 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929165 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:56:59.931468 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929167 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:56:59.931468 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929170 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:56:59.931468 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929172 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:56:59.931468 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929175 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:56:59.931468 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929177 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:56:59.931468 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929180 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:56:59.931468 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929182 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:56:59.931468 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929184 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:56:59.931468 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929187 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:56:59.931468 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929189 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:56:59.931468 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929192 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:56:59.931468 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929194 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:56:59.931468 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929197 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:56:59.931956 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929199 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:56:59.931956 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929202 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:56:59.931956 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929205 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:56:59.931956 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929207 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:56:59.931956 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929209 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:56:59.931956 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929212 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:56:59.931956 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929215 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:56:59.931956 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929219 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:56:59.931956 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929222 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:56:59.931956 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929225 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:56:59.931956 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929227 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:56:59.931956 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929230 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:56:59.931956 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929245 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:56:59.931956 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929248 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:56:59.931956 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929250 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:56:59.931956 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929253 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:56:59.931956 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929256 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:56:59.931956 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929258 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:56:59.931956 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929261 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:56:59.931956 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929263 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:56:59.932459 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929266 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:56:59.932459 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929269 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:56:59.932459 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929271 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:56:59.932459 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929273 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:56:59.932459 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929276 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:56:59.932459 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929279 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:56:59.932459 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929281 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:56:59.932459 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929284 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:56:59.932459 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929286 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:56:59.932459 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929289 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:56:59.932459 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929291 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:56:59.932459 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929294 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:56:59.932459 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929296 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:56:59.932459 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929298 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:56:59.932459 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929302 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:56:59.932459 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929305 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:56:59.932459 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929308 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:56:59.932459 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929310 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:56:59.932459 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929313 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:56:59.932459 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929315 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:56:59.933012 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929318 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:56:59.933012 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929320 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:56:59.933012 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929323 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:56:59.933012 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929326 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:56:59.933012 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929329 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:56:59.933012 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929332 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:56:59.933012 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929335 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:56:59.933012 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929337 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:56:59.933012 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929340 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:56:59.933012 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929342 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:56:59.933012 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929346 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:56:59.933012 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929351 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:56:59.933012 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929354 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:56:59.933012 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929357 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:56:59.933012 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929359 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:56:59.933012 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929361 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:56:59.933012 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929364 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:56:59.933012 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929366 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:56:59.933012 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.929369 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929439 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929445 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929451 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929458 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929462 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929465 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929469 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929475 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929480 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929483 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929486 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929489 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929492 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929495 2581 flags.go:64] FLAG: --cgroup-root="" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929498 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929500 2581 flags.go:64] FLAG: --client-ca-file="" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929503 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929506 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929510 2581 flags.go:64] FLAG: --cluster-domain="" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929513 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929516 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929519 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929522 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 16:56:59.933502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929526 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929529 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929532 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929535 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929538 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929541 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929544 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929547 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929550 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929554 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929557 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929560 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929567 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929570 2581 flags.go:64] FLAG: --enable-server="true" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929573 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929578 2581 flags.go:64] FLAG: --event-burst="100" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929581 2581 flags.go:64] FLAG: --event-qps="50" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929584 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929592 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929595 2581 flags.go:64] FLAG: --eviction-hard="" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929599 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929602 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929605 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929607 2581 flags.go:64] FLAG: --eviction-soft="" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929611 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 16:56:59.934135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929613 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929616 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929619 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929622 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929624 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929627 2581 flags.go:64] FLAG: --feature-gates="" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929635 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929638 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929640 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929643 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929646 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929649 2581 flags.go:64] FLAG: --help="false" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929652 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-136-0.ec2.internal" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929655 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929657 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929660 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929663 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929667 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929669 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929674 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929676 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929679 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929682 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929685 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 16:56:59.934766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929688 2581 flags.go:64] FLAG: --kube-reserved="" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929691 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929695 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929698 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929701 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929703 2581 flags.go:64] FLAG: --lock-file="" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929706 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929709 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929712 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929717 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929720 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929722 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929725 2581 flags.go:64] FLAG: --logging-format="text" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929728 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929731 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929733 2581 flags.go:64] FLAG: --manifest-url="" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929736 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929740 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929743 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929748 2581 flags.go:64] FLAG: --max-pods="110" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929751 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929753 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929756 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929759 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929762 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 16:56:59.935370 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929765 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929768 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929776 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929779 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929781 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929784 2581 flags.go:64] FLAG: --pod-cidr="" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929787 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929792 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929795 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929798 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929801 2581 flags.go:64] FLAG: --port="10250" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929804 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929807 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0de5f84de93d8f401" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929810 2581 flags.go:64] FLAG: --qos-reserved="" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929813 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929816 2581 flags.go:64] FLAG: --register-node="true" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929819 2581 flags.go:64] FLAG: --register-with-taints="" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929822 2581 flags.go:64] FLAG: --registry-burst="10" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929825 2581 flags.go:64] FLAG: --registry-qps="5" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929828 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929831 2581 flags.go:64] FLAG: --reserved-memory="" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929834 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929837 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929840 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929842 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 16:56:59.936316 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929845 2581 flags.go:64] FLAG: --runonce="false" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929848 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929850 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929853 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929856 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929859 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929862 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929865 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929868 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929872 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929875 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929877 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929880 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929883 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929886 2581 flags.go:64] FLAG: --system-cgroups="" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929888 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929893 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929896 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929899 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929904 2581 flags.go:64] FLAG: --tls-min-version="" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929907 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929909 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929912 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929915 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929917 2581 flags.go:64] FLAG: --v="2" Jul 02 16:56:59.937380 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929921 2581 flags.go:64] FLAG: --version="false" Jul 02 16:56:59.938163 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929925 2581 flags.go:64] FLAG: --vmodule="" Jul 02 16:56:59.938163 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929928 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 16:56:59.938163 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.929931 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 16:56:59.938163 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930047 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:56:59.938163 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930052 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:56:59.938163 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930055 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:56:59.938163 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930058 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:56:59.938163 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930061 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:56:59.938163 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930063 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:56:59.938163 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930067 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:56:59.938163 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930069 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:56:59.938163 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930072 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:56:59.938163 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930076 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:56:59.938163 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930078 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:56:59.938163 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930081 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:56:59.938163 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930085 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:56:59.938163 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930088 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:56:59.938163 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930090 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:56:59.938163 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930093 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:56:59.938163 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930095 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:56:59.938857 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930098 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:56:59.938857 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930100 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:56:59.938857 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930103 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:56:59.938857 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930105 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:56:59.938857 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930108 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:56:59.938857 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930111 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:56:59.938857 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930113 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:56:59.938857 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930116 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:56:59.938857 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930119 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:56:59.938857 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930121 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:56:59.938857 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930124 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:56:59.938857 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930127 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:56:59.938857 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930129 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:56:59.938857 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930132 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:56:59.938857 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930134 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:56:59.938857 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930137 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:56:59.938857 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930140 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:56:59.938857 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930142 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:56:59.938857 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930144 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:56:59.938857 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930147 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:56:59.939758 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930149 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:56:59.939758 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930152 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:56:59.939758 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930154 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:56:59.939758 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930157 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:56:59.939758 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930161 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:56:59.939758 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930163 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:56:59.939758 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930166 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:56:59.939758 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930169 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:56:59.939758 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930172 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:56:59.939758 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930174 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:56:59.939758 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930177 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:56:59.939758 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930179 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:56:59.939758 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930182 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:56:59.939758 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930185 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:56:59.939758 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930187 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:56:59.939758 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930190 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:56:59.939758 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930192 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:56:59.939758 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930194 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:56:59.939758 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930198 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:56:59.939758 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930200 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:56:59.940393 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930203 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:56:59.940393 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930205 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:56:59.940393 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930208 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:56:59.940393 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930210 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:56:59.940393 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930213 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:56:59.940393 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930215 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:56:59.940393 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930218 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:56:59.940393 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930220 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:56:59.940393 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930222 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:56:59.940393 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930225 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:56:59.940393 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930227 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:56:59.940393 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930242 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:56:59.940393 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930245 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:56:59.940393 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930247 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:56:59.940393 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930251 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:56:59.940393 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930255 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:56:59.940393 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930259 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:56:59.940393 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930262 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:56:59.940393 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930264 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:56:59.940942 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930268 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:56:59.940942 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930272 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:56:59.940942 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930275 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:56:59.940942 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930279 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:56:59.940942 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930282 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:56:59.940942 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930285 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:56:59.940942 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930287 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:56:59.940942 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930290 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:56:59.940942 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930292 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:56:59.940942 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930295 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:56:59.940942 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930298 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:56:59.940942 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930300 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:56:59.940942 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930303 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:56:59.940942 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930306 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:56:59.940942 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930309 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:56:59.940942 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930311 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:56:59.940942 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930315 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:56:59.940942 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930318 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:56:59.940942 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930322 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:56:59.941425 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930324 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:56:59.941425 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930327 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:56:59.941425 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930329 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:56:59.941425 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.930332 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:56:59.941425 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.930987 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 16:56:59.941425 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.937709 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 16:56:59.941425 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.937731 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 16:56:59.941425 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.938545 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 16:56:59.941425 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.938559 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 16:56:59.941425 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938643 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:56:59.941425 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938652 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:56:59.941425 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938658 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:56:59.941425 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938662 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:56:59.941425 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938667 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:56:59.941425 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938671 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:56:59.942014 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938676 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:56:59.942014 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938680 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:56:59.942014 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938685 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:56:59.942014 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938689 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:56:59.942014 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938693 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:56:59.942014 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938698 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:56:59.942014 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938704 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:56:59.942014 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938710 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:56:59.942014 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938715 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:56:59.942014 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938720 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:56:59.942014 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938724 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:56:59.942014 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938728 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:56:59.942014 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938733 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:56:59.942014 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938737 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:56:59.942014 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938741 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:56:59.942014 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938745 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:56:59.942014 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938749 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:56:59.942014 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938754 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:56:59.942014 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938758 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:56:59.942014 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938763 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:56:59.942736 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938767 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:56:59.942736 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938771 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:56:59.942736 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938775 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:56:59.942736 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938782 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:56:59.942736 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938786 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:56:59.942736 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938791 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:56:59.942736 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938795 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:56:59.942736 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938799 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:56:59.942736 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938804 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:56:59.942736 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938808 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:56:59.942736 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938812 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:56:59.942736 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938816 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:56:59.942736 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938820 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:56:59.942736 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938825 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:56:59.942736 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938829 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:56:59.942736 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938833 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:56:59.942736 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938838 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:56:59.942736 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938842 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:56:59.942736 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938846 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:56:59.942736 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938850 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:56:59.943285 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938854 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:56:59.943285 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938858 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:56:59.943285 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938862 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:56:59.943285 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938866 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:56:59.943285 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938869 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:56:59.943285 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938873 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:56:59.943285 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938877 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:56:59.943285 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938881 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:56:59.943285 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938886 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:56:59.943285 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938891 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:56:59.943285 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938895 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:56:59.943285 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938899 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:56:59.943285 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938903 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:56:59.943285 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938907 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:56:59.943285 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938911 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:56:59.943285 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938916 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:56:59.943285 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938921 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:56:59.943285 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938926 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:56:59.943285 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938930 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:56:59.943934 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938937 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:56:59.943934 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938943 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:56:59.943934 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938947 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:56:59.943934 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938952 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:56:59.943934 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938957 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:56:59.943934 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938961 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:56:59.943934 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938965 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:56:59.943934 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938970 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:56:59.943934 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938974 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:56:59.943934 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938978 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:56:59.943934 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938982 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:56:59.943934 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938987 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:56:59.943934 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938991 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:56:59.943934 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938995 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:56:59.943934 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.938999 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:56:59.943934 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939003 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:56:59.943934 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939007 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:56:59.943934 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939011 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:56:59.943934 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939015 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:56:59.943934 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939019 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:56:59.944545 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939024 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:56:59.944545 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939028 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:56:59.944545 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939032 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:56:59.944545 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939036 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:56:59.944545 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939040 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:56:59.944545 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939044 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:56:59.944545 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939050 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:56:59.944545 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939055 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:56:59.944545 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939060 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:56:59.944545 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939064 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:56:59.944545 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939069 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:56:59.944545 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939073 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:56:59.944545 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939077 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:56:59.944545 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939082 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:56:59.944900 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.939090 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 16:56:59.944900 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939276 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:56:59.944900 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939285 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:56:59.944900 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939290 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:56:59.944900 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939294 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:56:59.944900 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939299 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:56:59.944900 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939305 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:56:59.944900 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939312 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:56:59.944900 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939316 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:56:59.944900 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939321 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:56:59.944900 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939326 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:56:59.944900 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939331 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:56:59.944900 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939336 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:56:59.944900 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939340 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:56:59.944900 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939344 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:56:59.945304 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939349 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:56:59.945304 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939354 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:56:59.945304 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939358 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:56:59.945304 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939362 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:56:59.945304 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939366 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:56:59.945304 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939370 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:56:59.945304 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939374 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:56:59.945304 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939378 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:56:59.945304 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939384 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:56:59.945304 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939390 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:56:59.945304 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939394 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:56:59.945304 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939398 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:56:59.945304 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939402 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:56:59.945304 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939407 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:56:59.945304 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939411 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:56:59.945304 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939416 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:56:59.945304 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939420 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:56:59.945304 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939423 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:56:59.945304 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939428 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:56:59.945798 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939432 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:56:59.945798 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939436 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:56:59.945798 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939440 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:56:59.945798 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939444 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:56:59.945798 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939448 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:56:59.945798 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939452 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:56:59.945798 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939456 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:56:59.945798 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939461 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:56:59.945798 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939464 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:56:59.945798 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939469 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:56:59.945798 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939475 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:56:59.945798 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939480 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:56:59.945798 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939486 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:56:59.945798 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939490 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:56:59.945798 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939495 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:56:59.945798 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939499 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:56:59.945798 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939503 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:56:59.945798 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939508 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:56:59.945798 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939512 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:56:59.946394 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939517 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:56:59.946394 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939521 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:56:59.946394 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939526 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:56:59.946394 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939529 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:56:59.946394 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939533 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:56:59.946394 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939538 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:56:59.946394 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939542 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:56:59.946394 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939546 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:56:59.946394 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939550 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:56:59.946394 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939555 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:56:59.946394 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939559 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:56:59.946394 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939564 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:56:59.946394 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939568 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:56:59.946394 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939571 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:56:59.946394 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939575 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:56:59.946394 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939579 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:56:59.946394 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939584 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:56:59.946394 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939587 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:56:59.946394 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939591 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:56:59.946394 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939595 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:56:59.946394 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939599 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:56:59.946955 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939603 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:56:59.946955 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939607 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:56:59.946955 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939612 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:56:59.946955 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939616 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:56:59.946955 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939620 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:56:59.946955 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939624 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:56:59.946955 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939628 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:56:59.946955 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939632 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:56:59.946955 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939636 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:56:59.946955 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939640 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:56:59.946955 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939645 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:56:59.946955 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939649 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:56:59.946955 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939653 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:56:59.946955 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939657 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:56:59.946955 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939661 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:56:59.946955 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939666 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:56:59.946955 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939670 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:56:59.946955 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939674 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:56:59.946955 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939678 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:56:59.946955 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939682 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:56:59.947477 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939687 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:56:59.947477 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939693 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:56:59.947477 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939697 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:56:59.947477 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939701 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:56:59.947477 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939706 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:56:59.947477 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:56:59.939710 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:56:59.947477 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.939717 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 16:56:59.947477 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.939889 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 16:56:59.947477 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.944351 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 16:56:59.947477 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.945737 2581 server.go:1019] "Starting client certificate rotation" Jul 02 16:56:59.947477 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.945838 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 16:56:59.947477 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.945873 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 16:56:59.948448 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.948432 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 16:56:59.952064 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.952043 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 16:56:59.960366 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.960348 2581 log.go:25] "Validated CRI v1 runtime API" Jul 02 16:56:59.962408 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.962391 2581 log.go:25] "Validated CRI v1 image API" Jul 02 16:56:59.963116 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.963099 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 16:56:59.965560 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.965541 2581 fs.go:135] Filesystem UUIDs: map[5417ab8f-43b2-475f-acfd-9d99d1e31a9d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b9e01c2a-ea6e-43d9-8fdd-125e56245361:/dev/nvme0n1p3] Jul 02 16:56:59.965626 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.965559 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 16:56:59.970452 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.970344 2581 manager.go:216] Machine: {Timestamp:2026-07-02 16:56:59.969085642 +0000 UTC m=+0.329607225 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097081 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23011bc9d6d4705bca98e8dcef5e5c SystemUUID:ec23011b-c9d6-d470-5bca-98e8dcef5e5c BootID:47794b9b-7c11-489e-8c27-51775cebfd2b Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a7:58:81:90:71 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a7:58:81:90:71 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:b0:3f:3e:67:df Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 16:56:59.970452 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.970445 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 16:56:59.970565 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.970534 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 16:56:59.972489 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.972462 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 16:56:59.972613 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.972492 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-0.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 16:56:59.973801 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.973791 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 16:56:59.973837 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.973803 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 16:56:59.973837 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.973811 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 16:56:59.974549 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.974539 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 16:56:59.975368 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.975357 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 16:56:59.976731 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.976714 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 16:56:59.978295 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.978281 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 02 16:56:59.978408 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.978399 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 16:56:59.978448 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.978434 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 02 16:56:59.978478 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.978451 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 16:56:59.978478 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.978461 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 16:56:59.978478 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.978470 2581 kubelet.go:398] "Adding apiserver pod source" Jul 02 16:56:59.978592 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.978480 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 16:56:59.978825 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.978812 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 16:56:59.978867 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.978841 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 16:56:59.982167 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.982147 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 16:56:59.983622 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.983608 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 16:56:59.983675 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.983638 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 16:56:59.984386 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.984376 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 16:56:59.984424 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.984390 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 16:56:59.984424 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.984396 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 16:56:59.984424 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.984401 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 16:56:59.984424 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.984408 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 16:56:59.984424 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.984413 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 16:56:59.984424 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.984421 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 16:56:59.984424 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.984426 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 16:56:59.984610 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.984433 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 16:56:59.984610 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.984438 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 16:56:59.984610 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.984445 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 16:56:59.984610 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.984453 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 16:56:59.985379 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.985366 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 16:56:59.985379 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.985380 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 16:56:59.986854 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:56:59.986829 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 16:56:59.987044 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.987027 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-0.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 16:56:59.987100 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:56:59.987060 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 16:56:59.988175 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.988161 2581 server.go:1268] "Started kubelet" Jul 02 16:56:59.988249 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.988209 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 16:56:59.988296 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.988247 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 16:56:59.988343 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.988299 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 16:56:59.988831 ip-10-0-136-0 systemd[1]: Started Kubernetes Kubelet. Jul 02 16:56:59.993226 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.993206 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 16:56:59.994018 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.993992 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 02 16:56:59.995011 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:56:59.994722 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 16:56:59.995203 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.995184 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ttj2b" Jul 02 16:56:59.999790 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.999775 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 16:56:59.999861 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:56:59.999790 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 16:56:59.999911 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:56:59.999857 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 02 16:57:00.000431 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.000413 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 16:57:00.000431 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.000423 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 16:57:00.000431 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.000435 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 16:57:00.000616 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.000508 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 02 16:57:00.000616 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.000516 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 02 16:57:00.000616 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.000556 2581 factory.go:55] Registering systemd factory Jul 02 16:57:00.000616 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.000594 2581 factory.go:223] Registration of the systemd container factory successfully Jul 02 16:57:00.000848 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.000830 2581 factory.go:153] Registering CRI-O factory Jul 02 16:57:00.000848 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.000849 2581 factory.go:223] Registration of the crio container factory successfully Jul 02 16:57:00.001034 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.000899 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 16:57:00.001034 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.000923 2581 factory.go:103] Registering Raw factory Jul 02 16:57:00.001034 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.000938 2581 manager.go:1196] Started watching for new ooms in manager Jul 02 16:57:00.001333 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.001319 2581 manager.go:349] Starting recovery of all containers Jul 02 16:57:00.002884 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.002862 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ttj2b" Jul 02 16:57:00.004497 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:00.004472 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 16:57:00.004585 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:00.004537 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 16:57:00.006371 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:00.004617 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-0.ec2.internal.18be87708edb7b1b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-0.ec2.internal,UID:ip-10-0-136-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-0.ec2.internal,},FirstTimestamp:2026-07-02 16:56:59.988130587 +0000 UTC m=+0.348652169,LastTimestamp:2026-07-02 16:56:59.988130587 +0000 UTC m=+0.348652169,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-0.ec2.internal,}" Jul 02 16:57:00.008666 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.008629 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 16:57:00.011446 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.011384 2581 manager.go:354] Recovery completed Jul 02 16:57:00.016200 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.016183 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:57:00.017900 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.017887 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:57:00.017965 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.017912 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:57:00.017965 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.017921 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:57:00.018408 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.018396 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 16:57:00.018408 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.018407 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 16:57:00.018510 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.018421 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 02 16:57:00.018510 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.018448 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:57:00.019171 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.019157 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:57:00.019245 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.019192 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:57:00.019245 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.019212 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:57:00.019567 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.019555 2581 policy_none.go:49] "None policy: Start" Jul 02 16:57:00.019599 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.019572 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 16:57:00.019599 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.019583 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 16:57:00.020040 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:00.019974 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-0.ec2.internal.18be877090a1bac0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-0.ec2.internal,UID:ip-10-0-136-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-0.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-0.ec2.internal,},FirstTimestamp:2026-07-02 16:57:00.017900224 +0000 UTC m=+0.378421810,LastTimestamp:2026-07-02 16:57:00.017900224 +0000 UTC m=+0.378421810,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-0.ec2.internal,}" Jul 02 16:57:00.020667 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.020655 2581 policy_none.go:47] "Start" Jul 02 16:57:00.057855 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.057836 2581 manager.go:337] "Starting Device Plugin manager" Jul 02 16:57:00.073260 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:00.057877 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 16:57:00.073260 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.057892 2581 server.go:87] "Starting device plugin registration server" Jul 02 16:57:00.073260 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.058138 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 16:57:00.073260 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.058148 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 16:57:00.073260 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.058276 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 16:57:00.073260 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.058340 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 16:57:00.073260 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.058348 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 16:57:00.073260 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:00.058856 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 16:57:00.073260 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:00.058914 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-0.ec2.internal\" not found" Jul 02 16:57:00.073260 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.067489 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 16:57:00.073260 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.067519 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 16:57:00.073260 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.067534 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 16:57:00.073260 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:00.067563 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 16:57:00.073260 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.069488 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:57:00.158505 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.158484 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:57:00.159355 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.159339 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:57:00.159438 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.159374 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:57:00.159438 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.159390 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:57:00.159438 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.159418 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-0.ec2.internal" Jul 02 16:57:00.165780 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.165765 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-0.ec2.internal" Jul 02 16:57:00.165838 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:00.165786 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-0.ec2.internal\": node \"ip-10-0-136-0.ec2.internal\" not found" Jul 02 16:57:00.168059 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.168044 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal"] Jul 02 16:57:00.168134 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.168124 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:57:00.168827 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.168811 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:57:00.168915 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.168839 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:57:00.168915 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.168852 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:57:00.170372 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.170336 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:57:00.170474 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.170462 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" Jul 02 16:57:00.170533 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.170496 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:57:00.171044 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.171024 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:57:00.171124 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.171057 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:57:00.171124 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.171067 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:57:00.171124 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.171085 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:57:00.171124 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.171095 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:57:00.171124 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.171072 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:57:00.172501 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.172484 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal" Jul 02 16:57:00.172571 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.172509 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:57:00.173181 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.173166 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:57:00.173265 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.173195 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:57:00.173265 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.173206 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:57:00.177246 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:00.177220 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 02 16:57:00.203898 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:00.203879 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-0.ec2.internal\" not found" node="ip-10-0-136-0.ec2.internal" Jul 02 16:57:00.208162 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:00.208146 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-0.ec2.internal\" not found" node="ip-10-0-136-0.ec2.internal" Jul 02 16:57:00.278298 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:00.278282 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 02 16:57:00.301513 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.301489 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bba57e227543207ebc56791803846e81-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal\" (UID: \"bba57e227543207ebc56791803846e81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" Jul 02 16:57:00.301592 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.301520 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bba57e227543207ebc56791803846e81-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal\" (UID: \"bba57e227543207ebc56791803846e81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" Jul 02 16:57:00.301592 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.301559 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/608c73c3a8e2a463a8943d59c528dfdc-config\") pod \"kube-apiserver-proxy-ip-10-0-136-0.ec2.internal\" (UID: \"608c73c3a8e2a463a8943d59c528dfdc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal" Jul 02 16:57:00.378385 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:00.378362 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 02 16:57:00.401681 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.401660 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bba57e227543207ebc56791803846e81-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal\" (UID: \"bba57e227543207ebc56791803846e81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" Jul 02 16:57:00.401681 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.401670 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bba57e227543207ebc56791803846e81-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal\" (UID: \"bba57e227543207ebc56791803846e81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" Jul 02 16:57:00.401798 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.401697 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bba57e227543207ebc56791803846e81-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal\" (UID: \"bba57e227543207ebc56791803846e81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" Jul 02 16:57:00.401798 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.401719 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/608c73c3a8e2a463a8943d59c528dfdc-config\") pod \"kube-apiserver-proxy-ip-10-0-136-0.ec2.internal\" (UID: \"608c73c3a8e2a463a8943d59c528dfdc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal" Jul 02 16:57:00.401798 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.401755 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/608c73c3a8e2a463a8943d59c528dfdc-config\") pod \"kube-apiserver-proxy-ip-10-0-136-0.ec2.internal\" (UID: \"608c73c3a8e2a463a8943d59c528dfdc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal" Jul 02 16:57:00.401798 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.401788 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bba57e227543207ebc56791803846e81-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal\" (UID: \"bba57e227543207ebc56791803846e81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" Jul 02 16:57:00.478962 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:00.478908 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 02 16:57:00.507437 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.507421 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" Jul 02 16:57:00.511473 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:00.511453 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal" Jul 02 16:57:00.579697 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:00.579673 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 02 16:57:00.680178 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:00.680153 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 02 16:57:01.950965 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:01.950919 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 02 16:57:02.051503 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:02.051471 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 02 16:57:02.093383 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:02.093361 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:57:02.116355 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:02.116336 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 16:57:02.116497 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:02.116476 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 16:57:02.116552 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:02.116504 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 16:57:02.151774 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:02.151751 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 02 16:57:02.178404 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:02.178376 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 16:52:01 +0000 UTC" deadline="2028-03-26 00:40:12.566285034 +0000 UTC" Jul 02 16:57:02.178404 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:02.178399 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15175h43m10.387888856s" Jul 02 16:57:02.252152 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:02.252134 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 02 16:57:02.352713 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:02.352687 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 02 16:57:02.361692 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:57:02.361664 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod608c73c3a8e2a463a8943d59c528dfdc.slice/crio-991aad827b48ab11789c964b5ea2af48805e3d68f91ccd96c6b8cd3ce6854707 WatchSource:0}: Error finding container 991aad827b48ab11789c964b5ea2af48805e3d68f91ccd96c6b8cd3ce6854707: Status 404 returned error can't find the container with id 991aad827b48ab11789c964b5ea2af48805e3d68f91ccd96c6b8cd3ce6854707 Jul 02 16:57:02.362210 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:57:02.362180 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba57e227543207ebc56791803846e81.slice/crio-5fc312fa32c3585b6b7d1f4e9bdd10d000f3d65dec7abe491da79b2dc4175b55 WatchSource:0}: Error finding container 5fc312fa32c3585b6b7d1f4e9bdd10d000f3d65dec7abe491da79b2dc4175b55: Status 404 returned error can't find the container with id 5fc312fa32c3585b6b7d1f4e9bdd10d000f3d65dec7abe491da79b2dc4175b55 Jul 02 16:57:02.366796 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:02.366782 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 16:57:02.433399 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:02.433379 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:57:02.471079 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:02.471057 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal" Jul 02 16:57:02.480552 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:02.480533 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 16:57:02.482699 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:02.482683 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" Jul 02 16:57:02.492234 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:02.492212 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 16:57:02.595164 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:02.595104 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:57:03.149700 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.149673 2581 apiserver.go:52] "Watching apiserver" Jul 02 16:57:03.158532 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.158508 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 16:57:03.159056 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.159028 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-lln24","kube-system/global-pull-secret-syncer-ttr6p","openshift-dns/node-resolver-rwcwq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal","openshift-multus/multus-b96cv","openshift-network-diagnostics/network-check-target-tl7jc","openshift-network-operator/iptables-alerter-7tbzl","kube-system/konnectivity-agent-nqz99","kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q","openshift-cluster-node-tuning-operator/tuned-lmszm","openshift-image-registry/node-ca-cwtmc","openshift-multus/multus-additional-cni-plugins-w5v9t","openshift-multus/network-metrics-daemon-6h8hw"] Jul 02 16:57:03.161306 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.161283 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.163834 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.162932 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.163834 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.163652 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 16:57:03.163834 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.163753 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 16:57:03.164276 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.164155 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tsc48\"" Jul 02 16:57:03.164276 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.164163 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 16:57:03.164810 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.164791 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rwcwq" Jul 02 16:57:03.166775 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.165406 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p9p7k\"" Jul 02 16:57:03.166775 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.165432 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 16:57:03.166775 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.165667 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 16:57:03.166775 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.165727 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 16:57:03.166775 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.165670 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 16:57:03.166775 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.165906 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 16:57:03.166775 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.166522 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:03.166775 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:03.166585 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h8hw" podUID="ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa" Jul 02 16:57:03.166775 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.166717 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 16:57:03.167231 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.167131 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k52bn\"" Jul 02 16:57:03.167231 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.167176 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 16:57:03.168913 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.168896 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.170596 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.170581 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 16:57:03.171141 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.170886 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 16:57:03.171141 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.170893 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-85657\"" Jul 02 16:57:03.171295 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.171186 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:03.171295 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:03.171257 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tl7jc" podUID="64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4" Jul 02 16:57:03.172727 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.172708 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nqz99" Jul 02 16:57:03.174262 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.174241 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7tbzl" Jul 02 16:57:03.174846 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.174828 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b2sp5\"" Jul 02 16:57:03.174944 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.174887 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 16:57:03.175022 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.174990 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 16:57:03.175761 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.175740 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:03.175849 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:03.175800 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttr6p" podUID="5a84fd75-a938-4cbb-9493-85d680bad63b" Jul 02 16:57:03.176480 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.176433 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 16:57:03.176572 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.176522 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-72dnn\"" Jul 02 16:57:03.176572 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.176522 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 16:57:03.176572 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.176566 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 16:57:03.177858 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.177838 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.178394 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178375 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3db22b8-b79c-4eb9-92d2-92988b69be86-sys-fs\") pod \"aws-ebs-csi-driver-node-sll4q\" (UID: \"b3db22b8-b79c-4eb9-92d2-92988b69be86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.178499 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178403 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/da991979-8409-483d-8bb2-b63217ebaf2b-hosts-file\") pod \"node-resolver-rwcwq\" (UID: \"da991979-8409-483d-8bb2-b63217ebaf2b\") " pod="openshift-dns/node-resolver-rwcwq" Jul 02 16:57:03.178499 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178423 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-os-release\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.178499 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178443 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3db22b8-b79c-4eb9-92d2-92988b69be86-socket-dir\") pod \"aws-ebs-csi-driver-node-sll4q\" (UID: \"b3db22b8-b79c-4eb9-92d2-92988b69be86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.178623 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178499 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eb5365f4-38af-4aff-8dbe-73cc522fb645-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.178623 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178524 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-multus-cni-dir\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.178623 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178541 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34514e3e-e8f3-4500-b52c-77c91e341f02-cni-binary-copy\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.178623 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178573 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-host-var-lib-cni-multus\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.178623 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178605 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwkqz\" (UniqueName: \"kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz\") pod \"network-check-target-tl7jc\" (UID: \"64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4\") " pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:03.178799 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178630 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3db22b8-b79c-4eb9-92d2-92988b69be86-registration-dir\") pod \"aws-ebs-csi-driver-node-sll4q\" (UID: \"b3db22b8-b79c-4eb9-92d2-92988b69be86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.178799 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178655 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb5365f4-38af-4aff-8dbe-73cc522fb645-system-cni-dir\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.178799 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178678 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eb5365f4-38af-4aff-8dbe-73cc522fb645-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.178799 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178712 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rf2s\" (UniqueName: \"kubernetes.io/projected/eb5365f4-38af-4aff-8dbe-73cc522fb645-kube-api-access-8rf2s\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.178799 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178737 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjttx\" (UniqueName: \"kubernetes.io/projected/da991979-8409-483d-8bb2-b63217ebaf2b-kube-api-access-hjttx\") pod \"node-resolver-rwcwq\" (UID: \"da991979-8409-483d-8bb2-b63217ebaf2b\") " pod="openshift-dns/node-resolver-rwcwq" Jul 02 16:57:03.178799 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178782 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-host-var-lib-kubelet\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.178987 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178812 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-host-run-multus-certs\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.178987 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178836 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvlzl\" (UniqueName: \"kubernetes.io/projected/34514e3e-e8f3-4500-b52c-77c91e341f02-kube-api-access-xvlzl\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.178987 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178858 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3db22b8-b79c-4eb9-92d2-92988b69be86-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sll4q\" (UID: \"b3db22b8-b79c-4eb9-92d2-92988b69be86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.178987 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178883 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs\") pod \"network-metrics-daemon-6h8hw\" (UID: \"ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa\") " pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:03.178987 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178907 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-cnibin\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.178987 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178930 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-host-run-netns\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.178987 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178955 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-host-var-lib-cni-bin\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.178987 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.178978 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-multus-socket-dir-parent\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.179353 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.179001 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-hostroot\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.179353 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.179040 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-multus-conf-dir\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.179353 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.179082 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3db22b8-b79c-4eb9-92d2-92988b69be86-device-dir\") pod \"aws-ebs-csi-driver-node-sll4q\" (UID: \"b3db22b8-b79c-4eb9-92d2-92988b69be86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.179353 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.179110 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc7pv\" (UniqueName: \"kubernetes.io/projected/b3db22b8-b79c-4eb9-92d2-92988b69be86-kube-api-access-pc7pv\") pod \"aws-ebs-csi-driver-node-sll4q\" (UID: \"b3db22b8-b79c-4eb9-92d2-92988b69be86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.179353 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.179136 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eb5365f4-38af-4aff-8dbe-73cc522fb645-cni-binary-copy\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.179353 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.179167 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-host-run-k8s-cni-cncf-io\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.179353 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.179197 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/34514e3e-e8f3-4500-b52c-77c91e341f02-multus-daemon-config\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.179353 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.179227 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-etc-kubernetes\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.179353 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.179253 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3db22b8-b79c-4eb9-92d2-92988b69be86-etc-selinux\") pod \"aws-ebs-csi-driver-node-sll4q\" (UID: \"b3db22b8-b79c-4eb9-92d2-92988b69be86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.179353 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.179275 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eb5365f4-38af-4aff-8dbe-73cc522fb645-os-release\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.179353 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.179332 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da991979-8409-483d-8bb2-b63217ebaf2b-tmp-dir\") pod \"node-resolver-rwcwq\" (UID: \"da991979-8409-483d-8bb2-b63217ebaf2b\") " pod="openshift-dns/node-resolver-rwcwq" Jul 02 16:57:03.179885 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.179366 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42gf7\" (UniqueName: \"kubernetes.io/projected/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-kube-api-access-42gf7\") pod \"network-metrics-daemon-6h8hw\" (UID: \"ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa\") " pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:03.179885 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.179391 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eb5365f4-38af-4aff-8dbe-73cc522fb645-cnibin\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.179885 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.179415 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eb5365f4-38af-4aff-8dbe-73cc522fb645-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.179885 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.179438 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-system-cni-dir\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.179885 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.179704 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.180273 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.180255 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 16:57:03.180352 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.180261 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 16:57:03.181041 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.181023 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cwtmc" Jul 02 16:57:03.181091 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.181042 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9cqpn\"" Jul 02 16:57:03.181318 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.181300 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 16:57:03.181318 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.181306 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 16:57:03.181496 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.181329 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 16:57:03.182419 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.182149 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 16:57:03.182419 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.182149 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 16:57:03.183656 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.183635 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 16:57:03.183871 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.183855 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 16:57:03.184087 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.184070 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6xwrv\"" Jul 02 16:57:03.184285 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.184265 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b278m\"" Jul 02 16:57:03.184343 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.184324 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 16:57:03.185077 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.185050 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 16:57:03.185710 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.185686 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 16:57:03.203952 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.203922 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pqxh2" Jul 02 16:57:03.211913 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.211896 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pqxh2" Jul 02 16:57:03.245138 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.245062 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" event={"ID":"bba57e227543207ebc56791803846e81","Type":"ContainerStarted","Data":"5fc312fa32c3585b6b7d1f4e9bdd10d000f3d65dec7abe491da79b2dc4175b55"} Jul 02 16:57:03.247089 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.247063 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal" event={"ID":"608c73c3a8e2a463a8943d59c528dfdc","Type":"ContainerStarted","Data":"991aad827b48ab11789c964b5ea2af48805e3d68f91ccd96c6b8cd3ce6854707"} Jul 02 16:57:03.272533 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.272508 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 16:57:03.279584 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.279564 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-etc-tuned\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.279689 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.279593 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-multus-socket-dir-parent\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.279689 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.279612 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3db22b8-b79c-4eb9-92d2-92988b69be86-device-dir\") pod \"aws-ebs-csi-driver-node-sll4q\" (UID: \"b3db22b8-b79c-4eb9-92d2-92988b69be86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.279689 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.279633 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-etc-sysctl-d\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.279689 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.279657 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/34514e3e-e8f3-4500-b52c-77c91e341f02-multus-daemon-config\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.279878 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.279692 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-multus-socket-dir-parent\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.279878 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.279710 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-etc-kubernetes\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.279878 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.279750 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3db22b8-b79c-4eb9-92d2-92988b69be86-etc-selinux\") pod \"aws-ebs-csi-driver-node-sll4q\" (UID: \"b3db22b8-b79c-4eb9-92d2-92988b69be86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.279878 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.279718 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3db22b8-b79c-4eb9-92d2-92988b69be86-device-dir\") pod \"aws-ebs-csi-driver-node-sll4q\" (UID: \"b3db22b8-b79c-4eb9-92d2-92988b69be86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.279878 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.279798 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-node-log\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.279878 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.279803 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-etc-kubernetes\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.280205 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.279886 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3db22b8-b79c-4eb9-92d2-92988b69be86-etc-selinux\") pod \"aws-ebs-csi-driver-node-sll4q\" (UID: \"b3db22b8-b79c-4eb9-92d2-92988b69be86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.280205 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.279900 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-ovn-node-metrics-cert\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.280205 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.279929 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-etc-systemd\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.280205 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.279947 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-var-lib-kubelet\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.280205 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.279968 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eb5365f4-38af-4aff-8dbe-73cc522fb645-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.280205 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.279986 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-run-systemd\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.280205 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280023 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-sys\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.280205 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280046 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-etc-modprobe-d\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.280205 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280070 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k424j\" (UniqueName: \"kubernetes.io/projected/80bb48b9-f232-4e0f-9fe4-2bc70ad76edc-kube-api-access-k424j\") pod \"node-ca-cwtmc\" (UID: \"80bb48b9-f232-4e0f-9fe4-2bc70ad76edc\") " pod="openshift-image-registry/node-ca-cwtmc" Jul 02 16:57:03.280205 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280114 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/da991979-8409-483d-8bb2-b63217ebaf2b-hosts-file\") pod \"node-resolver-rwcwq\" (UID: \"da991979-8409-483d-8bb2-b63217ebaf2b\") " pod="openshift-dns/node-resolver-rwcwq" Jul 02 16:57:03.280205 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280137 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3db22b8-b79c-4eb9-92d2-92988b69be86-socket-dir\") pod \"aws-ebs-csi-driver-node-sll4q\" (UID: \"b3db22b8-b79c-4eb9-92d2-92988b69be86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.280205 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280158 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eb5365f4-38af-4aff-8dbe-73cc522fb645-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.280205 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280170 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r89rc\" (UniqueName: \"kubernetes.io/projected/755934de-0eaf-4b45-bdb5-218edf1fcc2a-kube-api-access-r89rc\") pod \"iptables-alerter-7tbzl\" (UID: \"755934de-0eaf-4b45-bdb5-218edf1fcc2a\") " pod="openshift-network-operator/iptables-alerter-7tbzl" Jul 02 16:57:03.280205 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280197 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-run-openvswitch\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.280902 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280238 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-multus-cni-dir\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.280902 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280265 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb5365f4-38af-4aff-8dbe-73cc522fb645-system-cni-dir\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.280902 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280281 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/da991979-8409-483d-8bb2-b63217ebaf2b-hosts-file\") pod \"node-resolver-rwcwq\" (UID: \"da991979-8409-483d-8bb2-b63217ebaf2b\") " pod="openshift-dns/node-resolver-rwcwq" Jul 02 16:57:03.280902 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280291 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-host-kubelet\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.280902 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280320 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-host-run-ovn-kubernetes\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.280902 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280344 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-host-cni-bin\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.280902 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280366 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-env-overrides\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.280902 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280380 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3db22b8-b79c-4eb9-92d2-92988b69be86-socket-dir\") pod \"aws-ebs-csi-driver-node-sll4q\" (UID: \"b3db22b8-b79c-4eb9-92d2-92988b69be86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.280902 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280388 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80bb48b9-f232-4e0f-9fe4-2bc70ad76edc-host\") pod \"node-ca-cwtmc\" (UID: \"80bb48b9-f232-4e0f-9fe4-2bc70ad76edc\") " pod="openshift-image-registry/node-ca-cwtmc" Jul 02 16:57:03.280902 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280414 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjttx\" (UniqueName: \"kubernetes.io/projected/da991979-8409-483d-8bb2-b63217ebaf2b-kube-api-access-hjttx\") pod \"node-resolver-rwcwq\" (UID: \"da991979-8409-483d-8bb2-b63217ebaf2b\") " pod="openshift-dns/node-resolver-rwcwq" Jul 02 16:57:03.280902 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280422 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/34514e3e-e8f3-4500-b52c-77c91e341f02-multus-daemon-config\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.280902 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280440 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-host-run-multus-certs\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.280902 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280482 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvlzl\" (UniqueName: \"kubernetes.io/projected/34514e3e-e8f3-4500-b52c-77c91e341f02-kube-api-access-xvlzl\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.280902 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280495 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-multus-cni-dir\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.280902 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280507 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3db22b8-b79c-4eb9-92d2-92988b69be86-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sll4q\" (UID: \"b3db22b8-b79c-4eb9-92d2-92988b69be86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.280902 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280509 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb5365f4-38af-4aff-8dbe-73cc522fb645-system-cni-dir\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.280902 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280545 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs\") pod \"network-metrics-daemon-6h8hw\" (UID: \"ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa\") " pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:03.281625 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-cnibin\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.281625 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280580 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-host-run-multus-certs\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.281625 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280591 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3db22b8-b79c-4eb9-92d2-92988b69be86-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sll4q\" (UID: \"b3db22b8-b79c-4eb9-92d2-92988b69be86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.281625 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280630 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-cnibin\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.281625 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280633 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-host-run-netns\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.281625 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:03.280648 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:03.281625 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280671 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-host-run-netns\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.281625 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280676 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-host-var-lib-cni-bin\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.281625 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280709 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-host-slash\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.281625 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:03.280740 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs podName:ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa nodeName:}" failed. No retries permitted until 2026-07-02 16:57:03.780718024 +0000 UTC m=+2.971019169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs") pod "network-metrics-daemon-6h8hw" (UID: "ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:03.281625 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280749 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-host-var-lib-cni-bin\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.281625 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280799 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-log-socket\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.281625 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280834 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-host-cni-netd\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.281625 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280861 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-hostroot\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.281625 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280886 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-multus-conf-dir\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.281625 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280911 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc7pv\" (UniqueName: \"kubernetes.io/projected/b3db22b8-b79c-4eb9-92d2-92988b69be86-kube-api-access-pc7pv\") pod \"aws-ebs-csi-driver-node-sll4q\" (UID: \"b3db22b8-b79c-4eb9-92d2-92988b69be86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.281625 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280925 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-hostroot\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.281625 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280958 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-multus-conf-dir\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.282394 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.280988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eb5365f4-38af-4aff-8dbe-73cc522fb645-cni-binary-copy\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.282394 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281018 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/755934de-0eaf-4b45-bdb5-218edf1fcc2a-iptables-alerter-script\") pod \"iptables-alerter-7tbzl\" (UID: \"755934de-0eaf-4b45-bdb5-218edf1fcc2a\") " pod="openshift-network-operator/iptables-alerter-7tbzl" Jul 02 16:57:03.282394 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281053 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c30ff467-6c6e-49b4-b994-87a9ee61553d-agent-certs\") pod \"konnectivity-agent-nqz99\" (UID: \"c30ff467-6c6e-49b4-b994-87a9ee61553d\") " pod="kube-system/konnectivity-agent-nqz99" Jul 02 16:57:03.282394 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281078 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.282394 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281104 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-etc-sysconfig\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.282394 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281137 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-host-run-k8s-cni-cncf-io\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.282394 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281171 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eb5365f4-38af-4aff-8dbe-73cc522fb645-os-release\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.282394 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281188 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c30ff467-6c6e-49b4-b994-87a9ee61553d-konnectivity-ca\") pod \"konnectivity-agent-nqz99\" (UID: \"c30ff467-6c6e-49b4-b994-87a9ee61553d\") " pod="kube-system/konnectivity-agent-nqz99" Jul 02 16:57:03.282394 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281191 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-host-run-k8s-cni-cncf-io\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.282394 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281202 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80bb48b9-f232-4e0f-9fe4-2bc70ad76edc-serviceca\") pod \"node-ca-cwtmc\" (UID: \"80bb48b9-f232-4e0f-9fe4-2bc70ad76edc\") " pod="openshift-image-registry/node-ca-cwtmc" Jul 02 16:57:03.282394 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281218 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da991979-8409-483d-8bb2-b63217ebaf2b-tmp-dir\") pod \"node-resolver-rwcwq\" (UID: \"da991979-8409-483d-8bb2-b63217ebaf2b\") " pod="openshift-dns/node-resolver-rwcwq" Jul 02 16:57:03.282394 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281233 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42gf7\" (UniqueName: \"kubernetes.io/projected/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-kube-api-access-42gf7\") pod \"network-metrics-daemon-6h8hw\" (UID: \"ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa\") " pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:03.282394 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281230 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eb5365f4-38af-4aff-8dbe-73cc522fb645-os-release\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.282394 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281336 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eb5365f4-38af-4aff-8dbe-73cc522fb645-cnibin\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.282394 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281379 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5a84fd75-a938-4cbb-9493-85d680bad63b-kubelet-config\") pod \"global-pull-secret-syncer-ttr6p\" (UID: \"5a84fd75-a938-4cbb-9493-85d680bad63b\") " pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:03.282394 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281400 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret\") pod \"global-pull-secret-syncer-ttr6p\" (UID: \"5a84fd75-a938-4cbb-9493-85d680bad63b\") " pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:03.282924 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281429 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-var-lib-openvswitch\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.282924 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281442 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eb5365f4-38af-4aff-8dbe-73cc522fb645-cnibin\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.282924 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281478 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-ovnkube-script-lib\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.282924 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281511 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-etc-kubernetes\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.282924 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281525 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da991979-8409-483d-8bb2-b63217ebaf2b-tmp-dir\") pod \"node-resolver-rwcwq\" (UID: \"da991979-8409-483d-8bb2-b63217ebaf2b\") " pod="openshift-dns/node-resolver-rwcwq" Jul 02 16:57:03.282924 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281537 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-system-cni-dir\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.282924 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281581 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3db22b8-b79c-4eb9-92d2-92988b69be86-sys-fs\") pod \"aws-ebs-csi-driver-node-sll4q\" (UID: \"b3db22b8-b79c-4eb9-92d2-92988b69be86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.282924 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281619 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eb5365f4-38af-4aff-8dbe-73cc522fb645-cni-binary-copy\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.282924 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281632 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-system-cni-dir\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.282924 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281705 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3db22b8-b79c-4eb9-92d2-92988b69be86-sys-fs\") pod \"aws-ebs-csi-driver-node-sll4q\" (UID: \"b3db22b8-b79c-4eb9-92d2-92988b69be86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.282924 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281688 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-lib-modules\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.282924 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281748 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-os-release\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.282924 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281786 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eb5365f4-38af-4aff-8dbe-73cc522fb645-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.282924 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281817 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-os-release\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.282924 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281850 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/755934de-0eaf-4b45-bdb5-218edf1fcc2a-host-slash\") pod \"iptables-alerter-7tbzl\" (UID: \"755934de-0eaf-4b45-bdb5-218edf1fcc2a\") " pod="openshift-network-operator/iptables-alerter-7tbzl" Jul 02 16:57:03.282924 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281905 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-host\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.282924 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281928 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34514e3e-e8f3-4500-b52c-77c91e341f02-cni-binary-copy\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.283513 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.281964 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-host-var-lib-cni-multus\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.283513 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.282014 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwkqz\" (UniqueName: \"kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz\") pod \"network-check-target-tl7jc\" (UID: \"64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4\") " pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:03.283513 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.282038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3db22b8-b79c-4eb9-92d2-92988b69be86-registration-dir\") pod \"aws-ebs-csi-driver-node-sll4q\" (UID: \"b3db22b8-b79c-4eb9-92d2-92988b69be86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.283513 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.282057 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-host-var-lib-cni-multus\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.283513 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.282062 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eb5365f4-38af-4aff-8dbe-73cc522fb645-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.283513 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.282090 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rf2s\" (UniqueName: \"kubernetes.io/projected/eb5365f4-38af-4aff-8dbe-73cc522fb645-kube-api-access-8rf2s\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.283513 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.282098 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3db22b8-b79c-4eb9-92d2-92988b69be86-registration-dir\") pod \"aws-ebs-csi-driver-node-sll4q\" (UID: \"b3db22b8-b79c-4eb9-92d2-92988b69be86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.283513 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.282113 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-host-run-netns\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.283513 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.282147 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-ovnkube-config\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.283513 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.282174 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-host-var-lib-kubelet\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.283513 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.282196 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-run-ovn\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.283513 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.282218 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-tmp\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.283513 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.282262 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eb5365f4-38af-4aff-8dbe-73cc522fb645-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.283513 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.282240 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqm27\" (UniqueName: \"kubernetes.io/projected/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-kube-api-access-xqm27\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.283513 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.282297 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34514e3e-e8f3-4500-b52c-77c91e341f02-host-var-lib-kubelet\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.283513 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.282311 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5a84fd75-a938-4cbb-9493-85d680bad63b-dbus\") pod \"global-pull-secret-syncer-ttr6p\" (UID: \"5a84fd75-a938-4cbb-9493-85d680bad63b\") " pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:03.283513 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.282335 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-systemd-units\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.284044 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.282357 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-etc-openvswitch\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.284044 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.282385 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkt5z\" (UniqueName: \"kubernetes.io/projected/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-kube-api-access-kkt5z\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.284044 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.282408 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34514e3e-e8f3-4500-b52c-77c91e341f02-cni-binary-copy\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.284044 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.282410 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-etc-sysctl-conf\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.284044 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.282446 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-run\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.284044 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.282619 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eb5365f4-38af-4aff-8dbe-73cc522fb645-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.286478 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.286445 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 16:57:03.287065 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:03.287048 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:57:03.287148 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:03.287070 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:57:03.287148 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:03.287084 2581 projected.go:196] Error preparing data for projected volume kube-api-access-wwkqz for pod openshift-network-diagnostics/network-check-target-tl7jc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:03.287148 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:03.287132 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz podName:64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:03.78711624 +0000 UTC m=+2.977417389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wwkqz" (UniqueName: "kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz") pod "network-check-target-tl7jc" (UID: "64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:03.290064 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.290033 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvlzl\" (UniqueName: \"kubernetes.io/projected/34514e3e-e8f3-4500-b52c-77c91e341f02-kube-api-access-xvlzl\") pod \"multus-b96cv\" (UID: \"34514e3e-e8f3-4500-b52c-77c91e341f02\") " pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.290158 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.290061 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjttx\" (UniqueName: \"kubernetes.io/projected/da991979-8409-483d-8bb2-b63217ebaf2b-kube-api-access-hjttx\") pod \"node-resolver-rwcwq\" (UID: \"da991979-8409-483d-8bb2-b63217ebaf2b\") " pod="openshift-dns/node-resolver-rwcwq" Jul 02 16:57:03.290158 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.290086 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc7pv\" (UniqueName: \"kubernetes.io/projected/b3db22b8-b79c-4eb9-92d2-92988b69be86-kube-api-access-pc7pv\") pod \"aws-ebs-csi-driver-node-sll4q\" (UID: \"b3db22b8-b79c-4eb9-92d2-92988b69be86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.290158 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.290111 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42gf7\" (UniqueName: \"kubernetes.io/projected/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-kube-api-access-42gf7\") pod \"network-metrics-daemon-6h8hw\" (UID: \"ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa\") " pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:03.290772 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.290749 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rf2s\" (UniqueName: \"kubernetes.io/projected/eb5365f4-38af-4aff-8dbe-73cc522fb645-kube-api-access-8rf2s\") pod \"multus-additional-cni-plugins-w5v9t\" (UID: \"eb5365f4-38af-4aff-8dbe-73cc522fb645\") " pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.365590 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.365566 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:57:03.383386 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383357 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-run-systemd\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.383386 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383386 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-sys\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.383576 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-etc-modprobe-d\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.383576 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383433 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k424j\" (UniqueName: \"kubernetes.io/projected/80bb48b9-f232-4e0f-9fe4-2bc70ad76edc-kube-api-access-k424j\") pod \"node-ca-cwtmc\" (UID: \"80bb48b9-f232-4e0f-9fe4-2bc70ad76edc\") " pod="openshift-image-registry/node-ca-cwtmc" Jul 02 16:57:03.383576 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383476 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r89rc\" (UniqueName: \"kubernetes.io/projected/755934de-0eaf-4b45-bdb5-218edf1fcc2a-kube-api-access-r89rc\") pod \"iptables-alerter-7tbzl\" (UID: \"755934de-0eaf-4b45-bdb5-218edf1fcc2a\") " pod="openshift-network-operator/iptables-alerter-7tbzl" Jul 02 16:57:03.383576 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383496 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-run-openvswitch\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.383576 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383503 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-run-systemd\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.383576 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383511 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-host-kubelet\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.383576 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383565 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-etc-modprobe-d\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.383892 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383566 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-host-run-ovn-kubernetes\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.383892 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383601 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-host-run-ovn-kubernetes\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.383892 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383611 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-host-cni-bin\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.383892 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383639 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-host-kubelet\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.383892 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383650 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-sys\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.383892 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383704 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-run-openvswitch\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.383892 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383708 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-host-cni-bin\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.383892 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383744 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-env-overrides\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.383892 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383768 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80bb48b9-f232-4e0f-9fe4-2bc70ad76edc-host\") pod \"node-ca-cwtmc\" (UID: \"80bb48b9-f232-4e0f-9fe4-2bc70ad76edc\") " pod="openshift-image-registry/node-ca-cwtmc" Jul 02 16:57:03.383892 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383805 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80bb48b9-f232-4e0f-9fe4-2bc70ad76edc-host\") pod \"node-ca-cwtmc\" (UID: \"80bb48b9-f232-4e0f-9fe4-2bc70ad76edc\") " pod="openshift-image-registry/node-ca-cwtmc" Jul 02 16:57:03.383892 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383832 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-host-slash\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.383892 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383863 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-log-socket\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.383892 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383889 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-host-cni-netd\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.384521 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383910 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-host-slash\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.384521 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383916 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/755934de-0eaf-4b45-bdb5-218edf1fcc2a-iptables-alerter-script\") pod \"iptables-alerter-7tbzl\" (UID: \"755934de-0eaf-4b45-bdb5-218edf1fcc2a\") " pod="openshift-network-operator/iptables-alerter-7tbzl" Jul 02 16:57:03.384521 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383974 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c30ff467-6c6e-49b4-b994-87a9ee61553d-agent-certs\") pod \"konnectivity-agent-nqz99\" (UID: \"c30ff467-6c6e-49b4-b994-87a9ee61553d\") " pod="kube-system/konnectivity-agent-nqz99" Jul 02 16:57:03.384521 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.383986 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-log-socket\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.384521 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384005 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.384521 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384011 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-host-cni-netd\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.384521 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384031 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-etc-sysconfig\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.384521 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384056 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c30ff467-6c6e-49b4-b994-87a9ee61553d-konnectivity-ca\") pod \"konnectivity-agent-nqz99\" (UID: \"c30ff467-6c6e-49b4-b994-87a9ee61553d\") " pod="kube-system/konnectivity-agent-nqz99" Jul 02 16:57:03.384521 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80bb48b9-f232-4e0f-9fe4-2bc70ad76edc-serviceca\") pod \"node-ca-cwtmc\" (UID: \"80bb48b9-f232-4e0f-9fe4-2bc70ad76edc\") " pod="openshift-image-registry/node-ca-cwtmc" Jul 02 16:57:03.384521 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384105 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5a84fd75-a938-4cbb-9493-85d680bad63b-kubelet-config\") pod \"global-pull-secret-syncer-ttr6p\" (UID: \"5a84fd75-a938-4cbb-9493-85d680bad63b\") " pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:03.384521 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384121 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-etc-sysconfig\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.384521 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384129 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret\") pod \"global-pull-secret-syncer-ttr6p\" (UID: \"5a84fd75-a938-4cbb-9493-85d680bad63b\") " pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:03.384521 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384153 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-var-lib-openvswitch\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.384521 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384175 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-ovnkube-script-lib\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.384521 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384197 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-etc-kubernetes\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.384521 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384228 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-lib-modules\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.384521 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384231 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-env-overrides\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.385359 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384267 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/755934de-0eaf-4b45-bdb5-218edf1fcc2a-host-slash\") pod \"iptables-alerter-7tbzl\" (UID: \"755934de-0eaf-4b45-bdb5-218edf1fcc2a\") " pod="openshift-network-operator/iptables-alerter-7tbzl" Jul 02 16:57:03.385359 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384284 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-host\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.385359 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384321 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-host-run-netns\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.385359 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384338 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-lib-modules\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.385359 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-ovnkube-config\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.385359 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384075 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.385359 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384353 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/755934de-0eaf-4b45-bdb5-218edf1fcc2a-host-slash\") pod \"iptables-alerter-7tbzl\" (UID: \"755934de-0eaf-4b45-bdb5-218edf1fcc2a\") " pod="openshift-network-operator/iptables-alerter-7tbzl" Jul 02 16:57:03.385359 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384373 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-run-ovn\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.385359 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384395 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-tmp\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.385359 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384414 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5a84fd75-a938-4cbb-9493-85d680bad63b-kubelet-config\") pod \"global-pull-secret-syncer-ttr6p\" (UID: \"5a84fd75-a938-4cbb-9493-85d680bad63b\") " pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:03.385359 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384419 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqm27\" (UniqueName: \"kubernetes.io/projected/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-kube-api-access-xqm27\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.385359 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:03.384430 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:03.385359 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384449 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5a84fd75-a938-4cbb-9493-85d680bad63b-dbus\") pod \"global-pull-secret-syncer-ttr6p\" (UID: \"5a84fd75-a938-4cbb-9493-85d680bad63b\") " pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:03.385359 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384493 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-systemd-units\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.385359 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:03.384510 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret podName:5a84fd75-a938-4cbb-9493-85d680bad63b nodeName:}" failed. No retries permitted until 2026-07-02 16:57:03.884492642 +0000 UTC m=+3.074793778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret") pod "global-pull-secret-syncer-ttr6p" (UID: "5a84fd75-a938-4cbb-9493-85d680bad63b") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:03.385359 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384526 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-systemd-units\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.385359 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384539 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-etc-openvswitch\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.386173 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384559 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80bb48b9-f232-4e0f-9fe4-2bc70ad76edc-serviceca\") pod \"node-ca-cwtmc\" (UID: \"80bb48b9-f232-4e0f-9fe4-2bc70ad76edc\") " pod="openshift-image-registry/node-ca-cwtmc" Jul 02 16:57:03.386173 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384566 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkt5z\" (UniqueName: \"kubernetes.io/projected/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-kube-api-access-kkt5z\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.386173 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384578 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5a84fd75-a938-4cbb-9493-85d680bad63b-dbus\") pod \"global-pull-secret-syncer-ttr6p\" (UID: \"5a84fd75-a938-4cbb-9493-85d680bad63b\") " pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:03.386173 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384447 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/755934de-0eaf-4b45-bdb5-218edf1fcc2a-iptables-alerter-script\") pod \"iptables-alerter-7tbzl\" (UID: \"755934de-0eaf-4b45-bdb5-218edf1fcc2a\") " pod="openshift-network-operator/iptables-alerter-7tbzl" Jul 02 16:57:03.386173 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384590 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-etc-sysctl-conf\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.386173 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384621 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-etc-kubernetes\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.386173 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384629 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-run\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.386173 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384652 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-etc-tuned\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.386173 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384662 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c30ff467-6c6e-49b4-b994-87a9ee61553d-konnectivity-ca\") pod \"konnectivity-agent-nqz99\" (UID: \"c30ff467-6c6e-49b4-b994-87a9ee61553d\") " pod="kube-system/konnectivity-agent-nqz99" Jul 02 16:57:03.386173 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384679 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-etc-openvswitch\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.386173 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384683 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-etc-sysctl-d\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.386173 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384708 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-etc-sysctl-conf\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.386173 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384715 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-node-log\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.386173 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384737 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-ovn-node-metrics-cert\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.386173 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384759 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-etc-systemd\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.386173 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384772 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-etc-sysctl-d\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.386173 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384783 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-var-lib-kubelet\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.386173 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384851 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-var-lib-kubelet\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.387020 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384857 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-host\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.387020 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384906 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-run-ovn\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.387020 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384916 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-ovnkube-config\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.387020 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384942 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-node-log\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.387020 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384963 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-var-lib-openvswitch\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.387020 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384969 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-host-run-netns\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.387020 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.384997 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-run\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.387020 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.385017 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-etc-systemd\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.387020 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.385106 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-ovnkube-script-lib\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.387483 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.387209 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-tmp\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.387483 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.387274 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-etc-tuned\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.387483 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.387311 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-ovn-node-metrics-cert\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.387641 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.387617 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c30ff467-6c6e-49b4-b994-87a9ee61553d-agent-certs\") pod \"konnectivity-agent-nqz99\" (UID: \"c30ff467-6c6e-49b4-b994-87a9ee61553d\") " pod="kube-system/konnectivity-agent-nqz99" Jul 02 16:57:03.392182 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.392132 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k424j\" (UniqueName: \"kubernetes.io/projected/80bb48b9-f232-4e0f-9fe4-2bc70ad76edc-kube-api-access-k424j\") pod \"node-ca-cwtmc\" (UID: \"80bb48b9-f232-4e0f-9fe4-2bc70ad76edc\") " pod="openshift-image-registry/node-ca-cwtmc" Jul 02 16:57:03.394012 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.393989 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r89rc\" (UniqueName: \"kubernetes.io/projected/755934de-0eaf-4b45-bdb5-218edf1fcc2a-kube-api-access-r89rc\") pod \"iptables-alerter-7tbzl\" (UID: \"755934de-0eaf-4b45-bdb5-218edf1fcc2a\") " pod="openshift-network-operator/iptables-alerter-7tbzl" Jul 02 16:57:03.394549 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.394527 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqm27\" (UniqueName: \"kubernetes.io/projected/1c44a3ec-5437-4626-bb56-f2bf1b137aeb-kube-api-access-xqm27\") pod \"tuned-lmszm\" (UID: \"1c44a3ec-5437-4626-bb56-f2bf1b137aeb\") " pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.394626 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.394554 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkt5z\" (UniqueName: \"kubernetes.io/projected/1f9623eb-d52b-45dc-ae42-3fd20e210c7f-kube-api-access-kkt5z\") pod \"ovnkube-node-lln24\" (UID: \"1f9623eb-d52b-45dc-ae42-3fd20e210c7f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.473423 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.473363 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" Jul 02 16:57:03.481884 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.481866 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w5v9t" Jul 02 16:57:03.493178 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.493161 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rwcwq" Jul 02 16:57:03.499046 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.499031 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b96cv" Jul 02 16:57:03.506740 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.506725 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nqz99" Jul 02 16:57:03.514576 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.514560 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7tbzl" Jul 02 16:57:03.524256 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.524239 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:03.531175 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.531159 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lmszm" Jul 02 16:57:03.537929 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.537910 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cwtmc" Jul 02 16:57:03.787527 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.787498 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwkqz\" (UniqueName: \"kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz\") pod \"network-check-target-tl7jc\" (UID: \"64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4\") " pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:03.787685 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.787541 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs\") pod \"network-metrics-daemon-6h8hw\" (UID: \"ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa\") " pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:03.787685 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:03.787650 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:03.787685 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:03.787662 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:57:03.787685 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:03.787678 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:57:03.787685 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:03.787689 2581 projected.go:196] Error preparing data for projected volume kube-api-access-wwkqz for pod openshift-network-diagnostics/network-check-target-tl7jc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:03.787884 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:03.787707 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs podName:ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa nodeName:}" failed. No retries permitted until 2026-07-02 16:57:04.787688562 +0000 UTC m=+3.977989705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs") pod "network-metrics-daemon-6h8hw" (UID: "ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:03.787884 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:03.787725 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz podName:64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:04.78771388 +0000 UTC m=+3.978015030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwkqz" (UniqueName: "kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz") pod "network-check-target-tl7jc" (UID: "64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:03.888057 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:03.888028 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret\") pod \"global-pull-secret-syncer-ttr6p\" (UID: \"5a84fd75-a938-4cbb-9493-85d680bad63b\") " pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:03.888193 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:03.888154 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:03.888249 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:03.888207 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret podName:5a84fd75-a938-4cbb-9493-85d680bad63b nodeName:}" failed. No retries permitted until 2026-07-02 16:57:04.888194072 +0000 UTC m=+4.078495209 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret") pod "global-pull-secret-syncer-ttr6p" (UID: "5a84fd75-a938-4cbb-9493-85d680bad63b") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:04.210856 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:57:04.210832 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod755934de_0eaf_4b45_bdb5_218edf1fcc2a.slice/crio-139b384bf60aba56e46837c11f6612b1f492298c92c51a563cafe817e6d7f0a7 WatchSource:0}: Error finding container 139b384bf60aba56e46837c11f6612b1f492298c92c51a563cafe817e6d7f0a7: Status 404 returned error can't find the container with id 139b384bf60aba56e46837c11f6612b1f492298c92c51a563cafe817e6d7f0a7 Jul 02 16:57:04.212611 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:57:04.212586 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda991979_8409_483d_8bb2_b63217ebaf2b.slice/crio-a4933c5db851c062e66954e24d68e0a3e19814aef667f5a5e086caaa514020a7 WatchSource:0}: Error finding container a4933c5db851c062e66954e24d68e0a3e19814aef667f5a5e086caaa514020a7: Status 404 returned error can't find the container with id a4933c5db851c062e66954e24d68e0a3e19814aef667f5a5e086caaa514020a7 Jul 02 16:57:04.214117 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:04.214069 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 16:52:03 +0000 UTC" deadline="2027-12-22 00:18:40.729990529 +0000 UTC" Jul 02 16:57:04.214117 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:04.214096 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12895h21m36.515898692s" Jul 02 16:57:04.216969 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:57:04.216946 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f9623eb_d52b_45dc_ae42_3fd20e210c7f.slice/crio-936fda8102af4a7e41016566f3f4f8d6280d88b23929c06e26fc4a02871c2eb2 WatchSource:0}: Error finding container 936fda8102af4a7e41016566f3f4f8d6280d88b23929c06e26fc4a02871c2eb2: Status 404 returned error can't find the container with id 936fda8102af4a7e41016566f3f4f8d6280d88b23929c06e26fc4a02871c2eb2 Jul 02 16:57:04.217720 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:57:04.217699 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80bb48b9_f232_4e0f_9fe4_2bc70ad76edc.slice/crio-10df302523de78fc3d4f433b8ddff0db83b55c1c619601499abe2695ade046c8 WatchSource:0}: Error finding container 10df302523de78fc3d4f433b8ddff0db83b55c1c619601499abe2695ade046c8: Status 404 returned error can't find the container with id 10df302523de78fc3d4f433b8ddff0db83b55c1c619601499abe2695ade046c8 Jul 02 16:57:04.218264 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:57:04.218241 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34514e3e_e8f3_4500_b52c_77c91e341f02.slice/crio-f965041063d9c7b7875cbdb94d278808c85c3ff6e3a85df9b088e000dd0f0584 WatchSource:0}: Error finding container f965041063d9c7b7875cbdb94d278808c85c3ff6e3a85df9b088e000dd0f0584: Status 404 returned error can't find the container with id f965041063d9c7b7875cbdb94d278808c85c3ff6e3a85df9b088e000dd0f0584 Jul 02 16:57:04.219740 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:57:04.219629 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb5365f4_38af_4aff_8dbe_73cc522fb645.slice/crio-80ae0cde51dc53b753bc7d6f272736d400aa2a566d15885b53d8304e5ffa0468 WatchSource:0}: Error finding container 80ae0cde51dc53b753bc7d6f272736d400aa2a566d15885b53d8304e5ffa0468: Status 404 returned error can't find the container with id 80ae0cde51dc53b753bc7d6f272736d400aa2a566d15885b53d8304e5ffa0468 Jul 02 16:57:04.254898 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:04.254870 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b96cv" event={"ID":"34514e3e-e8f3-4500-b52c-77c91e341f02","Type":"ContainerStarted","Data":"f965041063d9c7b7875cbdb94d278808c85c3ff6e3a85df9b088e000dd0f0584"} Jul 02 16:57:04.256105 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:04.256082 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lln24" event={"ID":"1f9623eb-d52b-45dc-ae42-3fd20e210c7f","Type":"ContainerStarted","Data":"936fda8102af4a7e41016566f3f4f8d6280d88b23929c06e26fc4a02871c2eb2"} Jul 02 16:57:04.260070 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:04.260048 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rwcwq" event={"ID":"da991979-8409-483d-8bb2-b63217ebaf2b","Type":"ContainerStarted","Data":"a4933c5db851c062e66954e24d68e0a3e19814aef667f5a5e086caaa514020a7"} Jul 02 16:57:04.261135 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:04.261116 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cwtmc" event={"ID":"80bb48b9-f232-4e0f-9fe4-2bc70ad76edc","Type":"ContainerStarted","Data":"10df302523de78fc3d4f433b8ddff0db83b55c1c619601499abe2695ade046c8"} Jul 02 16:57:04.262187 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:04.262156 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" event={"ID":"b3db22b8-b79c-4eb9-92d2-92988b69be86","Type":"ContainerStarted","Data":"223480a5e3174125d849d12946e297a242a033457a6c42aa6edcc0768e4ae066"} Jul 02 16:57:04.263042 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:04.263024 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7tbzl" event={"ID":"755934de-0eaf-4b45-bdb5-218edf1fcc2a","Type":"ContainerStarted","Data":"139b384bf60aba56e46837c11f6612b1f492298c92c51a563cafe817e6d7f0a7"} Jul 02 16:57:04.263947 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:04.263924 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nqz99" event={"ID":"c30ff467-6c6e-49b4-b994-87a9ee61553d","Type":"ContainerStarted","Data":"22bc7592f4fd7c8ffee77588a628ddb3cf5a9131cb51ac68bca4ad05ef56d6f6"} Jul 02 16:57:04.267295 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:04.267274 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lmszm" event={"ID":"1c44a3ec-5437-4626-bb56-f2bf1b137aeb","Type":"ContainerStarted","Data":"c939e865dc9d78ead71b10bb53bfe6be2116ad9779081ea658ecf17f1d1ce053"} Jul 02 16:57:04.270845 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:04.270826 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w5v9t" event={"ID":"eb5365f4-38af-4aff-8dbe-73cc522fb645","Type":"ContainerStarted","Data":"80ae0cde51dc53b753bc7d6f272736d400aa2a566d15885b53d8304e5ffa0468"} Jul 02 16:57:04.416009 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:04.415829 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:57:04.795115 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:04.795083 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs\") pod \"network-metrics-daemon-6h8hw\" (UID: \"ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa\") " pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:04.795327 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:04.795157 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwkqz\" (UniqueName: \"kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz\") pod \"network-check-target-tl7jc\" (UID: \"64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4\") " pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:04.795327 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:04.795307 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:57:04.795327 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:04.795327 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:57:04.795521 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:04.795340 2581 projected.go:196] Error preparing data for projected volume kube-api-access-wwkqz for pod openshift-network-diagnostics/network-check-target-tl7jc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:04.795521 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:04.795393 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz podName:64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:06.795373562 +0000 UTC m=+5.985674728 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwkqz" (UniqueName: "kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz") pod "network-check-target-tl7jc" (UID: "64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:04.795804 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:04.795786 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:04.795870 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:04.795841 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs podName:ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa nodeName:}" failed. No retries permitted until 2026-07-02 16:57:06.795825183 +0000 UTC m=+5.986126330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs") pod "network-metrics-daemon-6h8hw" (UID: "ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:04.896305 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:04.896276 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret\") pod \"global-pull-secret-syncer-ttr6p\" (UID: \"5a84fd75-a938-4cbb-9493-85d680bad63b\") " pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:04.896484 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:04.896389 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:04.896484 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:04.896441 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret podName:5a84fd75-a938-4cbb-9493-85d680bad63b nodeName:}" failed. No retries permitted until 2026-07-02 16:57:06.896425532 +0000 UTC m=+6.086726667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret") pod "global-pull-secret-syncer-ttr6p" (UID: "5a84fd75-a938-4cbb-9493-85d680bad63b") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:05.215276 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:05.215168 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 16:52:03 +0000 UTC" deadline="2028-04-15 16:43:53.40656054 +0000 UTC" Jul 02 16:57:05.215276 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:05.215227 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15671h46m48.191337811s" Jul 02 16:57:05.239593 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:05.239564 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:05.239593 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:05.239587 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:05.239800 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:05.239712 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h8hw" podUID="ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa" Jul 02 16:57:05.239800 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:05.239784 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tl7jc" podUID="64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4" Jul 02 16:57:05.239917 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:05.239864 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:05.239970 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:05.239935 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttr6p" podUID="5a84fd75-a938-4cbb-9493-85d680bad63b" Jul 02 16:57:05.292070 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:05.292036 2581 generic.go:356] "Generic (PLEG): container finished" podID="bba57e227543207ebc56791803846e81" containerID="3705391bdde20efafa9ada11623fa2d0cd812d7bab6e30a88624e5e9aea62db2" exitCode=0 Jul 02 16:57:05.292232 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:05.292131 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" event={"ID":"bba57e227543207ebc56791803846e81","Type":"ContainerDied","Data":"3705391bdde20efafa9ada11623fa2d0cd812d7bab6e30a88624e5e9aea62db2"} Jul 02 16:57:05.306675 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:05.306541 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal" event={"ID":"608c73c3a8e2a463a8943d59c528dfdc","Type":"ContainerStarted","Data":"d337a7c3a4e3ef140ccfb38b148288bf3f1f61bc76f1eed70dd740a632fb8c9c"} Jul 02 16:57:06.326175 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:06.326113 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" event={"ID":"bba57e227543207ebc56791803846e81","Type":"ContainerStarted","Data":"7af342157a07b07ae954efa606df21204b3e0746a60d15cd4b91bfb82400c60f"} Jul 02 16:57:06.341080 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:06.340502 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal" podStartSLOduration=4.340482311 podStartE2EDuration="4.340482311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:05.320103105 +0000 UTC m=+4.510404264" watchObservedRunningTime="2026-07-02 16:57:06.340482311 +0000 UTC m=+5.530783470" Jul 02 16:57:06.812174 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:06.812144 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs\") pod \"network-metrics-daemon-6h8hw\" (UID: \"ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa\") " pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:06.812358 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:06.812210 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwkqz\" (UniqueName: \"kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz\") pod \"network-check-target-tl7jc\" (UID: \"64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4\") " pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:06.812432 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:06.812363 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:57:06.812432 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:06.812382 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:57:06.812432 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:06.812395 2581 projected.go:196] Error preparing data for projected volume kube-api-access-wwkqz for pod openshift-network-diagnostics/network-check-target-tl7jc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:06.812598 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:06.812448 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz podName:64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:10.812429417 +0000 UTC m=+10.002730557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwkqz" (UniqueName: "kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz") pod "network-check-target-tl7jc" (UID: "64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:06.813069 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:06.812771 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:06.813069 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:06.812829 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs podName:ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa nodeName:}" failed. No retries permitted until 2026-07-02 16:57:10.812813211 +0000 UTC m=+10.003114351 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs") pod "network-metrics-daemon-6h8hw" (UID: "ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:06.912569 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:06.912536 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret\") pod \"global-pull-secret-syncer-ttr6p\" (UID: \"5a84fd75-a938-4cbb-9493-85d680bad63b\") " pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:06.912735 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:06.912662 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:06.912735 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:06.912721 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret podName:5a84fd75-a938-4cbb-9493-85d680bad63b nodeName:}" failed. No retries permitted until 2026-07-02 16:57:10.912704406 +0000 UTC m=+10.103005543 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret") pod "global-pull-secret-syncer-ttr6p" (UID: "5a84fd75-a938-4cbb-9493-85d680bad63b") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:07.238230 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:07.238201 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:07.238402 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:07.238337 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h8hw" podUID="ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa" Jul 02 16:57:07.238479 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:07.238424 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:07.238584 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:07.238559 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttr6p" podUID="5a84fd75-a938-4cbb-9493-85d680bad63b" Jul 02 16:57:07.238652 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:07.238637 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:07.238731 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:07.238714 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tl7jc" podUID="64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4" Jul 02 16:57:09.239255 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:09.239165 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:09.239703 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:09.239165 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:09.239703 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:09.239309 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tl7jc" podUID="64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4" Jul 02 16:57:09.239703 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:09.239556 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:09.239703 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:09.239652 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttr6p" podUID="5a84fd75-a938-4cbb-9493-85d680bad63b" Jul 02 16:57:09.239927 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:09.239762 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h8hw" podUID="ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa" Jul 02 16:57:10.858306 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:10.858270 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs\") pod \"network-metrics-daemon-6h8hw\" (UID: \"ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa\") " pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:10.858781 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:10.858353 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwkqz\" (UniqueName: \"kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz\") pod \"network-check-target-tl7jc\" (UID: \"64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4\") " pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:10.858781 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:10.858441 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:10.858781 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:10.858517 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:57:10.858781 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:10.858536 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:57:10.858781 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:10.858541 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs podName:ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa nodeName:}" failed. No retries permitted until 2026-07-02 16:57:18.858518756 +0000 UTC m=+18.048819894 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs") pod "network-metrics-daemon-6h8hw" (UID: "ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:10.858781 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:10.858549 2581 projected.go:196] Error preparing data for projected volume kube-api-access-wwkqz for pod openshift-network-diagnostics/network-check-target-tl7jc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:10.858781 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:10.858600 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz podName:64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:18.858584873 +0000 UTC m=+18.048886019 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwkqz" (UniqueName: "kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz") pod "network-check-target-tl7jc" (UID: "64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:10.958919 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:10.958878 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret\") pod \"global-pull-secret-syncer-ttr6p\" (UID: \"5a84fd75-a938-4cbb-9493-85d680bad63b\") " pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:10.959091 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:10.959035 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:10.959091 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:10.959091 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret podName:5a84fd75-a938-4cbb-9493-85d680bad63b nodeName:}" failed. No retries permitted until 2026-07-02 16:57:18.959074562 +0000 UTC m=+18.149375703 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret") pod "global-pull-secret-syncer-ttr6p" (UID: "5a84fd75-a938-4cbb-9493-85d680bad63b") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:11.238142 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:11.238113 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:11.238309 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:11.238249 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h8hw" podUID="ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa" Jul 02 16:57:11.239181 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:11.239153 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:11.243077 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:11.239597 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tl7jc" podUID="64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4" Jul 02 16:57:11.243077 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:11.241417 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:11.243077 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:11.241592 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttr6p" podUID="5a84fd75-a938-4cbb-9493-85d680bad63b" Jul 02 16:57:13.238980 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:13.238534 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:13.238980 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:13.238657 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tl7jc" podUID="64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4" Jul 02 16:57:13.238980 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:13.238681 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:13.238980 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:13.238758 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttr6p" podUID="5a84fd75-a938-4cbb-9493-85d680bad63b" Jul 02 16:57:13.238980 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:13.238782 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:13.238980 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:13.238854 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h8hw" podUID="ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa" Jul 02 16:57:15.238032 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:15.238000 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:15.238548 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:15.238000 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:15.238548 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:15.238118 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tl7jc" podUID="64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4" Jul 02 16:57:15.238548 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:15.238222 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h8hw" podUID="ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa" Jul 02 16:57:15.238548 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:15.238002 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:15.238548 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:15.238309 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttr6p" podUID="5a84fd75-a938-4cbb-9493-85d680bad63b" Jul 02 16:57:17.241076 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:17.241048 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:17.241491 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:17.241146 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:17.241491 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:17.241155 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttr6p" podUID="5a84fd75-a938-4cbb-9493-85d680bad63b" Jul 02 16:57:17.241491 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:17.241179 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:17.241491 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:17.241284 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h8hw" podUID="ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa" Jul 02 16:57:17.241491 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:17.241354 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tl7jc" podUID="64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4" Jul 02 16:57:18.922644 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:18.922612 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwkqz\" (UniqueName: \"kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz\") pod \"network-check-target-tl7jc\" (UID: \"64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4\") " pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:18.923130 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:18.922672 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs\") pod \"network-metrics-daemon-6h8hw\" (UID: \"ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa\") " pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:18.923130 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:18.922798 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:57:18.923130 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:18.922822 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:57:18.923130 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:18.922835 2581 projected.go:196] Error preparing data for projected volume kube-api-access-wwkqz for pod openshift-network-diagnostics/network-check-target-tl7jc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:18.923130 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:18.922894 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz podName:64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:34.922877377 +0000 UTC m=+34.113178525 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwkqz" (UniqueName: "kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz") pod "network-check-target-tl7jc" (UID: "64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:18.923130 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:18.922905 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:18.923130 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:18.922949 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs podName:ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa nodeName:}" failed. No retries permitted until 2026-07-02 16:57:34.922937661 +0000 UTC m=+34.113238797 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs") pod "network-metrics-daemon-6h8hw" (UID: "ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:19.023555 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:19.023522 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret\") pod \"global-pull-secret-syncer-ttr6p\" (UID: \"5a84fd75-a938-4cbb-9493-85d680bad63b\") " pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:19.023715 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:19.023654 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:19.023779 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:19.023717 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret podName:5a84fd75-a938-4cbb-9493-85d680bad63b nodeName:}" failed. No retries permitted until 2026-07-02 16:57:35.023699372 +0000 UTC m=+34.214000514 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret") pod "global-pull-secret-syncer-ttr6p" (UID: "5a84fd75-a938-4cbb-9493-85d680bad63b") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:19.238759 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:19.238731 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:19.238952 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:19.238735 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:19.238952 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:19.238741 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:19.238952 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:19.238872 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h8hw" podUID="ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa" Jul 02 16:57:19.239133 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:19.238981 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tl7jc" podUID="64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4" Jul 02 16:57:19.239133 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:19.239081 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttr6p" podUID="5a84fd75-a938-4cbb-9493-85d680bad63b" Jul 02 16:57:21.239318 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:21.239284 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:21.239819 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:21.239388 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:21.239819 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:21.239389 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h8hw" podUID="ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa" Jul 02 16:57:21.239819 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:21.239511 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tl7jc" podUID="64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4" Jul 02 16:57:21.239819 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:21.239542 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:21.239819 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:21.239607 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttr6p" podUID="5a84fd75-a938-4cbb-9493-85d680bad63b" Jul 02 16:57:23.242189 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.242034 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:23.242829 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.242082 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:23.242829 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:23.242286 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h8hw" podUID="ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa" Jul 02 16:57:23.242829 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.242092 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:23.242829 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:23.242336 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tl7jc" podUID="64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4" Jul 02 16:57:23.242829 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:23.242397 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttr6p" podUID="5a84fd75-a938-4cbb-9493-85d680bad63b" Jul 02 16:57:23.358346 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.358270 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nqz99" event={"ID":"c30ff467-6c6e-49b4-b994-87a9ee61553d","Type":"ContainerStarted","Data":"f49879ac4d8de6dcfecbf5896e393dab1f1fa74e1e2a28d2d9cbf3b842f2c78a"} Jul 02 16:57:23.360230 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.360192 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lmszm" event={"ID":"1c44a3ec-5437-4626-bb56-f2bf1b137aeb","Type":"ContainerStarted","Data":"03107e8debd75e949711c853f246aaab2946504b0cf4c7045dfa9e44879ab532"} Jul 02 16:57:23.362200 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.362174 2581 generic.go:356] "Generic (PLEG): container finished" podID="eb5365f4-38af-4aff-8dbe-73cc522fb645" containerID="67a9306df0722ec98b3786a7a0c27df383f395ff057058ed221d8e46ee0d25e0" exitCode=0 Jul 02 16:57:23.362297 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.362265 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w5v9t" event={"ID":"eb5365f4-38af-4aff-8dbe-73cc522fb645","Type":"ContainerDied","Data":"67a9306df0722ec98b3786a7a0c27df383f395ff057058ed221d8e46ee0d25e0"} Jul 02 16:57:23.364162 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.364136 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b96cv" event={"ID":"34514e3e-e8f3-4500-b52c-77c91e341f02","Type":"ContainerStarted","Data":"c93cfbe9f15b11c2833415fed6030bd3c98d3e95e8014860de24575a53548bd5"} Jul 02 16:57:23.367595 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.367577 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lln24_1f9623eb-d52b-45dc-ae42-3fd20e210c7f/ovn-acl-logging/0.log" Jul 02 16:57:23.367971 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.367943 2581 generic.go:356] "Generic (PLEG): container finished" podID="1f9623eb-d52b-45dc-ae42-3fd20e210c7f" containerID="daed7dafad2520c309eb7e3d06f86af07e995ac5357e867555f646155ced787a" exitCode=1 Jul 02 16:57:23.368073 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.368028 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lln24" event={"ID":"1f9623eb-d52b-45dc-ae42-3fd20e210c7f","Type":"ContainerStarted","Data":"1a2a835359a162dcd90622691d2337c4bad9cee3001b17bd78aaee7e822a218a"} Jul 02 16:57:23.368133 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.368104 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lln24" event={"ID":"1f9623eb-d52b-45dc-ae42-3fd20e210c7f","Type":"ContainerStarted","Data":"094bd5ebfe406135e8a4bc7a3573c335d0905c2f9b7f6816286fd30d2e24b93b"} Jul 02 16:57:23.368224 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.368199 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lln24" event={"ID":"1f9623eb-d52b-45dc-ae42-3fd20e210c7f","Type":"ContainerStarted","Data":"05c0182db41da53671027d362364cd0ae1d8129912928f26ea95b4015514d86e"} Jul 02 16:57:23.368280 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.368264 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lln24" event={"ID":"1f9623eb-d52b-45dc-ae42-3fd20e210c7f","Type":"ContainerStarted","Data":"9912f6e77c6c65e1c60ea9d915aa0929ca8af3e68a7f429e2192b1784e73ad18"} Jul 02 16:57:23.368330 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.368312 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lln24" event={"ID":"1f9623eb-d52b-45dc-ae42-3fd20e210c7f","Type":"ContainerDied","Data":"daed7dafad2520c309eb7e3d06f86af07e995ac5357e867555f646155ced787a"} Jul 02 16:57:23.368378 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.368365 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lln24" event={"ID":"1f9623eb-d52b-45dc-ae42-3fd20e210c7f","Type":"ContainerStarted","Data":"4b012fa558756f5b92e2580559363dba5c66f9ac1f4af6d88bc0b24cc86cec3a"} Jul 02 16:57:23.369654 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.369629 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rwcwq" event={"ID":"da991979-8409-483d-8bb2-b63217ebaf2b","Type":"ContainerStarted","Data":"06d346fa3f859a4fa06a46648cc829010bb53c470a30a1f008aadb5076145e0b"} Jul 02 16:57:23.371248 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.371227 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cwtmc" event={"ID":"80bb48b9-f232-4e0f-9fe4-2bc70ad76edc","Type":"ContainerStarted","Data":"5198ba4a8652cb33023473ee88602540f59ac65ab59ad30ef36b06f83b8449ba"} Jul 02 16:57:23.372699 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.372680 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" event={"ID":"b3db22b8-b79c-4eb9-92d2-92988b69be86","Type":"ContainerStarted","Data":"fd4cc9d3069b8d0d4b528d5da4751c34704219be6b9942efdb8e5299a4c5510b"} Jul 02 16:57:23.373901 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.373865 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" podStartSLOduration=21.373854504 podStartE2EDuration="21.373854504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:06.341064126 +0000 UTC m=+5.531365282" watchObservedRunningTime="2026-07-02 16:57:23.373854504 +0000 UTC m=+22.564155662" Jul 02 16:57:23.386468 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.386423 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nqz99" podStartSLOduration=8.660786148 podStartE2EDuration="22.386409182s" totalImagesPullingTime="13.725623034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:23.373416142 +0000 UTC m=+22.563717299" watchObservedRunningTime="2026-07-02 16:57:23.386409182 +0000 UTC m=+22.576710341" Jul 02 16:57:23.386655 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.386630 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cwtmc" podStartSLOduration=4.292785941 podStartE2EDuration="22.386624258s" totalImagesPullingTime="18.093838317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:23.385990035 +0000 UTC m=+22.576291190" watchObservedRunningTime="2026-07-02 16:57:23.386624258 +0000 UTC m=+22.576925428" Jul 02 16:57:23.399290 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.399259 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rwcwq" podStartSLOduration=4.312661142 podStartE2EDuration="22.399248723s" totalImagesPullingTime="18.086587581s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:23.398995087 +0000 UTC m=+22.589296244" watchObservedRunningTime="2026-07-02 16:57:23.399248723 +0000 UTC m=+22.589549882" Jul 02 16:57:23.415891 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.415854 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-b96cv" podStartSLOduration=4.29330489 podStartE2EDuration="22.415844711s" totalImagesPullingTime="18.122539821s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:23.41538165 +0000 UTC m=+22.605682809" watchObservedRunningTime="2026-07-02 16:57:23.415844711 +0000 UTC m=+22.606145869" Jul 02 16:57:23.431104 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.431072 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lmszm" podStartSLOduration=4.338210738 podStartE2EDuration="22.431062386s" totalImagesPullingTime="18.092851648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:23.430971932 +0000 UTC m=+22.621273090" watchObservedRunningTime="2026-07-02 16:57:23.431062386 +0000 UTC m=+22.621363544" Jul 02 16:57:23.571373 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:23.571352 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 16:57:24.240620 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:24.240513 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T16:57:23.571367649Z","UUID":"04937b5a-e1b1-4851-a2c4-f417a3ff8439","Handler":null,"Name":"","Endpoint":""} Jul 02 16:57:24.242076 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:24.242053 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 16:57:24.242203 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:24.242098 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 16:57:24.377695 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:24.377657 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" event={"ID":"b3db22b8-b79c-4eb9-92d2-92988b69be86","Type":"ContainerStarted","Data":"ba4aee080f622001dfb242ab4b6a6e0ae864afa83d922b891c53f40a4cc4542e"} Jul 02 16:57:24.379882 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:24.379850 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7tbzl" event={"ID":"755934de-0eaf-4b45-bdb5-218edf1fcc2a","Type":"ContainerStarted","Data":"550ed844b31039ce03047caa84bc52da0b9ff6bda63e05f8c7bd2af797c6aff6"} Jul 02 16:57:24.397042 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:24.396993 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7tbzl" podStartSLOduration=5.296982662 podStartE2EDuration="23.396972859s" totalImagesPullingTime="18.099990197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:24.396824811 +0000 UTC m=+23.587125969" watchObservedRunningTime="2026-07-02 16:57:24.396972859 +0000 UTC m=+23.587274018" Jul 02 16:57:25.238544 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:25.238511 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:25.238544 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:25.238531 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:25.238754 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:25.238511 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:25.238754 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:25.238644 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h8hw" podUID="ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa" Jul 02 16:57:25.238754 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:25.238740 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttr6p" podUID="5a84fd75-a938-4cbb-9493-85d680bad63b" Jul 02 16:57:25.238892 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:25.238813 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tl7jc" podUID="64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4" Jul 02 16:57:25.385730 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:25.385702 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lln24_1f9623eb-d52b-45dc-ae42-3fd20e210c7f/ovn-acl-logging/0.log" Jul 02 16:57:25.386169 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:25.386136 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lln24" event={"ID":"1f9623eb-d52b-45dc-ae42-3fd20e210c7f","Type":"ContainerStarted","Data":"6b09b15ddf45840db8450b7e417998bd9bbb3239f9e559ffa517b132a9bc3a7a"} Jul 02 16:57:25.388440 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:25.388405 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" event={"ID":"b3db22b8-b79c-4eb9-92d2-92988b69be86","Type":"ContainerStarted","Data":"c49fcb7a5b03f29f85aa7795f4a40f91377329b3bd958b04b292e0a73cddb5d8"} Jul 02 16:57:25.406259 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:25.406208 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sll4q" podStartSLOduration=4.291177743 podStartE2EDuration="24.406188952s" totalImagesPullingTime="20.115011209s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:25.405473858 +0000 UTC m=+24.595775010" watchObservedRunningTime="2026-07-02 16:57:25.406188952 +0000 UTC m=+24.596490111" Jul 02 16:57:26.667392 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:26.667229 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nqz99" Jul 02 16:57:27.238416 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:27.238389 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:27.238585 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:27.238391 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:27.238585 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:27.238527 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tl7jc" podUID="64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4" Jul 02 16:57:27.238698 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:27.238587 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h8hw" podUID="ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa" Jul 02 16:57:27.238698 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:27.238650 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:27.238795 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:27.238743 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttr6p" podUID="5a84fd75-a938-4cbb-9493-85d680bad63b" Jul 02 16:57:28.032197 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:28.032019 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nqz99" Jul 02 16:57:28.032806 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:28.032557 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nqz99" Jul 02 16:57:28.395766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:28.395675 2581 generic.go:356] "Generic (PLEG): container finished" podID="eb5365f4-38af-4aff-8dbe-73cc522fb645" containerID="83f9e8292dc3c475eb09ac07a9855d213a957f5d21abf9157abd7a0e66cdb8b1" exitCode=0 Jul 02 16:57:28.395766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:28.395736 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w5v9t" event={"ID":"eb5365f4-38af-4aff-8dbe-73cc522fb645","Type":"ContainerDied","Data":"83f9e8292dc3c475eb09ac07a9855d213a957f5d21abf9157abd7a0e66cdb8b1"} Jul 02 16:57:28.399433 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:28.399416 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lln24_1f9623eb-d52b-45dc-ae42-3fd20e210c7f/ovn-acl-logging/0.log" Jul 02 16:57:28.399894 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:28.399870 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lln24" event={"ID":"1f9623eb-d52b-45dc-ae42-3fd20e210c7f","Type":"ContainerStarted","Data":"28bdbb91a846ffd68c27147d913860ef73ba5093516a7ec5f2093669362f5fac"} Jul 02 16:57:28.400377 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:28.400361 2581 scope.go:117] "RemoveContainer" containerID="daed7dafad2520c309eb7e3d06f86af07e995ac5357e867555f646155ced787a" Jul 02 16:57:28.400594 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:28.400580 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nqz99" Jul 02 16:57:29.241299 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:29.241275 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:29.241619 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:29.241278 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:29.241619 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:29.241368 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tl7jc" podUID="64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4" Jul 02 16:57:29.241619 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:29.241278 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:29.241619 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:29.241439 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttr6p" podUID="5a84fd75-a938-4cbb-9493-85d680bad63b" Jul 02 16:57:29.241619 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:29.241517 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h8hw" podUID="ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa" Jul 02 16:57:29.365794 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:29.365767 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ttr6p"] Jul 02 16:57:29.368838 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:29.368815 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tl7jc"] Jul 02 16:57:29.370064 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:29.370040 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6h8hw"] Jul 02 16:57:29.406717 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:29.406668 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lln24_1f9623eb-d52b-45dc-ae42-3fd20e210c7f/ovn-acl-logging/0.log" Jul 02 16:57:29.407218 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:29.407191 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lln24" event={"ID":"1f9623eb-d52b-45dc-ae42-3fd20e210c7f","Type":"ContainerStarted","Data":"0f9e37c91576ae2b95e12f86c3fe66f3be83c4119f95625d67fcf06536a73c53"} Jul 02 16:57:29.407875 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:29.407446 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:29.407875 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:29.407502 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:29.407875 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:29.407576 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttr6p" podUID="5a84fd75-a938-4cbb-9493-85d680bad63b" Jul 02 16:57:29.407875 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:29.407619 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tl7jc" podUID="64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4" Jul 02 16:57:29.407875 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:29.407664 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:29.407875 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:29.407733 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h8hw" podUID="ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa" Jul 02 16:57:29.407875 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:29.407760 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:29.407875 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:29.407816 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:29.407875 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:29.407860 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:29.427554 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:29.427531 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:29.427756 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:29.427738 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:57:29.445740 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:29.445702 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lln24" podStartSLOduration=10.297601426 podStartE2EDuration="28.445689801s" totalImagesPullingTime="18.148088375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:29.444600084 +0000 UTC m=+28.634901241" watchObservedRunningTime="2026-07-02 16:57:29.445689801 +0000 UTC m=+28.635990956" Jul 02 16:57:30.411434 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:30.411398 2581 generic.go:356] "Generic (PLEG): container finished" podID="eb5365f4-38af-4aff-8dbe-73cc522fb645" containerID="aee720dbadfbdd1cfa89c75b55bebf47eeb7e01846968a855afc699e62193c29" exitCode=0 Jul 02 16:57:30.411923 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:30.411484 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w5v9t" event={"ID":"eb5365f4-38af-4aff-8dbe-73cc522fb645","Type":"ContainerDied","Data":"aee720dbadfbdd1cfa89c75b55bebf47eeb7e01846968a855afc699e62193c29"} Jul 02 16:57:31.239182 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:31.239154 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:31.239306 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:31.239241 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:31.239306 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:31.239284 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:31.239306 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:31.239281 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttr6p" podUID="5a84fd75-a938-4cbb-9493-85d680bad63b" Jul 02 16:57:31.239427 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:31.239363 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tl7jc" podUID="64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4" Jul 02 16:57:31.239484 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:31.239448 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h8hw" podUID="ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa" Jul 02 16:57:32.418443 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:32.418249 2581 generic.go:356] "Generic (PLEG): container finished" podID="eb5365f4-38af-4aff-8dbe-73cc522fb645" containerID="90ba107f88d18d113648b94b93f6639f4fdec5f80bfe4ae886fb1714333cb2a5" exitCode=0 Jul 02 16:57:32.419029 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:32.418336 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w5v9t" event={"ID":"eb5365f4-38af-4aff-8dbe-73cc522fb645","Type":"ContainerDied","Data":"90ba107f88d18d113648b94b93f6639f4fdec5f80bfe4ae886fb1714333cb2a5"} Jul 02 16:57:33.238023 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:33.237994 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:33.238178 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:33.237994 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:33.238178 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:33.238106 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttr6p" podUID="5a84fd75-a938-4cbb-9493-85d680bad63b" Jul 02 16:57:33.238178 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:33.238168 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tl7jc" podUID="64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4" Jul 02 16:57:33.238343 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:33.237994 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:33.238343 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:33.238266 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h8hw" podUID="ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa" Jul 02 16:57:34.112324 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.112292 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeReady" Jul 02 16:57:34.112835 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.112434 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 16:57:34.190945 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.190877 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vj7s5"] Jul 02 16:57:34.221540 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.221512 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n5rjx"] Jul 02 16:57:34.221681 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.221662 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vj7s5" Jul 02 16:57:34.225475 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.225349 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 16:57:34.225475 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.225433 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8ljz5\"" Jul 02 16:57:34.225475 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.225438 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 16:57:34.235320 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.235296 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vj7s5"] Jul 02 16:57:34.235494 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.235342 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n5rjx"] Jul 02 16:57:34.235494 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.235396 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n5rjx" Jul 02 16:57:34.242770 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.242714 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-624v7\"" Jul 02 16:57:34.242888 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.242843 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 16:57:34.242948 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.242717 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 16:57:34.243007 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.242981 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 16:57:34.346095 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.346071 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad81f415-2238-465c-aa67-12486b816585-cert\") pod \"ingress-canary-n5rjx\" (UID: \"ad81f415-2238-465c-aa67-12486b816585\") " pod="openshift-ingress-canary/ingress-canary-n5rjx" Jul 02 16:57:34.346223 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.346107 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-config-volume\") pod \"dns-default-vj7s5\" (UID: \"effa5ec3-b115-43eb-8cbd-8d12a3b1785b\") " pod="openshift-dns/dns-default-vj7s5" Jul 02 16:57:34.346223 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.346139 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7qvd\" (UniqueName: \"kubernetes.io/projected/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-kube-api-access-t7qvd\") pod \"dns-default-vj7s5\" (UID: \"effa5ec3-b115-43eb-8cbd-8d12a3b1785b\") " pod="openshift-dns/dns-default-vj7s5" Jul 02 16:57:34.346357 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.346258 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsdb6\" (UniqueName: \"kubernetes.io/projected/ad81f415-2238-465c-aa67-12486b816585-kube-api-access-tsdb6\") pod \"ingress-canary-n5rjx\" (UID: \"ad81f415-2238-465c-aa67-12486b816585\") " pod="openshift-ingress-canary/ingress-canary-n5rjx" Jul 02 16:57:34.346357 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.346293 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-tmp-dir\") pod \"dns-default-vj7s5\" (UID: \"effa5ec3-b115-43eb-8cbd-8d12a3b1785b\") " pod="openshift-dns/dns-default-vj7s5" Jul 02 16:57:34.346357 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.346328 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-metrics-tls\") pod \"dns-default-vj7s5\" (UID: \"effa5ec3-b115-43eb-8cbd-8d12a3b1785b\") " pod="openshift-dns/dns-default-vj7s5" Jul 02 16:57:34.447010 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.446928 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-metrics-tls\") pod \"dns-default-vj7s5\" (UID: \"effa5ec3-b115-43eb-8cbd-8d12a3b1785b\") " pod="openshift-dns/dns-default-vj7s5" Jul 02 16:57:34.447010 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.446989 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad81f415-2238-465c-aa67-12486b816585-cert\") pod \"ingress-canary-n5rjx\" (UID: \"ad81f415-2238-465c-aa67-12486b816585\") " pod="openshift-ingress-canary/ingress-canary-n5rjx" Jul 02 16:57:34.447010 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.447011 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-config-volume\") pod \"dns-default-vj7s5\" (UID: \"effa5ec3-b115-43eb-8cbd-8d12a3b1785b\") " pod="openshift-dns/dns-default-vj7s5" Jul 02 16:57:34.447272 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.447036 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7qvd\" (UniqueName: \"kubernetes.io/projected/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-kube-api-access-t7qvd\") pod \"dns-default-vj7s5\" (UID: \"effa5ec3-b115-43eb-8cbd-8d12a3b1785b\") " pod="openshift-dns/dns-default-vj7s5" Jul 02 16:57:34.447272 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:34.447061 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:57:34.447272 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.447090 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsdb6\" (UniqueName: \"kubernetes.io/projected/ad81f415-2238-465c-aa67-12486b816585-kube-api-access-tsdb6\") pod \"ingress-canary-n5rjx\" (UID: \"ad81f415-2238-465c-aa67-12486b816585\") " pod="openshift-ingress-canary/ingress-canary-n5rjx" Jul 02 16:57:34.447272 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.447115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-tmp-dir\") pod \"dns-default-vj7s5\" (UID: \"effa5ec3-b115-43eb-8cbd-8d12a3b1785b\") " pod="openshift-dns/dns-default-vj7s5" Jul 02 16:57:34.447272 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:34.447134 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-metrics-tls podName:effa5ec3-b115-43eb-8cbd-8d12a3b1785b nodeName:}" failed. No retries permitted until 2026-07-02 16:57:34.947114634 +0000 UTC m=+34.137415776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-metrics-tls") pod "dns-default-vj7s5" (UID: "effa5ec3-b115-43eb-8cbd-8d12a3b1785b") : secret "dns-default-metrics-tls" not found Jul 02 16:57:34.447553 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.447496 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-tmp-dir\") pod \"dns-default-vj7s5\" (UID: \"effa5ec3-b115-43eb-8cbd-8d12a3b1785b\") " pod="openshift-dns/dns-default-vj7s5" Jul 02 16:57:34.447730 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.447706 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-config-volume\") pod \"dns-default-vj7s5\" (UID: \"effa5ec3-b115-43eb-8cbd-8d12a3b1785b\") " pod="openshift-dns/dns-default-vj7s5" Jul 02 16:57:34.451752 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.451732 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad81f415-2238-465c-aa67-12486b816585-cert\") pod \"ingress-canary-n5rjx\" (UID: \"ad81f415-2238-465c-aa67-12486b816585\") " pod="openshift-ingress-canary/ingress-canary-n5rjx" Jul 02 16:57:34.463599 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.463580 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsdb6\" (UniqueName: \"kubernetes.io/projected/ad81f415-2238-465c-aa67-12486b816585-kube-api-access-tsdb6\") pod \"ingress-canary-n5rjx\" (UID: \"ad81f415-2238-465c-aa67-12486b816585\") " pod="openshift-ingress-canary/ingress-canary-n5rjx" Jul 02 16:57:34.464852 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.464824 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7qvd\" (UniqueName: \"kubernetes.io/projected/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-kube-api-access-t7qvd\") pod \"dns-default-vj7s5\" (UID: \"effa5ec3-b115-43eb-8cbd-8d12a3b1785b\") " pod="openshift-dns/dns-default-vj7s5" Jul 02 16:57:34.543698 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.543671 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n5rjx" Jul 02 16:57:34.774814 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.774784 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n5rjx"] Jul 02 16:57:34.778598 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:57:34.778570 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad81f415_2238_465c_aa67_12486b816585.slice/crio-06bad65220ef7457860d52aeb2963e79f8fdf53000083652a1d68cb4bd0662b9 WatchSource:0}: Error finding container 06bad65220ef7457860d52aeb2963e79f8fdf53000083652a1d68cb4bd0662b9: Status 404 returned error can't find the container with id 06bad65220ef7457860d52aeb2963e79f8fdf53000083652a1d68cb4bd0662b9 Jul 02 16:57:34.951119 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.951087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwkqz\" (UniqueName: \"kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz\") pod \"network-check-target-tl7jc\" (UID: \"64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4\") " pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:34.951283 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.951163 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-metrics-tls\") pod \"dns-default-vj7s5\" (UID: \"effa5ec3-b115-43eb-8cbd-8d12a3b1785b\") " pod="openshift-dns/dns-default-vj7s5" Jul 02 16:57:34.951283 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:34.951195 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs\") pod \"network-metrics-daemon-6h8hw\" (UID: \"ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa\") " pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:34.951283 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:34.951259 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:57:34.951423 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:34.951287 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:57:34.951423 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:34.951292 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:57:34.951423 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:34.951301 2581 projected.go:196] Error preparing data for projected volume kube-api-access-wwkqz for pod openshift-network-diagnostics/network-check-target-tl7jc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:34.951423 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:34.951317 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:34.951423 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:34.951359 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-metrics-tls podName:effa5ec3-b115-43eb-8cbd-8d12a3b1785b nodeName:}" failed. No retries permitted until 2026-07-02 16:57:35.95134054 +0000 UTC m=+35.141641687 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-metrics-tls") pod "dns-default-vj7s5" (UID: "effa5ec3-b115-43eb-8cbd-8d12a3b1785b") : secret "dns-default-metrics-tls" not found Jul 02 16:57:34.951423 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:34.951376 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz podName:64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:06.951368389 +0000 UTC m=+66.141669536 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwkqz" (UniqueName: "kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz") pod "network-check-target-tl7jc" (UID: "64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:34.951423 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:34.951394 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs podName:ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa nodeName:}" failed. No retries permitted until 2026-07-02 16:58:06.951386529 +0000 UTC m=+66.141687665 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs") pod "network-metrics-daemon-6h8hw" (UID: "ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:35.052471 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:35.052383 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret\") pod \"global-pull-secret-syncer-ttr6p\" (UID: \"5a84fd75-a938-4cbb-9493-85d680bad63b\") " pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:35.052609 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:35.052542 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:35.052654 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:35.052608 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret podName:5a84fd75-a938-4cbb-9493-85d680bad63b nodeName:}" failed. No retries permitted until 2026-07-02 16:58:07.052587886 +0000 UTC m=+66.242889025 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret") pod "global-pull-secret-syncer-ttr6p" (UID: "5a84fd75-a938-4cbb-9493-85d680bad63b") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:35.241771 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:35.241741 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:57:35.242312 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:35.241749 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:57:35.242312 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:35.241749 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:57:35.244757 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:35.244735 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pjpx2\"" Jul 02 16:57:35.244897 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:35.244781 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 16:57:35.244897 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:35.244735 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 16:57:35.245561 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:35.245532 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 16:57:35.245681 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:35.245600 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 16:57:35.245832 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:35.245816 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tqd6m\"" Jul 02 16:57:35.428211 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:35.428126 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n5rjx" event={"ID":"ad81f415-2238-465c-aa67-12486b816585","Type":"ContainerStarted","Data":"06bad65220ef7457860d52aeb2963e79f8fdf53000083652a1d68cb4bd0662b9"} Jul 02 16:57:35.957282 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:35.957251 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-metrics-tls\") pod \"dns-default-vj7s5\" (UID: \"effa5ec3-b115-43eb-8cbd-8d12a3b1785b\") " pod="openshift-dns/dns-default-vj7s5" Jul 02 16:57:35.957443 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:35.957370 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:57:35.957443 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:35.957433 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-metrics-tls podName:effa5ec3-b115-43eb-8cbd-8d12a3b1785b nodeName:}" failed. No retries permitted until 2026-07-02 16:57:37.957410922 +0000 UTC m=+37.147712063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-metrics-tls") pod "dns-default-vj7s5" (UID: "effa5ec3-b115-43eb-8cbd-8d12a3b1785b") : secret "dns-default-metrics-tls" not found Jul 02 16:57:36.977059 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:36.977026 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-qb8gt"] Jul 02 16:57:37.001188 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:37.001154 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-qb8gt"] Jul 02 16:57:37.001307 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:37.001273 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-qb8gt" Jul 02 16:57:37.005010 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:37.004988 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 02 16:57:37.005125 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:37.004988 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-vlzfl\"" Jul 02 16:57:37.005854 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:37.005834 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 02 16:57:37.165431 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:37.165398 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdvhk\" (UniqueName: \"kubernetes.io/projected/5b898a26-1564-43c9-9867-d3ea306542d8-kube-api-access-mdvhk\") pod \"migrator-786f9fbc5-qb8gt\" (UID: \"5b898a26-1564-43c9-9867-d3ea306542d8\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-qb8gt" Jul 02 16:57:37.266065 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:37.266041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdvhk\" (UniqueName: \"kubernetes.io/projected/5b898a26-1564-43c9-9867-d3ea306542d8-kube-api-access-mdvhk\") pod \"migrator-786f9fbc5-qb8gt\" (UID: \"5b898a26-1564-43c9-9867-d3ea306542d8\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-qb8gt" Jul 02 16:57:37.279107 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:37.279079 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdvhk\" (UniqueName: \"kubernetes.io/projected/5b898a26-1564-43c9-9867-d3ea306542d8-kube-api-access-mdvhk\") pod \"migrator-786f9fbc5-qb8gt\" (UID: \"5b898a26-1564-43c9-9867-d3ea306542d8\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-qb8gt" Jul 02 16:57:37.311364 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:37.311341 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-qb8gt" Jul 02 16:57:37.437635 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:37.437597 2581 generic.go:356] "Generic (PLEG): container finished" podID="eb5365f4-38af-4aff-8dbe-73cc522fb645" containerID="caa3cf24144a91a8d82ac0d20e66bc3f3a7b0b406434fab4cc50d1a49e16bcac" exitCode=0 Jul 02 16:57:37.437798 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:37.437678 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w5v9t" event={"ID":"eb5365f4-38af-4aff-8dbe-73cc522fb645","Type":"ContainerDied","Data":"caa3cf24144a91a8d82ac0d20e66bc3f3a7b0b406434fab4cc50d1a49e16bcac"} Jul 02 16:57:37.502977 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:37.502895 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-qb8gt"] Jul 02 16:57:37.972372 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:37.972121 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-metrics-tls\") pod \"dns-default-vj7s5\" (UID: \"effa5ec3-b115-43eb-8cbd-8d12a3b1785b\") " pod="openshift-dns/dns-default-vj7s5" Jul 02 16:57:37.972544 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:37.972286 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:57:37.972544 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:37.972491 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-metrics-tls podName:effa5ec3-b115-43eb-8cbd-8d12a3b1785b nodeName:}" failed. No retries permitted until 2026-07-02 16:57:41.972472816 +0000 UTC m=+41.162773975 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-metrics-tls") pod "dns-default-vj7s5" (UID: "effa5ec3-b115-43eb-8cbd-8d12a3b1785b") : secret "dns-default-metrics-tls" not found Jul 02 16:57:38.444392 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:38.444353 2581 generic.go:356] "Generic (PLEG): container finished" podID="eb5365f4-38af-4aff-8dbe-73cc522fb645" containerID="5a174a9d5de612b05a7d87641a6e6b9a5107e5995ba71bc158e13fbee03f3109" exitCode=0 Jul 02 16:57:38.444870 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:38.444467 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w5v9t" event={"ID":"eb5365f4-38af-4aff-8dbe-73cc522fb645","Type":"ContainerDied","Data":"5a174a9d5de612b05a7d87641a6e6b9a5107e5995ba71bc158e13fbee03f3109"} Jul 02 16:57:38.445712 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:38.445669 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-qb8gt" event={"ID":"5b898a26-1564-43c9-9867-d3ea306542d8","Type":"ContainerStarted","Data":"6983f22246b9d6ba45fe7cb9bf6b5bb95e2a622fe4ebef622347b8dbc8ffb6e0"} Jul 02 16:57:39.451223 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:39.451185 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w5v9t" event={"ID":"eb5365f4-38af-4aff-8dbe-73cc522fb645","Type":"ContainerStarted","Data":"250ed61e01cfc7a5a5667bfaf2e3e068ba944cc2ff9f8b8fd69f0440deab644c"} Jul 02 16:57:39.452616 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:39.452595 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n5rjx" event={"ID":"ad81f415-2238-465c-aa67-12486b816585","Type":"ContainerStarted","Data":"6f1e9fd062cebb7be5775d18c68b1febd92de397a74f35120434c595f4b92859"} Jul 02 16:57:39.485071 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:39.485022 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w5v9t" podStartSLOduration=9.784006475 podStartE2EDuration="38.485008576s" totalImagesPullingTime="28.701002101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:39.484624221 +0000 UTC m=+38.674925379" watchObservedRunningTime="2026-07-02 16:57:39.485008576 +0000 UTC m=+38.675309734" Jul 02 16:57:39.510178 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:39.510133 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n5rjx" podStartSLOduration=1.573746316 podStartE2EDuration="5.510119156s" totalImagesPullingTime="3.93637284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:39.509548586 +0000 UTC m=+38.699849745" watchObservedRunningTime="2026-07-02 16:57:39.510119156 +0000 UTC m=+38.700420343" Jul 02 16:57:40.456114 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:40.456039 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-qb8gt" event={"ID":"5b898a26-1564-43c9-9867-d3ea306542d8","Type":"ContainerStarted","Data":"f1427c151abecca5c145325adc359e9ba06705398c48bef439a9a7be84bf418d"} Jul 02 16:57:40.456560 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:40.456118 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-qb8gt" event={"ID":"5b898a26-1564-43c9-9867-d3ea306542d8","Type":"ContainerStarted","Data":"95c2b3a9b7c1e0fa704a192820143d6804ae7c9f7f473bcbb81450e71f9faae3"} Jul 02 16:57:40.478684 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:40.478639 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-qb8gt" podStartSLOduration=1.861771939 podStartE2EDuration="4.478625079s" totalImagesPullingTime="2.61685314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:40.477446029 +0000 UTC m=+39.667747187" watchObservedRunningTime="2026-07-02 16:57:40.478625079 +0000 UTC m=+39.668926236" Jul 02 16:57:41.999879 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:41.999839 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-metrics-tls\") pod \"dns-default-vj7s5\" (UID: \"effa5ec3-b115-43eb-8cbd-8d12a3b1785b\") " pod="openshift-dns/dns-default-vj7s5" Jul 02 16:57:42.000258 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:41.999984 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:57:42.000258 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:57:42.000056 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-metrics-tls podName:effa5ec3-b115-43eb-8cbd-8d12a3b1785b nodeName:}" failed. No retries permitted until 2026-07-02 16:57:50.000037086 +0000 UTC m=+49.190338255 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-metrics-tls") pod "dns-default-vj7s5" (UID: "effa5ec3-b115-43eb-8cbd-8d12a3b1785b") : secret "dns-default-metrics-tls" not found Jul 02 16:57:50.052009 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:50.051974 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-metrics-tls\") pod \"dns-default-vj7s5\" (UID: \"effa5ec3-b115-43eb-8cbd-8d12a3b1785b\") " pod="openshift-dns/dns-default-vj7s5" Jul 02 16:57:50.055247 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:50.055226 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/effa5ec3-b115-43eb-8cbd-8d12a3b1785b-metrics-tls\") pod \"dns-default-vj7s5\" (UID: \"effa5ec3-b115-43eb-8cbd-8d12a3b1785b\") " pod="openshift-dns/dns-default-vj7s5" Jul 02 16:57:50.133313 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:50.133287 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vj7s5" Jul 02 16:57:50.265695 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:50.265670 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vj7s5"] Jul 02 16:57:50.268920 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:57:50.268898 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeffa5ec3_b115_43eb_8cbd_8d12a3b1785b.slice/crio-0c1c0ab32e1c72aff1ea3268087e5137d8f88c2fc8d092ac226a0334fb206cf8 WatchSource:0}: Error finding container 0c1c0ab32e1c72aff1ea3268087e5137d8f88c2fc8d092ac226a0334fb206cf8: Status 404 returned error can't find the container with id 0c1c0ab32e1c72aff1ea3268087e5137d8f88c2fc8d092ac226a0334fb206cf8 Jul 02 16:57:50.481641 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:50.481571 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vj7s5" event={"ID":"effa5ec3-b115-43eb-8cbd-8d12a3b1785b","Type":"ContainerStarted","Data":"0c1c0ab32e1c72aff1ea3268087e5137d8f88c2fc8d092ac226a0334fb206cf8"} Jul 02 16:57:52.489154 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:52.489123 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vj7s5" event={"ID":"effa5ec3-b115-43eb-8cbd-8d12a3b1785b","Type":"ContainerStarted","Data":"e7d48c52548fb874df9ecceba97e70cedc04c2f4608f82fba8c1c12d4a951559"} Jul 02 16:57:52.489522 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:52.489174 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vj7s5" event={"ID":"effa5ec3-b115-43eb-8cbd-8d12a3b1785b","Type":"ContainerStarted","Data":"e04b47fc14ae93c10123d35ad292d4e3762f27b8ecabf01268cf2a030399d07d"} Jul 02 16:57:52.489522 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:52.489255 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vj7s5" Jul 02 16:57:52.538279 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:57:52.538208 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vj7s5" podStartSLOduration=16.507140498 podStartE2EDuration="18.538190257s" totalImagesPullingTime="2.031049759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:52.533097403 +0000 UTC m=+51.723398561" watchObservedRunningTime="2026-07-02 16:57:52.538190257 +0000 UTC m=+51.728491415" Jul 02 16:58:01.423875 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:01.423850 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lln24" Jul 02 16:58:02.495396 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:02.495360 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vj7s5" Jul 02 16:58:03.254625 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.254582 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c9b6959f8-rl4xp"] Jul 02 16:58:03.259044 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.259021 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-qpplk"] Jul 02 16:58:03.259200 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.259170 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c9b6959f8-rl4xp" Jul 02 16:58:03.261174 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.261153 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b98b74ccb-749z7"] Jul 02 16:58:03.261307 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.261291 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qpplk" Jul 02 16:58:03.263087 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.263065 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b98b74ccb-749z7" Jul 02 16:58:03.273942 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.273919 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 02 16:58:03.276020 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.276000 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 16:58:03.277313 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.277282 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 02 16:58:03.277540 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.277518 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dtz6f\"" Jul 02 16:58:03.277620 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.277586 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 02 16:58:03.277823 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.277799 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 02 16:58:03.277940 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.277913 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 02 16:58:03.278018 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.277960 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 02 16:58:03.278163 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.278134 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-72m92\"" Jul 02 16:58:03.278309 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.278290 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 02 16:58:03.278696 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.278442 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-qpplk"] Jul 02 16:58:03.278696 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.278478 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 16:58:03.279334 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.279310 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c9b6959f8-rl4xp"] Jul 02 16:58:03.307389 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.307370 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b98b74ccb-749z7"] Jul 02 16:58:03.332351 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.332329 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e3a7d98e-a804-44be-b323-5ab1fcfce2b6-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b98b74ccb-749z7\" (UID: \"e3a7d98e-a804-44be-b323-5ab1fcfce2b6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b98b74ccb-749z7" Jul 02 16:58:03.332442 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.332364 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1ef99d90-0d60-4628-852a-072abc39d2c7-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-qpplk\" (UID: \"1ef99d90-0d60-4628-852a-072abc39d2c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qpplk" Jul 02 16:58:03.332442 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.332391 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ef99d90-0d60-4628-852a-072abc39d2c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-qpplk\" (UID: \"1ef99d90-0d60-4628-852a-072abc39d2c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qpplk" Jul 02 16:58:03.332558 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.332449 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw7c5\" (UniqueName: \"kubernetes.io/projected/e3a7d98e-a804-44be-b323-5ab1fcfce2b6-kube-api-access-tw7c5\") pod \"klusterlet-addon-workmgr-7b98b74ccb-749z7\" (UID: \"e3a7d98e-a804-44be-b323-5ab1fcfce2b6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b98b74ccb-749z7" Jul 02 16:58:03.332558 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.332497 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4lzs\" (UniqueName: \"kubernetes.io/projected/388099d9-da0e-4e39-b3b8-6978687f328b-kube-api-access-t4lzs\") pod \"managed-serviceaccount-addon-agent-7c9b6959f8-rl4xp\" (UID: \"388099d9-da0e-4e39-b3b8-6978687f328b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c9b6959f8-rl4xp" Jul 02 16:58:03.332558 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.332516 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/388099d9-da0e-4e39-b3b8-6978687f328b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c9b6959f8-rl4xp\" (UID: \"388099d9-da0e-4e39-b3b8-6978687f328b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c9b6959f8-rl4xp" Jul 02 16:58:03.332558 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.332535 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcdh2\" (UniqueName: \"kubernetes.io/projected/1ef99d90-0d60-4628-852a-072abc39d2c7-kube-api-access-bcdh2\") pod \"cluster-monitoring-operator-54cb84584-qpplk\" (UID: \"1ef99d90-0d60-4628-852a-072abc39d2c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qpplk" Jul 02 16:58:03.332558 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.332553 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3a7d98e-a804-44be-b323-5ab1fcfce2b6-tmp\") pod \"klusterlet-addon-workmgr-7b98b74ccb-749z7\" (UID: \"e3a7d98e-a804-44be-b323-5ab1fcfce2b6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b98b74ccb-749z7" Jul 02 16:58:03.433425 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.433400 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/388099d9-da0e-4e39-b3b8-6978687f328b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c9b6959f8-rl4xp\" (UID: \"388099d9-da0e-4e39-b3b8-6978687f328b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c9b6959f8-rl4xp" Jul 02 16:58:03.433522 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.433429 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcdh2\" (UniqueName: \"kubernetes.io/projected/1ef99d90-0d60-4628-852a-072abc39d2c7-kube-api-access-bcdh2\") pod \"cluster-monitoring-operator-54cb84584-qpplk\" (UID: \"1ef99d90-0d60-4628-852a-072abc39d2c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qpplk" Jul 02 16:58:03.433522 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.433448 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3a7d98e-a804-44be-b323-5ab1fcfce2b6-tmp\") pod \"klusterlet-addon-workmgr-7b98b74ccb-749z7\" (UID: \"e3a7d98e-a804-44be-b323-5ab1fcfce2b6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b98b74ccb-749z7" Jul 02 16:58:03.433522 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.433513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e3a7d98e-a804-44be-b323-5ab1fcfce2b6-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b98b74ccb-749z7\" (UID: \"e3a7d98e-a804-44be-b323-5ab1fcfce2b6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b98b74ccb-749z7" Jul 02 16:58:03.433679 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.433641 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1ef99d90-0d60-4628-852a-072abc39d2c7-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-qpplk\" (UID: \"1ef99d90-0d60-4628-852a-072abc39d2c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qpplk" Jul 02 16:58:03.433736 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.433685 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ef99d90-0d60-4628-852a-072abc39d2c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-qpplk\" (UID: \"1ef99d90-0d60-4628-852a-072abc39d2c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qpplk" Jul 02 16:58:03.433736 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.433708 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw7c5\" (UniqueName: \"kubernetes.io/projected/e3a7d98e-a804-44be-b323-5ab1fcfce2b6-kube-api-access-tw7c5\") pod \"klusterlet-addon-workmgr-7b98b74ccb-749z7\" (UID: \"e3a7d98e-a804-44be-b323-5ab1fcfce2b6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b98b74ccb-749z7" Jul 02 16:58:03.433839 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.433734 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4lzs\" (UniqueName: \"kubernetes.io/projected/388099d9-da0e-4e39-b3b8-6978687f328b-kube-api-access-t4lzs\") pod \"managed-serviceaccount-addon-agent-7c9b6959f8-rl4xp\" (UID: \"388099d9-da0e-4e39-b3b8-6978687f328b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c9b6959f8-rl4xp" Jul 02 16:58:03.433916 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.433886 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3a7d98e-a804-44be-b323-5ab1fcfce2b6-tmp\") pod \"klusterlet-addon-workmgr-7b98b74ccb-749z7\" (UID: \"e3a7d98e-a804-44be-b323-5ab1fcfce2b6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b98b74ccb-749z7" Jul 02 16:58:03.434416 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.434401 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1ef99d90-0d60-4628-852a-072abc39d2c7-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-qpplk\" (UID: \"1ef99d90-0d60-4628-852a-072abc39d2c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qpplk" Jul 02 16:58:03.435905 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.435885 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ef99d90-0d60-4628-852a-072abc39d2c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-qpplk\" (UID: \"1ef99d90-0d60-4628-852a-072abc39d2c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qpplk" Jul 02 16:58:03.436010 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.435919 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e3a7d98e-a804-44be-b323-5ab1fcfce2b6-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b98b74ccb-749z7\" (UID: \"e3a7d98e-a804-44be-b323-5ab1fcfce2b6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b98b74ccb-749z7" Jul 02 16:58:03.436072 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.436028 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/388099d9-da0e-4e39-b3b8-6978687f328b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c9b6959f8-rl4xp\" (UID: \"388099d9-da0e-4e39-b3b8-6978687f328b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c9b6959f8-rl4xp" Jul 02 16:58:03.446922 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.446903 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c4f695bc5-rkmbt"] Jul 02 16:58:03.449642 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.449628 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.452978 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.452960 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 16:58:03.461839 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.461820 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcdh2\" (UniqueName: \"kubernetes.io/projected/1ef99d90-0d60-4628-852a-072abc39d2c7-kube-api-access-bcdh2\") pod \"cluster-monitoring-operator-54cb84584-qpplk\" (UID: \"1ef99d90-0d60-4628-852a-072abc39d2c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qpplk" Jul 02 16:58:03.469673 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.469651 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 16:58:03.469880 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.469866 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7hkvr\"" Jul 02 16:58:03.473569 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.473549 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4lzs\" (UniqueName: \"kubernetes.io/projected/388099d9-da0e-4e39-b3b8-6978687f328b-kube-api-access-t4lzs\") pod \"managed-serviceaccount-addon-agent-7c9b6959f8-rl4xp\" (UID: \"388099d9-da0e-4e39-b3b8-6978687f328b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c9b6959f8-rl4xp" Jul 02 16:58:03.475844 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.475807 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 16:58:03.481575 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.481557 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw7c5\" (UniqueName: \"kubernetes.io/projected/e3a7d98e-a804-44be-b323-5ab1fcfce2b6-kube-api-access-tw7c5\") pod \"klusterlet-addon-workmgr-7b98b74ccb-749z7\" (UID: \"e3a7d98e-a804-44be-b323-5ab1fcfce2b6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b98b74ccb-749z7" Jul 02 16:58:03.483841 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.483824 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 16:58:03.528359 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.528303 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c4f695bc5-rkmbt"] Jul 02 16:58:03.534610 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.534580 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ff10ecb-8890-42f1-8938-85d24bb7c11a-registry-tls\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.534747 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.534623 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ff10ecb-8890-42f1-8938-85d24bb7c11a-ca-trust-extracted\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.534747 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.534643 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ff10ecb-8890-42f1-8938-85d24bb7c11a-registry-certificates\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.534747 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.534697 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ff10ecb-8890-42f1-8938-85d24bb7c11a-bound-sa-token\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.534855 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.534784 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ff10ecb-8890-42f1-8938-85d24bb7c11a-image-registry-private-configuration\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.534855 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.534843 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pztq\" (UniqueName: \"kubernetes.io/projected/8ff10ecb-8890-42f1-8938-85d24bb7c11a-kube-api-access-4pztq\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.534927 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.534891 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ff10ecb-8890-42f1-8938-85d24bb7c11a-installation-pull-secrets\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.534927 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.534923 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ff10ecb-8890-42f1-8938-85d24bb7c11a-trusted-ca\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.581596 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.581576 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c9b6959f8-rl4xp" Jul 02 16:58:03.588500 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.588481 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qpplk" Jul 02 16:58:03.594536 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.594517 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b98b74ccb-749z7" Jul 02 16:58:03.638251 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.638214 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pztq\" (UniqueName: \"kubernetes.io/projected/8ff10ecb-8890-42f1-8938-85d24bb7c11a-kube-api-access-4pztq\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.638396 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.638307 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ff10ecb-8890-42f1-8938-85d24bb7c11a-installation-pull-secrets\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.638396 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.638360 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ff10ecb-8890-42f1-8938-85d24bb7c11a-trusted-ca\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.638534 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.638406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ff10ecb-8890-42f1-8938-85d24bb7c11a-registry-tls\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.638534 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.638432 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ff10ecb-8890-42f1-8938-85d24bb7c11a-ca-trust-extracted\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.644660 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.640198 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ff10ecb-8890-42f1-8938-85d24bb7c11a-trusted-ca\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.644660 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.640604 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ff10ecb-8890-42f1-8938-85d24bb7c11a-registry-certificates\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.644660 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.640643 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ff10ecb-8890-42f1-8938-85d24bb7c11a-bound-sa-token\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.644660 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.640696 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ff10ecb-8890-42f1-8938-85d24bb7c11a-image-registry-private-configuration\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.644660 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.641372 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ff10ecb-8890-42f1-8938-85d24bb7c11a-ca-trust-extracted\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.644660 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.643370 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ff10ecb-8890-42f1-8938-85d24bb7c11a-registry-certificates\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.644660 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.643687 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ff10ecb-8890-42f1-8938-85d24bb7c11a-image-registry-private-configuration\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.644660 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.644088 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ff10ecb-8890-42f1-8938-85d24bb7c11a-installation-pull-secrets\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.645928 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.645899 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ff10ecb-8890-42f1-8938-85d24bb7c11a-registry-tls\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.657251 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.657201 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ff10ecb-8890-42f1-8938-85d24bb7c11a-bound-sa-token\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.657917 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.657867 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pztq\" (UniqueName: \"kubernetes.io/projected/8ff10ecb-8890-42f1-8938-85d24bb7c11a-kube-api-access-4pztq\") pod \"image-registry-6c4f695bc5-rkmbt\" (UID: \"8ff10ecb-8890-42f1-8938-85d24bb7c11a\") " pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.750900 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.750871 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-qpplk"] Jul 02 16:58:03.757196 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.757175 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:03.757699 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:58:03.757679 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ef99d90_0d60_4628_852a_072abc39d2c7.slice/crio-95650ffe1ea4edc2ba1c81085d1ba85a99327f54d8fcf4160b3c924833bad03e WatchSource:0}: Error finding container 95650ffe1ea4edc2ba1c81085d1ba85a99327f54d8fcf4160b3c924833bad03e: Status 404 returned error can't find the container with id 95650ffe1ea4edc2ba1c81085d1ba85a99327f54d8fcf4160b3c924833bad03e Jul 02 16:58:03.760766 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.760742 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c9b6959f8-rl4xp"] Jul 02 16:58:03.762838 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:58:03.762816 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod388099d9_da0e_4e39_b3b8_6978687f328b.slice/crio-fd606033c7014ea023569ca58a6dcb170dea8db13bb25f5d0530ff329e438319 WatchSource:0}: Error finding container fd606033c7014ea023569ca58a6dcb170dea8db13bb25f5d0530ff329e438319: Status 404 returned error can't find the container with id fd606033c7014ea023569ca58a6dcb170dea8db13bb25f5d0530ff329e438319 Jul 02 16:58:03.780397 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.780342 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b98b74ccb-749z7"] Jul 02 16:58:03.783123 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:58:03.783099 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3a7d98e_a804_44be_b323_5ab1fcfce2b6.slice/crio-7f76bf244814f4461387d972bb00f0a8dda3b518666ffdce00a37974fd03dabd WatchSource:0}: Error finding container 7f76bf244814f4461387d972bb00f0a8dda3b518666ffdce00a37974fd03dabd: Status 404 returned error can't find the container with id 7f76bf244814f4461387d972bb00f0a8dda3b518666ffdce00a37974fd03dabd Jul 02 16:58:03.909094 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:03.909065 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c4f695bc5-rkmbt"] Jul 02 16:58:03.911853 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:58:03.911826 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ff10ecb_8890_42f1_8938_85d24bb7c11a.slice/crio-51b6bb8ce9bdf3f761962091bbf5adbe9a3da1f45232c97e25ff9ded08047968 WatchSource:0}: Error finding container 51b6bb8ce9bdf3f761962091bbf5adbe9a3da1f45232c97e25ff9ded08047968: Status 404 returned error can't find the container with id 51b6bb8ce9bdf3f761962091bbf5adbe9a3da1f45232c97e25ff9ded08047968 Jul 02 16:58:04.536828 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:04.536784 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b98b74ccb-749z7" event={"ID":"e3a7d98e-a804-44be-b323-5ab1fcfce2b6","Type":"ContainerStarted","Data":"7f76bf244814f4461387d972bb00f0a8dda3b518666ffdce00a37974fd03dabd"} Jul 02 16:58:04.538255 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:04.538225 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qpplk" event={"ID":"1ef99d90-0d60-4628-852a-072abc39d2c7","Type":"ContainerStarted","Data":"95650ffe1ea4edc2ba1c81085d1ba85a99327f54d8fcf4160b3c924833bad03e"} Jul 02 16:58:04.539688 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:04.539654 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c9b6959f8-rl4xp" event={"ID":"388099d9-da0e-4e39-b3b8-6978687f328b","Type":"ContainerStarted","Data":"fd606033c7014ea023569ca58a6dcb170dea8db13bb25f5d0530ff329e438319"} Jul 02 16:58:04.541967 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:04.541605 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" event={"ID":"8ff10ecb-8890-42f1-8938-85d24bb7c11a","Type":"ContainerStarted","Data":"22bae31eb7cf46be0b857c47d8e0e82b648f7c359cc8235232b292d831022c19"} Jul 02 16:58:04.541967 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:04.541652 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" event={"ID":"8ff10ecb-8890-42f1-8938-85d24bb7c11a","Type":"ContainerStarted","Data":"51b6bb8ce9bdf3f761962091bbf5adbe9a3da1f45232c97e25ff9ded08047968"} Jul 02 16:58:04.541967 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:04.541920 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:06.965449 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:06.965411 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs\") pod \"network-metrics-daemon-6h8hw\" (UID: \"ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa\") " pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:58:06.965814 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:06.965519 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwkqz\" (UniqueName: \"kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz\") pod \"network-check-target-tl7jc\" (UID: \"64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4\") " pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:58:06.968986 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:06.968966 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 16:58:06.969828 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:06.969808 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 16:58:06.979013 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:06.978967 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa-metrics-certs\") pod \"network-metrics-daemon-6h8hw\" (UID: \"ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa\") " pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:58:06.981795 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:06.981758 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 16:58:06.989398 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:06.989378 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwkqz\" (UniqueName: \"kubernetes.io/projected/64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4-kube-api-access-wwkqz\") pod \"network-check-target-tl7jc\" (UID: \"64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4\") " pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:58:07.065149 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:07.065124 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tqd6m\"" Jul 02 16:58:07.066375 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:07.066341 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret\") pod \"global-pull-secret-syncer-ttr6p\" (UID: \"5a84fd75-a938-4cbb-9493-85d680bad63b\") " pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:58:07.070004 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:07.069979 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 16:58:07.072616 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:07.072595 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:58:07.072962 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:07.072925 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pjpx2\"" Jul 02 16:58:07.079540 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:07.079487 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a84fd75-a938-4cbb-9493-85d680bad63b-original-pull-secret\") pod \"global-pull-secret-syncer-ttr6p\" (UID: \"5a84fd75-a938-4cbb-9493-85d680bad63b\") " pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:58:07.080349 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:07.080327 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h8hw" Jul 02 16:58:07.279853 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:07.279780 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" podStartSLOduration=4.279757772 podStartE2EDuration="4.279757772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:04.587574289 +0000 UTC m=+63.777875448" watchObservedRunningTime="2026-07-02 16:58:07.279757772 +0000 UTC m=+66.470058911" Jul 02 16:58:07.280484 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:07.280444 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tl7jc"] Jul 02 16:58:07.284815 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:58:07.284779 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64bb4bd0_539c_4c21_8fc6_a32cd9e2a5d4.slice/crio-d25bf66be1753132928e84b8fe4251d2ca7bf757ddc863bc8349653f353d7f55 WatchSource:0}: Error finding container d25bf66be1753132928e84b8fe4251d2ca7bf757ddc863bc8349653f353d7f55: Status 404 returned error can't find the container with id d25bf66be1753132928e84b8fe4251d2ca7bf757ddc863bc8349653f353d7f55 Jul 02 16:58:07.293113 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:07.293086 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6h8hw"] Jul 02 16:58:07.314097 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:58:07.314067 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae1c7b38_01e0_4ce7_ae9f_3f6701a140fa.slice/crio-1cc33fd6ceb82715d2f4d2e943a314c8c8996855f66da018c39d70bb7e92feee WatchSource:0}: Error finding container 1cc33fd6ceb82715d2f4d2e943a314c8c8996855f66da018c39d70bb7e92feee: Status 404 returned error can't find the container with id 1cc33fd6ceb82715d2f4d2e943a314c8c8996855f66da018c39d70bb7e92feee Jul 02 16:58:07.353989 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:07.353969 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttr6p" Jul 02 16:58:07.542117 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:07.542083 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ttr6p"] Jul 02 16:58:07.545513 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:58:07.545482 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a84fd75_a938_4cbb_9493_85d680bad63b.slice/crio-7a793a7f2151f16e6562d927c85c46be116376eef22c9cc55856242998dda94f WatchSource:0}: Error finding container 7a793a7f2151f16e6562d927c85c46be116376eef22c9cc55856242998dda94f: Status 404 returned error can't find the container with id 7a793a7f2151f16e6562d927c85c46be116376eef22c9cc55856242998dda94f Jul 02 16:58:07.555066 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:07.554927 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qpplk" event={"ID":"1ef99d90-0d60-4628-852a-072abc39d2c7","Type":"ContainerStarted","Data":"379b56a36c0a9aae7f25c616e8771c314af6782a5ab88bca2eccef5a1fc6c690"} Jul 02 16:58:07.558052 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:07.558023 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c9b6959f8-rl4xp" event={"ID":"388099d9-da0e-4e39-b3b8-6978687f328b","Type":"ContainerStarted","Data":"85260a6c9a3cc8aea2eb81d62ee23d38437d597244ec85b2404cf44ddb57f104"} Jul 02 16:58:07.561008 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:07.560980 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ttr6p" event={"ID":"5a84fd75-a938-4cbb-9493-85d680bad63b","Type":"ContainerStarted","Data":"7a793a7f2151f16e6562d927c85c46be116376eef22c9cc55856242998dda94f"} Jul 02 16:58:07.562550 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:07.562493 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tl7jc" event={"ID":"64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4","Type":"ContainerStarted","Data":"d25bf66be1753132928e84b8fe4251d2ca7bf757ddc863bc8349653f353d7f55"} Jul 02 16:58:07.564004 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:07.563971 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6h8hw" event={"ID":"ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa","Type":"ContainerStarted","Data":"1cc33fd6ceb82715d2f4d2e943a314c8c8996855f66da018c39d70bb7e92feee"} Jul 02 16:58:07.617975 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:07.617928 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qpplk" podStartSLOduration=1.48093223 podStartE2EDuration="4.617909767s" totalImagesPullingTime="3.136977537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:07.617519198 +0000 UTC m=+66.807820359" watchObservedRunningTime="2026-07-02 16:58:07.617909767 +0000 UTC m=+66.808210909" Jul 02 16:58:07.643394 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:07.643254 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c9b6959f8-rl4xp" podStartSLOduration=1.5043342100000001 podStartE2EDuration="4.643234127s" totalImagesPullingTime="3.138899917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:07.642987287 +0000 UTC m=+66.833288445" watchObservedRunningTime="2026-07-02 16:58:07.643234127 +0000 UTC m=+66.833535286" Jul 02 16:58:09.571727 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:09.571696 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5fstr"] Jul 02 16:58:09.593095 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:09.593068 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:09.605048 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:09.605024 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 16:58:09.606317 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:09.606290 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 16:58:09.606429 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:09.606352 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 16:58:09.607048 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:09.607024 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 16:58:09.607048 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:09.607039 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-blnmw\"" Jul 02 16:58:09.653394 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:09.653320 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5fstr"] Jul 02 16:58:09.685705 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:09.685681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qvmv\" (UniqueName: \"kubernetes.io/projected/fcd99657-53a6-4660-a45a-9af6d2d9ab92-kube-api-access-5qvmv\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:09.685795 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:09.685722 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fcd99657-53a6-4660-a45a-9af6d2d9ab92-crio-socket\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:09.685795 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:09.685755 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcd99657-53a6-4660-a45a-9af6d2d9ab92-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:09.685795 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:09.685776 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcd99657-53a6-4660-a45a-9af6d2d9ab92-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:09.685923 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:09.685848 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fcd99657-53a6-4660-a45a-9af6d2d9ab92-data-volume\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:09.787017 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:09.786990 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcd99657-53a6-4660-a45a-9af6d2d9ab92-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:09.787137 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:09.787038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcd99657-53a6-4660-a45a-9af6d2d9ab92-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:09.787137 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:09.787078 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fcd99657-53a6-4660-a45a-9af6d2d9ab92-data-volume\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:09.787137 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:58:09.787082 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 16:58:09.787137 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:09.787115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qvmv\" (UniqueName: \"kubernetes.io/projected/fcd99657-53a6-4660-a45a-9af6d2d9ab92-kube-api-access-5qvmv\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:09.787137 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:09.787133 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fcd99657-53a6-4660-a45a-9af6d2d9ab92-crio-socket\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:09.787514 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:58:09.787158 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcd99657-53a6-4660-a45a-9af6d2d9ab92-kube-rbac-proxy-cm podName:fcd99657-53a6-4660-a45a-9af6d2d9ab92 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:10.28713707 +0000 UTC m=+69.477438223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fcd99657-53a6-4660-a45a-9af6d2d9ab92-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5fstr" (UID: "fcd99657-53a6-4660-a45a-9af6d2d9ab92") : configmap "kube-rbac-proxy" not found Jul 02 16:58:09.787514 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:58:09.787170 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 16:58:09.787514 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:09.787186 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fcd99657-53a6-4660-a45a-9af6d2d9ab92-crio-socket\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:09.787514 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:58:09.787222 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd99657-53a6-4660-a45a-9af6d2d9ab92-insights-runtime-extractor-tls podName:fcd99657-53a6-4660-a45a-9af6d2d9ab92 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:10.287207647 +0000 UTC m=+69.477508793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fcd99657-53a6-4660-a45a-9af6d2d9ab92-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5fstr" (UID: "fcd99657-53a6-4660-a45a-9af6d2d9ab92") : secret "insights-runtime-extractor-tls" not found Jul 02 16:58:09.787514 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:09.787443 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fcd99657-53a6-4660-a45a-9af6d2d9ab92-data-volume\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:09.837550 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:09.837433 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qvmv\" (UniqueName: \"kubernetes.io/projected/fcd99657-53a6-4660-a45a-9af6d2d9ab92-kube-api-access-5qvmv\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:10.291441 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:10.291289 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcd99657-53a6-4660-a45a-9af6d2d9ab92-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:10.291441 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:10.291343 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcd99657-53a6-4660-a45a-9af6d2d9ab92-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:10.291441 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:58:10.291430 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 16:58:10.291710 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:58:10.291516 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcd99657-53a6-4660-a45a-9af6d2d9ab92-kube-rbac-proxy-cm podName:fcd99657-53a6-4660-a45a-9af6d2d9ab92 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:11.291497712 +0000 UTC m=+70.481798872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fcd99657-53a6-4660-a45a-9af6d2d9ab92-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5fstr" (UID: "fcd99657-53a6-4660-a45a-9af6d2d9ab92") : configmap "kube-rbac-proxy" not found Jul 02 16:58:10.291710 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:58:10.291521 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 16:58:10.291710 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:58:10.291557 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd99657-53a6-4660-a45a-9af6d2d9ab92-insights-runtime-extractor-tls podName:fcd99657-53a6-4660-a45a-9af6d2d9ab92 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:11.291547052 +0000 UTC m=+70.481848192 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fcd99657-53a6-4660-a45a-9af6d2d9ab92-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5fstr" (UID: "fcd99657-53a6-4660-a45a-9af6d2d9ab92") : secret "insights-runtime-extractor-tls" not found Jul 02 16:58:11.299401 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:11.299367 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcd99657-53a6-4660-a45a-9af6d2d9ab92-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:11.299401 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:11.299405 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcd99657-53a6-4660-a45a-9af6d2d9ab92-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:11.299846 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:58:11.299516 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 16:58:11.299846 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:58:11.299528 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 16:58:11.299846 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:58:11.299586 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd99657-53a6-4660-a45a-9af6d2d9ab92-insights-runtime-extractor-tls podName:fcd99657-53a6-4660-a45a-9af6d2d9ab92 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:13.299569512 +0000 UTC m=+72.489870649 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fcd99657-53a6-4660-a45a-9af6d2d9ab92-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5fstr" (UID: "fcd99657-53a6-4660-a45a-9af6d2d9ab92") : secret "insights-runtime-extractor-tls" not found Jul 02 16:58:11.299846 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:58:11.299604 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcd99657-53a6-4660-a45a-9af6d2d9ab92-kube-rbac-proxy-cm podName:fcd99657-53a6-4660-a45a-9af6d2d9ab92 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:13.299596637 +0000 UTC m=+72.489897773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fcd99657-53a6-4660-a45a-9af6d2d9ab92-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5fstr" (UID: "fcd99657-53a6-4660-a45a-9af6d2d9ab92") : configmap "kube-rbac-proxy" not found Jul 02 16:58:11.350503 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:11.350476 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vj7s5_effa5ec3-b115-43eb-8cbd-8d12a3b1785b/dns/0.log" Jul 02 16:58:11.495270 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:11.495242 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vj7s5_effa5ec3-b115-43eb-8cbd-8d12a3b1785b/kube-rbac-proxy/0.log" Jul 02 16:58:12.113673 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:12.113651 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rwcwq_da991979-8409-483d-8bb2-b63217ebaf2b/dns-node-resolver/0.log" Jul 02 16:58:12.519137 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:12.519106 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6c4f695bc5-rkmbt_8ff10ecb-8890-42f1-8938-85d24bb7c11a/registry/0.log" Jul 02 16:58:13.106707 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:13.106639 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cwtmc_80bb48b9-f232-4e0f-9fe4-2bc70ad76edc/node-ca/0.log" Jul 02 16:58:13.315503 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:13.315450 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcd99657-53a6-4660-a45a-9af6d2d9ab92-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:13.315663 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:13.315514 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcd99657-53a6-4660-a45a-9af6d2d9ab92-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:13.315663 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:58:13.315583 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 16:58:13.315663 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:58:13.315627 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 16:58:13.315663 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:58:13.315652 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcd99657-53a6-4660-a45a-9af6d2d9ab92-kube-rbac-proxy-cm podName:fcd99657-53a6-4660-a45a-9af6d2d9ab92 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:17.315634336 +0000 UTC m=+76.505935485 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fcd99657-53a6-4660-a45a-9af6d2d9ab92-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5fstr" (UID: "fcd99657-53a6-4660-a45a-9af6d2d9ab92") : configmap "kube-rbac-proxy" not found Jul 02 16:58:13.315887 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:58:13.315672 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd99657-53a6-4660-a45a-9af6d2d9ab92-insights-runtime-extractor-tls podName:fcd99657-53a6-4660-a45a-9af6d2d9ab92 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:17.315660655 +0000 UTC m=+76.505961791 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fcd99657-53a6-4660-a45a-9af6d2d9ab92-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5fstr" (UID: "fcd99657-53a6-4660-a45a-9af6d2d9ab92") : secret "insights-runtime-extractor-tls" not found Jul 02 16:58:13.592000 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:13.591968 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ttr6p" event={"ID":"5a84fd75-a938-4cbb-9493-85d680bad63b","Type":"ContainerStarted","Data":"b592b732d65422f1d7f4bf81bc128284defdacdb44f0ef203af6002b52c4d48f"} Jul 02 16:58:13.593503 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:13.593475 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tl7jc" event={"ID":"64bb4bd0-539c-4c21-8fc6-a32cd9e2a5d4","Type":"ContainerStarted","Data":"7512b782b2ff5d0b764534c08eba15eee5f74d2a17ae45aa790a45f035f0b88f"} Jul 02 16:58:13.593634 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:13.593568 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:58:13.595157 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:13.595128 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6h8hw" event={"ID":"ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa","Type":"ContainerStarted","Data":"00724bb4c79e3c84798fd4702191843b5f7a87648374ca3f3bfeb458c006e378"} Jul 02 16:58:13.595262 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:13.595170 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6h8hw" event={"ID":"ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa","Type":"ContainerStarted","Data":"1cdd266360c5029f89a6291d3d97668db1308838006cca9ed0772dace6d8ede6"} Jul 02 16:58:13.596444 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:13.596426 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b98b74ccb-749z7" event={"ID":"e3a7d98e-a804-44be-b323-5ab1fcfce2b6","Type":"ContainerStarted","Data":"ac57aeddb3ac88b1b89a5cf0ec18152f5be2e5c8bf547b0cd18dbcc83e5ae4cb"} Jul 02 16:58:13.596616 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:13.596604 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b98b74ccb-749z7" Jul 02 16:58:13.597954 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:13.597933 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b98b74ccb-749z7" Jul 02 16:58:13.699515 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:13.699450 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ttr6p" podStartSLOduration=67.632147836 podStartE2EDuration="1m12.699438521s" totalImagesPullingTime="5.067290685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:13.63637459 +0000 UTC m=+72.826675748" watchObservedRunningTime="2026-07-02 16:58:13.699438521 +0000 UTC m=+72.889739682" Jul 02 16:58:13.700079 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:13.700055 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tl7jc" podStartSLOduration=67.388335322 podStartE2EDuration="1m12.700047467s" totalImagesPullingTime="5.311712145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:13.698344796 +0000 UTC m=+72.888645953" watchObservedRunningTime="2026-07-02 16:58:13.700047467 +0000 UTC m=+72.890348625" Jul 02 16:58:13.740856 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:13.740816 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b98b74ccb-749z7" podStartSLOduration=1.9522286869999999 podStartE2EDuration="10.740801176s" totalImagesPullingTime="8.788572489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:13.740681846 +0000 UTC m=+72.930983005" watchObservedRunningTime="2026-07-02 16:58:13.740801176 +0000 UTC m=+72.931102336" Jul 02 16:58:13.822922 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:13.822885 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6h8hw" podStartSLOduration=67.564217034 podStartE2EDuration="1m12.822874599s" totalImagesPullingTime="5.258657565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:13.822305554 +0000 UTC m=+73.012606713" watchObservedRunningTime="2026-07-02 16:58:13.822874599 +0000 UTC m=+73.013175756" Jul 02 16:58:13.987582 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:13.987563 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n5rjx_ad81f415-2238-465c-aa67-12486b816585/serve-healthcheck-canary/0.log" Jul 02 16:58:14.341818 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.341765 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c44f45796-47jbk"] Jul 02 16:58:14.343927 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.343912 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:14.347939 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.347922 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-z9582\"" Jul 02 16:58:14.348485 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.348467 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 16:58:14.348543 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.348510 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 16:58:14.348939 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.348916 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 16:58:14.348995 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.348982 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 16:58:14.349040 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.348931 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 16:58:14.349121 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.349103 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 16:58:14.364687 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.364668 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 16:58:14.378275 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.378253 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c44f45796-47jbk"] Jul 02 16:58:14.422672 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.422650 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d74d99f-8d97-4c96-839a-40de15d37b41-console-serving-cert\") pod \"console-5c44f45796-47jbk\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:14.422780 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.422695 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d74d99f-8d97-4c96-839a-40de15d37b41-service-ca\") pod \"console-5c44f45796-47jbk\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:14.422780 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.422722 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d74d99f-8d97-4c96-839a-40de15d37b41-console-oauth-config\") pod \"console-5c44f45796-47jbk\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:14.422780 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.422755 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d74d99f-8d97-4c96-839a-40de15d37b41-oauth-serving-cert\") pod \"console-5c44f45796-47jbk\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:14.422947 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.422781 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d74d99f-8d97-4c96-839a-40de15d37b41-console-config\") pod \"console-5c44f45796-47jbk\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:14.422947 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.422871 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvs2x\" (UniqueName: \"kubernetes.io/projected/3d74d99f-8d97-4c96-839a-40de15d37b41-kube-api-access-gvs2x\") pod \"console-5c44f45796-47jbk\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:14.523811 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.523784 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d74d99f-8d97-4c96-839a-40de15d37b41-console-serving-cert\") pod \"console-5c44f45796-47jbk\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:14.523917 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.523821 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d74d99f-8d97-4c96-839a-40de15d37b41-service-ca\") pod \"console-5c44f45796-47jbk\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:14.523917 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.523842 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d74d99f-8d97-4c96-839a-40de15d37b41-console-oauth-config\") pod \"console-5c44f45796-47jbk\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:14.523917 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.523862 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d74d99f-8d97-4c96-839a-40de15d37b41-oauth-serving-cert\") pod \"console-5c44f45796-47jbk\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:14.523917 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.523886 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d74d99f-8d97-4c96-839a-40de15d37b41-console-config\") pod \"console-5c44f45796-47jbk\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:14.523917 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.523914 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvs2x\" (UniqueName: \"kubernetes.io/projected/3d74d99f-8d97-4c96-839a-40de15d37b41-kube-api-access-gvs2x\") pod \"console-5c44f45796-47jbk\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:14.524585 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.524562 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d74d99f-8d97-4c96-839a-40de15d37b41-service-ca\") pod \"console-5c44f45796-47jbk\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:14.524670 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.524609 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d74d99f-8d97-4c96-839a-40de15d37b41-oauth-serving-cert\") pod \"console-5c44f45796-47jbk\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:14.524670 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.524654 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d74d99f-8d97-4c96-839a-40de15d37b41-console-config\") pod \"console-5c44f45796-47jbk\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:14.526277 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.526257 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d74d99f-8d97-4c96-839a-40de15d37b41-console-serving-cert\") pod \"console-5c44f45796-47jbk\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:14.526508 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.526488 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d74d99f-8d97-4c96-839a-40de15d37b41-console-oauth-config\") pod \"console-5c44f45796-47jbk\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:14.558212 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.558188 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvs2x\" (UniqueName: \"kubernetes.io/projected/3d74d99f-8d97-4c96-839a-40de15d37b41-kube-api-access-gvs2x\") pod \"console-5c44f45796-47jbk\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:14.652923 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.652855 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:14.819329 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:14.819174 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c44f45796-47jbk"] Jul 02 16:58:14.821959 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:58:14.821930 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d74d99f_8d97_4c96_839a_40de15d37b41.slice/crio-f1b23c3c8b35b1a5b49f3b30806bd3d0b2d557ca0cb4809a9fff012f6a9c38cb WatchSource:0}: Error finding container f1b23c3c8b35b1a5b49f3b30806bd3d0b2d557ca0cb4809a9fff012f6a9c38cb: Status 404 returned error can't find the container with id f1b23c3c8b35b1a5b49f3b30806bd3d0b2d557ca0cb4809a9fff012f6a9c38cb Jul 02 16:58:15.605086 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:15.605047 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c44f45796-47jbk" event={"ID":"3d74d99f-8d97-4c96-839a-40de15d37b41","Type":"ContainerStarted","Data":"f1b23c3c8b35b1a5b49f3b30806bd3d0b2d557ca0cb4809a9fff012f6a9c38cb"} Jul 02 16:58:17.343700 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:17.343663 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcd99657-53a6-4660-a45a-9af6d2d9ab92-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:17.344152 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:17.343775 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcd99657-53a6-4660-a45a-9af6d2d9ab92-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:17.344343 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:17.344321 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcd99657-53a6-4660-a45a-9af6d2d9ab92-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:17.346160 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:17.346137 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcd99657-53a6-4660-a45a-9af6d2d9ab92-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5fstr\" (UID: \"fcd99657-53a6-4660-a45a-9af6d2d9ab92\") " pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:17.405179 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:17.405146 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5fstr" Jul 02 16:58:17.860306 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:17.860278 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7lzwr"] Jul 02 16:58:17.862372 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:17.862354 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:17.878367 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:17.878153 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 16:58:17.885523 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:17.885497 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 16:58:17.888939 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:17.888713 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 16:58:17.889606 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:17.889578 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5m6cm\"" Jul 02 16:58:17.898967 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:17.898932 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 16:58:17.949258 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:17.949234 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3cfa74c-f9d4-4908-9ce6-b39874418a24-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:17.949489 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:17.949317 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c3cfa74c-f9d4-4908-9ce6-b39874418a24-node-exporter-tls\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:17.949489 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:17.949379 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c3cfa74c-f9d4-4908-9ce6-b39874418a24-node-exporter-accelerators-collector-config\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:17.949489 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:17.949439 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps2ms\" (UniqueName: \"kubernetes.io/projected/c3cfa74c-f9d4-4908-9ce6-b39874418a24-kube-api-access-ps2ms\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:17.949623 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:17.949514 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c3cfa74c-f9d4-4908-9ce6-b39874418a24-node-exporter-textfile\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:17.949623 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:17.949547 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3cfa74c-f9d4-4908-9ce6-b39874418a24-sys\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:17.949623 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:17.949573 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3cfa74c-f9d4-4908-9ce6-b39874418a24-metrics-client-ca\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:17.949623 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:17.949599 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c3cfa74c-f9d4-4908-9ce6-b39874418a24-root\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:17.949784 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:17.949628 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c3cfa74c-f9d4-4908-9ce6-b39874418a24-node-exporter-wtmp\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:18.050933 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.050907 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c3cfa74c-f9d4-4908-9ce6-b39874418a24-node-exporter-tls\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:18.051095 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.050945 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c3cfa74c-f9d4-4908-9ce6-b39874418a24-node-exporter-accelerators-collector-config\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:18.051095 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.050966 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps2ms\" (UniqueName: \"kubernetes.io/projected/c3cfa74c-f9d4-4908-9ce6-b39874418a24-kube-api-access-ps2ms\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:18.051212 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.051158 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c3cfa74c-f9d4-4908-9ce6-b39874418a24-node-exporter-textfile\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:18.051212 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.051180 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3cfa74c-f9d4-4908-9ce6-b39874418a24-sys\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:18.051212 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.051203 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3cfa74c-f9d4-4908-9ce6-b39874418a24-metrics-client-ca\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:18.051362 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.051221 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c3cfa74c-f9d4-4908-9ce6-b39874418a24-root\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:18.051362 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.051236 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c3cfa74c-f9d4-4908-9ce6-b39874418a24-node-exporter-wtmp\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:18.051362 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.051272 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3cfa74c-f9d4-4908-9ce6-b39874418a24-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:18.051362 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.051283 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3cfa74c-f9d4-4908-9ce6-b39874418a24-sys\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:18.051362 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.051328 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c3cfa74c-f9d4-4908-9ce6-b39874418a24-root\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:18.051648 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.051416 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c3cfa74c-f9d4-4908-9ce6-b39874418a24-node-exporter-wtmp\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:18.051648 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.051556 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c3cfa74c-f9d4-4908-9ce6-b39874418a24-node-exporter-textfile\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:18.051648 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.051636 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c3cfa74c-f9d4-4908-9ce6-b39874418a24-node-exporter-accelerators-collector-config\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:18.051813 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.051793 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3cfa74c-f9d4-4908-9ce6-b39874418a24-metrics-client-ca\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:18.053393 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.053372 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c3cfa74c-f9d4-4908-9ce6-b39874418a24-node-exporter-tls\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:18.053512 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.053488 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3cfa74c-f9d4-4908-9ce6-b39874418a24-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:18.055647 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.055627 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5fstr"] Jul 02 16:58:18.059175 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:58:18.059146 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd99657_53a6_4660_a45a_9af6d2d9ab92.slice/crio-e2b9060c0f4275d980f618cf80f374380379ebdc24b9a167268adf51b8915f7a WatchSource:0}: Error finding container e2b9060c0f4275d980f618cf80f374380379ebdc24b9a167268adf51b8915f7a: Status 404 returned error can't find the container with id e2b9060c0f4275d980f618cf80f374380379ebdc24b9a167268adf51b8915f7a Jul 02 16:58:18.087004 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.086945 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps2ms\" (UniqueName: \"kubernetes.io/projected/c3cfa74c-f9d4-4908-9ce6-b39874418a24-kube-api-access-ps2ms\") pod \"node-exporter-7lzwr\" (UID: \"c3cfa74c-f9d4-4908-9ce6-b39874418a24\") " pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:18.173105 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.173081 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7lzwr" Jul 02 16:58:18.182295 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:58:18.182274 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3cfa74c_f9d4_4908_9ce6_b39874418a24.slice/crio-015dc895937219b011f2123839af47f9d326f6cb8ec0949436f4b2323fa73bd3 WatchSource:0}: Error finding container 015dc895937219b011f2123839af47f9d326f6cb8ec0949436f4b2323fa73bd3: Status 404 returned error can't find the container with id 015dc895937219b011f2123839af47f9d326f6cb8ec0949436f4b2323fa73bd3 Jul 02 16:58:18.634019 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.633931 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5fstr" event={"ID":"fcd99657-53a6-4660-a45a-9af6d2d9ab92","Type":"ContainerStarted","Data":"e2b9060c0f4275d980f618cf80f374380379ebdc24b9a167268adf51b8915f7a"} Jul 02 16:58:18.637710 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.637681 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c44f45796-47jbk" event={"ID":"3d74d99f-8d97-4c96-839a-40de15d37b41","Type":"ContainerStarted","Data":"89c7a95c01d6ac0279173c02cae10a7bc31c9d59b9c43f54cff216bcaf1a01e4"} Jul 02 16:58:18.639496 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:18.639471 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7lzwr" event={"ID":"c3cfa74c-f9d4-4908-9ce6-b39874418a24","Type":"ContainerStarted","Data":"015dc895937219b011f2123839af47f9d326f6cb8ec0949436f4b2323fa73bd3"} Jul 02 16:58:19.645865 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:19.645771 2581 generic.go:356] "Generic (PLEG): container finished" podID="c3cfa74c-f9d4-4908-9ce6-b39874418a24" containerID="6dac63462f7fc4f6fe11fd6a17ab8fc188c915db470136d639312a0a70363ded" exitCode=0 Jul 02 16:58:19.646289 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:19.645855 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7lzwr" event={"ID":"c3cfa74c-f9d4-4908-9ce6-b39874418a24","Type":"ContainerDied","Data":"6dac63462f7fc4f6fe11fd6a17ab8fc188c915db470136d639312a0a70363ded"} Jul 02 16:58:19.793744 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:19.793357 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c44f45796-47jbk" podStartSLOduration=2.750766359 podStartE2EDuration="5.793336632s" totalImagesPullingTime="3.042570273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:18.690317679 +0000 UTC m=+77.880618854" watchObservedRunningTime="2026-07-02 16:58:19.793336632 +0000 UTC m=+78.983637790" Jul 02 16:58:20.496573 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.496536 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78dd88685-thqxc"] Jul 02 16:58:20.503868 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.503844 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:20.518973 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.518945 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 02 16:58:20.533988 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.533953 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78dd88685-thqxc"] Jul 02 16:58:20.572310 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.572284 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-service-ca\") pod \"console-78dd88685-thqxc\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:20.572435 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.572326 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-oauth-serving-cert\") pod \"console-78dd88685-thqxc\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:20.572435 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.572404 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/112a1016-2ffc-4406-b0e9-fcce10061fc0-console-serving-cert\") pod \"console-78dd88685-thqxc\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:20.572587 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.572449 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-console-config\") pod \"console-78dd88685-thqxc\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:20.572587 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.572514 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-trusted-ca-bundle\") pod \"console-78dd88685-thqxc\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:20.572587 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.572565 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcqst\" (UniqueName: \"kubernetes.io/projected/112a1016-2ffc-4406-b0e9-fcce10061fc0-kube-api-access-gcqst\") pod \"console-78dd88685-thqxc\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:20.572740 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.572603 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/112a1016-2ffc-4406-b0e9-fcce10061fc0-console-oauth-config\") pod \"console-78dd88685-thqxc\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:20.651346 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.651316 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7lzwr" event={"ID":"c3cfa74c-f9d4-4908-9ce6-b39874418a24","Type":"ContainerStarted","Data":"863ba6642196dc1820d4888a2137171221f793878c1ff1987f9cb958b0280333"} Jul 02 16:58:20.673707 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.673676 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-service-ca\") pod \"console-78dd88685-thqxc\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:20.673841 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.673722 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-oauth-serving-cert\") pod \"console-78dd88685-thqxc\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:20.673841 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.673756 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/112a1016-2ffc-4406-b0e9-fcce10061fc0-console-serving-cert\") pod \"console-78dd88685-thqxc\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:20.673841 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.673785 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-console-config\") pod \"console-78dd88685-thqxc\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:20.673841 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.673810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-trusted-ca-bundle\") pod \"console-78dd88685-thqxc\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:20.673841 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.673838 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcqst\" (UniqueName: \"kubernetes.io/projected/112a1016-2ffc-4406-b0e9-fcce10061fc0-kube-api-access-gcqst\") pod \"console-78dd88685-thqxc\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:20.674037 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.673872 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/112a1016-2ffc-4406-b0e9-fcce10061fc0-console-oauth-config\") pod \"console-78dd88685-thqxc\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:20.674622 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.674562 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-service-ca\") pod \"console-78dd88685-thqxc\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:20.674813 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.674636 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-console-config\") pod \"console-78dd88685-thqxc\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:20.674813 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.674797 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-oauth-serving-cert\") pod \"console-78dd88685-thqxc\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:20.675080 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.675034 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-trusted-ca-bundle\") pod \"console-78dd88685-thqxc\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:20.677167 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.677138 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/112a1016-2ffc-4406-b0e9-fcce10061fc0-console-serving-cert\") pod \"console-78dd88685-thqxc\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:20.677670 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.677649 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/112a1016-2ffc-4406-b0e9-fcce10061fc0-console-oauth-config\") pod \"console-78dd88685-thqxc\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:20.696638 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.696593 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcqst\" (UniqueName: \"kubernetes.io/projected/112a1016-2ffc-4406-b0e9-fcce10061fc0-kube-api-access-gcqst\") pod \"console-78dd88685-thqxc\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:20.816250 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:20.816167 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:21.612785 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:21.612681 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-qbhsg"] Jul 02 16:58:21.615218 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:21.615195 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-qbhsg" Jul 02 16:58:21.620666 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:21.620616 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-z2877\"" Jul 02 16:58:21.621572 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:21.621546 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 02 16:58:21.639203 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:21.639173 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-qbhsg"] Jul 02 16:58:21.681322 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:21.681300 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e0d6f99-8dd7-4488-ad82-f76e85f61870-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-qbhsg\" (UID: \"3e0d6f99-8dd7-4488-ad82-f76e85f61870\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-qbhsg" Jul 02 16:58:21.681693 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:21.681340 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5w6m\" (UniqueName: \"kubernetes.io/projected/3e0d6f99-8dd7-4488-ad82-f76e85f61870-kube-api-access-f5w6m\") pod \"monitoring-plugin-cd8656b8-qbhsg\" (UID: \"3e0d6f99-8dd7-4488-ad82-f76e85f61870\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-qbhsg" Jul 02 16:58:21.782623 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:21.782596 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e0d6f99-8dd7-4488-ad82-f76e85f61870-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-qbhsg\" (UID: \"3e0d6f99-8dd7-4488-ad82-f76e85f61870\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-qbhsg" Jul 02 16:58:21.782758 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:21.782641 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5w6m\" (UniqueName: \"kubernetes.io/projected/3e0d6f99-8dd7-4488-ad82-f76e85f61870-kube-api-access-f5w6m\") pod \"monitoring-plugin-cd8656b8-qbhsg\" (UID: \"3e0d6f99-8dd7-4488-ad82-f76e85f61870\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-qbhsg" Jul 02 16:58:21.785209 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:21.785185 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e0d6f99-8dd7-4488-ad82-f76e85f61870-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-qbhsg\" (UID: \"3e0d6f99-8dd7-4488-ad82-f76e85f61870\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-qbhsg" Jul 02 16:58:21.828523 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:21.828491 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5w6m\" (UniqueName: \"kubernetes.io/projected/3e0d6f99-8dd7-4488-ad82-f76e85f61870-kube-api-access-f5w6m\") pod \"monitoring-plugin-cd8656b8-qbhsg\" (UID: \"3e0d6f99-8dd7-4488-ad82-f76e85f61870\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-qbhsg" Jul 02 16:58:21.925191 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:21.925107 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-qbhsg" Jul 02 16:58:22.107615 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.107580 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-qbhsg"] Jul 02 16:58:22.111352 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:58:22.111324 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e0d6f99_8dd7_4488_ad82_f76e85f61870.slice/crio-21c8ddf7e2382c17c89e15c77c6a2f7601b96c21b5301c3431096688e8e24a0f WatchSource:0}: Error finding container 21c8ddf7e2382c17c89e15c77c6a2f7601b96c21b5301c3431096688e8e24a0f: Status 404 returned error can't find the container with id 21c8ddf7e2382c17c89e15c77c6a2f7601b96c21b5301c3431096688e8e24a0f Jul 02 16:58:22.140293 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.140273 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78dd88685-thqxc"] Jul 02 16:58:22.143127 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:58:22.143105 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod112a1016_2ffc_4406_b0e9_fcce10061fc0.slice/crio-bdae11d071f8306b92a7d8dc33a73663650e5a103d309fc6bf2593eaef0f760f WatchSource:0}: Error finding container bdae11d071f8306b92a7d8dc33a73663650e5a103d309fc6bf2593eaef0f760f: Status 404 returned error can't find the container with id bdae11d071f8306b92a7d8dc33a73663650e5a103d309fc6bf2593eaef0f760f Jul 02 16:58:22.516211 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.516174 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-8476989897-v9wf4"] Jul 02 16:58:22.518319 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.518296 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.530092 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.530072 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 16:58:22.530262 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.530250 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-tnxlv\"" Jul 02 16:58:22.530965 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.530939 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-p6raascgg6r\"" Jul 02 16:58:22.531034 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.530980 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 02 16:58:22.532063 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.532046 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 02 16:58:22.534037 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.534021 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 02 16:58:22.552829 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.552811 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8476989897-v9wf4"] Jul 02 16:58:22.589261 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.589231 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22836475-c8d0-4330-ad79-1ab78d3fe123-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8476989897-v9wf4\" (UID: \"22836475-c8d0-4330-ad79-1ab78d3fe123\") " pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.589365 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.589277 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/22836475-c8d0-4330-ad79-1ab78d3fe123-audit-log\") pod \"metrics-server-8476989897-v9wf4\" (UID: \"22836475-c8d0-4330-ad79-1ab78d3fe123\") " pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.589365 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.589303 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7w89\" (UniqueName: \"kubernetes.io/projected/22836475-c8d0-4330-ad79-1ab78d3fe123-kube-api-access-t7w89\") pod \"metrics-server-8476989897-v9wf4\" (UID: \"22836475-c8d0-4330-ad79-1ab78d3fe123\") " pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.589512 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.589364 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/22836475-c8d0-4330-ad79-1ab78d3fe123-metrics-server-audit-profiles\") pod \"metrics-server-8476989897-v9wf4\" (UID: \"22836475-c8d0-4330-ad79-1ab78d3fe123\") " pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.589512 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.589418 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/22836475-c8d0-4330-ad79-1ab78d3fe123-secret-metrics-server-client-certs\") pod \"metrics-server-8476989897-v9wf4\" (UID: \"22836475-c8d0-4330-ad79-1ab78d3fe123\") " pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.589512 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.589449 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/22836475-c8d0-4330-ad79-1ab78d3fe123-secret-metrics-server-tls\") pod \"metrics-server-8476989897-v9wf4\" (UID: \"22836475-c8d0-4330-ad79-1ab78d3fe123\") " pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.589512 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.589500 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/22836475-c8d0-4330-ad79-1ab78d3fe123-client-ca-bundle\") pod \"metrics-server-8476989897-v9wf4\" (UID: \"22836475-c8d0-4330-ad79-1ab78d3fe123\") " pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.661244 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.661216 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5fstr" event={"ID":"fcd99657-53a6-4660-a45a-9af6d2d9ab92","Type":"ContainerStarted","Data":"b6e7272110644c6038a1238709ff5770f25cbd45d63a0b700287bf3cf5ce3912"} Jul 02 16:58:22.663301 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.663276 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7lzwr" event={"ID":"c3cfa74c-f9d4-4908-9ce6-b39874418a24","Type":"ContainerStarted","Data":"6cd133c8033e7a9351894b325fced0717c23fb8b57448b97b77c88516b83404d"} Jul 02 16:58:22.664516 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.664488 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-qbhsg" event={"ID":"3e0d6f99-8dd7-4488-ad82-f76e85f61870","Type":"ContainerStarted","Data":"21c8ddf7e2382c17c89e15c77c6a2f7601b96c21b5301c3431096688e8e24a0f"} Jul 02 16:58:22.665906 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.665884 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78dd88685-thqxc" event={"ID":"112a1016-2ffc-4406-b0e9-fcce10061fc0","Type":"ContainerStarted","Data":"82f88c6d092ccafe5049a291c3aa53ebb04e2f6d2a7cf7aa8f66b4811b388a75"} Jul 02 16:58:22.665978 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.665926 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78dd88685-thqxc" event={"ID":"112a1016-2ffc-4406-b0e9-fcce10061fc0","Type":"ContainerStarted","Data":"bdae11d071f8306b92a7d8dc33a73663650e5a103d309fc6bf2593eaef0f760f"} Jul 02 16:58:22.690308 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.690284 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/22836475-c8d0-4330-ad79-1ab78d3fe123-audit-log\") pod \"metrics-server-8476989897-v9wf4\" (UID: \"22836475-c8d0-4330-ad79-1ab78d3fe123\") " pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.690668 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.690322 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7w89\" (UniqueName: \"kubernetes.io/projected/22836475-c8d0-4330-ad79-1ab78d3fe123-kube-api-access-t7w89\") pod \"metrics-server-8476989897-v9wf4\" (UID: \"22836475-c8d0-4330-ad79-1ab78d3fe123\") " pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.690668 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.690372 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/22836475-c8d0-4330-ad79-1ab78d3fe123-metrics-server-audit-profiles\") pod \"metrics-server-8476989897-v9wf4\" (UID: \"22836475-c8d0-4330-ad79-1ab78d3fe123\") " pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.690668 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.690418 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/22836475-c8d0-4330-ad79-1ab78d3fe123-secret-metrics-server-client-certs\") pod \"metrics-server-8476989897-v9wf4\" (UID: \"22836475-c8d0-4330-ad79-1ab78d3fe123\") " pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.690668 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.690472 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/22836475-c8d0-4330-ad79-1ab78d3fe123-secret-metrics-server-tls\") pod \"metrics-server-8476989897-v9wf4\" (UID: \"22836475-c8d0-4330-ad79-1ab78d3fe123\") " pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.690668 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.690516 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/22836475-c8d0-4330-ad79-1ab78d3fe123-client-ca-bundle\") pod \"metrics-server-8476989897-v9wf4\" (UID: \"22836475-c8d0-4330-ad79-1ab78d3fe123\") " pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.690668 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.690570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22836475-c8d0-4330-ad79-1ab78d3fe123-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8476989897-v9wf4\" (UID: \"22836475-c8d0-4330-ad79-1ab78d3fe123\") " pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.690980 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.690720 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/22836475-c8d0-4330-ad79-1ab78d3fe123-audit-log\") pod \"metrics-server-8476989897-v9wf4\" (UID: \"22836475-c8d0-4330-ad79-1ab78d3fe123\") " pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.691519 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.691495 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22836475-c8d0-4330-ad79-1ab78d3fe123-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8476989897-v9wf4\" (UID: \"22836475-c8d0-4330-ad79-1ab78d3fe123\") " pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.691610 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.691561 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/22836475-c8d0-4330-ad79-1ab78d3fe123-metrics-server-audit-profiles\") pod \"metrics-server-8476989897-v9wf4\" (UID: \"22836475-c8d0-4330-ad79-1ab78d3fe123\") " pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.693317 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.693292 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/22836475-c8d0-4330-ad79-1ab78d3fe123-secret-metrics-server-tls\") pod \"metrics-server-8476989897-v9wf4\" (UID: \"22836475-c8d0-4330-ad79-1ab78d3fe123\") " pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.693473 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.693441 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/22836475-c8d0-4330-ad79-1ab78d3fe123-secret-metrics-server-client-certs\") pod \"metrics-server-8476989897-v9wf4\" (UID: \"22836475-c8d0-4330-ad79-1ab78d3fe123\") " pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.693668 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.693648 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/22836475-c8d0-4330-ad79-1ab78d3fe123-client-ca-bundle\") pod \"metrics-server-8476989897-v9wf4\" (UID: \"22836475-c8d0-4330-ad79-1ab78d3fe123\") " pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.695433 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.695380 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7lzwr" podStartSLOduration=4.523823034 podStartE2EDuration="5.695362707s" totalImagesPullingTime="1.095469984s" totalInitContainerRuntime="76.069689ms" isStatefulPod=true podCreationTimestamp="2026-07-02 16:58:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:22.693033613 +0000 UTC m=+81.883334774" watchObservedRunningTime="2026-07-02 16:58:22.695362707 +0000 UTC m=+81.885663868" Jul 02 16:58:22.729357 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.729337 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7w89\" (UniqueName: \"kubernetes.io/projected/22836475-c8d0-4330-ad79-1ab78d3fe123-kube-api-access-t7w89\") pod \"metrics-server-8476989897-v9wf4\" (UID: \"22836475-c8d0-4330-ad79-1ab78d3fe123\") " pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.741793 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.741752 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78dd88685-thqxc" podStartSLOduration=2.741739551 podStartE2EDuration="2.741739551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:22.740562063 +0000 UTC m=+81.930863260" watchObservedRunningTime="2026-07-02 16:58:22.741739551 +0000 UTC m=+81.932040708" Jul 02 16:58:22.826988 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.826936 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:22.974082 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:22.974041 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8476989897-v9wf4"] Jul 02 16:58:22.977661 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:58:22.977633 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22836475_c8d0_4330_ad79_1ab78d3fe123.slice/crio-a116b11277227a77d7bd4bc4df560d700e0baa3fb6963940dacc821c1f834784 WatchSource:0}: Error finding container a116b11277227a77d7bd4bc4df560d700e0baa3fb6963940dacc821c1f834784: Status 404 returned error can't find the container with id a116b11277227a77d7bd4bc4df560d700e0baa3fb6963940dacc821c1f834784 Jul 02 16:58:23.673445 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:23.673407 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5fstr" event={"ID":"fcd99657-53a6-4660-a45a-9af6d2d9ab92","Type":"ContainerStarted","Data":"f53505b7fc9a6dd0f4af0ea3f8f9f836f71b5c4fd662ffc4bc8a0bbf91e5c9e4"} Jul 02 16:58:23.676103 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:23.675875 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8476989897-v9wf4" event={"ID":"22836475-c8d0-4330-ad79-1ab78d3fe123","Type":"ContainerStarted","Data":"a116b11277227a77d7bd4bc4df560d700e0baa3fb6963940dacc821c1f834784"} Jul 02 16:58:24.653472 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:24.653428 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:24.653903 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:24.653507 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:24.660072 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:24.660045 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:24.681101 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:24.681063 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-qbhsg" event={"ID":"3e0d6f99-8dd7-4488-ad82-f76e85f61870","Type":"ContainerStarted","Data":"3099f37e73f7125aeff7d62656a48211abbce4ac1c3fbd162fbe2fe589ffb55e"} Jul 02 16:58:24.683685 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:24.682025 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-qbhsg" Jul 02 16:58:24.688049 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:24.688019 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-qbhsg" Jul 02 16:58:24.691202 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:24.691178 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:58:24.709146 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:24.709103 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-qbhsg" podStartSLOduration=1.969995678 podStartE2EDuration="3.709086652s" totalImagesPullingTime="1.739090974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:24.708306784 +0000 UTC m=+83.898607941" watchObservedRunningTime="2026-07-02 16:58:24.709086652 +0000 UTC m=+83.899387829" Jul 02 16:58:25.047244 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.047213 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78dd88685-thqxc"] Jul 02 16:58:25.101467 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.101427 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-884d55fb9-fv4r6"] Jul 02 16:58:25.107263 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.107241 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.138565 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.138540 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-884d55fb9-fv4r6"] Jul 02 16:58:25.179095 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.179055 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 16:58:25.184122 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.184097 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.190111 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.190017 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 16:58:25.193548 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.193317 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 16:58:25.193548 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.193345 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 16:58:25.193548 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.193386 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 16:58:25.193548 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.193400 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 16:58:25.193548 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.193345 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 16:58:25.193852 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.193681 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 16:58:25.193852 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.193720 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 16:58:25.194197 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.194032 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 16:58:25.194197 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.194091 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1a4h71fg0h15j\"" Jul 02 16:58:25.194197 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.194097 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-s6pqz\"" Jul 02 16:58:25.194197 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.194161 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 16:58:25.194432 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.194276 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 16:58:25.201935 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.201914 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 16:58:25.206635 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.206615 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 16:58:25.212981 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.212950 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-trusted-ca-bundle\") pod \"console-884d55fb9-fv4r6\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.213086 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.213020 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-service-ca\") pod \"console-884d55fb9-fv4r6\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.213164 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.213110 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-console-config\") pod \"console-884d55fb9-fv4r6\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.213225 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.213148 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dfd6547-f5ec-4c70-91c4-0658b1644f65-console-serving-cert\") pod \"console-884d55fb9-fv4r6\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.213225 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.213194 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-oauth-serving-cert\") pod \"console-884d55fb9-fv4r6\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.213338 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.213242 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghnr4\" (UniqueName: \"kubernetes.io/projected/1dfd6547-f5ec-4c70-91c4-0658b1644f65-kube-api-access-ghnr4\") pod \"console-884d55fb9-fv4r6\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.213338 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.213272 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dfd6547-f5ec-4c70-91c4-0658b1644f65-console-oauth-config\") pod \"console-884d55fb9-fv4r6\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.215319 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.215294 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 16:58:25.220008 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.219987 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 16:58:25.314121 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314062 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.314121 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314096 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/caae0fb0-76c7-4763-ba54-f133eee22bdb-config-out\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.314314 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314120 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.314314 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314149 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/caae0fb0-76c7-4763-ba54-f133eee22bdb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.314314 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314187 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.314314 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314212 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.314314 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314248 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.314314 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314266 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dn5h\" (UniqueName: \"kubernetes.io/projected/caae0fb0-76c7-4763-ba54-f133eee22bdb-kube-api-access-6dn5h\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.314314 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314284 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-config\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.314314 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314312 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-console-config\") pod \"console-884d55fb9-fv4r6\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.314733 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314352 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dfd6547-f5ec-4c70-91c4-0658b1644f65-console-serving-cert\") pod \"console-884d55fb9-fv4r6\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.314733 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-oauth-serving-cert\") pod \"console-884d55fb9-fv4r6\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.314733 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314399 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-web-config\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.314733 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314421 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.314733 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314473 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghnr4\" (UniqueName: \"kubernetes.io/projected/1dfd6547-f5ec-4c70-91c4-0658b1644f65-kube-api-access-ghnr4\") pod \"console-884d55fb9-fv4r6\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.314733 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314506 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dfd6547-f5ec-4c70-91c4-0658b1644f65-console-oauth-config\") pod \"console-884d55fb9-fv4r6\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.314733 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314565 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.314733 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314610 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.314733 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314650 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.314733 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314684 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.314733 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314720 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.315205 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-trusted-ca-bundle\") pod \"console-884d55fb9-fv4r6\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.315205 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314792 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.315205 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314845 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.315205 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.314869 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.315205 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.315008 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.315205 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.315091 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-service-ca\") pod \"console-884d55fb9-fv4r6\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.315205 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.315087 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-console-config\") pod \"console-884d55fb9-fv4r6\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.315490 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.315167 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-oauth-serving-cert\") pod \"console-884d55fb9-fv4r6\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.315759 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.315735 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-service-ca\") pod \"console-884d55fb9-fv4r6\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.316061 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.316030 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-trusted-ca-bundle\") pod \"console-884d55fb9-fv4r6\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.318215 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.318169 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dfd6547-f5ec-4c70-91c4-0658b1644f65-console-oauth-config\") pod \"console-884d55fb9-fv4r6\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.318215 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.318177 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dfd6547-f5ec-4c70-91c4-0658b1644f65-console-serving-cert\") pod \"console-884d55fb9-fv4r6\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.332663 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.332622 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghnr4\" (UniqueName: \"kubernetes.io/projected/1dfd6547-f5ec-4c70-91c4-0658b1644f65-kube-api-access-ghnr4\") pod \"console-884d55fb9-fv4r6\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.415641 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.415612 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.415765 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.415655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.415765 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.415682 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.415765 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.415710 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.415765 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.415739 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.415956 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.415797 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.415956 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.415831 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/caae0fb0-76c7-4763-ba54-f133eee22bdb-config-out\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.415956 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.415854 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.415956 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.415884 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/caae0fb0-76c7-4763-ba54-f133eee22bdb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.415956 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.415907 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.415956 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.415931 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.416252 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.415968 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.416252 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.415991 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dn5h\" (UniqueName: \"kubernetes.io/projected/caae0fb0-76c7-4763-ba54-f133eee22bdb-kube-api-access-6dn5h\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.416252 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.416042 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-config\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.416252 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.416088 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-web-config\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.416252 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.416112 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.416252 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.416160 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.416252 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.416190 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.416252 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.416220 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.416252 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.416250 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.416725 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.416411 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.416725 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.416596 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.416725 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.416658 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.418734 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.417644 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.418734 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.418718 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.418918 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.418897 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:25.418984 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.418937 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.419519 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.419263 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/caae0fb0-76c7-4763-ba54-f133eee22bdb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.419617 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.419553 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.420086 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.419806 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.420086 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.419964 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.420086 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.419802 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.420571 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.420439 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.421449 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.421387 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-web-config\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.421760 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.421739 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/caae0fb0-76c7-4763-ba54-f133eee22bdb-config-out\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.421966 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.421914 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.422337 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.422312 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.423075 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.423050 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.423215 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.423181 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-config\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.423321 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.423301 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.427807 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.427784 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dn5h\" (UniqueName: \"kubernetes.io/projected/caae0fb0-76c7-4763-ba54-f133eee22bdb-kube-api-access-6dn5h\") pod \"prometheus-k8s-0\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.495717 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.495681 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:25.550920 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.550899 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c4f695bc5-rkmbt" Jul 02 16:58:25.880220 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.880118 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-884d55fb9-fv4r6"] Jul 02 16:58:25.882815 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:58:25.882789 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dfd6547_f5ec_4c70_91c4_0658b1644f65.slice/crio-5c13b311823d153779be301b9495912927c9897b4ac9f78a1cbad30d47b94a50 WatchSource:0}: Error finding container 5c13b311823d153779be301b9495912927c9897b4ac9f78a1cbad30d47b94a50: Status 404 returned error can't find the container with id 5c13b311823d153779be301b9495912927c9897b4ac9f78a1cbad30d47b94a50 Jul 02 16:58:25.933401 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:25.933378 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 16:58:25.939584 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:58:25.939559 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaae0fb0_76c7_4763_ba54_f133eee22bdb.slice/crio-e70bca482403d4afd9797d3cd0117e4aafeecde56565ae9c5eacb3613e6028b7 WatchSource:0}: Error finding container e70bca482403d4afd9797d3cd0117e4aafeecde56565ae9c5eacb3613e6028b7: Status 404 returned error can't find the container with id e70bca482403d4afd9797d3cd0117e4aafeecde56565ae9c5eacb3613e6028b7 Jul 02 16:58:26.691242 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:26.691144 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-884d55fb9-fv4r6" event={"ID":"1dfd6547-f5ec-4c70-91c4-0658b1644f65","Type":"ContainerStarted","Data":"96c8f86d06a0d7fe1831e555d2c423dbc831042c5f42d0bb3450e8d56ad2cecb"} Jul 02 16:58:26.691242 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:26.691205 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-884d55fb9-fv4r6" event={"ID":"1dfd6547-f5ec-4c70-91c4-0658b1644f65","Type":"ContainerStarted","Data":"5c13b311823d153779be301b9495912927c9897b4ac9f78a1cbad30d47b94a50"} Jul 02 16:58:26.693045 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:26.693015 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8476989897-v9wf4" event={"ID":"22836475-c8d0-4330-ad79-1ab78d3fe123","Type":"ContainerStarted","Data":"c78071f971bdf03bbdc6e68ca8bb0e5718917c04e9ee61c5214424851a818f4e"} Jul 02 16:58:26.694468 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:26.694422 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caae0fb0-76c7-4763-ba54-f133eee22bdb","Type":"ContainerStarted","Data":"e70bca482403d4afd9797d3cd0117e4aafeecde56565ae9c5eacb3613e6028b7"} Jul 02 16:58:26.696858 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:26.696829 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5fstr" event={"ID":"fcd99657-53a6-4660-a45a-9af6d2d9ab92","Type":"ContainerStarted","Data":"7b96442d4d2bc2f9884ebdb887d5e90c67b338128ea3a70683c207d2a81616f2"} Jul 02 16:58:26.723027 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:26.722982 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-884d55fb9-fv4r6" podStartSLOduration=1.722967771 podStartE2EDuration="1.722967771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:26.722061602 +0000 UTC m=+85.912362761" watchObservedRunningTime="2026-07-02 16:58:26.722967771 +0000 UTC m=+85.913268929" Jul 02 16:58:26.766760 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:26.766705 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-8476989897-v9wf4" podStartSLOduration=2.012070927 podStartE2EDuration="4.766687169s" totalImagesPullingTime="2.754616242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:26.764043377 +0000 UTC m=+85.954344547" watchObservedRunningTime="2026-07-02 16:58:26.766687169 +0000 UTC m=+85.956988325" Jul 02 16:58:26.810029 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:26.809989 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5fstr" podStartSLOduration=10.260360795 podStartE2EDuration="17.809973922s" totalImagesPullingTime="7.549613127s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:58:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:26.808967376 +0000 UTC m=+85.999268534" watchObservedRunningTime="2026-07-02 16:58:26.809973922 +0000 UTC m=+86.000275080" Jul 02 16:58:27.706450 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:27.706410 2581 generic.go:356] "Generic (PLEG): container finished" podID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerID="defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f" exitCode=0 Jul 02 16:58:27.706911 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:27.706515 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caae0fb0-76c7-4763-ba54-f133eee22bdb","Type":"ContainerDied","Data":"defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f"} Jul 02 16:58:30.817151 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:30.817122 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:31.726001 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:31.725962 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caae0fb0-76c7-4763-ba54-f133eee22bdb","Type":"ContainerStarted","Data":"4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de"} Jul 02 16:58:31.726182 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:31.726061 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caae0fb0-76c7-4763-ba54-f133eee22bdb","Type":"ContainerStarted","Data":"b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb"} Jul 02 16:58:33.737471 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:33.737431 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caae0fb0-76c7-4763-ba54-f133eee22bdb","Type":"ContainerStarted","Data":"fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc"} Jul 02 16:58:33.737845 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:33.737518 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caae0fb0-76c7-4763-ba54-f133eee22bdb","Type":"ContainerStarted","Data":"46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7"} Jul 02 16:58:33.737845 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:33.737546 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caae0fb0-76c7-4763-ba54-f133eee22bdb","Type":"ContainerStarted","Data":"e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8"} Jul 02 16:58:33.737845 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:33.737579 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caae0fb0-76c7-4763-ba54-f133eee22bdb","Type":"ContainerStarted","Data":"fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24"} Jul 02 16:58:33.805113 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:33.805061 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.6301502770000003 podStartE2EDuration="8.805045577s" totalImagesPullingTime="6.155761537s" totalInitContainerRuntime="19.133763ms" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:33.798813645 +0000 UTC m=+92.989114803" watchObservedRunningTime="2026-07-02 16:58:33.805045577 +0000 UTC m=+92.995346735" Jul 02 16:58:35.419846 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:35.419813 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:35.420246 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:35.419871 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:35.424501 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:35.424475 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:35.496648 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:35.496627 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:35.750523 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:35.750501 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 16:58:35.858725 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:35.858698 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c44f45796-47jbk"] Jul 02 16:58:42.827966 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:42.827932 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:42.828347 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:42.827990 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:58:44.602435 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:44.602393 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tl7jc" Jul 02 16:58:50.068963 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.068903 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-78dd88685-thqxc" podUID="112a1016-2ffc-4406-b0e9-fcce10061fc0" containerName="console" containerID="cri-o://82f88c6d092ccafe5049a291c3aa53ebb04e2f6d2a7cf7aa8f66b4811b388a75" gracePeriod=15 Jul 02 16:58:50.357728 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.357702 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:50.517240 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.517208 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcqst\" (UniqueName: \"kubernetes.io/projected/112a1016-2ffc-4406-b0e9-fcce10061fc0-kube-api-access-gcqst\") pod \"112a1016-2ffc-4406-b0e9-fcce10061fc0\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " Jul 02 16:58:50.517402 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.517246 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-service-ca\") pod \"112a1016-2ffc-4406-b0e9-fcce10061fc0\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " Jul 02 16:58:50.517402 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.517272 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-oauth-serving-cert\") pod \"112a1016-2ffc-4406-b0e9-fcce10061fc0\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " Jul 02 16:58:50.517402 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.517291 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/112a1016-2ffc-4406-b0e9-fcce10061fc0-console-oauth-config\") pod \"112a1016-2ffc-4406-b0e9-fcce10061fc0\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " Jul 02 16:58:50.517597 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.517425 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-trusted-ca-bundle\") pod \"112a1016-2ffc-4406-b0e9-fcce10061fc0\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " Jul 02 16:58:50.517597 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.517495 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-console-config\") pod \"112a1016-2ffc-4406-b0e9-fcce10061fc0\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " Jul 02 16:58:50.517597 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.517562 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/112a1016-2ffc-4406-b0e9-fcce10061fc0-console-serving-cert\") pod \"112a1016-2ffc-4406-b0e9-fcce10061fc0\" (UID: \"112a1016-2ffc-4406-b0e9-fcce10061fc0\") " Jul 02 16:58:50.517757 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.517687 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "112a1016-2ffc-4406-b0e9-fcce10061fc0" (UID: "112a1016-2ffc-4406-b0e9-fcce10061fc0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:58:50.517816 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.517715 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-service-ca" (OuterVolumeSpecName: "service-ca") pod "112a1016-2ffc-4406-b0e9-fcce10061fc0" (UID: "112a1016-2ffc-4406-b0e9-fcce10061fc0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:58:50.517868 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.517844 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-oauth-serving-cert\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:58:50.517868 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.517851 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-console-config" (OuterVolumeSpecName: "console-config") pod "112a1016-2ffc-4406-b0e9-fcce10061fc0" (UID: "112a1016-2ffc-4406-b0e9-fcce10061fc0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:58:50.517970 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.517913 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "112a1016-2ffc-4406-b0e9-fcce10061fc0" (UID: "112a1016-2ffc-4406-b0e9-fcce10061fc0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:58:50.519429 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.519403 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/112a1016-2ffc-4406-b0e9-fcce10061fc0-kube-api-access-gcqst" (OuterVolumeSpecName: "kube-api-access-gcqst") pod "112a1016-2ffc-4406-b0e9-fcce10061fc0" (UID: "112a1016-2ffc-4406-b0e9-fcce10061fc0"). InnerVolumeSpecName "kube-api-access-gcqst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:58:50.519573 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.519448 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/112a1016-2ffc-4406-b0e9-fcce10061fc0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "112a1016-2ffc-4406-b0e9-fcce10061fc0" (UID: "112a1016-2ffc-4406-b0e9-fcce10061fc0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:58:50.519573 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.519483 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/112a1016-2ffc-4406-b0e9-fcce10061fc0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "112a1016-2ffc-4406-b0e9-fcce10061fc0" (UID: "112a1016-2ffc-4406-b0e9-fcce10061fc0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:58:50.618155 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.618102 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/112a1016-2ffc-4406-b0e9-fcce10061fc0-console-oauth-config\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:58:50.618155 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.618122 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-trusted-ca-bundle\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:58:50.618155 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.618132 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-console-config\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:58:50.618155 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.618141 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/112a1016-2ffc-4406-b0e9-fcce10061fc0-console-serving-cert\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:58:50.618155 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.618150 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcqst\" (UniqueName: \"kubernetes.io/projected/112a1016-2ffc-4406-b0e9-fcce10061fc0-kube-api-access-gcqst\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:58:50.618359 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.618159 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/112a1016-2ffc-4406-b0e9-fcce10061fc0-service-ca\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:58:50.813943 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.813915 2581 generic.go:356] "Generic (PLEG): container finished" podID="112a1016-2ffc-4406-b0e9-fcce10061fc0" containerID="82f88c6d092ccafe5049a291c3aa53ebb04e2f6d2a7cf7aa8f66b4811b388a75" exitCode=0 Jul 02 16:58:50.814069 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.813965 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78dd88685-thqxc" Jul 02 16:58:50.814069 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.814001 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78dd88685-thqxc" event={"ID":"112a1016-2ffc-4406-b0e9-fcce10061fc0","Type":"ContainerDied","Data":"82f88c6d092ccafe5049a291c3aa53ebb04e2f6d2a7cf7aa8f66b4811b388a75"} Jul 02 16:58:50.814142 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.814084 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78dd88685-thqxc" event={"ID":"112a1016-2ffc-4406-b0e9-fcce10061fc0","Type":"ContainerDied","Data":"bdae11d071f8306b92a7d8dc33a73663650e5a103d309fc6bf2593eaef0f760f"} Jul 02 16:58:50.814142 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.814120 2581 scope.go:117] "RemoveContainer" containerID="82f88c6d092ccafe5049a291c3aa53ebb04e2f6d2a7cf7aa8f66b4811b388a75" Jul 02 16:58:50.822947 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.822930 2581 scope.go:117] "RemoveContainer" containerID="82f88c6d092ccafe5049a291c3aa53ebb04e2f6d2a7cf7aa8f66b4811b388a75" Jul 02 16:58:50.823215 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:58:50.823196 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82f88c6d092ccafe5049a291c3aa53ebb04e2f6d2a7cf7aa8f66b4811b388a75\": container with ID starting with 82f88c6d092ccafe5049a291c3aa53ebb04e2f6d2a7cf7aa8f66b4811b388a75 not found: ID does not exist" containerID="82f88c6d092ccafe5049a291c3aa53ebb04e2f6d2a7cf7aa8f66b4811b388a75" Jul 02 16:58:50.823262 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.823223 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f88c6d092ccafe5049a291c3aa53ebb04e2f6d2a7cf7aa8f66b4811b388a75"} err="failed to get container status \"82f88c6d092ccafe5049a291c3aa53ebb04e2f6d2a7cf7aa8f66b4811b388a75\": rpc error: code = NotFound desc = could not find container \"82f88c6d092ccafe5049a291c3aa53ebb04e2f6d2a7cf7aa8f66b4811b388a75\": container with ID starting with 82f88c6d092ccafe5049a291c3aa53ebb04e2f6d2a7cf7aa8f66b4811b388a75 not found: ID does not exist" Jul 02 16:58:50.841331 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.841310 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78dd88685-thqxc"] Jul 02 16:58:50.846732 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:50.846713 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78dd88685-thqxc"] Jul 02 16:58:51.243339 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:58:51.243302 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="112a1016-2ffc-4406-b0e9-fcce10061fc0" path="/var/lib/kubelet/pods/112a1016-2ffc-4406-b0e9-fcce10061fc0/volumes" Jul 02 16:59:00.877565 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:00.877527 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5c44f45796-47jbk" podUID="3d74d99f-8d97-4c96-839a-40de15d37b41" containerName="console" containerID="cri-o://89c7a95c01d6ac0279173c02cae10a7bc31c9d59b9c43f54cff216bcaf1a01e4" gracePeriod=15 Jul 02 16:59:01.134016 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.133947 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:59:01.295496 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.295471 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvs2x\" (UniqueName: \"kubernetes.io/projected/3d74d99f-8d97-4c96-839a-40de15d37b41-kube-api-access-gvs2x\") pod \"3d74d99f-8d97-4c96-839a-40de15d37b41\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " Jul 02 16:59:01.295621 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.295523 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d74d99f-8d97-4c96-839a-40de15d37b41-console-oauth-config\") pod \"3d74d99f-8d97-4c96-839a-40de15d37b41\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " Jul 02 16:59:01.295621 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.295545 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d74d99f-8d97-4c96-839a-40de15d37b41-console-serving-cert\") pod \"3d74d99f-8d97-4c96-839a-40de15d37b41\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " Jul 02 16:59:01.295621 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.295574 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d74d99f-8d97-4c96-839a-40de15d37b41-console-config\") pod \"3d74d99f-8d97-4c96-839a-40de15d37b41\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " Jul 02 16:59:01.295853 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.295638 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d74d99f-8d97-4c96-839a-40de15d37b41-oauth-serving-cert\") pod \"3d74d99f-8d97-4c96-839a-40de15d37b41\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " Jul 02 16:59:01.295853 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.295685 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d74d99f-8d97-4c96-839a-40de15d37b41-service-ca\") pod \"3d74d99f-8d97-4c96-839a-40de15d37b41\" (UID: \"3d74d99f-8d97-4c96-839a-40de15d37b41\") " Jul 02 16:59:01.296056 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.296027 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d74d99f-8d97-4c96-839a-40de15d37b41-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3d74d99f-8d97-4c96-839a-40de15d37b41" (UID: "3d74d99f-8d97-4c96-839a-40de15d37b41"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:59:01.296056 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.296042 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d74d99f-8d97-4c96-839a-40de15d37b41-console-config" (OuterVolumeSpecName: "console-config") pod "3d74d99f-8d97-4c96-839a-40de15d37b41" (UID: "3d74d99f-8d97-4c96-839a-40de15d37b41"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:59:01.296184 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.296061 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d74d99f-8d97-4c96-839a-40de15d37b41-service-ca" (OuterVolumeSpecName: "service-ca") pod "3d74d99f-8d97-4c96-839a-40de15d37b41" (UID: "3d74d99f-8d97-4c96-839a-40de15d37b41"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:59:01.297576 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.297551 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d74d99f-8d97-4c96-839a-40de15d37b41-kube-api-access-gvs2x" (OuterVolumeSpecName: "kube-api-access-gvs2x") pod "3d74d99f-8d97-4c96-839a-40de15d37b41" (UID: "3d74d99f-8d97-4c96-839a-40de15d37b41"). InnerVolumeSpecName "kube-api-access-gvs2x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:59:01.297960 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.297941 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d74d99f-8d97-4c96-839a-40de15d37b41-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3d74d99f-8d97-4c96-839a-40de15d37b41" (UID: "3d74d99f-8d97-4c96-839a-40de15d37b41"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:59:01.298045 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.297967 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d74d99f-8d97-4c96-839a-40de15d37b41-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3d74d99f-8d97-4c96-839a-40de15d37b41" (UID: "3d74d99f-8d97-4c96-839a-40de15d37b41"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:59:01.396563 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.396500 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d74d99f-8d97-4c96-839a-40de15d37b41-oauth-serving-cert\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:01.396563 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.396521 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d74d99f-8d97-4c96-839a-40de15d37b41-service-ca\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:01.396563 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.396530 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvs2x\" (UniqueName: \"kubernetes.io/projected/3d74d99f-8d97-4c96-839a-40de15d37b41-kube-api-access-gvs2x\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:01.396563 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.396539 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d74d99f-8d97-4c96-839a-40de15d37b41-console-oauth-config\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:01.396563 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.396549 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d74d99f-8d97-4c96-839a-40de15d37b41-console-serving-cert\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:01.396563 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.396558 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d74d99f-8d97-4c96-839a-40de15d37b41-console-config\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:01.855238 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.855202 2581 generic.go:356] "Generic (PLEG): container finished" podID="3d74d99f-8d97-4c96-839a-40de15d37b41" containerID="89c7a95c01d6ac0279173c02cae10a7bc31c9d59b9c43f54cff216bcaf1a01e4" exitCode=0 Jul 02 16:59:01.855427 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.855256 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c44f45796-47jbk" Jul 02 16:59:01.855427 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.855281 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c44f45796-47jbk" event={"ID":"3d74d99f-8d97-4c96-839a-40de15d37b41","Type":"ContainerDied","Data":"89c7a95c01d6ac0279173c02cae10a7bc31c9d59b9c43f54cff216bcaf1a01e4"} Jul 02 16:59:01.855427 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.855330 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c44f45796-47jbk" event={"ID":"3d74d99f-8d97-4c96-839a-40de15d37b41","Type":"ContainerDied","Data":"f1b23c3c8b35b1a5b49f3b30806bd3d0b2d557ca0cb4809a9fff012f6a9c38cb"} Jul 02 16:59:01.855427 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.855350 2581 scope.go:117] "RemoveContainer" containerID="89c7a95c01d6ac0279173c02cae10a7bc31c9d59b9c43f54cff216bcaf1a01e4" Jul 02 16:59:01.863232 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.863217 2581 scope.go:117] "RemoveContainer" containerID="89c7a95c01d6ac0279173c02cae10a7bc31c9d59b9c43f54cff216bcaf1a01e4" Jul 02 16:59:01.863510 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:59:01.863490 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89c7a95c01d6ac0279173c02cae10a7bc31c9d59b9c43f54cff216bcaf1a01e4\": container with ID starting with 89c7a95c01d6ac0279173c02cae10a7bc31c9d59b9c43f54cff216bcaf1a01e4 not found: ID does not exist" containerID="89c7a95c01d6ac0279173c02cae10a7bc31c9d59b9c43f54cff216bcaf1a01e4" Jul 02 16:59:01.863579 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.863521 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89c7a95c01d6ac0279173c02cae10a7bc31c9d59b9c43f54cff216bcaf1a01e4"} err="failed to get container status \"89c7a95c01d6ac0279173c02cae10a7bc31c9d59b9c43f54cff216bcaf1a01e4\": rpc error: code = NotFound desc = could not find container \"89c7a95c01d6ac0279173c02cae10a7bc31c9d59b9c43f54cff216bcaf1a01e4\": container with ID starting with 89c7a95c01d6ac0279173c02cae10a7bc31c9d59b9c43f54cff216bcaf1a01e4 not found: ID does not exist" Jul 02 16:59:01.877558 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.877536 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c44f45796-47jbk"] Jul 02 16:59:01.884318 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:01.884289 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c44f45796-47jbk"] Jul 02 16:59:02.832524 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:02.832494 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:59:02.836136 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:02.836111 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-8476989897-v9wf4" Jul 02 16:59:03.243505 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:03.243475 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d74d99f-8d97-4c96-839a-40de15d37b41" path="/var/lib/kubelet/pods/3d74d99f-8d97-4c96-839a-40de15d37b41/volumes" Jul 02 16:59:25.496814 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:25.496781 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:25.516191 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:25.516172 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:25.967199 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:25.967117 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:43.372303 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.372269 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 16:59:43.372813 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.372562 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="prometheus" containerID="cri-o://b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb" gracePeriod=600 Jul 02 16:59:43.372813 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.372574 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="kube-rbac-proxy-thanos" containerID="cri-o://fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc" gracePeriod=600 Jul 02 16:59:43.372813 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.372603 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="kube-rbac-proxy" containerID="cri-o://46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7" gracePeriod=600 Jul 02 16:59:43.372813 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.372622 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="config-reloader" containerID="cri-o://4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de" gracePeriod=600 Jul 02 16:59:43.372813 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.372636 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="kube-rbac-proxy-web" containerID="cri-o://e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8" gracePeriod=600 Jul 02 16:59:43.372813 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.372606 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="thanos-sidecar" containerID="cri-o://fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24" gracePeriod=600 Jul 02 16:59:43.620210 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.620188 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:43.695317 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.695255 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/caae0fb0-76c7-4763-ba54-f133eee22bdb-config-out\") pod \"caae0fb0-76c7-4763-ba54-f133eee22bdb\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " Jul 02 16:59:43.695317 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.695287 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-thanos-prometheus-http-client-file\") pod \"caae0fb0-76c7-4763-ba54-f133eee22bdb\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " Jul 02 16:59:43.695317 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.695305 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-configmap-metrics-client-ca\") pod \"caae0fb0-76c7-4763-ba54-f133eee22bdb\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " Jul 02 16:59:43.695619 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.695324 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"caae0fb0-76c7-4763-ba54-f133eee22bdb\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " Jul 02 16:59:43.695619 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.695344 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"caae0fb0-76c7-4763-ba54-f133eee22bdb\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " Jul 02 16:59:43.695619 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.695365 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-rulefiles-1\") pod \"caae0fb0-76c7-4763-ba54-f133eee22bdb\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " Jul 02 16:59:43.695619 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.695478 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dn5h\" (UniqueName: \"kubernetes.io/projected/caae0fb0-76c7-4763-ba54-f133eee22bdb-kube-api-access-6dn5h\") pod \"caae0fb0-76c7-4763-ba54-f133eee22bdb\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " Jul 02 16:59:43.695619 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.695511 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/caae0fb0-76c7-4763-ba54-f133eee22bdb-tls-assets\") pod \"caae0fb0-76c7-4763-ba54-f133eee22bdb\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " Jul 02 16:59:43.695619 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.695540 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-trusted-ca-bundle\") pod \"caae0fb0-76c7-4763-ba54-f133eee22bdb\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " Jul 02 16:59:43.695619 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.695569 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-configmap-serving-certs-ca-bundle\") pod \"caae0fb0-76c7-4763-ba54-f133eee22bdb\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " Jul 02 16:59:43.695619 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.695604 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-configmap-kubelet-serving-ca-bundle\") pod \"caae0fb0-76c7-4763-ba54-f133eee22bdb\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " Jul 02 16:59:43.696009 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.695637 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-db\") pod \"caae0fb0-76c7-4763-ba54-f133eee22bdb\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " Jul 02 16:59:43.696009 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.695663 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-kube-rbac-proxy\") pod \"caae0fb0-76c7-4763-ba54-f133eee22bdb\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " Jul 02 16:59:43.696009 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.695691 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-rulefiles-0\") pod \"caae0fb0-76c7-4763-ba54-f133eee22bdb\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " Jul 02 16:59:43.696009 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.695732 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-rulefiles-2\") pod \"caae0fb0-76c7-4763-ba54-f133eee22bdb\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " Jul 02 16:59:43.696009 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.695764 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-config\") pod \"caae0fb0-76c7-4763-ba54-f133eee22bdb\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " Jul 02 16:59:43.696009 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.695810 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-web-config\") pod \"caae0fb0-76c7-4763-ba54-f133eee22bdb\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " Jul 02 16:59:43.696009 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.695841 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-prometheus-k8s-tls\") pod \"caae0fb0-76c7-4763-ba54-f133eee22bdb\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " Jul 02 16:59:43.696009 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.695868 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "caae0fb0-76c7-4763-ba54-f133eee22bdb" (UID: "caae0fb0-76c7-4763-ba54-f133eee22bdb"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:59:43.696009 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.695886 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-grpc-tls\") pod \"caae0fb0-76c7-4763-ba54-f133eee22bdb\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " Jul 02 16:59:43.696009 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.695921 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-metrics-client-certs\") pod \"caae0fb0-76c7-4763-ba54-f133eee22bdb\" (UID: \"caae0fb0-76c7-4763-ba54-f133eee22bdb\") " Jul 02 16:59:43.696508 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.696117 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "caae0fb0-76c7-4763-ba54-f133eee22bdb" (UID: "caae0fb0-76c7-4763-ba54-f133eee22bdb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:59:43.696508 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.696200 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-configmap-metrics-client-ca\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:43.696508 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.696221 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:43.696508 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.696335 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "caae0fb0-76c7-4763-ba54-f133eee22bdb" (UID: "caae0fb0-76c7-4763-ba54-f133eee22bdb"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:59:43.698213 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.696772 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "caae0fb0-76c7-4763-ba54-f133eee22bdb" (UID: "caae0fb0-76c7-4763-ba54-f133eee22bdb"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:59:43.698213 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.697273 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "caae0fb0-76c7-4763-ba54-f133eee22bdb" (UID: "caae0fb0-76c7-4763-ba54-f133eee22bdb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:59:43.698213 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.697309 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "caae0fb0-76c7-4763-ba54-f133eee22bdb" (UID: "caae0fb0-76c7-4763-ba54-f133eee22bdb"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:59:43.698213 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.697834 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "caae0fb0-76c7-4763-ba54-f133eee22bdb" (UID: "caae0fb0-76c7-4763-ba54-f133eee22bdb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:59:43.698213 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.697922 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "caae0fb0-76c7-4763-ba54-f133eee22bdb" (UID: "caae0fb0-76c7-4763-ba54-f133eee22bdb"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:59:43.698968 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.698935 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caae0fb0-76c7-4763-ba54-f133eee22bdb-config-out" (OuterVolumeSpecName: "config-out") pod "caae0fb0-76c7-4763-ba54-f133eee22bdb" (UID: "caae0fb0-76c7-4763-ba54-f133eee22bdb"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:59:43.699885 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.699853 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "caae0fb0-76c7-4763-ba54-f133eee22bdb" (UID: "caae0fb0-76c7-4763-ba54-f133eee22bdb"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:59:43.699993 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.699905 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caae0fb0-76c7-4763-ba54-f133eee22bdb-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "caae0fb0-76c7-4763-ba54-f133eee22bdb" (UID: "caae0fb0-76c7-4763-ba54-f133eee22bdb"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:59:43.699993 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.699935 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "caae0fb0-76c7-4763-ba54-f133eee22bdb" (UID: "caae0fb0-76c7-4763-ba54-f133eee22bdb"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:59:43.700257 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.700230 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "caae0fb0-76c7-4763-ba54-f133eee22bdb" (UID: "caae0fb0-76c7-4763-ba54-f133eee22bdb"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:59:43.700339 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.700265 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caae0fb0-76c7-4763-ba54-f133eee22bdb-kube-api-access-6dn5h" (OuterVolumeSpecName: "kube-api-access-6dn5h") pod "caae0fb0-76c7-4763-ba54-f133eee22bdb" (UID: "caae0fb0-76c7-4763-ba54-f133eee22bdb"). InnerVolumeSpecName "kube-api-access-6dn5h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:59:43.700339 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.700326 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "caae0fb0-76c7-4763-ba54-f133eee22bdb" (UID: "caae0fb0-76c7-4763-ba54-f133eee22bdb"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:59:43.700529 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.700512 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "caae0fb0-76c7-4763-ba54-f133eee22bdb" (UID: "caae0fb0-76c7-4763-ba54-f133eee22bdb"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:59:43.700591 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.700534 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "caae0fb0-76c7-4763-ba54-f133eee22bdb" (UID: "caae0fb0-76c7-4763-ba54-f133eee22bdb"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:59:43.700793 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.700771 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "caae0fb0-76c7-4763-ba54-f133eee22bdb" (UID: "caae0fb0-76c7-4763-ba54-f133eee22bdb"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:59:43.700975 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.700955 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-config" (OuterVolumeSpecName: "config") pod "caae0fb0-76c7-4763-ba54-f133eee22bdb" (UID: "caae0fb0-76c7-4763-ba54-f133eee22bdb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:59:43.709381 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.709358 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-web-config" (OuterVolumeSpecName: "web-config") pod "caae0fb0-76c7-4763-ba54-f133eee22bdb" (UID: "caae0fb0-76c7-4763-ba54-f133eee22bdb"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:59:43.796991 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.796970 2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-metrics-client-certs\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:43.796991 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.796991 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/caae0fb0-76c7-4763-ba54-f133eee22bdb-config-out\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:43.797100 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.797000 2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:43.797100 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.797011 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:43.797100 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.797020 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:43.797100 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.797029 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dn5h\" (UniqueName: \"kubernetes.io/projected/caae0fb0-76c7-4763-ba54-f133eee22bdb-kube-api-access-6dn5h\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:43.797100 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.797037 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/caae0fb0-76c7-4763-ba54-f133eee22bdb-tls-assets\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:43.797100 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.797046 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:43.797100 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.797054 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:43.797100 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.797062 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:43.797100 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.797070 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-db\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:43.797100 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.797078 2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-kube-rbac-proxy\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:43.797100 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.797086 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:43.797100 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.797094 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/caae0fb0-76c7-4763-ba54-f133eee22bdb-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:43.797100 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.797102 2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-config\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:43.797495 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.797110 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-web-config\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:43.797495 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.797117 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:43.797495 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:43.797125 2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/caae0fb0-76c7-4763-ba54-f133eee22bdb-secret-grpc-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 16:59:44.022896 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.022861 2581 generic.go:356] "Generic (PLEG): container finished" podID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerID="fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc" exitCode=0 Jul 02 16:59:44.022896 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.022891 2581 generic.go:356] "Generic (PLEG): container finished" podID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerID="46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7" exitCode=0 Jul 02 16:59:44.023079 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.022903 2581 generic.go:356] "Generic (PLEG): container finished" podID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerID="e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8" exitCode=0 Jul 02 16:59:44.023079 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.022917 2581 generic.go:356] "Generic (PLEG): container finished" podID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerID="fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24" exitCode=0 Jul 02 16:59:44.023079 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.022925 2581 generic.go:356] "Generic (PLEG): container finished" podID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerID="4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de" exitCode=0 Jul 02 16:59:44.023079 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.022932 2581 generic.go:356] "Generic (PLEG): container finished" podID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerID="b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb" exitCode=0 Jul 02 16:59:44.023079 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.022943 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.023079 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.022948 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caae0fb0-76c7-4763-ba54-f133eee22bdb","Type":"ContainerDied","Data":"fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc"} Jul 02 16:59:44.023079 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.023038 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caae0fb0-76c7-4763-ba54-f133eee22bdb","Type":"ContainerDied","Data":"46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7"} Jul 02 16:59:44.023400 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.023087 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caae0fb0-76c7-4763-ba54-f133eee22bdb","Type":"ContainerDied","Data":"e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8"} Jul 02 16:59:44.023400 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.023110 2581 scope.go:117] "RemoveContainer" containerID="fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc" Jul 02 16:59:44.023400 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.023131 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caae0fb0-76c7-4763-ba54-f133eee22bdb","Type":"ContainerDied","Data":"fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24"} Jul 02 16:59:44.023400 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.023176 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caae0fb0-76c7-4763-ba54-f133eee22bdb","Type":"ContainerDied","Data":"4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de"} Jul 02 16:59:44.023400 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.023217 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caae0fb0-76c7-4763-ba54-f133eee22bdb","Type":"ContainerDied","Data":"b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb"} Jul 02 16:59:44.023400 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.023259 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caae0fb0-76c7-4763-ba54-f133eee22bdb","Type":"ContainerDied","Data":"e70bca482403d4afd9797d3cd0117e4aafeecde56565ae9c5eacb3613e6028b7"} Jul 02 16:59:44.032879 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.032860 2581 scope.go:117] "RemoveContainer" containerID="46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7" Jul 02 16:59:44.039812 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.039797 2581 scope.go:117] "RemoveContainer" containerID="e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8" Jul 02 16:59:44.045939 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.045922 2581 scope.go:117] "RemoveContainer" containerID="fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24" Jul 02 16:59:44.049082 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.049062 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 16:59:44.053032 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.053012 2581 scope.go:117] "RemoveContainer" containerID="4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de" Jul 02 16:59:44.053804 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.053789 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 16:59:44.059336 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.059319 2581 scope.go:117] "RemoveContainer" containerID="b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb" Jul 02 16:59:44.066298 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.066282 2581 scope.go:117] "RemoveContainer" containerID="defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f" Jul 02 16:59:44.072618 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.072571 2581 scope.go:117] "RemoveContainer" containerID="fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc" Jul 02 16:59:44.072839 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:59:44.072821 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc\": container with ID starting with fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc not found: ID does not exist" containerID="fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc" Jul 02 16:59:44.072890 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.072849 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc"} err="failed to get container status \"fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc\": rpc error: code = NotFound desc = could not find container \"fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc\": container with ID starting with fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc not found: ID does not exist" Jul 02 16:59:44.072890 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.072867 2581 scope.go:117] "RemoveContainer" containerID="46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7" Jul 02 16:59:44.073102 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:59:44.073085 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7\": container with ID starting with 46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7 not found: ID does not exist" containerID="46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7" Jul 02 16:59:44.073159 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.073108 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7"} err="failed to get container status \"46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7\": rpc error: code = NotFound desc = could not find container \"46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7\": container with ID starting with 46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7 not found: ID does not exist" Jul 02 16:59:44.073159 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.073125 2581 scope.go:117] "RemoveContainer" containerID="e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8" Jul 02 16:59:44.073354 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:59:44.073337 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8\": container with ID starting with e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8 not found: ID does not exist" containerID="e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8" Jul 02 16:59:44.073414 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.073364 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8"} err="failed to get container status \"e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8\": rpc error: code = NotFound desc = could not find container \"e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8\": container with ID starting with e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8 not found: ID does not exist" Jul 02 16:59:44.073414 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.073387 2581 scope.go:117] "RemoveContainer" containerID="fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24" Jul 02 16:59:44.073642 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:59:44.073625 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24\": container with ID starting with fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24 not found: ID does not exist" containerID="fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24" Jul 02 16:59:44.073686 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.073650 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24"} err="failed to get container status \"fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24\": rpc error: code = NotFound desc = could not find container \"fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24\": container with ID starting with fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24 not found: ID does not exist" Jul 02 16:59:44.073686 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.073667 2581 scope.go:117] "RemoveContainer" containerID="4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de" Jul 02 16:59:44.073886 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:59:44.073869 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de\": container with ID starting with 4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de not found: ID does not exist" containerID="4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de" Jul 02 16:59:44.073948 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.073892 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de"} err="failed to get container status \"4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de\": rpc error: code = NotFound desc = could not find container \"4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de\": container with ID starting with 4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de not found: ID does not exist" Jul 02 16:59:44.073948 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.073907 2581 scope.go:117] "RemoveContainer" containerID="b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb" Jul 02 16:59:44.074141 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:59:44.074126 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb\": container with ID starting with b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb not found: ID does not exist" containerID="b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb" Jul 02 16:59:44.074181 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.074144 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb"} err="failed to get container status \"b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb\": rpc error: code = NotFound desc = could not find container \"b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb\": container with ID starting with b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb not found: ID does not exist" Jul 02 16:59:44.074181 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.074155 2581 scope.go:117] "RemoveContainer" containerID="defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f" Jul 02 16:59:44.074373 ip-10-0-136-0 kubenswrapper[2581]: E0702 16:59:44.074356 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f\": container with ID starting with defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f not found: ID does not exist" containerID="defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f" Jul 02 16:59:44.074415 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.074378 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f"} err="failed to get container status \"defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f\": rpc error: code = NotFound desc = could not find container \"defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f\": container with ID starting with defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f not found: ID does not exist" Jul 02 16:59:44.074415 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.074392 2581 scope.go:117] "RemoveContainer" containerID="fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc" Jul 02 16:59:44.074635 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.074617 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc"} err="failed to get container status \"fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc\": rpc error: code = NotFound desc = could not find container \"fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc\": container with ID starting with fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc not found: ID does not exist" Jul 02 16:59:44.074682 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.074635 2581 scope.go:117] "RemoveContainer" containerID="46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7" Jul 02 16:59:44.074865 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.074849 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7"} err="failed to get container status \"46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7\": rpc error: code = NotFound desc = could not find container \"46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7\": container with ID starting with 46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7 not found: ID does not exist" Jul 02 16:59:44.074905 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.074866 2581 scope.go:117] "RemoveContainer" containerID="e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8" Jul 02 16:59:44.075069 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.075054 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8"} err="failed to get container status \"e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8\": rpc error: code = NotFound desc = could not find container \"e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8\": container with ID starting with e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8 not found: ID does not exist" Jul 02 16:59:44.075110 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.075070 2581 scope.go:117] "RemoveContainer" containerID="fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24" Jul 02 16:59:44.075244 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.075229 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24"} err="failed to get container status \"fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24\": rpc error: code = NotFound desc = could not find container \"fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24\": container with ID starting with fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24 not found: ID does not exist" Jul 02 16:59:44.075244 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.075244 2581 scope.go:117] "RemoveContainer" containerID="4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de" Jul 02 16:59:44.075411 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.075397 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de"} err="failed to get container status \"4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de\": rpc error: code = NotFound desc = could not find container \"4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de\": container with ID starting with 4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de not found: ID does not exist" Jul 02 16:59:44.075474 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.075412 2581 scope.go:117] "RemoveContainer" containerID="b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb" Jul 02 16:59:44.075621 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.075606 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb"} err="failed to get container status \"b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb\": rpc error: code = NotFound desc = could not find container \"b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb\": container with ID starting with b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb not found: ID does not exist" Jul 02 16:59:44.075621 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.075620 2581 scope.go:117] "RemoveContainer" containerID="defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f" Jul 02 16:59:44.075794 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.075777 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f"} err="failed to get container status \"defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f\": rpc error: code = NotFound desc = could not find container \"defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f\": container with ID starting with defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f not found: ID does not exist" Jul 02 16:59:44.075834 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.075794 2581 scope.go:117] "RemoveContainer" containerID="fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc" Jul 02 16:59:44.075970 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.075956 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc"} err="failed to get container status \"fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc\": rpc error: code = NotFound desc = could not find container \"fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc\": container with ID starting with fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc not found: ID does not exist" Jul 02 16:59:44.076008 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.075971 2581 scope.go:117] "RemoveContainer" containerID="46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7" Jul 02 16:59:44.076165 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.076147 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7"} err="failed to get container status \"46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7\": rpc error: code = NotFound desc = could not find container \"46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7\": container with ID starting with 46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7 not found: ID does not exist" Jul 02 16:59:44.076202 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.076167 2581 scope.go:117] "RemoveContainer" containerID="e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8" Jul 02 16:59:44.076407 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.076391 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8"} err="failed to get container status \"e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8\": rpc error: code = NotFound desc = could not find container \"e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8\": container with ID starting with e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8 not found: ID does not exist" Jul 02 16:59:44.076446 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.076408 2581 scope.go:117] "RemoveContainer" containerID="fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24" Jul 02 16:59:44.076621 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.076605 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24"} err="failed to get container status \"fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24\": rpc error: code = NotFound desc = could not find container \"fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24\": container with ID starting with fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24 not found: ID does not exist" Jul 02 16:59:44.076670 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.076620 2581 scope.go:117] "RemoveContainer" containerID="4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de" Jul 02 16:59:44.076834 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.076817 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de"} err="failed to get container status \"4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de\": rpc error: code = NotFound desc = could not find container \"4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de\": container with ID starting with 4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de not found: ID does not exist" Jul 02 16:59:44.076872 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.076835 2581 scope.go:117] "RemoveContainer" containerID="b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb" Jul 02 16:59:44.077025 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.077007 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb"} err="failed to get container status \"b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb\": rpc error: code = NotFound desc = could not find container \"b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb\": container with ID starting with b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb not found: ID does not exist" Jul 02 16:59:44.077063 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.077028 2581 scope.go:117] "RemoveContainer" containerID="defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f" Jul 02 16:59:44.077234 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.077218 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f"} err="failed to get container status \"defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f\": rpc error: code = NotFound desc = could not find container \"defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f\": container with ID starting with defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f not found: ID does not exist" Jul 02 16:59:44.077234 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.077232 2581 scope.go:117] "RemoveContainer" containerID="fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc" Jul 02 16:59:44.077416 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.077401 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc"} err="failed to get container status \"fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc\": rpc error: code = NotFound desc = could not find container \"fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc\": container with ID starting with fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc not found: ID does not exist" Jul 02 16:59:44.077477 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.077416 2581 scope.go:117] "RemoveContainer" containerID="46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7" Jul 02 16:59:44.077592 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.077579 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7"} err="failed to get container status \"46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7\": rpc error: code = NotFound desc = could not find container \"46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7\": container with ID starting with 46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7 not found: ID does not exist" Jul 02 16:59:44.077592 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.077591 2581 scope.go:117] "RemoveContainer" containerID="e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8" Jul 02 16:59:44.077801 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.077775 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8"} err="failed to get container status \"e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8\": rpc error: code = NotFound desc = could not find container \"e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8\": container with ID starting with e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8 not found: ID does not exist" Jul 02 16:59:44.077844 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.077801 2581 scope.go:117] "RemoveContainer" containerID="fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24" Jul 02 16:59:44.077981 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.077966 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24"} err="failed to get container status \"fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24\": rpc error: code = NotFound desc = could not find container \"fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24\": container with ID starting with fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24 not found: ID does not exist" Jul 02 16:59:44.078022 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.077980 2581 scope.go:117] "RemoveContainer" containerID="4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de" Jul 02 16:59:44.078148 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.078136 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de"} err="failed to get container status \"4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de\": rpc error: code = NotFound desc = could not find container \"4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de\": container with ID starting with 4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de not found: ID does not exist" Jul 02 16:59:44.078189 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.078148 2581 scope.go:117] "RemoveContainer" containerID="b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb" Jul 02 16:59:44.078283 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.078269 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb"} err="failed to get container status \"b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb\": rpc error: code = NotFound desc = could not find container \"b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb\": container with ID starting with b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb not found: ID does not exist" Jul 02 16:59:44.078326 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.078283 2581 scope.go:117] "RemoveContainer" containerID="defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f" Jul 02 16:59:44.078448 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.078429 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f"} err="failed to get container status \"defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f\": rpc error: code = NotFound desc = could not find container \"defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f\": container with ID starting with defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f not found: ID does not exist" Jul 02 16:59:44.078508 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.078449 2581 scope.go:117] "RemoveContainer" containerID="fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc" Jul 02 16:59:44.078648 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.078630 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc"} err="failed to get container status \"fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc\": rpc error: code = NotFound desc = could not find container \"fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc\": container with ID starting with fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc not found: ID does not exist" Jul 02 16:59:44.078690 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.078648 2581 scope.go:117] "RemoveContainer" containerID="46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7" Jul 02 16:59:44.078854 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.078838 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7"} err="failed to get container status \"46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7\": rpc error: code = NotFound desc = could not find container \"46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7\": container with ID starting with 46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7 not found: ID does not exist" Jul 02 16:59:44.078854 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.078852 2581 scope.go:117] "RemoveContainer" containerID="e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8" Jul 02 16:59:44.079034 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.079018 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8"} err="failed to get container status \"e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8\": rpc error: code = NotFound desc = could not find container \"e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8\": container with ID starting with e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8 not found: ID does not exist" Jul 02 16:59:44.079072 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.079032 2581 scope.go:117] "RemoveContainer" containerID="fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24" Jul 02 16:59:44.079241 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.079227 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24"} err="failed to get container status \"fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24\": rpc error: code = NotFound desc = could not find container \"fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24\": container with ID starting with fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24 not found: ID does not exist" Jul 02 16:59:44.079241 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.079240 2581 scope.go:117] "RemoveContainer" containerID="4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de" Jul 02 16:59:44.079425 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.079407 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de"} err="failed to get container status \"4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de\": rpc error: code = NotFound desc = could not find container \"4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de\": container with ID starting with 4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de not found: ID does not exist" Jul 02 16:59:44.079425 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.079424 2581 scope.go:117] "RemoveContainer" containerID="b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb" Jul 02 16:59:44.079679 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.079648 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb"} err="failed to get container status \"b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb\": rpc error: code = NotFound desc = could not find container \"b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb\": container with ID starting with b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb not found: ID does not exist" Jul 02 16:59:44.079749 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.079680 2581 scope.go:117] "RemoveContainer" containerID="defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f" Jul 02 16:59:44.080028 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.080007 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f"} err="failed to get container status \"defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f\": rpc error: code = NotFound desc = could not find container \"defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f\": container with ID starting with defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f not found: ID does not exist" Jul 02 16:59:44.080028 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.080027 2581 scope.go:117] "RemoveContainer" containerID="fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc" Jul 02 16:59:44.080322 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.080301 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc"} err="failed to get container status \"fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc\": rpc error: code = NotFound desc = could not find container \"fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc\": container with ID starting with fad8c44c67839e37c22de3fdd89bef98a9a3711a28e84a80503bd2542cd5aabc not found: ID does not exist" Jul 02 16:59:44.080416 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.080323 2581 scope.go:117] "RemoveContainer" containerID="46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7" Jul 02 16:59:44.080646 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.080626 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7"} err="failed to get container status \"46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7\": rpc error: code = NotFound desc = could not find container \"46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7\": container with ID starting with 46aafec3502774949f0b55311699d7eff8297b6fe5cd2cba6b6dca9b3989eeb7 not found: ID does not exist" Jul 02 16:59:44.080646 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.080646 2581 scope.go:117] "RemoveContainer" containerID="e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8" Jul 02 16:59:44.080953 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.080931 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8"} err="failed to get container status \"e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8\": rpc error: code = NotFound desc = could not find container \"e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8\": container with ID starting with e2ac09f37601686c10af719cec2fd093dd9b7083a2a5e0f89e5902fd2d7b08d8 not found: ID does not exist" Jul 02 16:59:44.081009 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.080956 2581 scope.go:117] "RemoveContainer" containerID="fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24" Jul 02 16:59:44.081187 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081156 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24"} err="failed to get container status \"fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24\": rpc error: code = NotFound desc = could not find container \"fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24\": container with ID starting with fda29bbfbaed3cf596fb9ca7ccdb79e3c546f795fb6d3ae0e8e570a46266ac24 not found: ID does not exist" Jul 02 16:59:44.081187 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081177 2581 scope.go:117] "RemoveContainer" containerID="4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de" Jul 02 16:59:44.081394 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081379 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de"} err="failed to get container status \"4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de\": rpc error: code = NotFound desc = could not find container \"4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de\": container with ID starting with 4c8040d2278ed1fa5924f4fe33d954a2af6de5856031d5f307d608e03a15a4de not found: ID does not exist" Jul 02 16:59:44.081534 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081395 2581 scope.go:117] "RemoveContainer" containerID="b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb" Jul 02 16:59:44.081534 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081508 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 16:59:44.081770 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081738 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb"} err="failed to get container status \"b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb\": rpc error: code = NotFound desc = could not find container \"b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb\": container with ID starting with b63e7054b99cd31fd430b441d1ae7164240ee36ffb238b5e905f630a0bc99efb not found: ID does not exist" Jul 02 16:59:44.081828 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081771 2581 scope.go:117] "RemoveContainer" containerID="defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f" Jul 02 16:59:44.081828 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081792 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="prometheus" Jul 02 16:59:44.081828 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081806 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="prometheus" Jul 02 16:59:44.081828 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081818 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="kube-rbac-proxy" Jul 02 16:59:44.081828 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081828 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="kube-rbac-proxy" Jul 02 16:59:44.082011 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081839 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="kube-rbac-proxy-web" Jul 02 16:59:44.082011 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081845 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="kube-rbac-proxy-web" Jul 02 16:59:44.082011 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081853 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="thanos-sidecar" Jul 02 16:59:44.082011 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081858 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="thanos-sidecar" Jul 02 16:59:44.082011 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081871 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d74d99f-8d97-4c96-839a-40de15d37b41" containerName="console" Jul 02 16:59:44.082011 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081878 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d74d99f-8d97-4c96-839a-40de15d37b41" containerName="console" Jul 02 16:59:44.082011 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081888 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="init-config-reloader" Jul 02 16:59:44.082011 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081893 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="init-config-reloader" Jul 02 16:59:44.082011 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081907 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="config-reloader" Jul 02 16:59:44.082011 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081914 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="config-reloader" Jul 02 16:59:44.082011 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081925 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="kube-rbac-proxy-thanos" Jul 02 16:59:44.082011 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081933 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="kube-rbac-proxy-thanos" Jul 02 16:59:44.082011 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081941 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="112a1016-2ffc-4406-b0e9-fcce10061fc0" containerName="console" Jul 02 16:59:44.082011 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081947 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="112a1016-2ffc-4406-b0e9-fcce10061fc0" containerName="console" Jul 02 16:59:44.082011 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.081978 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f"} err="failed to get container status \"defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f\": rpc error: code = NotFound desc = could not find container \"defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f\": container with ID starting with defe2aefab310e73d65304ff9bb3893064ead48083bd436549f62c5e1e66532f not found: ID does not exist" Jul 02 16:59:44.082011 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.082003 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d74d99f-8d97-4c96-839a-40de15d37b41" containerName="console" Jul 02 16:59:44.082011 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.082014 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="thanos-sidecar" Jul 02 16:59:44.082011 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.082020 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="kube-rbac-proxy-web" Jul 02 16:59:44.082538 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.082026 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="kube-rbac-proxy" Jul 02 16:59:44.082538 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.082031 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="kube-rbac-proxy-thanos" Jul 02 16:59:44.082538 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.082036 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="112a1016-2ffc-4406-b0e9-fcce10061fc0" containerName="console" Jul 02 16:59:44.082538 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.082044 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="config-reloader" Jul 02 16:59:44.082538 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.082054 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" containerName="prometheus" Jul 02 16:59:44.085871 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.085857 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.088567 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.088548 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 16:59:44.088871 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.088852 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 16:59:44.088972 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.088894 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 16:59:44.089088 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.089071 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 16:59:44.089167 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.089109 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 16:59:44.089167 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.089123 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 16:59:44.089167 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.089151 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-s6pqz\"" Jul 02 16:59:44.089340 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.089075 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1a4h71fg0h15j\"" Jul 02 16:59:44.089340 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.089071 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 16:59:44.089340 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.089196 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 16:59:44.089536 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.089347 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 16:59:44.089536 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.089416 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 16:59:44.089536 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.089499 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 16:59:44.089536 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.089512 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 16:59:44.092105 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.092085 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 16:59:44.096357 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.096340 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 16:59:44.103822 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.103797 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 16:59:44.200217 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.200185 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa54d365-bb74-4e2b-8886-ee3888816de9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.200310 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.200235 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa54d365-bb74-4e2b-8886-ee3888816de9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.200310 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.200289 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.200378 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.200323 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.200414 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.200374 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa54d365-bb74-4e2b-8886-ee3888816de9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.200414 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.200399 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.200496 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.200418 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-config\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.200496 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.200434 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.200496 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.200471 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa54d365-bb74-4e2b-8886-ee3888816de9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.200588 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.200508 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-web-config\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.200588 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.200528 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa54d365-bb74-4e2b-8886-ee3888816de9-config-out\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.200588 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.200543 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.200588 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.200576 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9glsp\" (UniqueName: \"kubernetes.io/projected/fa54d365-bb74-4e2b-8886-ee3888816de9-kube-api-access-9glsp\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.200705 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.200601 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.200705 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.200620 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fa54d365-bb74-4e2b-8886-ee3888816de9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.200705 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.200651 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fa54d365-bb74-4e2b-8886-ee3888816de9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.200705 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.200681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa54d365-bb74-4e2b-8886-ee3888816de9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.200705 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.200699 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa54d365-bb74-4e2b-8886-ee3888816de9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.200886 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.200718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.200886 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.200741 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa54d365-bb74-4e2b-8886-ee3888816de9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.301317 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.301256 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.301317 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.301282 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa54d365-bb74-4e2b-8886-ee3888816de9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.301317 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.301300 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-web-config\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.301317 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.301318 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa54d365-bb74-4e2b-8886-ee3888816de9-config-out\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.301592 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.301336 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.301592 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.301354 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9glsp\" (UniqueName: \"kubernetes.io/projected/fa54d365-bb74-4e2b-8886-ee3888816de9-kube-api-access-9glsp\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.301592 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.301377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.301592 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.301401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fa54d365-bb74-4e2b-8886-ee3888816de9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.301592 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.301424 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fa54d365-bb74-4e2b-8886-ee3888816de9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.301592 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.301475 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa54d365-bb74-4e2b-8886-ee3888816de9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.301592 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.301500 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa54d365-bb74-4e2b-8886-ee3888816de9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.301592 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.301524 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.301592 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.301555 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa54d365-bb74-4e2b-8886-ee3888816de9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.301592 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.301593 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa54d365-bb74-4e2b-8886-ee3888816de9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.302074 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.301627 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa54d365-bb74-4e2b-8886-ee3888816de9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.302074 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.301665 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.302074 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.301688 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.302074 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.301720 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa54d365-bb74-4e2b-8886-ee3888816de9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.302074 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.301753 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.302074 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.301777 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-config\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.302361 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.302110 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa54d365-bb74-4e2b-8886-ee3888816de9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.302361 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.302134 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa54d365-bb74-4e2b-8886-ee3888816de9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.302833 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.302629 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fa54d365-bb74-4e2b-8886-ee3888816de9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.302833 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.302702 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fa54d365-bb74-4e2b-8886-ee3888816de9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.303446 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.303423 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa54d365-bb74-4e2b-8886-ee3888816de9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.304299 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.304275 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa54d365-bb74-4e2b-8886-ee3888816de9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.304413 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.304391 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-config\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.304502 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.304428 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-web-config\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.304588 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.304355 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa54d365-bb74-4e2b-8886-ee3888816de9-config-out\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.304685 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.304632 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.304767 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.304677 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.305870 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.305837 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.307893 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.306654 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.307893 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.306902 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.307893 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.306914 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa54d365-bb74-4e2b-8886-ee3888816de9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.307893 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.307168 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.310531 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.308281 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa54d365-bb74-4e2b-8886-ee3888816de9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.310531 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.308449 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa54d365-bb74-4e2b-8886-ee3888816de9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.310531 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.308513 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa54d365-bb74-4e2b-8886-ee3888816de9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.311626 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.311289 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9glsp\" (UniqueName: \"kubernetes.io/projected/fa54d365-bb74-4e2b-8886-ee3888816de9-kube-api-access-9glsp\") pod \"prometheus-k8s-0\" (UID: \"fa54d365-bb74-4e2b-8886-ee3888816de9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.395261 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.395206 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:44.527547 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:44.527514 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 16:59:44.530789 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:59:44.530752 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa54d365_bb74_4e2b_8886_ee3888816de9.slice/crio-d1cd02adfa850b88234674d12383376f32de77a844e45f3e40931bd262c7aff3 WatchSource:0}: Error finding container d1cd02adfa850b88234674d12383376f32de77a844e45f3e40931bd262c7aff3: Status 404 returned error can't find the container with id d1cd02adfa850b88234674d12383376f32de77a844e45f3e40931bd262c7aff3 Jul 02 16:59:45.028600 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:45.028567 2581 generic.go:356] "Generic (PLEG): container finished" podID="fa54d365-bb74-4e2b-8886-ee3888816de9" containerID="bf59fbab528dafa7df7f0665636718fdabebf66b73e3cfbdb8b871e21ba788f9" exitCode=0 Jul 02 16:59:45.028719 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:45.028660 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa54d365-bb74-4e2b-8886-ee3888816de9","Type":"ContainerDied","Data":"bf59fbab528dafa7df7f0665636718fdabebf66b73e3cfbdb8b871e21ba788f9"} Jul 02 16:59:45.028767 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:45.028728 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa54d365-bb74-4e2b-8886-ee3888816de9","Type":"ContainerStarted","Data":"d1cd02adfa850b88234674d12383376f32de77a844e45f3e40931bd262c7aff3"} Jul 02 16:59:45.246212 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:45.246184 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caae0fb0-76c7-4763-ba54-f133eee22bdb" path="/var/lib/kubelet/pods/caae0fb0-76c7-4763-ba54-f133eee22bdb/volumes" Jul 02 16:59:46.038419 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:46.038381 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa54d365-bb74-4e2b-8886-ee3888816de9","Type":"ContainerStarted","Data":"e18075d17e523833e16b37817fe57afc55c05f1913b0cc54ba9d1edc198563bd"} Jul 02 16:59:46.038809 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:46.038477 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa54d365-bb74-4e2b-8886-ee3888816de9","Type":"ContainerStarted","Data":"d8993225e2f665ee2931bf5f9bef414a72a30cea73402db4bc97bd5200cab7ab"} Jul 02 16:59:46.038809 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:46.038505 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa54d365-bb74-4e2b-8886-ee3888816de9","Type":"ContainerStarted","Data":"2d1d251c4e13cf94acc77561f931a204c6e08e654dac1cfbd36b0dd5507c3dd7"} Jul 02 16:59:46.038809 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:46.038530 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa54d365-bb74-4e2b-8886-ee3888816de9","Type":"ContainerStarted","Data":"4e83600601e9d5a1a2860dc105a2cf25e0f0bc6b0535eb3eca4dc223006cbde2"} Jul 02 16:59:46.038809 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:46.038554 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa54d365-bb74-4e2b-8886-ee3888816de9","Type":"ContainerStarted","Data":"49fb049375d104b98827e7360dc11c3f24be97da85af7dafa556233c41f99f7b"} Jul 02 16:59:46.038809 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:46.038580 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa54d365-bb74-4e2b-8886-ee3888816de9","Type":"ContainerStarted","Data":"338d12ad20dd48fa9f00f4b8119acc178325dd7c0d64c304d7ec0de6ee9c267b"} Jul 02 16:59:46.067374 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:46.067318 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.045998835 podStartE2EDuration="2.067294996s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.296161ms" isStatefulPod=false podCreationTimestamp="2026-07-02 16:59:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:59:46.066104548 +0000 UTC m=+165.256405781" watchObservedRunningTime="2026-07-02 16:59:46.067294996 +0000 UTC m=+165.257596156" Jul 02 16:59:47.165275 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.165243 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55bf7bdbf4-d859q"] Jul 02 16:59:47.167400 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.167383 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.184672 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.184647 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55bf7bdbf4-d859q"] Jul 02 16:59:47.226578 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.226553 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-service-ca\") pod \"console-55bf7bdbf4-d859q\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.226705 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.226582 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/540114d4-3c02-4b39-a8be-fef13e07d65b-console-oauth-config\") pod \"console-55bf7bdbf4-d859q\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.226705 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.226599 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-oauth-serving-cert\") pod \"console-55bf7bdbf4-d859q\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.226705 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.226643 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-trusted-ca-bundle\") pod \"console-55bf7bdbf4-d859q\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.226705 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.226691 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6sw9\" (UniqueName: \"kubernetes.io/projected/540114d4-3c02-4b39-a8be-fef13e07d65b-kube-api-access-t6sw9\") pod \"console-55bf7bdbf4-d859q\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.226855 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.226744 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-console-config\") pod \"console-55bf7bdbf4-d859q\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.226855 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.226772 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/540114d4-3c02-4b39-a8be-fef13e07d65b-console-serving-cert\") pod \"console-55bf7bdbf4-d859q\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.327537 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.327509 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6sw9\" (UniqueName: \"kubernetes.io/projected/540114d4-3c02-4b39-a8be-fef13e07d65b-kube-api-access-t6sw9\") pod \"console-55bf7bdbf4-d859q\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.327653 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.327551 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-console-config\") pod \"console-55bf7bdbf4-d859q\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.327653 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.327569 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/540114d4-3c02-4b39-a8be-fef13e07d65b-console-serving-cert\") pod \"console-55bf7bdbf4-d859q\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.327653 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.327591 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-service-ca\") pod \"console-55bf7bdbf4-d859q\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.327807 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.327699 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/540114d4-3c02-4b39-a8be-fef13e07d65b-console-oauth-config\") pod \"console-55bf7bdbf4-d859q\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.327807 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.327729 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-oauth-serving-cert\") pod \"console-55bf7bdbf4-d859q\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.327807 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.327760 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-trusted-ca-bundle\") pod \"console-55bf7bdbf4-d859q\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.328295 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.328267 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-console-config\") pod \"console-55bf7bdbf4-d859q\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.328295 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.328277 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-service-ca\") pod \"console-55bf7bdbf4-d859q\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.328501 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.328481 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-oauth-serving-cert\") pod \"console-55bf7bdbf4-d859q\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.328780 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.328756 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-trusted-ca-bundle\") pod \"console-55bf7bdbf4-d859q\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.330093 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.330062 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/540114d4-3c02-4b39-a8be-fef13e07d65b-console-serving-cert\") pod \"console-55bf7bdbf4-d859q\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.330191 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.330149 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/540114d4-3c02-4b39-a8be-fef13e07d65b-console-oauth-config\") pod \"console-55bf7bdbf4-d859q\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.335290 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.335268 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6sw9\" (UniqueName: \"kubernetes.io/projected/540114d4-3c02-4b39-a8be-fef13e07d65b-kube-api-access-t6sw9\") pod \"console-55bf7bdbf4-d859q\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.476749 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.476682 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:47.598442 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:47.598419 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55bf7bdbf4-d859q"] Jul 02 16:59:47.600968 ip-10-0-136-0 kubenswrapper[2581]: W0702 16:59:47.600942 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod540114d4_3c02_4b39_a8be_fef13e07d65b.slice/crio-89090100c487459c147dda0a6d23e9952782837e5451ae64db82d3a9c0585e7d WatchSource:0}: Error finding container 89090100c487459c147dda0a6d23e9952782837e5451ae64db82d3a9c0585e7d: Status 404 returned error can't find the container with id 89090100c487459c147dda0a6d23e9952782837e5451ae64db82d3a9c0585e7d Jul 02 16:59:48.049880 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:48.049839 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55bf7bdbf4-d859q" event={"ID":"540114d4-3c02-4b39-a8be-fef13e07d65b","Type":"ContainerStarted","Data":"59f694e0c16040345f3161994f979c0d6a01f02a6e60550147f7a8ce2393918a"} Jul 02 16:59:48.050046 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:48.049899 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55bf7bdbf4-d859q" event={"ID":"540114d4-3c02-4b39-a8be-fef13e07d65b","Type":"ContainerStarted","Data":"89090100c487459c147dda0a6d23e9952782837e5451ae64db82d3a9c0585e7d"} Jul 02 16:59:48.066978 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:48.066928 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55bf7bdbf4-d859q" podStartSLOduration=1.06690755 podStartE2EDuration="1.06690755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:59:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:59:48.065327004 +0000 UTC m=+167.255628167" watchObservedRunningTime="2026-07-02 16:59:48.06690755 +0000 UTC m=+167.257208708" Jul 02 16:59:49.395615 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:49.395579 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:57.477837 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:57.477757 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:57.477837 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:57.477819 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:57.482299 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:57.482276 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:58.096930 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:58.096900 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 16:59:58.144693 ip-10-0-136-0 kubenswrapper[2581]: I0702 16:59:58.144660 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-884d55fb9-fv4r6"] Jul 02 17:00:23.171349 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.171286 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-884d55fb9-fv4r6" podUID="1dfd6547-f5ec-4c70-91c4-0658b1644f65" containerName="console" containerID="cri-o://96c8f86d06a0d7fe1831e555d2c423dbc831042c5f42d0bb3450e8d56ad2cecb" gracePeriod=15 Jul 02 17:00:23.404682 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.404653 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 17:00:23.488916 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.488892 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dfd6547-f5ec-4c70-91c4-0658b1644f65-console-serving-cert\") pod \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " Jul 02 17:00:23.489039 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.488927 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-trusted-ca-bundle\") pod \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " Jul 02 17:00:23.489039 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.488960 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-console-config\") pod \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " Jul 02 17:00:23.489039 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.489000 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dfd6547-f5ec-4c70-91c4-0658b1644f65-console-oauth-config\") pod \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " Jul 02 17:00:23.489039 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.489028 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-service-ca\") pod \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " Jul 02 17:00:23.489231 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.489059 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-oauth-serving-cert\") pod \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " Jul 02 17:00:23.489231 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.489102 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghnr4\" (UniqueName: \"kubernetes.io/projected/1dfd6547-f5ec-4c70-91c4-0658b1644f65-kube-api-access-ghnr4\") pod \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\" (UID: \"1dfd6547-f5ec-4c70-91c4-0658b1644f65\") " Jul 02 17:00:23.489494 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.489429 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1dfd6547-f5ec-4c70-91c4-0658b1644f65" (UID: "1dfd6547-f5ec-4c70-91c4-0658b1644f65"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:00:23.489494 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.489435 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-service-ca" (OuterVolumeSpecName: "service-ca") pod "1dfd6547-f5ec-4c70-91c4-0658b1644f65" (UID: "1dfd6547-f5ec-4c70-91c4-0658b1644f65"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:00:23.489494 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.489486 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-console-config" (OuterVolumeSpecName: "console-config") pod "1dfd6547-f5ec-4c70-91c4-0658b1644f65" (UID: "1dfd6547-f5ec-4c70-91c4-0658b1644f65"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:00:23.489701 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.489570 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1dfd6547-f5ec-4c70-91c4-0658b1644f65" (UID: "1dfd6547-f5ec-4c70-91c4-0658b1644f65"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:00:23.491014 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.490994 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dfd6547-f5ec-4c70-91c4-0658b1644f65-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1dfd6547-f5ec-4c70-91c4-0658b1644f65" (UID: "1dfd6547-f5ec-4c70-91c4-0658b1644f65"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:00:23.491145 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.491126 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dfd6547-f5ec-4c70-91c4-0658b1644f65-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1dfd6547-f5ec-4c70-91c4-0658b1644f65" (UID: "1dfd6547-f5ec-4c70-91c4-0658b1644f65"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:00:23.491225 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.491202 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dfd6547-f5ec-4c70-91c4-0658b1644f65-kube-api-access-ghnr4" (OuterVolumeSpecName: "kube-api-access-ghnr4") pod "1dfd6547-f5ec-4c70-91c4-0658b1644f65" (UID: "1dfd6547-f5ec-4c70-91c4-0658b1644f65"). InnerVolumeSpecName "kube-api-access-ghnr4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:00:23.590232 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.590208 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dfd6547-f5ec-4c70-91c4-0658b1644f65-console-serving-cert\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:00:23.590232 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.590230 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-trusted-ca-bundle\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:00:23.590350 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.590240 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-console-config\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:00:23.590350 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.590249 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dfd6547-f5ec-4c70-91c4-0658b1644f65-console-oauth-config\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:00:23.590350 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.590257 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-service-ca\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:00:23.590350 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.590266 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dfd6547-f5ec-4c70-91c4-0658b1644f65-oauth-serving-cert\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:00:23.590350 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:23.590275 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghnr4\" (UniqueName: \"kubernetes.io/projected/1dfd6547-f5ec-4c70-91c4-0658b1644f65-kube-api-access-ghnr4\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:00:24.191784 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:24.191749 2581 generic.go:356] "Generic (PLEG): container finished" podID="1dfd6547-f5ec-4c70-91c4-0658b1644f65" containerID="96c8f86d06a0d7fe1831e555d2c423dbc831042c5f42d0bb3450e8d56ad2cecb" exitCode=0 Jul 02 17:00:24.192224 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:24.191797 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-884d55fb9-fv4r6" Jul 02 17:00:24.192224 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:24.191836 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-884d55fb9-fv4r6" event={"ID":"1dfd6547-f5ec-4c70-91c4-0658b1644f65","Type":"ContainerDied","Data":"96c8f86d06a0d7fe1831e555d2c423dbc831042c5f42d0bb3450e8d56ad2cecb"} Jul 02 17:00:24.192224 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:24.191903 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-884d55fb9-fv4r6" event={"ID":"1dfd6547-f5ec-4c70-91c4-0658b1644f65","Type":"ContainerDied","Data":"5c13b311823d153779be301b9495912927c9897b4ac9f78a1cbad30d47b94a50"} Jul 02 17:00:24.192224 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:24.191933 2581 scope.go:117] "RemoveContainer" containerID="96c8f86d06a0d7fe1831e555d2c423dbc831042c5f42d0bb3450e8d56ad2cecb" Jul 02 17:00:24.200322 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:24.200307 2581 scope.go:117] "RemoveContainer" containerID="96c8f86d06a0d7fe1831e555d2c423dbc831042c5f42d0bb3450e8d56ad2cecb" Jul 02 17:00:24.200601 ip-10-0-136-0 kubenswrapper[2581]: E0702 17:00:24.200583 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96c8f86d06a0d7fe1831e555d2c423dbc831042c5f42d0bb3450e8d56ad2cecb\": container with ID starting with 96c8f86d06a0d7fe1831e555d2c423dbc831042c5f42d0bb3450e8d56ad2cecb not found: ID does not exist" containerID="96c8f86d06a0d7fe1831e555d2c423dbc831042c5f42d0bb3450e8d56ad2cecb" Jul 02 17:00:24.200650 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:24.200609 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96c8f86d06a0d7fe1831e555d2c423dbc831042c5f42d0bb3450e8d56ad2cecb"} err="failed to get container status \"96c8f86d06a0d7fe1831e555d2c423dbc831042c5f42d0bb3450e8d56ad2cecb\": rpc error: code = NotFound desc = could not find container \"96c8f86d06a0d7fe1831e555d2c423dbc831042c5f42d0bb3450e8d56ad2cecb\": container with ID starting with 96c8f86d06a0d7fe1831e555d2c423dbc831042c5f42d0bb3450e8d56ad2cecb not found: ID does not exist" Jul 02 17:00:24.213060 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:24.213035 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-884d55fb9-fv4r6"] Jul 02 17:00:24.218932 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:24.218910 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-884d55fb9-fv4r6"] Jul 02 17:00:25.243181 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:25.243145 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dfd6547-f5ec-4c70-91c4-0658b1644f65" path="/var/lib/kubelet/pods/1dfd6547-f5ec-4c70-91c4-0658b1644f65/volumes" Jul 02 17:00:44.396182 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:44.396149 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:44.411281 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:44.411256 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:45.284102 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:45.284075 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:57.260744 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.260711 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86485665d6-djxp5"] Jul 02 17:00:57.261215 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.260993 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dfd6547-f5ec-4c70-91c4-0658b1644f65" containerName="console" Jul 02 17:00:57.261215 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.261006 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dfd6547-f5ec-4c70-91c4-0658b1644f65" containerName="console" Jul 02 17:00:57.261215 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.261064 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dfd6547-f5ec-4c70-91c4-0658b1644f65" containerName="console" Jul 02 17:00:57.263608 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.263592 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.283785 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.283762 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86485665d6-djxp5"] Jul 02 17:00:57.329016 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.328985 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-service-ca\") pod \"console-86485665d6-djxp5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.329156 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.329021 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-console-oauth-config\") pod \"console-86485665d6-djxp5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.329156 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.329043 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-oauth-serving-cert\") pod \"console-86485665d6-djxp5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.329156 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.329128 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-trusted-ca-bundle\") pod \"console-86485665d6-djxp5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.329156 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.329154 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-console-serving-cert\") pod \"console-86485665d6-djxp5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.329366 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.329189 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-console-config\") pod \"console-86485665d6-djxp5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.329366 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.329256 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfp8w\" (UniqueName: \"kubernetes.io/projected/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-kube-api-access-dfp8w\") pod \"console-86485665d6-djxp5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.430413 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.430383 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-console-config\") pod \"console-86485665d6-djxp5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.430556 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.430432 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfp8w\" (UniqueName: \"kubernetes.io/projected/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-kube-api-access-dfp8w\") pod \"console-86485665d6-djxp5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.430556 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.430497 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-service-ca\") pod \"console-86485665d6-djxp5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.430556 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.430530 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-console-oauth-config\") pod \"console-86485665d6-djxp5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.430734 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.430554 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-oauth-serving-cert\") pod \"console-86485665d6-djxp5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.430734 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.430595 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-trusted-ca-bundle\") pod \"console-86485665d6-djxp5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.430734 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.430623 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-console-serving-cert\") pod \"console-86485665d6-djxp5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.431139 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.431110 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-console-config\") pod \"console-86485665d6-djxp5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.431265 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.431208 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-oauth-serving-cert\") pod \"console-86485665d6-djxp5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.431377 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.431353 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-service-ca\") pod \"console-86485665d6-djxp5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.431428 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.431408 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-trusted-ca-bundle\") pod \"console-86485665d6-djxp5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.432997 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.432976 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-console-oauth-config\") pod \"console-86485665d6-djxp5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.433125 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.433059 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-console-serving-cert\") pod \"console-86485665d6-djxp5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.437860 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.437839 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfp8w\" (UniqueName: \"kubernetes.io/projected/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-kube-api-access-dfp8w\") pod \"console-86485665d6-djxp5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.572939 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.572884 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:00:57.699203 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:57.699174 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86485665d6-djxp5"] Jul 02 17:00:57.702146 ip-10-0-136-0 kubenswrapper[2581]: W0702 17:00:57.702119 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda006c4bc_d58c_4759_b429_d2ae9a2ce8c5.slice/crio-30fcbbbf7b1fde67bacb76f57d1ccb47ad580a505f143505e4ee42268024c3d2 WatchSource:0}: Error finding container 30fcbbbf7b1fde67bacb76f57d1ccb47ad580a505f143505e4ee42268024c3d2: Status 404 returned error can't find the container with id 30fcbbbf7b1fde67bacb76f57d1ccb47ad580a505f143505e4ee42268024c3d2 Jul 02 17:00:58.319041 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:58.319007 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86485665d6-djxp5" event={"ID":"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5","Type":"ContainerStarted","Data":"7e571e2597c4bfcf8caa86bcab04746e80d1b1bfe5d23df945c4a7221a72730a"} Jul 02 17:00:58.319390 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:58.319054 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86485665d6-djxp5" event={"ID":"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5","Type":"ContainerStarted","Data":"30fcbbbf7b1fde67bacb76f57d1ccb47ad580a505f143505e4ee42268024c3d2"} Jul 02 17:00:58.338468 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:00:58.338421 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86485665d6-djxp5" podStartSLOduration=1.338404368 podStartE2EDuration="1.338404368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:00:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:00:58.336927943 +0000 UTC m=+237.527229100" watchObservedRunningTime="2026-07-02 17:00:58.338404368 +0000 UTC m=+237.528705527" Jul 02 17:01:07.574081 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:07.574045 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:01:07.574479 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:07.574105 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:01:07.578661 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:07.578638 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:01:08.357861 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:08.357834 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:01:08.412266 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:08.412239 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55bf7bdbf4-d859q"] Jul 02 17:01:33.432790 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.432675 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-55bf7bdbf4-d859q" podUID="540114d4-3c02-4b39-a8be-fef13e07d65b" containerName="console" containerID="cri-o://59f694e0c16040345f3161994f979c0d6a01f02a6e60550147f7a8ce2393918a" gracePeriod=15 Jul 02 17:01:33.665440 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.665415 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 17:01:33.782325 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.782298 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6sw9\" (UniqueName: \"kubernetes.io/projected/540114d4-3c02-4b39-a8be-fef13e07d65b-kube-api-access-t6sw9\") pod \"540114d4-3c02-4b39-a8be-fef13e07d65b\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " Jul 02 17:01:33.782483 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.782339 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/540114d4-3c02-4b39-a8be-fef13e07d65b-console-oauth-config\") pod \"540114d4-3c02-4b39-a8be-fef13e07d65b\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " Jul 02 17:01:33.782483 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.782356 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-trusted-ca-bundle\") pod \"540114d4-3c02-4b39-a8be-fef13e07d65b\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " Jul 02 17:01:33.782483 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.782389 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-service-ca\") pod \"540114d4-3c02-4b39-a8be-fef13e07d65b\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " Jul 02 17:01:33.782483 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.782428 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/540114d4-3c02-4b39-a8be-fef13e07d65b-console-serving-cert\") pod \"540114d4-3c02-4b39-a8be-fef13e07d65b\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " Jul 02 17:01:33.782483 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.782450 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-console-config\") pod \"540114d4-3c02-4b39-a8be-fef13e07d65b\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " Jul 02 17:01:33.782760 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.782495 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-oauth-serving-cert\") pod \"540114d4-3c02-4b39-a8be-fef13e07d65b\" (UID: \"540114d4-3c02-4b39-a8be-fef13e07d65b\") " Jul 02 17:01:33.782969 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.782942 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "540114d4-3c02-4b39-a8be-fef13e07d65b" (UID: "540114d4-3c02-4b39-a8be-fef13e07d65b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:01:33.783075 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.783033 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-console-config" (OuterVolumeSpecName: "console-config") pod "540114d4-3c02-4b39-a8be-fef13e07d65b" (UID: "540114d4-3c02-4b39-a8be-fef13e07d65b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:01:33.783075 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.783044 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "540114d4-3c02-4b39-a8be-fef13e07d65b" (UID: "540114d4-3c02-4b39-a8be-fef13e07d65b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:01:33.783075 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.783051 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-service-ca" (OuterVolumeSpecName: "service-ca") pod "540114d4-3c02-4b39-a8be-fef13e07d65b" (UID: "540114d4-3c02-4b39-a8be-fef13e07d65b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:01:33.784561 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.784536 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/540114d4-3c02-4b39-a8be-fef13e07d65b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "540114d4-3c02-4b39-a8be-fef13e07d65b" (UID: "540114d4-3c02-4b39-a8be-fef13e07d65b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:01:33.784659 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.784636 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/540114d4-3c02-4b39-a8be-fef13e07d65b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "540114d4-3c02-4b39-a8be-fef13e07d65b" (UID: "540114d4-3c02-4b39-a8be-fef13e07d65b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:01:33.784706 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.784650 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/540114d4-3c02-4b39-a8be-fef13e07d65b-kube-api-access-t6sw9" (OuterVolumeSpecName: "kube-api-access-t6sw9") pod "540114d4-3c02-4b39-a8be-fef13e07d65b" (UID: "540114d4-3c02-4b39-a8be-fef13e07d65b"). InnerVolumeSpecName "kube-api-access-t6sw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:01:33.883128 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.883110 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6sw9\" (UniqueName: \"kubernetes.io/projected/540114d4-3c02-4b39-a8be-fef13e07d65b-kube-api-access-t6sw9\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:01:33.883128 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.883129 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/540114d4-3c02-4b39-a8be-fef13e07d65b-console-oauth-config\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:01:33.883242 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.883140 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-trusted-ca-bundle\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:01:33.883242 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.883149 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-service-ca\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:01:33.883242 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.883157 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/540114d4-3c02-4b39-a8be-fef13e07d65b-console-serving-cert\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:01:33.883242 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.883165 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-console-config\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:01:33.883242 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:33.883173 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/540114d4-3c02-4b39-a8be-fef13e07d65b-oauth-serving-cert\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:01:34.453923 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:34.453890 2581 generic.go:356] "Generic (PLEG): container finished" podID="540114d4-3c02-4b39-a8be-fef13e07d65b" containerID="59f694e0c16040345f3161994f979c0d6a01f02a6e60550147f7a8ce2393918a" exitCode=0 Jul 02 17:01:34.454279 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:34.453932 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55bf7bdbf4-d859q" Jul 02 17:01:34.454279 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:34.453982 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55bf7bdbf4-d859q" event={"ID":"540114d4-3c02-4b39-a8be-fef13e07d65b","Type":"ContainerDied","Data":"59f694e0c16040345f3161994f979c0d6a01f02a6e60550147f7a8ce2393918a"} Jul 02 17:01:34.454279 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:34.454032 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55bf7bdbf4-d859q" event={"ID":"540114d4-3c02-4b39-a8be-fef13e07d65b","Type":"ContainerDied","Data":"89090100c487459c147dda0a6d23e9952782837e5451ae64db82d3a9c0585e7d"} Jul 02 17:01:34.454279 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:34.454053 2581 scope.go:117] "RemoveContainer" containerID="59f694e0c16040345f3161994f979c0d6a01f02a6e60550147f7a8ce2393918a" Jul 02 17:01:34.462327 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:34.462312 2581 scope.go:117] "RemoveContainer" containerID="59f694e0c16040345f3161994f979c0d6a01f02a6e60550147f7a8ce2393918a" Jul 02 17:01:34.462611 ip-10-0-136-0 kubenswrapper[2581]: E0702 17:01:34.462593 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59f694e0c16040345f3161994f979c0d6a01f02a6e60550147f7a8ce2393918a\": container with ID starting with 59f694e0c16040345f3161994f979c0d6a01f02a6e60550147f7a8ce2393918a not found: ID does not exist" containerID="59f694e0c16040345f3161994f979c0d6a01f02a6e60550147f7a8ce2393918a" Jul 02 17:01:34.462678 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:34.462623 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59f694e0c16040345f3161994f979c0d6a01f02a6e60550147f7a8ce2393918a"} err="failed to get container status \"59f694e0c16040345f3161994f979c0d6a01f02a6e60550147f7a8ce2393918a\": rpc error: code = NotFound desc = could not find container \"59f694e0c16040345f3161994f979c0d6a01f02a6e60550147f7a8ce2393918a\": container with ID starting with 59f694e0c16040345f3161994f979c0d6a01f02a6e60550147f7a8ce2393918a not found: ID does not exist" Jul 02 17:01:34.475314 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:34.475292 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55bf7bdbf4-d859q"] Jul 02 17:01:34.479056 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:34.479033 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55bf7bdbf4-d859q"] Jul 02 17:01:35.243529 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:01:35.243492 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="540114d4-3c02-4b39-a8be-fef13e07d65b" path="/var/lib/kubelet/pods/540114d4-3c02-4b39-a8be-fef13e07d65b/volumes" Jul 02 17:02:01.188186 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:02:01.188140 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lln24_1f9623eb-d52b-45dc-ae42-3fd20e210c7f/ovn-acl-logging/0.log" Jul 02 17:02:01.192106 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:02:01.192083 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 17:02:01.193721 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:02:01.193699 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lln24_1f9623eb-d52b-45dc-ae42-3fd20e210c7f/ovn-acl-logging/0.log" Jul 02 17:03:35.771617 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:35.771585 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd"] Jul 02 17:03:35.772082 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:35.771871 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="540114d4-3c02-4b39-a8be-fef13e07d65b" containerName="console" Jul 02 17:03:35.772082 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:35.771886 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="540114d4-3c02-4b39-a8be-fef13e07d65b" containerName="console" Jul 02 17:03:35.772082 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:35.771944 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="540114d4-3c02-4b39-a8be-fef13e07d65b" containerName="console" Jul 02 17:03:35.773978 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:35.773961 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" Jul 02 17:03:35.779201 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:35.779175 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 17:03:35.779339 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:35.779238 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tl59g\"" Jul 02 17:03:35.779482 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:35.779468 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 17:03:35.779533 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:35.779503 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 17:03:35.779608 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:35.779591 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 17:03:35.799757 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:35.799738 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd"] Jul 02 17:03:35.933134 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:35.933114 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9-webhook-cert\") pod \"opendatahub-operator-controller-manager-8b6c9f55f-lxqfd\" (UID: \"9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" Jul 02 17:03:35.933249 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:35.933143 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9-manifests\") pod \"opendatahub-operator-controller-manager-8b6c9f55f-lxqfd\" (UID: \"9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" Jul 02 17:03:35.933249 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:35.933164 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9-tmp\") pod \"opendatahub-operator-controller-manager-8b6c9f55f-lxqfd\" (UID: \"9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" Jul 02 17:03:35.933249 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:35.933217 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gq2g\" (UniqueName: \"kubernetes.io/projected/9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9-kube-api-access-8gq2g\") pod \"opendatahub-operator-controller-manager-8b6c9f55f-lxqfd\" (UID: \"9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" Jul 02 17:03:35.933434 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:35.933256 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8b6c9f55f-lxqfd\" (UID: \"9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" Jul 02 17:03:36.034112 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:36.034049 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9-tmp\") pod \"opendatahub-operator-controller-manager-8b6c9f55f-lxqfd\" (UID: \"9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" Jul 02 17:03:36.034214 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:36.034107 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gq2g\" (UniqueName: \"kubernetes.io/projected/9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9-kube-api-access-8gq2g\") pod \"opendatahub-operator-controller-manager-8b6c9f55f-lxqfd\" (UID: \"9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" Jul 02 17:03:36.034214 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:36.034152 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8b6c9f55f-lxqfd\" (UID: \"9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" Jul 02 17:03:36.034322 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:36.034216 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9-webhook-cert\") pod \"opendatahub-operator-controller-manager-8b6c9f55f-lxqfd\" (UID: \"9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" Jul 02 17:03:36.034322 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:36.034244 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9-manifests\") pod \"opendatahub-operator-controller-manager-8b6c9f55f-lxqfd\" (UID: \"9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" Jul 02 17:03:36.034607 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:36.034581 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9-manifests\") pod \"opendatahub-operator-controller-manager-8b6c9f55f-lxqfd\" (UID: \"9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" Jul 02 17:03:36.036465 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:36.036424 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9-tmp\") pod \"opendatahub-operator-controller-manager-8b6c9f55f-lxqfd\" (UID: \"9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" Jul 02 17:03:36.036545 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:36.036520 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8b6c9f55f-lxqfd\" (UID: \"9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" Jul 02 17:03:36.036545 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:36.036526 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9-webhook-cert\") pod \"opendatahub-operator-controller-manager-8b6c9f55f-lxqfd\" (UID: \"9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" Jul 02 17:03:36.048254 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:36.048232 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gq2g\" (UniqueName: \"kubernetes.io/projected/9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9-kube-api-access-8gq2g\") pod \"opendatahub-operator-controller-manager-8b6c9f55f-lxqfd\" (UID: \"9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" Jul 02 17:03:36.083784 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:36.083758 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" Jul 02 17:03:36.212891 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:36.212863 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd"] Jul 02 17:03:36.216517 ip-10-0-136-0 kubenswrapper[2581]: W0702 17:03:36.216487 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f0eb97f_865d_4ca0_b4e8_e61f97ecfcf9.slice/crio-46deb6bf17643fe6e514c93e3984647e3dfdec5e30ec25e09c3ff0daf796426a WatchSource:0}: Error finding container 46deb6bf17643fe6e514c93e3984647e3dfdec5e30ec25e09c3ff0daf796426a: Status 404 returned error can't find the container with id 46deb6bf17643fe6e514c93e3984647e3dfdec5e30ec25e09c3ff0daf796426a Jul 02 17:03:36.218327 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:36.218310 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 17:03:36.901572 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:36.901494 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" event={"ID":"9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9","Type":"ContainerStarted","Data":"46deb6bf17643fe6e514c93e3984647e3dfdec5e30ec25e09c3ff0daf796426a"} Jul 02 17:03:39.913910 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:39.913881 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" event={"ID":"9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9","Type":"ContainerStarted","Data":"3ea7e0dee9098a2208de51d2fe376a89480cf567c4724fd7d7bcb2e62701208c"} Jul 02 17:03:40.919589 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:40.919550 2581 generic.go:356] "Generic (PLEG): container finished" podID="9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9" containerID="3ea7e0dee9098a2208de51d2fe376a89480cf567c4724fd7d7bcb2e62701208c" exitCode=0 Jul 02 17:03:40.920014 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:40.919624 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" event={"ID":"9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9","Type":"ContainerDied","Data":"3ea7e0dee9098a2208de51d2fe376a89480cf567c4724fd7d7bcb2e62701208c"} Jul 02 17:03:41.926695 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:41.926654 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" event={"ID":"9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9","Type":"ContainerStarted","Data":"0b254a1257dd19a827facd39cd2fff8a29bc206b61339cc1802a0de46a7b7819"} Jul 02 17:03:41.927130 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:41.926787 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" Jul 02 17:03:41.951786 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:41.951738 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" podStartSLOduration=2.809506511 podStartE2EDuration="6.951697603s" totalImagesPullingTime="3.110699688s" totalInitContainerRuntime="1.031491404s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:03:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:03:41.950238833 +0000 UTC m=+401.140539992" watchObservedRunningTime="2026-07-02 17:03:41.951697603 +0000 UTC m=+401.141998761" Jul 02 17:03:52.932581 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:03:52.932552 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8b6c9f55f-lxqfd" Jul 02 17:04:02.326927 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.326896 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f677bc8d7-65486"] Jul 02 17:04:02.330516 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.330499 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f677bc8d7-65486" Jul 02 17:04:02.333301 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.333280 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 17:04:02.334136 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.334119 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8bdb2\"" Jul 02 17:04:02.334376 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.334352 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 17:04:02.334376 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.334363 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 17:04:02.334530 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.334377 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 17:04:02.334530 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.334384 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 17:04:02.342530 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.342510 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f677bc8d7-65486"] Jul 02 17:04:02.433723 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.433699 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c80aa4b9-55ad-4028-b5f3-3401562bbdfb-metrics-cert\") pod \"lws-controller-manager-6f677bc8d7-65486\" (UID: \"c80aa4b9-55ad-4028-b5f3-3401562bbdfb\") " pod="openshift-lws-operator/lws-controller-manager-6f677bc8d7-65486" Jul 02 17:04:02.433851 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.433748 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5pg5\" (UniqueName: \"kubernetes.io/projected/c80aa4b9-55ad-4028-b5f3-3401562bbdfb-kube-api-access-m5pg5\") pod \"lws-controller-manager-6f677bc8d7-65486\" (UID: \"c80aa4b9-55ad-4028-b5f3-3401562bbdfb\") " pod="openshift-lws-operator/lws-controller-manager-6f677bc8d7-65486" Jul 02 17:04:02.433851 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.433769 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c80aa4b9-55ad-4028-b5f3-3401562bbdfb-cert\") pod \"lws-controller-manager-6f677bc8d7-65486\" (UID: \"c80aa4b9-55ad-4028-b5f3-3401562bbdfb\") " pod="openshift-lws-operator/lws-controller-manager-6f677bc8d7-65486" Jul 02 17:04:02.433851 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.433835 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c80aa4b9-55ad-4028-b5f3-3401562bbdfb-manager-config\") pod \"lws-controller-manager-6f677bc8d7-65486\" (UID: \"c80aa4b9-55ad-4028-b5f3-3401562bbdfb\") " pod="openshift-lws-operator/lws-controller-manager-6f677bc8d7-65486" Jul 02 17:04:02.535056 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.535028 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c80aa4b9-55ad-4028-b5f3-3401562bbdfb-metrics-cert\") pod \"lws-controller-manager-6f677bc8d7-65486\" (UID: \"c80aa4b9-55ad-4028-b5f3-3401562bbdfb\") " pod="openshift-lws-operator/lws-controller-manager-6f677bc8d7-65486" Jul 02 17:04:02.535185 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.535065 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5pg5\" (UniqueName: \"kubernetes.io/projected/c80aa4b9-55ad-4028-b5f3-3401562bbdfb-kube-api-access-m5pg5\") pod \"lws-controller-manager-6f677bc8d7-65486\" (UID: \"c80aa4b9-55ad-4028-b5f3-3401562bbdfb\") " pod="openshift-lws-operator/lws-controller-manager-6f677bc8d7-65486" Jul 02 17:04:02.535185 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.535086 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c80aa4b9-55ad-4028-b5f3-3401562bbdfb-cert\") pod \"lws-controller-manager-6f677bc8d7-65486\" (UID: \"c80aa4b9-55ad-4028-b5f3-3401562bbdfb\") " pod="openshift-lws-operator/lws-controller-manager-6f677bc8d7-65486" Jul 02 17:04:02.535185 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.535107 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c80aa4b9-55ad-4028-b5f3-3401562bbdfb-manager-config\") pod \"lws-controller-manager-6f677bc8d7-65486\" (UID: \"c80aa4b9-55ad-4028-b5f3-3401562bbdfb\") " pod="openshift-lws-operator/lws-controller-manager-6f677bc8d7-65486" Jul 02 17:04:02.535745 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.535726 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c80aa4b9-55ad-4028-b5f3-3401562bbdfb-manager-config\") pod \"lws-controller-manager-6f677bc8d7-65486\" (UID: \"c80aa4b9-55ad-4028-b5f3-3401562bbdfb\") " pod="openshift-lws-operator/lws-controller-manager-6f677bc8d7-65486" Jul 02 17:04:02.537501 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.537481 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c80aa4b9-55ad-4028-b5f3-3401562bbdfb-cert\") pod \"lws-controller-manager-6f677bc8d7-65486\" (UID: \"c80aa4b9-55ad-4028-b5f3-3401562bbdfb\") " pod="openshift-lws-operator/lws-controller-manager-6f677bc8d7-65486" Jul 02 17:04:02.537588 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.537508 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c80aa4b9-55ad-4028-b5f3-3401562bbdfb-metrics-cert\") pod \"lws-controller-manager-6f677bc8d7-65486\" (UID: \"c80aa4b9-55ad-4028-b5f3-3401562bbdfb\") " pod="openshift-lws-operator/lws-controller-manager-6f677bc8d7-65486" Jul 02 17:04:02.549944 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.549923 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5pg5\" (UniqueName: \"kubernetes.io/projected/c80aa4b9-55ad-4028-b5f3-3401562bbdfb-kube-api-access-m5pg5\") pod \"lws-controller-manager-6f677bc8d7-65486\" (UID: \"c80aa4b9-55ad-4028-b5f3-3401562bbdfb\") " pod="openshift-lws-operator/lws-controller-manager-6f677bc8d7-65486" Jul 02 17:04:02.639205 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.639152 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f677bc8d7-65486" Jul 02 17:04:02.770511 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:02.770488 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f677bc8d7-65486"] Jul 02 17:04:02.772548 ip-10-0-136-0 kubenswrapper[2581]: W0702 17:04:02.772508 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc80aa4b9_55ad_4028_b5f3_3401562bbdfb.slice/crio-28bdf27e062c0a4256417c6ad4154d6509133a798699fc3b629dec530b0d9932 WatchSource:0}: Error finding container 28bdf27e062c0a4256417c6ad4154d6509133a798699fc3b629dec530b0d9932: Status 404 returned error can't find the container with id 28bdf27e062c0a4256417c6ad4154d6509133a798699fc3b629dec530b0d9932 Jul 02 17:04:03.009967 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.009939 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f677bc8d7-65486" event={"ID":"c80aa4b9-55ad-4028-b5f3-3401562bbdfb","Type":"ContainerStarted","Data":"28bdf27e062c0a4256417c6ad4154d6509133a798699fc3b629dec530b0d9932"} Jul 02 17:04:03.591660 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.591631 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn"] Jul 02 17:04:03.594922 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.594900 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.597761 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.597740 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-2vnnc\"" Jul 02 17:04:03.597849 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.597778 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 17:04:03.597849 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.597817 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 17:04:03.597947 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.597866 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 17:04:03.612727 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.612704 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn"] Jul 02 17:04:03.644064 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.644037 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/194bd771-1018-4159-a5f5-f003f0750d14-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.644167 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.644067 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqmpw\" (UniqueName: \"kubernetes.io/projected/194bd771-1018-4159-a5f5-f003f0750d14-kube-api-access-vqmpw\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.644167 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.644094 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/194bd771-1018-4159-a5f5-f003f0750d14-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.644167 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.644108 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/194bd771-1018-4159-a5f5-f003f0750d14-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.644297 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.644183 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/194bd771-1018-4159-a5f5-f003f0750d14-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.644297 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.644223 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/194bd771-1018-4159-a5f5-f003f0750d14-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.644297 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.644242 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/194bd771-1018-4159-a5f5-f003f0750d14-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.644297 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.644267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/194bd771-1018-4159-a5f5-f003f0750d14-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.644429 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.644328 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/194bd771-1018-4159-a5f5-f003f0750d14-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.745117 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.745092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/194bd771-1018-4159-a5f5-f003f0750d14-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.745217 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.745125 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/194bd771-1018-4159-a5f5-f003f0750d14-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.745217 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.745153 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/194bd771-1018-4159-a5f5-f003f0750d14-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.745217 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.745185 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/194bd771-1018-4159-a5f5-f003f0750d14-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.745375 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.745227 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/194bd771-1018-4159-a5f5-f003f0750d14-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.745375 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.745258 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqmpw\" (UniqueName: \"kubernetes.io/projected/194bd771-1018-4159-a5f5-f003f0750d14-kube-api-access-vqmpw\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.745375 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.745299 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/194bd771-1018-4159-a5f5-f003f0750d14-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.745375 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.745324 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/194bd771-1018-4159-a5f5-f003f0750d14-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.745609 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.745378 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/194bd771-1018-4159-a5f5-f003f0750d14-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.745609 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.745548 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/194bd771-1018-4159-a5f5-f003f0750d14-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.745820 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.745794 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/194bd771-1018-4159-a5f5-f003f0750d14-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.745892 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.745856 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/194bd771-1018-4159-a5f5-f003f0750d14-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.745954 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.745885 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/194bd771-1018-4159-a5f5-f003f0750d14-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.745954 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.745913 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/194bd771-1018-4159-a5f5-f003f0750d14-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.747576 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.747548 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/194bd771-1018-4159-a5f5-f003f0750d14-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.747576 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.747573 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/194bd771-1018-4159-a5f5-f003f0750d14-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.755859 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.755832 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqmpw\" (UniqueName: \"kubernetes.io/projected/194bd771-1018-4159-a5f5-f003f0750d14-kube-api-access-vqmpw\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.756601 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.756582 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/194bd771-1018-4159-a5f5-f003f0750d14-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6784p5pn\" (UID: \"194bd771-1018-4159-a5f5-f003f0750d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:03.904496 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:03.904438 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:04.125121 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:04.125089 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn"] Jul 02 17:04:04.139216 ip-10-0-136-0 kubenswrapper[2581]: W0702 17:04:04.139185 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod194bd771_1018_4159_a5f5_f003f0750d14.slice/crio-6d9f6f14eefcb72342e50b8b010f7fa4966c597c6ff35cfe2ba7116da3537bdd WatchSource:0}: Error finding container 6d9f6f14eefcb72342e50b8b010f7fa4966c597c6ff35cfe2ba7116da3537bdd: Status 404 returned error can't find the container with id 6d9f6f14eefcb72342e50b8b010f7fa4966c597c6ff35cfe2ba7116da3537bdd Jul 02 17:04:05.022273 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:05.022230 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" event={"ID":"194bd771-1018-4159-a5f5-f003f0750d14","Type":"ContainerStarted","Data":"6d9f6f14eefcb72342e50b8b010f7fa4966c597c6ff35cfe2ba7116da3537bdd"} Jul 02 17:04:06.518780 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.518748 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt"] Jul 02 17:04:06.524315 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.524286 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:06.530767 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.530744 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 02 17:04:06.530885 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.530810 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dj8lt\"" Jul 02 17:04:06.531447 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.531428 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 02 17:04:06.531764 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.531739 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 02 17:04:06.549332 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.549308 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt"] Jul 02 17:04:06.563176 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.563154 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7c6764f6-5ea4-4730-97dd-7d466d48ffd9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-fx6kt\" (UID: \"7c6764f6-5ea4-4730-97dd-7d466d48ffd9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:06.563283 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.563191 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c6764f6-5ea4-4730-97dd-7d466d48ffd9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-fx6kt\" (UID: \"7c6764f6-5ea4-4730-97dd-7d466d48ffd9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:06.563283 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.563223 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7c6764f6-5ea4-4730-97dd-7d466d48ffd9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-fx6kt\" (UID: \"7c6764f6-5ea4-4730-97dd-7d466d48ffd9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:06.563283 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.563274 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c6764f6-5ea4-4730-97dd-7d466d48ffd9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-fx6kt\" (UID: \"7c6764f6-5ea4-4730-97dd-7d466d48ffd9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:06.563417 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.563313 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7c6764f6-5ea4-4730-97dd-7d466d48ffd9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-fx6kt\" (UID: \"7c6764f6-5ea4-4730-97dd-7d466d48ffd9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:06.563503 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.563424 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkc5w\" (UniqueName: \"kubernetes.io/projected/7c6764f6-5ea4-4730-97dd-7d466d48ffd9-kube-api-access-zkc5w\") pod \"istiod-openshift-gateway-94bb8fbfd-fx6kt\" (UID: \"7c6764f6-5ea4-4730-97dd-7d466d48ffd9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:06.563503 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.563486 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7c6764f6-5ea4-4730-97dd-7d466d48ffd9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-fx6kt\" (UID: \"7c6764f6-5ea4-4730-97dd-7d466d48ffd9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:06.664647 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.664617 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7c6764f6-5ea4-4730-97dd-7d466d48ffd9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-fx6kt\" (UID: \"7c6764f6-5ea4-4730-97dd-7d466d48ffd9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:06.664773 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.664656 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c6764f6-5ea4-4730-97dd-7d466d48ffd9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-fx6kt\" (UID: \"7c6764f6-5ea4-4730-97dd-7d466d48ffd9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:06.664773 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.664685 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7c6764f6-5ea4-4730-97dd-7d466d48ffd9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-fx6kt\" (UID: \"7c6764f6-5ea4-4730-97dd-7d466d48ffd9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:06.664773 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.664719 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c6764f6-5ea4-4730-97dd-7d466d48ffd9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-fx6kt\" (UID: \"7c6764f6-5ea4-4730-97dd-7d466d48ffd9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:06.664773 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.664749 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7c6764f6-5ea4-4730-97dd-7d466d48ffd9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-fx6kt\" (UID: \"7c6764f6-5ea4-4730-97dd-7d466d48ffd9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:06.664983 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.664797 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkc5w\" (UniqueName: \"kubernetes.io/projected/7c6764f6-5ea4-4730-97dd-7d466d48ffd9-kube-api-access-zkc5w\") pod \"istiod-openshift-gateway-94bb8fbfd-fx6kt\" (UID: \"7c6764f6-5ea4-4730-97dd-7d466d48ffd9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:06.664983 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.664840 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7c6764f6-5ea4-4730-97dd-7d466d48ffd9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-fx6kt\" (UID: \"7c6764f6-5ea4-4730-97dd-7d466d48ffd9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:06.665658 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.665630 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7c6764f6-5ea4-4730-97dd-7d466d48ffd9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-fx6kt\" (UID: \"7c6764f6-5ea4-4730-97dd-7d466d48ffd9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:06.667352 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.667331 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c6764f6-5ea4-4730-97dd-7d466d48ffd9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-fx6kt\" (UID: \"7c6764f6-5ea4-4730-97dd-7d466d48ffd9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:06.667471 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.667385 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7c6764f6-5ea4-4730-97dd-7d466d48ffd9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-fx6kt\" (UID: \"7c6764f6-5ea4-4730-97dd-7d466d48ffd9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:06.667585 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.667566 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7c6764f6-5ea4-4730-97dd-7d466d48ffd9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-fx6kt\" (UID: \"7c6764f6-5ea4-4730-97dd-7d466d48ffd9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:06.667637 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.667598 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7c6764f6-5ea4-4730-97dd-7d466d48ffd9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-fx6kt\" (UID: \"7c6764f6-5ea4-4730-97dd-7d466d48ffd9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:06.675675 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.675626 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c6764f6-5ea4-4730-97dd-7d466d48ffd9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-fx6kt\" (UID: \"7c6764f6-5ea4-4730-97dd-7d466d48ffd9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:06.675977 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.675957 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkc5w\" (UniqueName: \"kubernetes.io/projected/7c6764f6-5ea4-4730-97dd-7d466d48ffd9-kube-api-access-zkc5w\") pod \"istiod-openshift-gateway-94bb8fbfd-fx6kt\" (UID: \"7c6764f6-5ea4-4730-97dd-7d466d48ffd9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:06.835418 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:06.835355 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:07.255641 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:07.255604 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:04:07.255728 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:07.255692 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:04:07.255788 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:07.255739 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:04:07.424764 ip-10-0-136-0 kubenswrapper[2581]: W0702 17:04:07.424729 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c6764f6_5ea4_4730_97dd_7d466d48ffd9.slice/crio-42f37067b3a508ef05131ec629f2c0d7f0bded46d6535eb9465cc612b1da4298 WatchSource:0}: Error finding container 42f37067b3a508ef05131ec629f2c0d7f0bded46d6535eb9465cc612b1da4298: Status 404 returned error can't find the container with id 42f37067b3a508ef05131ec629f2c0d7f0bded46d6535eb9465cc612b1da4298 Jul 02 17:04:07.431378 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:07.431354 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt"] Jul 02 17:04:08.039823 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:08.039755 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f677bc8d7-65486" event={"ID":"c80aa4b9-55ad-4028-b5f3-3401562bbdfb","Type":"ContainerStarted","Data":"c2eeda776338d90ea2f678f03f6c769856652f049b1222a27336a28f45147f7c"} Jul 02 17:04:08.040255 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:08.039870 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6f677bc8d7-65486" Jul 02 17:04:08.041660 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:08.041629 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" event={"ID":"194bd771-1018-4159-a5f5-f003f0750d14","Type":"ContainerStarted","Data":"57c38c3d2521f83ade1f274caa6443fdf8b2b74a9d15db085b96c79fd94910ed"} Jul 02 17:04:08.043221 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:08.043197 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" event={"ID":"7c6764f6-5ea4-4730-97dd-7d466d48ffd9","Type":"ContainerStarted","Data":"42f37067b3a508ef05131ec629f2c0d7f0bded46d6535eb9465cc612b1da4298"} Jul 02 17:04:08.159276 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:08.159221 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6f677bc8d7-65486" podStartSLOduration=1.6866568659999999 podStartE2EDuration="6.159200293s" totalImagesPullingTime="4.472543427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:04:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:04:08.097524576 +0000 UTC m=+427.287825735" watchObservedRunningTime="2026-07-02 17:04:08.159200293 +0000 UTC m=+427.349501452" Jul 02 17:04:08.159879 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:08.159841 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" podStartSLOduration=2.045714987 podStartE2EDuration="5.159831682s" totalImagesPullingTime="3.114116695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:04:08.158659256 +0000 UTC m=+427.348960415" watchObservedRunningTime="2026-07-02 17:04:08.159831682 +0000 UTC m=+427.350132840" Jul 02 17:04:08.904815 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:08.904782 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:08.910125 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:08.910096 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:09.047364 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:09.047301 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:09.048151 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:09.048132 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6784p5pn" Jul 02 17:04:09.598912 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:09.598879 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:04:09.599001 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:09.598939 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:04:10.054075 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:10.054036 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" event={"ID":"7c6764f6-5ea4-4730-97dd-7d466d48ffd9","Type":"ContainerStarted","Data":"509b4517991f9919612f1c41910505401c46e0de8bec73e54829c884d469d7fd"} Jul 02 17:04:10.054546 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:10.054400 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:10.055800 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:10.055764 2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-fx6kt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 02 17:04:10.055955 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:10.055871 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" podUID="7c6764f6-5ea4-4730-97dd-7d466d48ffd9" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 17:04:10.099374 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:10.098657 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" podStartSLOduration=1.927464598 podStartE2EDuration="4.098638863s" totalImagesPullingTime="2.171174265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:04:10.095663645 +0000 UTC m=+429.285964802" watchObservedRunningTime="2026-07-02 17:04:10.098638863 +0000 UTC m=+429.288940021" Jul 02 17:04:11.059769 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:11.059735 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fx6kt" Jul 02 17:04:19.049131 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:19.049099 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6f677bc8d7-65486" Jul 02 17:04:51.843584 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:51.843553 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b89bdbb4b-gsq5r"] Jul 02 17:04:51.852840 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:51.852815 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:51.863663 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:51.863639 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b89bdbb4b-gsq5r"] Jul 02 17:04:52.004093 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.004068 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66f3d901-b858-4a08-8297-9c31959087b4-console-serving-cert\") pod \"console-6b89bdbb4b-gsq5r\" (UID: \"66f3d901-b858-4a08-8297-9c31959087b4\") " pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:52.004219 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.004098 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66f3d901-b858-4a08-8297-9c31959087b4-console-config\") pod \"console-6b89bdbb4b-gsq5r\" (UID: \"66f3d901-b858-4a08-8297-9c31959087b4\") " pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:52.004219 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.004136 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66f3d901-b858-4a08-8297-9c31959087b4-oauth-serving-cert\") pod \"console-6b89bdbb4b-gsq5r\" (UID: \"66f3d901-b858-4a08-8297-9c31959087b4\") " pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:52.004294 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.004223 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f3d901-b858-4a08-8297-9c31959087b4-trusted-ca-bundle\") pod \"console-6b89bdbb4b-gsq5r\" (UID: \"66f3d901-b858-4a08-8297-9c31959087b4\") " pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:52.004294 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.004262 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66f3d901-b858-4a08-8297-9c31959087b4-console-oauth-config\") pod \"console-6b89bdbb4b-gsq5r\" (UID: \"66f3d901-b858-4a08-8297-9c31959087b4\") " pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:52.004294 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.004281 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dchhq\" (UniqueName: \"kubernetes.io/projected/66f3d901-b858-4a08-8297-9c31959087b4-kube-api-access-dchhq\") pod \"console-6b89bdbb4b-gsq5r\" (UID: \"66f3d901-b858-4a08-8297-9c31959087b4\") " pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:52.004388 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.004329 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66f3d901-b858-4a08-8297-9c31959087b4-service-ca\") pod \"console-6b89bdbb4b-gsq5r\" (UID: \"66f3d901-b858-4a08-8297-9c31959087b4\") " pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:52.105323 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.105253 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66f3d901-b858-4a08-8297-9c31959087b4-oauth-serving-cert\") pod \"console-6b89bdbb4b-gsq5r\" (UID: \"66f3d901-b858-4a08-8297-9c31959087b4\") " pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:52.105323 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.105296 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f3d901-b858-4a08-8297-9c31959087b4-trusted-ca-bundle\") pod \"console-6b89bdbb4b-gsq5r\" (UID: \"66f3d901-b858-4a08-8297-9c31959087b4\") " pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:52.105323 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.105320 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66f3d901-b858-4a08-8297-9c31959087b4-console-oauth-config\") pod \"console-6b89bdbb4b-gsq5r\" (UID: \"66f3d901-b858-4a08-8297-9c31959087b4\") " pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:52.105547 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.105340 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dchhq\" (UniqueName: \"kubernetes.io/projected/66f3d901-b858-4a08-8297-9c31959087b4-kube-api-access-dchhq\") pod \"console-6b89bdbb4b-gsq5r\" (UID: \"66f3d901-b858-4a08-8297-9c31959087b4\") " pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:52.105547 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.105371 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66f3d901-b858-4a08-8297-9c31959087b4-service-ca\") pod \"console-6b89bdbb4b-gsq5r\" (UID: \"66f3d901-b858-4a08-8297-9c31959087b4\") " pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:52.105547 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.105404 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66f3d901-b858-4a08-8297-9c31959087b4-console-serving-cert\") pod \"console-6b89bdbb4b-gsq5r\" (UID: \"66f3d901-b858-4a08-8297-9c31959087b4\") " pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:52.105547 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.105428 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66f3d901-b858-4a08-8297-9c31959087b4-console-config\") pod \"console-6b89bdbb4b-gsq5r\" (UID: \"66f3d901-b858-4a08-8297-9c31959087b4\") " pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:52.106348 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.106319 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f3d901-b858-4a08-8297-9c31959087b4-trusted-ca-bundle\") pod \"console-6b89bdbb4b-gsq5r\" (UID: \"66f3d901-b858-4a08-8297-9c31959087b4\") " pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:52.106485 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.106328 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66f3d901-b858-4a08-8297-9c31959087b4-console-config\") pod \"console-6b89bdbb4b-gsq5r\" (UID: \"66f3d901-b858-4a08-8297-9c31959087b4\") " pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:52.106485 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.106332 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66f3d901-b858-4a08-8297-9c31959087b4-service-ca\") pod \"console-6b89bdbb4b-gsq5r\" (UID: \"66f3d901-b858-4a08-8297-9c31959087b4\") " pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:52.106575 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.106487 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66f3d901-b858-4a08-8297-9c31959087b4-oauth-serving-cert\") pod \"console-6b89bdbb4b-gsq5r\" (UID: \"66f3d901-b858-4a08-8297-9c31959087b4\") " pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:52.108034 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.107998 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66f3d901-b858-4a08-8297-9c31959087b4-console-serving-cert\") pod \"console-6b89bdbb4b-gsq5r\" (UID: \"66f3d901-b858-4a08-8297-9c31959087b4\") " pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:52.108298 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.108276 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66f3d901-b858-4a08-8297-9c31959087b4-console-oauth-config\") pod \"console-6b89bdbb4b-gsq5r\" (UID: \"66f3d901-b858-4a08-8297-9c31959087b4\") " pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:52.114048 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.114021 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dchhq\" (UniqueName: \"kubernetes.io/projected/66f3d901-b858-4a08-8297-9c31959087b4-kube-api-access-dchhq\") pod \"console-6b89bdbb4b-gsq5r\" (UID: \"66f3d901-b858-4a08-8297-9c31959087b4\") " pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:52.161419 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.161396 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:04:52.295994 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:52.295967 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b89bdbb4b-gsq5r"] Jul 02 17:04:52.299080 ip-10-0-136-0 kubenswrapper[2581]: W0702 17:04:52.299058 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f3d901_b858_4a08_8297_9c31959087b4.slice/crio-8516b7f67b1b61e02cbb37b6ea6cb9d2f29bf665974ed0c82ad0c85370e6eb94 WatchSource:0}: Error finding container 8516b7f67b1b61e02cbb37b6ea6cb9d2f29bf665974ed0c82ad0c85370e6eb94: Status 404 returned error can't find the container with id 8516b7f67b1b61e02cbb37b6ea6cb9d2f29bf665974ed0c82ad0c85370e6eb94 Jul 02 17:04:53.249975 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:53.249936 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b89bdbb4b-gsq5r" event={"ID":"66f3d901-b858-4a08-8297-9c31959087b4","Type":"ContainerStarted","Data":"6d206b01a32ae1d5cd91ece250d219ea48536b9832e7bbf204f73fab33dd3d1f"} Jul 02 17:04:53.250425 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:53.249994 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b89bdbb4b-gsq5r" event={"ID":"66f3d901-b858-4a08-8297-9c31959087b4","Type":"ContainerStarted","Data":"8516b7f67b1b61e02cbb37b6ea6cb9d2f29bf665974ed0c82ad0c85370e6eb94"} Jul 02 17:04:53.268425 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:04:53.268375 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b89bdbb4b-gsq5r" podStartSLOduration=2.268360776 podStartE2EDuration="2.268360776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:04:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:04:53.267164632 +0000 UTC m=+472.457465791" watchObservedRunningTime="2026-07-02 17:04:53.268360776 +0000 UTC m=+472.458661934" Jul 02 17:05:02.161538 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:02.161500 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:05:02.161974 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:02.161570 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:05:02.166289 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:02.166264 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:05:02.289864 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:02.289843 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b89bdbb4b-gsq5r" Jul 02 17:05:02.333291 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:02.333265 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86485665d6-djxp5"] Jul 02 17:05:27.353594 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.353530 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-86485665d6-djxp5" podUID="a006c4bc-d58c-4759-b429-d2ae9a2ce8c5" containerName="console" containerID="cri-o://7e571e2597c4bfcf8caa86bcab04746e80d1b1bfe5d23df945c4a7221a72730a" gracePeriod=15 Jul 02 17:05:27.594549 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.594522 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:05:27.682445 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.682388 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-console-serving-cert\") pod \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " Jul 02 17:05:27.682445 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.682422 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfp8w\" (UniqueName: \"kubernetes.io/projected/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-kube-api-access-dfp8w\") pod \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " Jul 02 17:05:27.682621 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.682448 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-console-oauth-config\") pod \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " Jul 02 17:05:27.682621 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.682522 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-console-config\") pod \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " Jul 02 17:05:27.682621 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.682549 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-trusted-ca-bundle\") pod \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " Jul 02 17:05:27.682621 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.682574 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-service-ca\") pod \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " Jul 02 17:05:27.682621 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.682612 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-oauth-serving-cert\") pod \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\" (UID: \"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5\") " Jul 02 17:05:27.682973 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.682950 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a006c4bc-d58c-4759-b429-d2ae9a2ce8c5" (UID: "a006c4bc-d58c-4759-b429-d2ae9a2ce8c5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:05:27.683044 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.682964 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-service-ca" (OuterVolumeSpecName: "service-ca") pod "a006c4bc-d58c-4759-b429-d2ae9a2ce8c5" (UID: "a006c4bc-d58c-4759-b429-d2ae9a2ce8c5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:05:27.683044 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.682944 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-console-config" (OuterVolumeSpecName: "console-config") pod "a006c4bc-d58c-4759-b429-d2ae9a2ce8c5" (UID: "a006c4bc-d58c-4759-b429-d2ae9a2ce8c5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:05:27.683190 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.683169 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a006c4bc-d58c-4759-b429-d2ae9a2ce8c5" (UID: "a006c4bc-d58c-4759-b429-d2ae9a2ce8c5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:05:27.684623 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.684599 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-kube-api-access-dfp8w" (OuterVolumeSpecName: "kube-api-access-dfp8w") pod "a006c4bc-d58c-4759-b429-d2ae9a2ce8c5" (UID: "a006c4bc-d58c-4759-b429-d2ae9a2ce8c5"). InnerVolumeSpecName "kube-api-access-dfp8w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:05:27.684710 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.684628 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a006c4bc-d58c-4759-b429-d2ae9a2ce8c5" (UID: "a006c4bc-d58c-4759-b429-d2ae9a2ce8c5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:05:27.684710 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.684643 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a006c4bc-d58c-4759-b429-d2ae9a2ce8c5" (UID: "a006c4bc-d58c-4759-b429-d2ae9a2ce8c5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:05:27.784124 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.784097 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-console-serving-cert\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:05:27.784124 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.784119 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfp8w\" (UniqueName: \"kubernetes.io/projected/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-kube-api-access-dfp8w\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:05:27.784124 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.784129 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-console-oauth-config\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:05:27.784322 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.784138 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-console-config\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:05:27.784322 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.784146 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-trusted-ca-bundle\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:05:27.784322 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.784163 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-service-ca\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:05:27.784322 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:27.784173 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5-oauth-serving-cert\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:05:28.394785 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:28.394749 2581 generic.go:356] "Generic (PLEG): container finished" podID="a006c4bc-d58c-4759-b429-d2ae9a2ce8c5" containerID="7e571e2597c4bfcf8caa86bcab04746e80d1b1bfe5d23df945c4a7221a72730a" exitCode=0 Jul 02 17:05:28.395193 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:28.394806 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86485665d6-djxp5" Jul 02 17:05:28.395193 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:28.394839 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86485665d6-djxp5" event={"ID":"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5","Type":"ContainerDied","Data":"7e571e2597c4bfcf8caa86bcab04746e80d1b1bfe5d23df945c4a7221a72730a"} Jul 02 17:05:28.395193 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:28.394894 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86485665d6-djxp5" event={"ID":"a006c4bc-d58c-4759-b429-d2ae9a2ce8c5","Type":"ContainerDied","Data":"30fcbbbf7b1fde67bacb76f57d1ccb47ad580a505f143505e4ee42268024c3d2"} Jul 02 17:05:28.395193 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:28.394922 2581 scope.go:117] "RemoveContainer" containerID="7e571e2597c4bfcf8caa86bcab04746e80d1b1bfe5d23df945c4a7221a72730a" Jul 02 17:05:28.405291 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:28.405272 2581 scope.go:117] "RemoveContainer" containerID="7e571e2597c4bfcf8caa86bcab04746e80d1b1bfe5d23df945c4a7221a72730a" Jul 02 17:05:28.405603 ip-10-0-136-0 kubenswrapper[2581]: E0702 17:05:28.405583 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e571e2597c4bfcf8caa86bcab04746e80d1b1bfe5d23df945c4a7221a72730a\": container with ID starting with 7e571e2597c4bfcf8caa86bcab04746e80d1b1bfe5d23df945c4a7221a72730a not found: ID does not exist" containerID="7e571e2597c4bfcf8caa86bcab04746e80d1b1bfe5d23df945c4a7221a72730a" Jul 02 17:05:28.405705 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:28.405613 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e571e2597c4bfcf8caa86bcab04746e80d1b1bfe5d23df945c4a7221a72730a"} err="failed to get container status \"7e571e2597c4bfcf8caa86bcab04746e80d1b1bfe5d23df945c4a7221a72730a\": rpc error: code = NotFound desc = could not find container \"7e571e2597c4bfcf8caa86bcab04746e80d1b1bfe5d23df945c4a7221a72730a\": container with ID starting with 7e571e2597c4bfcf8caa86bcab04746e80d1b1bfe5d23df945c4a7221a72730a not found: ID does not exist" Jul 02 17:05:28.452557 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:28.452528 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86485665d6-djxp5"] Jul 02 17:05:28.456761 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:28.456740 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86485665d6-djxp5"] Jul 02 17:05:29.248425 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:05:29.248394 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a006c4bc-d58c-4759-b429-d2ae9a2ce8c5" path="/var/lib/kubelet/pods/a006c4bc-d58c-4759-b429-d2ae9a2ce8c5/volumes" Jul 02 17:06:23.832235 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:23.832199 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s"] Jul 02 17:06:23.832700 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:23.832511 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a006c4bc-d58c-4759-b429-d2ae9a2ce8c5" containerName="console" Jul 02 17:06:23.832700 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:23.832524 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a006c4bc-d58c-4759-b429-d2ae9a2ce8c5" containerName="console" Jul 02 17:06:23.832700 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:23.832589 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a006c4bc-d58c-4759-b429-d2ae9a2ce8c5" containerName="console" Jul 02 17:06:23.834711 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:23.834694 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:23.837885 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:23.837868 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4vsst\"" Jul 02 17:06:23.854579 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:23.854556 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s"] Jul 02 17:06:24.013752 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.013718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0be034e3-6428-4046-b808-d14667af765d-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.013910 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.013760 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0be034e3-6428-4046-b808-d14667af765d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.013910 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.013832 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0be034e3-6428-4046-b808-d14667af765d-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.013910 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.013865 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be034e3-6428-4046-b808-d14667af765d-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.013910 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.013892 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0be034e3-6428-4046-b808-d14667af765d-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.014162 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.013916 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0be034e3-6428-4046-b808-d14667af765d-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.014162 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.013964 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0be034e3-6428-4046-b808-d14667af765d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.014162 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.013999 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxvg4\" (UniqueName: \"kubernetes.io/projected/0be034e3-6428-4046-b808-d14667af765d-kube-api-access-lxvg4\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.014162 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.014047 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be034e3-6428-4046-b808-d14667af765d-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.115120 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.115042 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0be034e3-6428-4046-b808-d14667af765d-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.115120 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.115083 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be034e3-6428-4046-b808-d14667af765d-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.115120 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.115102 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0be034e3-6428-4046-b808-d14667af765d-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.115120 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.115120 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0be034e3-6428-4046-b808-d14667af765d-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.115428 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.115138 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0be034e3-6428-4046-b808-d14667af765d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.115428 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.115166 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxvg4\" (UniqueName: \"kubernetes.io/projected/0be034e3-6428-4046-b808-d14667af765d-kube-api-access-lxvg4\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.115428 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.115279 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be034e3-6428-4046-b808-d14667af765d-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.115428 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.115326 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0be034e3-6428-4046-b808-d14667af765d-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.115428 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.115372 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0be034e3-6428-4046-b808-d14667af765d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.115706 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.115553 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0be034e3-6428-4046-b808-d14667af765d-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.115706 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.115570 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be034e3-6428-4046-b808-d14667af765d-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.115706 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.115677 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be034e3-6428-4046-b808-d14667af765d-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.115856 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.115780 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0be034e3-6428-4046-b808-d14667af765d-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.115979 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.115960 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0be034e3-6428-4046-b808-d14667af765d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.117493 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.117473 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0be034e3-6428-4046-b808-d14667af765d-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.117710 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.117693 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0be034e3-6428-4046-b808-d14667af765d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.122839 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.122817 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxvg4\" (UniqueName: \"kubernetes.io/projected/0be034e3-6428-4046-b808-d14667af765d-kube-api-access-lxvg4\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.122839 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.122837 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0be034e3-6428-4046-b808-d14667af765d-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-zzg6s\" (UID: \"0be034e3-6428-4046-b808-d14667af765d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.144961 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.144940 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:24.272901 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.272876 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s"] Jul 02 17:06:24.274855 ip-10-0-136-0 kubenswrapper[2581]: W0702 17:06:24.274825 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0be034e3_6428_4046_b808_d14667af765d.slice/crio-be58843fce55fb78519d7dc0d0cc390816f7ad12af5636e2dcf34a225730c39c WatchSource:0}: Error finding container be58843fce55fb78519d7dc0d0cc390816f7ad12af5636e2dcf34a225730c39c: Status 404 returned error can't find the container with id be58843fce55fb78519d7dc0d0cc390816f7ad12af5636e2dcf34a225730c39c Jul 02 17:06:24.276842 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.276807 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:06:24.276950 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.276887 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:06:24.276950 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.276930 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:06:24.624637 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.624605 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" event={"ID":"0be034e3-6428-4046-b808-d14667af765d","Type":"ContainerStarted","Data":"0209e75dfa619afe0d5df46e93565be25e7738abb9001222736f9e09fcb8b598"} Jul 02 17:06:24.624792 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.624664 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" event={"ID":"0be034e3-6428-4046-b808-d14667af765d","Type":"ContainerStarted","Data":"be58843fce55fb78519d7dc0d0cc390816f7ad12af5636e2dcf34a225730c39c"} Jul 02 17:06:24.649994 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:24.649948 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" podStartSLOduration=1.649933029 podStartE2EDuration="1.649933029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:06:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:06:24.648403875 +0000 UTC m=+563.838705033" watchObservedRunningTime="2026-07-02 17:06:24.649933029 +0000 UTC m=+563.840234187" Jul 02 17:06:25.146013 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:25.145980 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:25.151020 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:25.151000 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:25.628826 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:25.628803 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:06:25.629764 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:06:25.629744 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:07:01.214794 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:07:01.214768 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lln24_1f9623eb-d52b-45dc-ae42-3fd20e210c7f/ovn-acl-logging/0.log" Jul 02 17:07:01.217113 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:07:01.217091 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lln24_1f9623eb-d52b-45dc-ae42-3fd20e210c7f/ovn-acl-logging/0.log" Jul 02 17:07:04.830550 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:07:04.830516 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-d48ks"] Jul 02 17:07:04.833026 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:07:04.833006 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-d48ks" Jul 02 17:07:04.835635 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:07:04.835562 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 02 17:07:04.836477 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:07:04.836448 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 02 17:07:04.836542 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:07:04.836474 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-w25rz\"" Jul 02 17:07:04.865783 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:07:04.865764 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-d48ks"] Jul 02 17:07:04.932774 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:07:04.932750 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcmtc\" (UniqueName: \"kubernetes.io/projected/640e3e1a-3141-44cf-a61c-f5850be0535b-kube-api-access-vcmtc\") pod \"keycloak-operator-d8b9d7b4d-d48ks\" (UID: \"640e3e1a-3141-44cf-a61c-f5850be0535b\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-d48ks" Jul 02 17:07:05.033616 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:07:05.033593 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcmtc\" (UniqueName: \"kubernetes.io/projected/640e3e1a-3141-44cf-a61c-f5850be0535b-kube-api-access-vcmtc\") pod \"keycloak-operator-d8b9d7b4d-d48ks\" (UID: \"640e3e1a-3141-44cf-a61c-f5850be0535b\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-d48ks" Jul 02 17:07:05.044318 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:07:05.044293 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcmtc\" (UniqueName: \"kubernetes.io/projected/640e3e1a-3141-44cf-a61c-f5850be0535b-kube-api-access-vcmtc\") pod \"keycloak-operator-d8b9d7b4d-d48ks\" (UID: \"640e3e1a-3141-44cf-a61c-f5850be0535b\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-d48ks" Jul 02 17:07:05.142911 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:07:05.142864 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-d48ks" Jul 02 17:07:05.283622 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:07:05.283598 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-d48ks"] Jul 02 17:07:05.286130 ip-10-0-136-0 kubenswrapper[2581]: W0702 17:07:05.286102 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod640e3e1a_3141_44cf_a61c_f5850be0535b.slice/crio-be60a631f26ad107b6b59d39b66aa19d421245a1a8204f9d0205d862cdd0ce5a WatchSource:0}: Error finding container be60a631f26ad107b6b59d39b66aa19d421245a1a8204f9d0205d862cdd0ce5a: Status 404 returned error can't find the container with id be60a631f26ad107b6b59d39b66aa19d421245a1a8204f9d0205d862cdd0ce5a Jul 02 17:07:05.802808 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:07:05.802737 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-d48ks" event={"ID":"640e3e1a-3141-44cf-a61c-f5850be0535b","Type":"ContainerStarted","Data":"be60a631f26ad107b6b59d39b66aa19d421245a1a8204f9d0205d862cdd0ce5a"} Jul 02 17:07:10.828362 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:07:10.828284 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-d48ks" event={"ID":"640e3e1a-3141-44cf-a61c-f5850be0535b","Type":"ContainerStarted","Data":"686c2b427ea914b73348f5f48bf9145e4cf895c487babb5269b12f8afbd0fab7"} Jul 02 17:07:10.861635 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:07:10.861572 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d8b9d7b4d-d48ks" podStartSLOduration=1.611770159 podStartE2EDuration="6.861553241s" totalImagesPullingTime="5.249783082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:07:10.856666823 +0000 UTC m=+610.046967981" watchObservedRunningTime="2026-07-02 17:07:10.861553241 +0000 UTC m=+610.051854399" Jul 02 17:08:40.630842 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:08:40.630776 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-zzg6s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 02 17:08:40.630842 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:08:40.630825 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" podUID="0be034e3-6428-4046-b808-d14667af765d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 02 17:08:41.217464 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:08:41.217431 2581 generic.go:356] "Generic (PLEG): container finished" podID="0be034e3-6428-4046-b808-d14667af765d" containerID="0209e75dfa619afe0d5df46e93565be25e7738abb9001222736f9e09fcb8b598" exitCode=0 Jul 02 17:08:41.217612 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:08:41.217506 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" event={"ID":"0be034e3-6428-4046-b808-d14667af765d","Type":"ContainerDied","Data":"0209e75dfa619afe0d5df46e93565be25e7738abb9001222736f9e09fcb8b598"} Jul 02 17:08:41.217866 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:08:41.217846 2581 scope.go:117] "RemoveContainer" containerID="0209e75dfa619afe0d5df46e93565be25e7738abb9001222736f9e09fcb8b598" Jul 02 17:08:41.218799 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:08:41.218771 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:08:41.218871 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:08:41.218837 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:08:41.218925 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:08:41.218869 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:08:42.226740 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:08:42.226703 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" event={"ID":"0be034e3-6428-4046-b808-d14667af765d","Type":"ContainerStarted","Data":"b321962ff643f88978ac4016ed922520e1735f29897d0a50967689943ed2d04d"} Jul 02 17:08:43.145828 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:08:43.145794 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:08:43.146004 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:08:43.145980 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-zzg6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 02 17:08:43.146056 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:08:43.146030 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" podUID="0be034e3-6428-4046-b808-d14667af765d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 02 17:08:44.146246 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:08:44.146202 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-zzg6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 02 17:08:44.146744 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:08:44.146265 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" podUID="0be034e3-6428-4046-b808-d14667af765d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 02 17:08:45.145581 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:08:45.145545 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-zzg6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 02 17:08:45.145760 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:08:45.145595 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" podUID="0be034e3-6428-4046-b808-d14667af765d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 02 17:08:46.146207 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:08:46.146171 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-zzg6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 02 17:08:46.146601 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:08:46.146222 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" podUID="0be034e3-6428-4046-b808-d14667af765d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 02 17:08:47.149278 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:08:47.149243 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:08:47.149655 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:08:47.149571 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:08:47.150364 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:08:47.150345 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-zzg6s" Jul 02 17:10:13.385965 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.385933 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp"] Jul 02 17:10:13.389129 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.389112 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:13.392550 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.392518 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 02 17:10:13.392654 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.392549 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 17:10:13.392654 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.392529 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-n9z5j\"" Jul 02 17:10:13.392654 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.392530 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 17:10:13.400232 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.400211 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp"] Jul 02 17:10:13.438564 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.438542 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2af2f4a-eba5-47e0-9b78-ee5c3881508c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg2mp\" (UID: \"d2af2f4a-eba5-47e0-9b78-ee5c3881508c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:13.438666 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.438581 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2af2f4a-eba5-47e0-9b78-ee5c3881508c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg2mp\" (UID: \"d2af2f4a-eba5-47e0-9b78-ee5c3881508c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:13.438666 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.438642 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2af2f4a-eba5-47e0-9b78-ee5c3881508c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg2mp\" (UID: \"d2af2f4a-eba5-47e0-9b78-ee5c3881508c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:13.438778 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.438684 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2af2f4a-eba5-47e0-9b78-ee5c3881508c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg2mp\" (UID: \"d2af2f4a-eba5-47e0-9b78-ee5c3881508c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:13.438831 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.438793 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2af2f4a-eba5-47e0-9b78-ee5c3881508c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg2mp\" (UID: \"d2af2f4a-eba5-47e0-9b78-ee5c3881508c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:13.438889 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.438838 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2bdb\" (UniqueName: \"kubernetes.io/projected/d2af2f4a-eba5-47e0-9b78-ee5c3881508c-kube-api-access-s2bdb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg2mp\" (UID: \"d2af2f4a-eba5-47e0-9b78-ee5c3881508c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:13.539979 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.539953 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2af2f4a-eba5-47e0-9b78-ee5c3881508c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg2mp\" (UID: \"d2af2f4a-eba5-47e0-9b78-ee5c3881508c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:13.540117 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.539991 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2af2f4a-eba5-47e0-9b78-ee5c3881508c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg2mp\" (UID: \"d2af2f4a-eba5-47e0-9b78-ee5c3881508c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:13.540117 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.540062 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2af2f4a-eba5-47e0-9b78-ee5c3881508c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg2mp\" (UID: \"d2af2f4a-eba5-47e0-9b78-ee5c3881508c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:13.540117 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.540099 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2bdb\" (UniqueName: \"kubernetes.io/projected/d2af2f4a-eba5-47e0-9b78-ee5c3881508c-kube-api-access-s2bdb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg2mp\" (UID: \"d2af2f4a-eba5-47e0-9b78-ee5c3881508c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:13.540297 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.540128 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2af2f4a-eba5-47e0-9b78-ee5c3881508c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg2mp\" (UID: \"d2af2f4a-eba5-47e0-9b78-ee5c3881508c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:13.540297 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.540181 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2af2f4a-eba5-47e0-9b78-ee5c3881508c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg2mp\" (UID: \"d2af2f4a-eba5-47e0-9b78-ee5c3881508c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:13.540582 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.540559 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2af2f4a-eba5-47e0-9b78-ee5c3881508c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg2mp\" (UID: \"d2af2f4a-eba5-47e0-9b78-ee5c3881508c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:13.540704 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.540685 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2af2f4a-eba5-47e0-9b78-ee5c3881508c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg2mp\" (UID: \"d2af2f4a-eba5-47e0-9b78-ee5c3881508c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:13.540799 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.540739 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2af2f4a-eba5-47e0-9b78-ee5c3881508c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg2mp\" (UID: \"d2af2f4a-eba5-47e0-9b78-ee5c3881508c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:13.543315 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.543278 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2af2f4a-eba5-47e0-9b78-ee5c3881508c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg2mp\" (UID: \"d2af2f4a-eba5-47e0-9b78-ee5c3881508c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:13.543428 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.543391 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2af2f4a-eba5-47e0-9b78-ee5c3881508c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg2mp\" (UID: \"d2af2f4a-eba5-47e0-9b78-ee5c3881508c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:13.548749 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.548723 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2bdb\" (UniqueName: \"kubernetes.io/projected/d2af2f4a-eba5-47e0-9b78-ee5c3881508c-kube-api-access-s2bdb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg2mp\" (UID: \"d2af2f4a-eba5-47e0-9b78-ee5c3881508c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:13.699531 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.699449 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:13.824733 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.824666 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp"] Jul 02 17:10:13.826779 ip-10-0-136-0 kubenswrapper[2581]: W0702 17:10:13.826753 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2af2f4a_eba5_47e0_9b78_ee5c3881508c.slice/crio-a1d0395c00edfe1ab17e49b0d151e95f22384b08be9173e499a2145279c667e8 WatchSource:0}: Error finding container a1d0395c00edfe1ab17e49b0d151e95f22384b08be9173e499a2145279c667e8: Status 404 returned error can't find the container with id a1d0395c00edfe1ab17e49b0d151e95f22384b08be9173e499a2145279c667e8 Jul 02 17:10:13.828067 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:13.828048 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 17:10:14.611266 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:14.611221 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" event={"ID":"d2af2f4a-eba5-47e0-9b78-ee5c3881508c","Type":"ContainerStarted","Data":"a1d0395c00edfe1ab17e49b0d151e95f22384b08be9173e499a2145279c667e8"} Jul 02 17:10:15.617462 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:15.617427 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" event={"ID":"d2af2f4a-eba5-47e0-9b78-ee5c3881508c","Type":"ContainerStarted","Data":"26a15db934c124eef94e8cd1ca15d5b7388e4d0ef1cc67bdc00b8a4395ad558f"} Jul 02 17:10:15.636447 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:15.636399 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" podStartSLOduration=1.446263728 podStartE2EDuration="2.636384153s" totalImagesPullingTime="1.190120425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:10:15.634816529 +0000 UTC m=+794.825117689" watchObservedRunningTime="2026-07-02 17:10:15.636384153 +0000 UTC m=+794.826685311" Jul 02 17:10:23.700358 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:23.700288 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:23.700856 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:23.700364 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:23.712506 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:23.712485 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:10:24.664885 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:10:24.664858 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg2mp" Jul 02 17:12:01.241548 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:12:01.241446 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lln24_1f9623eb-d52b-45dc-ae42-3fd20e210c7f/ovn-acl-logging/0.log" Jul 02 17:12:01.242060 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:12:01.241544 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lln24_1f9623eb-d52b-45dc-ae42-3fd20e210c7f/ovn-acl-logging/0.log" Jul 02 17:17:01.267766 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:17:01.267685 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lln24_1f9623eb-d52b-45dc-ae42-3fd20e210c7f/ovn-acl-logging/0.log" Jul 02 17:17:01.269145 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:17:01.269122 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lln24_1f9623eb-d52b-45dc-ae42-3fd20e210c7f/ovn-acl-logging/0.log" Jul 02 17:22:01.293155 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:22:01.293125 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lln24_1f9623eb-d52b-45dc-ae42-3fd20e210c7f/ovn-acl-logging/0.log" Jul 02 17:22:01.295165 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:22:01.295148 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lln24_1f9623eb-d52b-45dc-ae42-3fd20e210c7f/ovn-acl-logging/0.log" Jul 02 17:24:52.702136 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.702107 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt"] Jul 02 17:24:52.704464 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.704430 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.709111 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.709091 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e9de6c51-openshift-default-dockercfg-6wwmt\"" Jul 02 17:24:52.738569 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.738544 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt"] Jul 02 17:24:52.765019 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.764992 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-token\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.765123 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.765023 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-workload-socket\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.765123 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.765047 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-envoy\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.765123 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.765075 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dlkp\" (UniqueName: \"kubernetes.io/projected/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-kube-api-access-9dlkp\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.765236 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.765159 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-podinfo\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.765236 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.765220 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-data\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.765313 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.765258 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istiod-ca-cert\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.765313 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.765286 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-workload-certs\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.765313 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.765309 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-credential-socket\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.866092 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.866059 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-data\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.866092 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.866096 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istiod-ca-cert\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.866317 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.866116 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-workload-certs\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.866317 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.866134 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-credential-socket\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.866317 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.866164 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-token\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.866317 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.866181 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-workload-socket\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.866317 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.866204 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-envoy\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.866317 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.866233 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dlkp\" (UniqueName: \"kubernetes.io/projected/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-kube-api-access-9dlkp\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.866317 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.866279 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-podinfo\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.866697 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.866546 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-data\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.866697 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.866645 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-workload-socket\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.866803 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.866709 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-workload-certs\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.866803 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.866783 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-credential-socket\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.866934 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.866917 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istiod-ca-cert\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.868665 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.868634 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-envoy\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.868790 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.868775 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-podinfo\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.874715 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.874695 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-token\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:52.874811 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:52.874696 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dlkp\" (UniqueName: \"kubernetes.io/projected/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-kube-api-access-9dlkp\") pod \"e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:53.015139 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:53.015120 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:53.144777 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:53.144705 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt"] Jul 02 17:24:53.147092 ip-10-0-136-0 kubenswrapper[2581]: W0702 17:24:53.147063 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c8a4be1_0b51_47f7_83ef_9051ee1104b7.slice/crio-ffae0d3f5e85ff201c670413aa09f55d7b14696d3640f8ff2102ab316d00caa2 WatchSource:0}: Error finding container ffae0d3f5e85ff201c670413aa09f55d7b14696d3640f8ff2102ab316d00caa2: Status 404 returned error can't find the container with id ffae0d3f5e85ff201c670413aa09f55d7b14696d3640f8ff2102ab316d00caa2 Jul 02 17:24:53.149188 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:53.149151 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:24:53.149263 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:53.149235 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:24:53.149305 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:53.149276 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:24:53.388930 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:53.388847 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" event={"ID":"4c8a4be1-0b51-47f7-83ef-9051ee1104b7","Type":"ContainerStarted","Data":"380609cfc7e5480a944bd3d602bd1357866f1848df32a55579f1cb3cca19f57c"} Jul 02 17:24:53.388930 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:53.388898 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" event={"ID":"4c8a4be1-0b51-47f7-83ef-9051ee1104b7","Type":"ContainerStarted","Data":"ffae0d3f5e85ff201c670413aa09f55d7b14696d3640f8ff2102ab316d00caa2"} Jul 02 17:24:53.408777 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:53.408733 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" podStartSLOduration=1.408718537 podStartE2EDuration="1.408718537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:24:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:24:53.407125824 +0000 UTC m=+1672.597427016" watchObservedRunningTime="2026-07-02 17:24:53.408718537 +0000 UTC m=+1672.599019697" Jul 02 17:24:54.015661 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:54.015627 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:54.020029 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:54.020007 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:54.394177 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:54.394090 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:54.394893 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:54.394875 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:24:59.190487 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:59.190439 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt"] Jul 02 17:24:59.190896 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:24:59.190611 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" podUID="4c8a4be1-0b51-47f7-83ef-9051ee1104b7" containerName="istio-proxy" containerID="cri-o://380609cfc7e5480a944bd3d602bd1357866f1848df32a55579f1cb3cca19f57c" gracePeriod=30 Jul 02 17:25:05.334872 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.334837 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb"] Jul 02 17:25:05.337763 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.337739 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.340008 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.339918 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d4601268-openshift-default-dockercfg-5v224\"" Jul 02 17:25:05.350822 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.350760 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb"] Jul 02 17:25:05.453938 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.453899 2581 generic.go:356] "Generic (PLEG): container finished" podID="4c8a4be1-0b51-47f7-83ef-9051ee1104b7" containerID="380609cfc7e5480a944bd3d602bd1357866f1848df32a55579f1cb3cca19f57c" exitCode=0 Jul 02 17:25:05.454071 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.454001 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" event={"ID":"4c8a4be1-0b51-47f7-83ef-9051ee1104b7","Type":"ContainerDied","Data":"380609cfc7e5480a944bd3d602bd1357866f1848df32a55579f1cb3cca19f57c"} Jul 02 17:25:05.454071 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.454045 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" event={"ID":"4c8a4be1-0b51-47f7-83ef-9051ee1104b7","Type":"ContainerDied","Data":"ffae0d3f5e85ff201c670413aa09f55d7b14696d3640f8ff2102ab316d00caa2"} Jul 02 17:25:05.454071 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.454062 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffae0d3f5e85ff201c670413aa09f55d7b14696d3640f8ff2102ab316d00caa2" Jul 02 17:25:05.455922 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.455884 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:25:05.489016 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.488992 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxwbx\" (UniqueName: \"kubernetes.io/projected/a2491854-1693-41b8-9c84-3dbcfb982997-kube-api-access-vxwbx\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.489147 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.489028 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2491854-1693-41b8-9c84-3dbcfb982997-istio-token\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.489147 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.489047 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2491854-1693-41b8-9c84-3dbcfb982997-istiod-ca-cert\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.489223 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.489166 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2491854-1693-41b8-9c84-3dbcfb982997-istio-podinfo\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.489223 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.489216 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-credential-socket\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.489298 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.489245 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-workload-socket\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.489340 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.489305 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-workload-certs\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.489387 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.489353 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-istio-data\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.489432 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.489413 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-istio-envoy\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.589709 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.589653 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-podinfo\") pod \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " Jul 02 17:25:05.589709 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.589706 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istiod-ca-cert\") pod \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " Jul 02 17:25:05.589854 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.589747 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-workload-socket\") pod \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " Jul 02 17:25:05.589854 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.589771 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-credential-socket\") pod \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " Jul 02 17:25:05.589854 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.589811 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dlkp\" (UniqueName: \"kubernetes.io/projected/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-kube-api-access-9dlkp\") pod \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " Jul 02 17:25:05.589854 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.589843 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-workload-certs\") pod \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " Jul 02 17:25:05.590032 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.589878 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-envoy\") pod \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " Jul 02 17:25:05.590032 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.589915 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-token\") pod \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " Jul 02 17:25:05.590032 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.589941 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-data\") pod \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\" (UID: \"4c8a4be1-0b51-47f7-83ef-9051ee1104b7\") " Jul 02 17:25:05.590183 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.590074 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2491854-1693-41b8-9c84-3dbcfb982997-istio-token\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.590183 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.590092 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4c8a4be1-0b51-47f7-83ef-9051ee1104b7" (UID: "4c8a4be1-0b51-47f7-83ef-9051ee1104b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:05.590183 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.590101 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4c8a4be1-0b51-47f7-83ef-9051ee1104b7" (UID: "4c8a4be1-0b51-47f7-83ef-9051ee1104b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:05.590183 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.590116 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2491854-1693-41b8-9c84-3dbcfb982997-istiod-ca-cert\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.590183 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.590177 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2491854-1693-41b8-9c84-3dbcfb982997-istio-podinfo\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.590439 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.590193 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4c8a4be1-0b51-47f7-83ef-9051ee1104b7" (UID: "4c8a4be1-0b51-47f7-83ef-9051ee1104b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:25:05.590439 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.590209 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-credential-socket\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.590439 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.590236 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-workload-socket\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.590439 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.590295 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-workload-certs\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.590439 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.590311 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4c8a4be1-0b51-47f7-83ef-9051ee1104b7" (UID: "4c8a4be1-0b51-47f7-83ef-9051ee1104b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:05.590439 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.590378 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-istio-data\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.590439 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.590418 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-istio-envoy\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.590827 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.590506 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxwbx\" (UniqueName: \"kubernetes.io/projected/a2491854-1693-41b8-9c84-3dbcfb982997-kube-api-access-vxwbx\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.590827 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.590559 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-workload-socket\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:05.590827 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.590574 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-credential-socket\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:05.590827 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.590590 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-workload-certs\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:05.590827 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.590605 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istiod-ca-cert\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:05.590827 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.590751 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-workload-certs\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.591434 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.591154 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-istio-data\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.591559 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.591502 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-workload-socket\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.591626 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.591562 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-data" (OuterVolumeSpecName: "istio-data") pod "4c8a4be1-0b51-47f7-83ef-9051ee1104b7" (UID: "4c8a4be1-0b51-47f7-83ef-9051ee1104b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:05.592343 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.592321 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2491854-1693-41b8-9c84-3dbcfb982997-istiod-ca-cert\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.592504 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.592411 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4c8a4be1-0b51-47f7-83ef-9051ee1104b7" (UID: "4c8a4be1-0b51-47f7-83ef-9051ee1104b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 17:25:05.592659 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.592630 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-kube-api-access-9dlkp" (OuterVolumeSpecName: "kube-api-access-9dlkp") pod "4c8a4be1-0b51-47f7-83ef-9051ee1104b7" (UID: "4c8a4be1-0b51-47f7-83ef-9051ee1104b7"). InnerVolumeSpecName "kube-api-access-9dlkp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:25:05.592920 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.592898 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-credential-socket\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.593008 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.592933 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4c8a4be1-0b51-47f7-83ef-9051ee1104b7" (UID: "4c8a4be1-0b51-47f7-83ef-9051ee1104b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:05.593351 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.593328 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-token" (OuterVolumeSpecName: "istio-token") pod "4c8a4be1-0b51-47f7-83ef-9051ee1104b7" (UID: "4c8a4be1-0b51-47f7-83ef-9051ee1104b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:25:05.593723 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.593704 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-istio-envoy\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.594075 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.594060 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2491854-1693-41b8-9c84-3dbcfb982997-istio-podinfo\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.598725 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.598702 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxwbx\" (UniqueName: \"kubernetes.io/projected/a2491854-1693-41b8-9c84-3dbcfb982997-kube-api-access-vxwbx\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.599645 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.599613 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2491854-1693-41b8-9c84-3dbcfb982997-istio-token\") pod \"e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.657806 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.657785 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:05.691023 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.690998 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dlkp\" (UniqueName: \"kubernetes.io/projected/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-kube-api-access-9dlkp\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:05.691023 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.691024 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-envoy\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:05.691155 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.691035 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-token\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:05.691155 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.691043 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-data\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:05.691155 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.691051 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c8a4be1-0b51-47f7-83ef-9051ee1104b7-istio-podinfo\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:05.786928 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.786895 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb"] Jul 02 17:25:05.790030 ip-10-0-136-0 kubenswrapper[2581]: W0702 17:25:05.790004 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2491854_1693_41b8_9c84_3dbcfb982997.slice/crio-052279e3012787c7f054ee35fd28b071ad0a74dc985a24ae1eb62100cb000fd7 WatchSource:0}: Error finding container 052279e3012787c7f054ee35fd28b071ad0a74dc985a24ae1eb62100cb000fd7: Status 404 returned error can't find the container with id 052279e3012787c7f054ee35fd28b071ad0a74dc985a24ae1eb62100cb000fd7 Jul 02 17:25:05.792145 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.792113 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:25:05.792229 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.792175 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:25:05.792229 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:05.792202 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:25:06.459776 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:06.459743 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt" Jul 02 17:25:06.459776 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:06.459764 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" event={"ID":"a2491854-1693-41b8-9c84-3dbcfb982997","Type":"ContainerStarted","Data":"61b35c4cebc171a8ec48f1921a7d422c17f94aa0abbb0a9602164a53a82c2449"} Jul 02 17:25:06.460305 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:06.459808 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" event={"ID":"a2491854-1693-41b8-9c84-3dbcfb982997","Type":"ContainerStarted","Data":"052279e3012787c7f054ee35fd28b071ad0a74dc985a24ae1eb62100cb000fd7"} Jul 02 17:25:06.490929 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:06.490869 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" podStartSLOduration=1.490850529 podStartE2EDuration="1.490850529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:25:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:25:06.489257257 +0000 UTC m=+1685.679558416" watchObservedRunningTime="2026-07-02 17:25:06.490850529 +0000 UTC m=+1685.681151688" Jul 02 17:25:06.506905 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:06.506879 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt"] Jul 02 17:25:06.513602 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:06.513579 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e9de6c51-openshift-default-857d75bfc9-msjlt"] Jul 02 17:25:06.658581 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:06.658324 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:06.683661 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:06.683633 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:07.244206 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:07.244171 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c8a4be1-0b51-47f7-83ef-9051ee1104b7" path="/var/lib/kubelet/pods/4c8a4be1-0b51-47f7-83ef-9051ee1104b7/volumes" Jul 02 17:25:07.464514 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:07.464482 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:07.465544 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:07.465522 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:17.797150 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:17.797109 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb"] Jul 02 17:25:17.797572 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:17.797351 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" podUID="a2491854-1693-41b8-9c84-3dbcfb982997" containerName="istio-proxy" containerID="cri-o://61b35c4cebc171a8ec48f1921a7d422c17f94aa0abbb0a9602164a53a82c2449" gracePeriod=30 Jul 02 17:25:19.142632 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.142611 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:19.315222 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.315191 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxwbx\" (UniqueName: \"kubernetes.io/projected/a2491854-1693-41b8-9c84-3dbcfb982997-kube-api-access-vxwbx\") pod \"a2491854-1693-41b8-9c84-3dbcfb982997\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " Jul 02 17:25:19.315361 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.315236 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2491854-1693-41b8-9c84-3dbcfb982997-istio-podinfo\") pod \"a2491854-1693-41b8-9c84-3dbcfb982997\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " Jul 02 17:25:19.315361 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.315286 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-workload-socket\") pod \"a2491854-1693-41b8-9c84-3dbcfb982997\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " Jul 02 17:25:19.315361 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.315307 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-istio-envoy\") pod \"a2491854-1693-41b8-9c84-3dbcfb982997\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " Jul 02 17:25:19.315361 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.315355 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-workload-certs\") pod \"a2491854-1693-41b8-9c84-3dbcfb982997\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " Jul 02 17:25:19.315605 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.315421 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2491854-1693-41b8-9c84-3dbcfb982997-istiod-ca-cert\") pod \"a2491854-1693-41b8-9c84-3dbcfb982997\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " Jul 02 17:25:19.315758 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.315447 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-credential-socket\") pod \"a2491854-1693-41b8-9c84-3dbcfb982997\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " Jul 02 17:25:19.315758 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.315727 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2491854-1693-41b8-9c84-3dbcfb982997-istio-token\") pod \"a2491854-1693-41b8-9c84-3dbcfb982997\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " Jul 02 17:25:19.315917 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.315760 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-istio-data\") pod \"a2491854-1693-41b8-9c84-3dbcfb982997\" (UID: \"a2491854-1693-41b8-9c84-3dbcfb982997\") " Jul 02 17:25:19.315917 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.315646 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a2491854-1693-41b8-9c84-3dbcfb982997" (UID: "a2491854-1693-41b8-9c84-3dbcfb982997"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:19.316090 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.315701 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a2491854-1693-41b8-9c84-3dbcfb982997" (UID: "a2491854-1693-41b8-9c84-3dbcfb982997"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:19.316090 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.315727 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a2491854-1693-41b8-9c84-3dbcfb982997" (UID: "a2491854-1693-41b8-9c84-3dbcfb982997"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:19.316090 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.315856 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2491854-1693-41b8-9c84-3dbcfb982997-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a2491854-1693-41b8-9c84-3dbcfb982997" (UID: "a2491854-1693-41b8-9c84-3dbcfb982997"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:25:19.316304 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.316280 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-workload-socket\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:19.316360 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.316310 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-workload-certs\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:19.316360 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.316325 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2491854-1693-41b8-9c84-3dbcfb982997-istiod-ca-cert\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:19.316360 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.316339 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-credential-socket\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:19.316650 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.316631 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-istio-data" (OuterVolumeSpecName: "istio-data") pod "a2491854-1693-41b8-9c84-3dbcfb982997" (UID: "a2491854-1693-41b8-9c84-3dbcfb982997"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:19.317403 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.317377 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a2491854-1693-41b8-9c84-3dbcfb982997-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a2491854-1693-41b8-9c84-3dbcfb982997" (UID: "a2491854-1693-41b8-9c84-3dbcfb982997"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 17:25:19.317502 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.317407 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a2491854-1693-41b8-9c84-3dbcfb982997" (UID: "a2491854-1693-41b8-9c84-3dbcfb982997"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:19.317634 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.317616 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2491854-1693-41b8-9c84-3dbcfb982997-kube-api-access-vxwbx" (OuterVolumeSpecName: "kube-api-access-vxwbx") pod "a2491854-1693-41b8-9c84-3dbcfb982997" (UID: "a2491854-1693-41b8-9c84-3dbcfb982997"). InnerVolumeSpecName "kube-api-access-vxwbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:25:19.317774 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.317761 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2491854-1693-41b8-9c84-3dbcfb982997-istio-token" (OuterVolumeSpecName: "istio-token") pod "a2491854-1693-41b8-9c84-3dbcfb982997" (UID: "a2491854-1693-41b8-9c84-3dbcfb982997"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:25:19.417927 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.417894 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxwbx\" (UniqueName: \"kubernetes.io/projected/a2491854-1693-41b8-9c84-3dbcfb982997-kube-api-access-vxwbx\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:19.417927 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.417929 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2491854-1693-41b8-9c84-3dbcfb982997-istio-podinfo\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:19.418100 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.417942 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-istio-envoy\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:19.418100 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.417954 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2491854-1693-41b8-9c84-3dbcfb982997-istio-token\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:19.418100 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.417965 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2491854-1693-41b8-9c84-3dbcfb982997-istio-data\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:19.518359 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.518327 2581 generic.go:356] "Generic (PLEG): container finished" podID="a2491854-1693-41b8-9c84-3dbcfb982997" containerID="61b35c4cebc171a8ec48f1921a7d422c17f94aa0abbb0a9602164a53a82c2449" exitCode=0 Jul 02 17:25:19.518545 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.518361 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" event={"ID":"a2491854-1693-41b8-9c84-3dbcfb982997","Type":"ContainerDied","Data":"61b35c4cebc171a8ec48f1921a7d422c17f94aa0abbb0a9602164a53a82c2449"} Jul 02 17:25:19.518545 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.518387 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" Jul 02 17:25:19.518545 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.518417 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb" event={"ID":"a2491854-1693-41b8-9c84-3dbcfb982997","Type":"ContainerDied","Data":"052279e3012787c7f054ee35fd28b071ad0a74dc985a24ae1eb62100cb000fd7"} Jul 02 17:25:19.518545 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.518441 2581 scope.go:117] "RemoveContainer" containerID="61b35c4cebc171a8ec48f1921a7d422c17f94aa0abbb0a9602164a53a82c2449" Jul 02 17:25:19.527258 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.527241 2581 scope.go:117] "RemoveContainer" containerID="61b35c4cebc171a8ec48f1921a7d422c17f94aa0abbb0a9602164a53a82c2449" Jul 02 17:25:19.527509 ip-10-0-136-0 kubenswrapper[2581]: E0702 17:25:19.527491 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61b35c4cebc171a8ec48f1921a7d422c17f94aa0abbb0a9602164a53a82c2449\": container with ID starting with 61b35c4cebc171a8ec48f1921a7d422c17f94aa0abbb0a9602164a53a82c2449 not found: ID does not exist" containerID="61b35c4cebc171a8ec48f1921a7d422c17f94aa0abbb0a9602164a53a82c2449" Jul 02 17:25:19.527560 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.527519 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61b35c4cebc171a8ec48f1921a7d422c17f94aa0abbb0a9602164a53a82c2449"} err="failed to get container status \"61b35c4cebc171a8ec48f1921a7d422c17f94aa0abbb0a9602164a53a82c2449\": rpc error: code = NotFound desc = could not find container \"61b35c4cebc171a8ec48f1921a7d422c17f94aa0abbb0a9602164a53a82c2449\": container with ID starting with 61b35c4cebc171a8ec48f1921a7d422c17f94aa0abbb0a9602164a53a82c2449 not found: ID does not exist" Jul 02 17:25:19.539047 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.539024 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb"] Jul 02 17:25:19.543233 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:19.543213 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d4601268-openshift-default-7d96c99bf-rxcxb"] Jul 02 17:25:21.248076 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:21.248041 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2491854-1693-41b8-9c84-3dbcfb982997" path="/var/lib/kubelet/pods/a2491854-1693-41b8-9c84-3dbcfb982997/volumes" Jul 02 17:25:23.816857 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.816831 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz"] Jul 02 17:25:23.817163 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.817130 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2491854-1693-41b8-9c84-3dbcfb982997" containerName="istio-proxy" Jul 02 17:25:23.817163 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.817141 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2491854-1693-41b8-9c84-3dbcfb982997" containerName="istio-proxy" Jul 02 17:25:23.817163 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.817151 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c8a4be1-0b51-47f7-83ef-9051ee1104b7" containerName="istio-proxy" Jul 02 17:25:23.817163 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.817156 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c8a4be1-0b51-47f7-83ef-9051ee1104b7" containerName="istio-proxy" Jul 02 17:25:23.817291 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.817218 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2491854-1693-41b8-9c84-3dbcfb982997" containerName="istio-proxy" Jul 02 17:25:23.817291 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.817229 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c8a4be1-0b51-47f7-83ef-9051ee1104b7" containerName="istio-proxy" Jul 02 17:25:23.820163 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.820144 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.822806 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.822785 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-57f9f126-openshift-default-dockercfg-r4ztm\"" Jul 02 17:25:23.832223 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.832197 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz"] Jul 02 17:25:23.849916 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.849889 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-token\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.850013 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.849925 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7e1320d-40c4-417e-922e-0b1d714325f3-istiod-ca-cert\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.850062 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.850008 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-workload-certs\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.850062 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.850037 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-credential-socket\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.850275 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.850118 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-podinfo\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.850275 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.850142 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbk7w\" (UniqueName: \"kubernetes.io/projected/c7e1320d-40c4-417e-922e-0b1d714325f3-kube-api-access-rbk7w\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.850275 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.850250 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-workload-socket\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.850575 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.850342 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-envoy\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.850575 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.850397 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-data\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.951082 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.951056 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-data\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.951233 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.951091 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-token\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.951233 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.951115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7e1320d-40c4-417e-922e-0b1d714325f3-istiod-ca-cert\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.951233 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.951150 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-workload-certs\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.951233 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.951170 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-credential-socket\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.951233 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.951204 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-podinfo\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.951233 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.951218 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbk7w\" (UniqueName: \"kubernetes.io/projected/c7e1320d-40c4-417e-922e-0b1d714325f3-kube-api-access-rbk7w\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.951585 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.951243 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-workload-socket\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.951585 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.951271 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-envoy\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.951585 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.951529 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-data\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.951980 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.951582 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-workload-certs\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.951980 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.951639 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-credential-socket\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.951980 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.951696 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-workload-socket\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.952091 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.951981 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7e1320d-40c4-417e-922e-0b1d714325f3-istiod-ca-cert\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.953554 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.953532 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-envoy\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.953647 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.953609 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-podinfo\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.959384 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.959356 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-token\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:23.959484 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:23.959361 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbk7w\" (UniqueName: \"kubernetes.io/projected/c7e1320d-40c4-417e-922e-0b1d714325f3-kube-api-access-rbk7w\") pod \"e2e-derive-57f9f126-openshift-default-7474f98747-97pqz\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:24.133437 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:24.133360 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:24.263155 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:24.263024 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz"] Jul 02 17:25:24.265768 ip-10-0-136-0 kubenswrapper[2581]: W0702 17:25:24.265738 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7e1320d_40c4_417e_922e_0b1d714325f3.slice/crio-d50f1f2917d780eca82a4c5f11cee654853f22f0acf023a03b81ea55c3d3b42d WatchSource:0}: Error finding container d50f1f2917d780eca82a4c5f11cee654853f22f0acf023a03b81ea55c3d3b42d: Status 404 returned error can't find the container with id d50f1f2917d780eca82a4c5f11cee654853f22f0acf023a03b81ea55c3d3b42d Jul 02 17:25:24.267935 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:24.267903 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:25:24.268037 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:24.267965 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:25:24.268037 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:24.267993 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:25:24.542615 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:24.542573 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" event={"ID":"c7e1320d-40c4-417e-922e-0b1d714325f3","Type":"ContainerStarted","Data":"89f07727f8144f8381fb9d43b49743a8b9797b6196eb3bf410dd3f43133f66ee"} Jul 02 17:25:24.542783 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:24.542640 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" event={"ID":"c7e1320d-40c4-417e-922e-0b1d714325f3","Type":"ContainerStarted","Data":"d50f1f2917d780eca82a4c5f11cee654853f22f0acf023a03b81ea55c3d3b42d"} Jul 02 17:25:24.562108 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:24.562042 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" podStartSLOduration=1.5620263639999998 podStartE2EDuration="1.562026364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:25:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:25:24.560227517 +0000 UTC m=+1703.750528672" watchObservedRunningTime="2026-07-02 17:25:24.562026364 +0000 UTC m=+1703.752327522" Jul 02 17:25:25.134003 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:25.133974 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:25.138845 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:25.138821 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:25.547535 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:25.547499 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:25.548862 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:25.548836 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:29.593126 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:29.593090 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz"] Jul 02 17:25:29.593567 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:29.593287 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" podUID="c7e1320d-40c4-417e-922e-0b1d714325f3" containerName="istio-proxy" containerID="cri-o://89f07727f8144f8381fb9d43b49743a8b9797b6196eb3bf410dd3f43133f66ee" gracePeriod=30 Jul 02 17:25:35.748468 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.748430 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:35.858127 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.858061 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-workload-socket\") pod \"c7e1320d-40c4-417e-922e-0b1d714325f3\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " Jul 02 17:25:35.858127 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.858112 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-token\") pod \"c7e1320d-40c4-417e-922e-0b1d714325f3\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " Jul 02 17:25:35.858326 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.858149 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbk7w\" (UniqueName: \"kubernetes.io/projected/c7e1320d-40c4-417e-922e-0b1d714325f3-kube-api-access-rbk7w\") pod \"c7e1320d-40c4-417e-922e-0b1d714325f3\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " Jul 02 17:25:35.858326 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.858177 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-credential-socket\") pod \"c7e1320d-40c4-417e-922e-0b1d714325f3\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " Jul 02 17:25:35.858326 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.858192 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-envoy\") pod \"c7e1320d-40c4-417e-922e-0b1d714325f3\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " Jul 02 17:25:35.858326 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.858289 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-workload-certs\") pod \"c7e1320d-40c4-417e-922e-0b1d714325f3\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " Jul 02 17:25:35.858655 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.858326 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-data\") pod \"c7e1320d-40c4-417e-922e-0b1d714325f3\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " Jul 02 17:25:35.858655 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.858345 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c7e1320d-40c4-417e-922e-0b1d714325f3" (UID: "c7e1320d-40c4-417e-922e-0b1d714325f3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:35.858655 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.858357 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7e1320d-40c4-417e-922e-0b1d714325f3-istiod-ca-cert\") pod \"c7e1320d-40c4-417e-922e-0b1d714325f3\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " Jul 02 17:25:35.858655 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.858383 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-podinfo\") pod \"c7e1320d-40c4-417e-922e-0b1d714325f3\" (UID: \"c7e1320d-40c4-417e-922e-0b1d714325f3\") " Jul 02 17:25:35.858655 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.858533 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c7e1320d-40c4-417e-922e-0b1d714325f3" (UID: "c7e1320d-40c4-417e-922e-0b1d714325f3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:35.858918 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.858729 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-workload-socket\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:35.858918 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.858797 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-credential-socket\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:35.859020 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.858911 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7e1320d-40c4-417e-922e-0b1d714325f3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c7e1320d-40c4-417e-922e-0b1d714325f3" (UID: "c7e1320d-40c4-417e-922e-0b1d714325f3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:25:35.859020 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.858987 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c7e1320d-40c4-417e-922e-0b1d714325f3" (UID: "c7e1320d-40c4-417e-922e-0b1d714325f3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:35.859387 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.859365 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-data" (OuterVolumeSpecName: "istio-data") pod "c7e1320d-40c4-417e-922e-0b1d714325f3" (UID: "c7e1320d-40c4-417e-922e-0b1d714325f3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:35.860392 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.860374 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-token" (OuterVolumeSpecName: "istio-token") pod "c7e1320d-40c4-417e-922e-0b1d714325f3" (UID: "c7e1320d-40c4-417e-922e-0b1d714325f3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:25:35.860689 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.860673 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c7e1320d-40c4-417e-922e-0b1d714325f3" (UID: "c7e1320d-40c4-417e-922e-0b1d714325f3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 17:25:35.860795 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.860773 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c7e1320d-40c4-417e-922e-0b1d714325f3" (UID: "c7e1320d-40c4-417e-922e-0b1d714325f3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:35.860835 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.860780 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7e1320d-40c4-417e-922e-0b1d714325f3-kube-api-access-rbk7w" (OuterVolumeSpecName: "kube-api-access-rbk7w") pod "c7e1320d-40c4-417e-922e-0b1d714325f3" (UID: "c7e1320d-40c4-417e-922e-0b1d714325f3"). InnerVolumeSpecName "kube-api-access-rbk7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:25:35.959423 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.959398 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-token\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:35.959423 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.959420 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbk7w\" (UniqueName: \"kubernetes.io/projected/c7e1320d-40c4-417e-922e-0b1d714325f3-kube-api-access-rbk7w\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:35.959593 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.959429 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-envoy\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:35.959593 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.959439 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-workload-certs\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:35.959593 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.959447 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-data\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:35.959593 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.959475 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7e1320d-40c4-417e-922e-0b1d714325f3-istiod-ca-cert\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:35.959593 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:35.959483 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7e1320d-40c4-417e-922e-0b1d714325f3-istio-podinfo\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:25:36.596418 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:36.596383 2581 generic.go:356] "Generic (PLEG): container finished" podID="c7e1320d-40c4-417e-922e-0b1d714325f3" containerID="89f07727f8144f8381fb9d43b49743a8b9797b6196eb3bf410dd3f43133f66ee" exitCode=0 Jul 02 17:25:36.596604 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:36.596427 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" Jul 02 17:25:36.596604 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:36.596444 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" event={"ID":"c7e1320d-40c4-417e-922e-0b1d714325f3","Type":"ContainerDied","Data":"89f07727f8144f8381fb9d43b49743a8b9797b6196eb3bf410dd3f43133f66ee"} Jul 02 17:25:36.596604 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:36.596510 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz" event={"ID":"c7e1320d-40c4-417e-922e-0b1d714325f3","Type":"ContainerDied","Data":"d50f1f2917d780eca82a4c5f11cee654853f22f0acf023a03b81ea55c3d3b42d"} Jul 02 17:25:36.596604 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:36.596534 2581 scope.go:117] "RemoveContainer" containerID="89f07727f8144f8381fb9d43b49743a8b9797b6196eb3bf410dd3f43133f66ee" Jul 02 17:25:36.605198 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:36.605181 2581 scope.go:117] "RemoveContainer" containerID="89f07727f8144f8381fb9d43b49743a8b9797b6196eb3bf410dd3f43133f66ee" Jul 02 17:25:36.605446 ip-10-0-136-0 kubenswrapper[2581]: E0702 17:25:36.605427 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89f07727f8144f8381fb9d43b49743a8b9797b6196eb3bf410dd3f43133f66ee\": container with ID starting with 89f07727f8144f8381fb9d43b49743a8b9797b6196eb3bf410dd3f43133f66ee not found: ID does not exist" containerID="89f07727f8144f8381fb9d43b49743a8b9797b6196eb3bf410dd3f43133f66ee" Jul 02 17:25:36.605540 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:36.605475 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89f07727f8144f8381fb9d43b49743a8b9797b6196eb3bf410dd3f43133f66ee"} err="failed to get container status \"89f07727f8144f8381fb9d43b49743a8b9797b6196eb3bf410dd3f43133f66ee\": rpc error: code = NotFound desc = could not find container \"89f07727f8144f8381fb9d43b49743a8b9797b6196eb3bf410dd3f43133f66ee\": container with ID starting with 89f07727f8144f8381fb9d43b49743a8b9797b6196eb3bf410dd3f43133f66ee not found: ID does not exist" Jul 02 17:25:36.618837 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:36.618815 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz"] Jul 02 17:25:36.625619 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:36.625597 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-57f9f126-openshift-default-7474f98747-97pqz"] Jul 02 17:25:37.244328 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:25:37.244295 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7e1320d-40c4-417e-922e-0b1d714325f3" path="/var/lib/kubelet/pods/c7e1320d-40c4-417e-922e-0b1d714325f3/volumes" Jul 02 17:27:01.316519 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:01.316494 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lln24_1f9623eb-d52b-45dc-ae42-3fd20e210c7f/ovn-acl-logging/0.log" Jul 02 17:27:01.327189 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:01.327165 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lln24_1f9623eb-d52b-45dc-ae42-3fd20e210c7f/ovn-acl-logging/0.log" Jul 02 17:27:18.733951 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.733911 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd"] Jul 02 17:27:18.734384 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.734274 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7e1320d-40c4-417e-922e-0b1d714325f3" containerName="istio-proxy" Jul 02 17:27:18.734384 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.734287 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7e1320d-40c4-417e-922e-0b1d714325f3" containerName="istio-proxy" Jul 02 17:27:18.734384 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.734356 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7e1320d-40c4-417e-922e-0b1d714325f3" containerName="istio-proxy" Jul 02 17:27:18.736444 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.736427 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.738871 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.738852 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-33ec67fa-openshift-default-dockercfg-7rgln\"" Jul 02 17:27:18.757553 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.757528 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd"] Jul 02 17:27:18.784712 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.784687 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-workload-certs\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.784807 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.784719 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-credential-socket\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.784807 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.784740 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/176a07b7-2421-4225-bc2e-66414db74296-istio-podinfo\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.784880 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.784827 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-workload-socket\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.784880 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.784854 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/176a07b7-2421-4225-bc2e-66414db74296-istio-token\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.784948 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.784888 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wv4w\" (UniqueName: \"kubernetes.io/projected/176a07b7-2421-4225-bc2e-66414db74296-kube-api-access-7wv4w\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.784948 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.784930 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-istio-envoy\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.785013 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.784960 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-istio-data\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.785013 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.785002 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/176a07b7-2421-4225-bc2e-66414db74296-istiod-ca-cert\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.886086 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.886047 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-workload-socket\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.886086 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.886084 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/176a07b7-2421-4225-bc2e-66414db74296-istio-token\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.886306 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.886111 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wv4w\" (UniqueName: \"kubernetes.io/projected/176a07b7-2421-4225-bc2e-66414db74296-kube-api-access-7wv4w\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.886306 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.886145 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-istio-envoy\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.886306 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.886174 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-istio-data\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.886306 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.886200 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/176a07b7-2421-4225-bc2e-66414db74296-istiod-ca-cert\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.886306 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.886221 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-workload-certs\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.886306 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.886252 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-credential-socket\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.886668 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.886345 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/176a07b7-2421-4225-bc2e-66414db74296-istio-podinfo\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.886668 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.886605 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-workload-socket\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.887127 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.886665 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-istio-data\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.887127 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.886746 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-credential-socket\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.887127 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.886786 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-workload-certs\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.887127 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.887098 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/176a07b7-2421-4225-bc2e-66414db74296-istiod-ca-cert\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.888335 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.888313 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-istio-envoy\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.888763 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.888745 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/176a07b7-2421-4225-bc2e-66414db74296-istio-podinfo\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.893025 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.893005 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/176a07b7-2421-4225-bc2e-66414db74296-istio-token\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:18.893942 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:18.893925 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wv4w\" (UniqueName: \"kubernetes.io/projected/176a07b7-2421-4225-bc2e-66414db74296-kube-api-access-7wv4w\") pod \"e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:19.046295 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:19.046272 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:19.176946 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:19.176911 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd"] Jul 02 17:27:19.180745 ip-10-0-136-0 kubenswrapper[2581]: W0702 17:27:19.180718 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod176a07b7_2421_4225_bc2e_66414db74296.slice/crio-2f84c730afffb670dc029d818a3285c56029645a8f646544e1fd2d1fcd8b1cbe WatchSource:0}: Error finding container 2f84c730afffb670dc029d818a3285c56029645a8f646544e1fd2d1fcd8b1cbe: Status 404 returned error can't find the container with id 2f84c730afffb670dc029d818a3285c56029645a8f646544e1fd2d1fcd8b1cbe Jul 02 17:27:19.183341 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:19.183304 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:27:19.183434 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:19.183389 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:27:19.183493 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:19.183432 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:27:20.035304 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:20.035269 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" event={"ID":"176a07b7-2421-4225-bc2e-66414db74296","Type":"ContainerStarted","Data":"89eca3582ebfa32720a511e0ecdee4b10c55cdf17381536f7a8a7e3cf02cc136"} Jul 02 17:27:20.035701 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:20.035323 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" event={"ID":"176a07b7-2421-4225-bc2e-66414db74296","Type":"ContainerStarted","Data":"2f84c730afffb670dc029d818a3285c56029645a8f646544e1fd2d1fcd8b1cbe"} Jul 02 17:27:20.046654 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:20.046632 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:20.051283 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:20.051259 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:20.055065 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:20.055020 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" podStartSLOduration=2.055004721 podStartE2EDuration="2.055004721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:27:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:27:20.053083276 +0000 UTC m=+1819.243384435" watchObservedRunningTime="2026-07-02 17:27:20.055004721 +0000 UTC m=+1819.245305882" Jul 02 17:27:21.039798 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:21.039772 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:21.040795 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:21.040776 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:36.676637 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:36.675821 2581 patch_prober.go:28] interesting pod/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": read tcp 10.134.0.2:43794->10.134.0.34:15021: read: connection reset by peer" start-of-body= Jul 02 17:27:36.676637 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:36.675884 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" podUID="176a07b7-2421-4225-bc2e-66414db74296" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": read tcp 10.134.0.2:43794->10.134.0.34:15021: read: connection reset by peer" Jul 02 17:27:37.123561 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:37.123529 2581 generic.go:356] "Generic (PLEG): container finished" podID="176a07b7-2421-4225-bc2e-66414db74296" containerID="89eca3582ebfa32720a511e0ecdee4b10c55cdf17381536f7a8a7e3cf02cc136" exitCode=0 Jul 02 17:27:37.123731 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:37.123605 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" event={"ID":"176a07b7-2421-4225-bc2e-66414db74296","Type":"ContainerDied","Data":"89eca3582ebfa32720a511e0ecdee4b10c55cdf17381536f7a8a7e3cf02cc136"} Jul 02 17:27:37.124001 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:37.123985 2581 scope.go:117] "RemoveContainer" containerID="89eca3582ebfa32720a511e0ecdee4b10c55cdf17381536f7a8a7e3cf02cc136" Jul 02 17:27:37.125039 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:37.125010 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:27:37.125121 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:37.125080 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:27:37.125121 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:37.125116 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:27:38.131732 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:38.131689 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" event={"ID":"176a07b7-2421-4225-bc2e-66414db74296","Type":"ContainerStarted","Data":"0d8e47f3178f875bd29d49ca078c79a71cdcb4f94721266d0afb1c1697e05c7a"} Jul 02 17:27:39.046711 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:39.046677 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:39.046945 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:39.046923 2581 patch_prober.go:28] interesting pod/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 02 17:27:39.046997 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:39.046972 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" podUID="176a07b7-2421-4225-bc2e-66414db74296" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 02 17:27:40.046802 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:40.046768 2581 patch_prober.go:28] interesting pod/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 02 17:27:40.047213 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:40.046835 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" podUID="176a07b7-2421-4225-bc2e-66414db74296" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 02 17:27:40.519550 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:40.519515 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd"] Jul 02 17:27:40.519980 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:40.519951 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" podUID="176a07b7-2421-4225-bc2e-66414db74296" containerName="istio-proxy" containerID="cri-o://0d8e47f3178f875bd29d49ca078c79a71cdcb4f94721266d0afb1c1697e05c7a" gracePeriod=30 Jul 02 17:27:47.374942 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.374916 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:47.435276 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.435251 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-istio-data\") pod \"176a07b7-2421-4225-bc2e-66414db74296\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " Jul 02 17:27:47.435465 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.435314 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-workload-socket\") pod \"176a07b7-2421-4225-bc2e-66414db74296\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " Jul 02 17:27:47.435465 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.435368 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/176a07b7-2421-4225-bc2e-66414db74296-istio-token\") pod \"176a07b7-2421-4225-bc2e-66414db74296\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " Jul 02 17:27:47.435465 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.435400 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-workload-certs\") pod \"176a07b7-2421-4225-bc2e-66414db74296\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " Jul 02 17:27:47.435465 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.435422 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-credential-socket\") pod \"176a07b7-2421-4225-bc2e-66414db74296\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " Jul 02 17:27:47.435706 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.435475 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/176a07b7-2421-4225-bc2e-66414db74296-istiod-ca-cert\") pod \"176a07b7-2421-4225-bc2e-66414db74296\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " Jul 02 17:27:47.435706 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.435515 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wv4w\" (UniqueName: \"kubernetes.io/projected/176a07b7-2421-4225-bc2e-66414db74296-kube-api-access-7wv4w\") pod \"176a07b7-2421-4225-bc2e-66414db74296\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " Jul 02 17:27:47.435706 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.435548 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-istio-envoy\") pod \"176a07b7-2421-4225-bc2e-66414db74296\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " Jul 02 17:27:47.435706 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.435577 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/176a07b7-2421-4225-bc2e-66414db74296-istio-podinfo\") pod \"176a07b7-2421-4225-bc2e-66414db74296\" (UID: \"176a07b7-2421-4225-bc2e-66414db74296\") " Jul 02 17:27:47.435901 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.435711 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "176a07b7-2421-4225-bc2e-66414db74296" (UID: "176a07b7-2421-4225-bc2e-66414db74296"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:27:47.435901 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.435835 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "176a07b7-2421-4225-bc2e-66414db74296" (UID: "176a07b7-2421-4225-bc2e-66414db74296"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:27:47.436008 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.435957 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "176a07b7-2421-4225-bc2e-66414db74296" (UID: "176a07b7-2421-4225-bc2e-66414db74296"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:27:47.436181 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.436146 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-workload-certs\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:27:47.436274 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.436181 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-credential-socket\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:27:47.436274 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.436202 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-workload-socket\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:27:47.436274 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.436149 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-istio-data" (OuterVolumeSpecName: "istio-data") pod "176a07b7-2421-4225-bc2e-66414db74296" (UID: "176a07b7-2421-4225-bc2e-66414db74296"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:27:47.436274 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.436241 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/176a07b7-2421-4225-bc2e-66414db74296-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "176a07b7-2421-4225-bc2e-66414db74296" (UID: "176a07b7-2421-4225-bc2e-66414db74296"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:27:47.437779 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.437750 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/176a07b7-2421-4225-bc2e-66414db74296-kube-api-access-7wv4w" (OuterVolumeSpecName: "kube-api-access-7wv4w") pod "176a07b7-2421-4225-bc2e-66414db74296" (UID: "176a07b7-2421-4225-bc2e-66414db74296"). InnerVolumeSpecName "kube-api-access-7wv4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:27:47.437894 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.437817 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/176a07b7-2421-4225-bc2e-66414db74296-istio-token" (OuterVolumeSpecName: "istio-token") pod "176a07b7-2421-4225-bc2e-66414db74296" (UID: "176a07b7-2421-4225-bc2e-66414db74296"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:27:47.437957 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.437899 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/176a07b7-2421-4225-bc2e-66414db74296-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "176a07b7-2421-4225-bc2e-66414db74296" (UID: "176a07b7-2421-4225-bc2e-66414db74296"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 17:27:47.438018 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.437978 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "176a07b7-2421-4225-bc2e-66414db74296" (UID: "176a07b7-2421-4225-bc2e-66414db74296"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:27:47.537004 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.536973 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wv4w\" (UniqueName: \"kubernetes.io/projected/176a07b7-2421-4225-bc2e-66414db74296-kube-api-access-7wv4w\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:27:47.537004 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.537003 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-istio-envoy\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:27:47.537181 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.537018 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/176a07b7-2421-4225-bc2e-66414db74296-istio-podinfo\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:27:47.537181 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.537029 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/176a07b7-2421-4225-bc2e-66414db74296-istio-data\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:27:47.537181 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.537040 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/176a07b7-2421-4225-bc2e-66414db74296-istio-token\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:27:47.537181 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:47.537050 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/176a07b7-2421-4225-bc2e-66414db74296-istiod-ca-cert\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:27:48.179356 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:48.179324 2581 generic.go:356] "Generic (PLEG): container finished" podID="176a07b7-2421-4225-bc2e-66414db74296" containerID="0d8e47f3178f875bd29d49ca078c79a71cdcb4f94721266d0afb1c1697e05c7a" exitCode=0 Jul 02 17:27:48.179536 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:48.179365 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" event={"ID":"176a07b7-2421-4225-bc2e-66414db74296","Type":"ContainerDied","Data":"0d8e47f3178f875bd29d49ca078c79a71cdcb4f94721266d0afb1c1697e05c7a"} Jul 02 17:27:48.179536 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:48.179384 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" Jul 02 17:27:48.179536 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:48.179428 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd" event={"ID":"176a07b7-2421-4225-bc2e-66414db74296","Type":"ContainerDied","Data":"2f84c730afffb670dc029d818a3285c56029645a8f646544e1fd2d1fcd8b1cbe"} Jul 02 17:27:48.179536 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:48.179449 2581 scope.go:117] "RemoveContainer" containerID="0d8e47f3178f875bd29d49ca078c79a71cdcb4f94721266d0afb1c1697e05c7a" Jul 02 17:27:48.188056 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:48.188032 2581 scope.go:117] "RemoveContainer" containerID="89eca3582ebfa32720a511e0ecdee4b10c55cdf17381536f7a8a7e3cf02cc136" Jul 02 17:27:48.195403 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:48.195386 2581 scope.go:117] "RemoveContainer" containerID="0d8e47f3178f875bd29d49ca078c79a71cdcb4f94721266d0afb1c1697e05c7a" Jul 02 17:27:48.195646 ip-10-0-136-0 kubenswrapper[2581]: E0702 17:27:48.195628 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d8e47f3178f875bd29d49ca078c79a71cdcb4f94721266d0afb1c1697e05c7a\": container with ID starting with 0d8e47f3178f875bd29d49ca078c79a71cdcb4f94721266d0afb1c1697e05c7a not found: ID does not exist" containerID="0d8e47f3178f875bd29d49ca078c79a71cdcb4f94721266d0afb1c1697e05c7a" Jul 02 17:27:48.195698 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:48.195653 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d8e47f3178f875bd29d49ca078c79a71cdcb4f94721266d0afb1c1697e05c7a"} err="failed to get container status \"0d8e47f3178f875bd29d49ca078c79a71cdcb4f94721266d0afb1c1697e05c7a\": rpc error: code = NotFound desc = could not find container \"0d8e47f3178f875bd29d49ca078c79a71cdcb4f94721266d0afb1c1697e05c7a\": container with ID starting with 0d8e47f3178f875bd29d49ca078c79a71cdcb4f94721266d0afb1c1697e05c7a not found: ID does not exist" Jul 02 17:27:48.195698 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:48.195670 2581 scope.go:117] "RemoveContainer" containerID="89eca3582ebfa32720a511e0ecdee4b10c55cdf17381536f7a8a7e3cf02cc136" Jul 02 17:27:48.195889 ip-10-0-136-0 kubenswrapper[2581]: E0702 17:27:48.195872 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89eca3582ebfa32720a511e0ecdee4b10c55cdf17381536f7a8a7e3cf02cc136\": container with ID starting with 89eca3582ebfa32720a511e0ecdee4b10c55cdf17381536f7a8a7e3cf02cc136 not found: ID does not exist" containerID="89eca3582ebfa32720a511e0ecdee4b10c55cdf17381536f7a8a7e3cf02cc136" Jul 02 17:27:48.195930 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:48.195905 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89eca3582ebfa32720a511e0ecdee4b10c55cdf17381536f7a8a7e3cf02cc136"} err="failed to get container status \"89eca3582ebfa32720a511e0ecdee4b10c55cdf17381536f7a8a7e3cf02cc136\": rpc error: code = NotFound desc = could not find container \"89eca3582ebfa32720a511e0ecdee4b10c55cdf17381536f7a8a7e3cf02cc136\": container with ID starting with 89eca3582ebfa32720a511e0ecdee4b10c55cdf17381536f7a8a7e3cf02cc136 not found: ID does not exist" Jul 02 17:27:48.200016 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:48.199994 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd"] Jul 02 17:27:48.204388 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:48.204366 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-33ec67fa-openshift-default-65fc49d9bc-xjddd"] Jul 02 17:27:49.243365 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:49.243320 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="176a07b7-2421-4225-bc2e-66414db74296" path="/var/lib/kubelet/pods/176a07b7-2421-4225-bc2e-66414db74296/volumes" Jul 02 17:27:59.735642 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.735607 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm"] Jul 02 17:27:59.736015 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.735908 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="176a07b7-2421-4225-bc2e-66414db74296" containerName="istio-proxy" Jul 02 17:27:59.736015 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.735919 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="176a07b7-2421-4225-bc2e-66414db74296" containerName="istio-proxy" Jul 02 17:27:59.736015 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.735935 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="176a07b7-2421-4225-bc2e-66414db74296" containerName="istio-proxy" Jul 02 17:27:59.736015 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.735941 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="176a07b7-2421-4225-bc2e-66414db74296" containerName="istio-proxy" Jul 02 17:27:59.736015 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.735998 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="176a07b7-2421-4225-bc2e-66414db74296" containerName="istio-proxy" Jul 02 17:27:59.739165 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.739141 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.741579 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.741559 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-cfcf23f1-openshift-default-dockercfg-9g2wk\"" Jul 02 17:27:59.752056 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.752035 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm"] Jul 02 17:27:59.837756 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.837722 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-envoy\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.837917 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.837770 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtg2s\" (UniqueName: \"kubernetes.io/projected/66c2b256-36bb-495d-9d8f-bf65385f3fc9-kube-api-access-wtg2s\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.837917 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.837864 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-data\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.837917 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.837903 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-workload-socket\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.838094 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.837944 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-workload-certs\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.838094 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.837992 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istiod-ca-cert\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.838094 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.838014 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-credential-socket\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.838230 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.838102 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-token\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.838230 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.838141 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-podinfo\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.939375 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.939349 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-workload-certs\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.939564 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.939384 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istiod-ca-cert\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.939564 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.939404 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-credential-socket\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.939564 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.939490 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-token\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.939564 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.939523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-podinfo\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.939564 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.939564 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-envoy\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.939894 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.939870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtg2s\" (UniqueName: \"kubernetes.io/projected/66c2b256-36bb-495d-9d8f-bf65385f3fc9-kube-api-access-wtg2s\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.939894 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.939885 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-credential-socket\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.940018 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.939941 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-workload-certs\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.940018 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.939969 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-data\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.940018 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.940011 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-workload-socket\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.940234 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.940212 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-data\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.940310 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.940212 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istiod-ca-cert\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.940404 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.940382 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-workload-socket\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.941877 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.941854 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-envoy\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.942246 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.942224 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-podinfo\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.947643 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.947611 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-token\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:27:59.947880 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:27:59.947863 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtg2s\" (UniqueName: \"kubernetes.io/projected/66c2b256-36bb-495d-9d8f-bf65385f3fc9-kube-api-access-wtg2s\") pod \"e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:28:00.049338 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:00.049312 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:28:00.178939 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:00.178913 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm"] Jul 02 17:28:00.181362 ip-10-0-136-0 kubenswrapper[2581]: W0702 17:28:00.181331 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66c2b256_36bb_495d_9d8f_bf65385f3fc9.slice/crio-25d3b176849f0c1e78cdea0fd91286335f25332e20f0a252d15f5e866898f888 WatchSource:0}: Error finding container 25d3b176849f0c1e78cdea0fd91286335f25332e20f0a252d15f5e866898f888: Status 404 returned error can't find the container with id 25d3b176849f0c1e78cdea0fd91286335f25332e20f0a252d15f5e866898f888 Jul 02 17:28:00.183733 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:00.183695 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:28:00.183824 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:00.183774 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:28:00.183824 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:00.183813 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:28:00.233247 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:00.233219 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" event={"ID":"66c2b256-36bb-495d-9d8f-bf65385f3fc9","Type":"ContainerStarted","Data":"25d3b176849f0c1e78cdea0fd91286335f25332e20f0a252d15f5e866898f888"} Jul 02 17:28:01.243508 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:01.243450 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" event={"ID":"66c2b256-36bb-495d-9d8f-bf65385f3fc9","Type":"ContainerStarted","Data":"bc29e2f7ad110d76590c3fd4ded9def858a814dfadb194812426810cb91cdb9e"} Jul 02 17:28:01.263337 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:01.263290 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" podStartSLOduration=2.263274735 podStartE2EDuration="2.263274735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:27:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:28:01.261843015 +0000 UTC m=+1860.452144175" watchObservedRunningTime="2026-07-02 17:28:01.263274735 +0000 UTC m=+1860.453575892" Jul 02 17:28:02.050383 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:02.050344 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:28:02.055586 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:02.055561 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:28:02.243774 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:02.243741 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:28:02.244690 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:02.244668 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:28:16.307007 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:16.306973 2581 generic.go:356] "Generic (PLEG): container finished" podID="66c2b256-36bb-495d-9d8f-bf65385f3fc9" containerID="bc29e2f7ad110d76590c3fd4ded9def858a814dfadb194812426810cb91cdb9e" exitCode=0 Jul 02 17:28:16.307430 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:16.307044 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" event={"ID":"66c2b256-36bb-495d-9d8f-bf65385f3fc9","Type":"ContainerDied","Data":"bc29e2f7ad110d76590c3fd4ded9def858a814dfadb194812426810cb91cdb9e"} Jul 02 17:28:16.307430 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:16.307374 2581 scope.go:117] "RemoveContainer" containerID="bc29e2f7ad110d76590c3fd4ded9def858a814dfadb194812426810cb91cdb9e" Jul 02 17:28:16.308312 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:16.308283 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:28:16.308411 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:16.308359 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:28:16.308411 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:16.308404 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:28:17.244227 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:17.244196 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:28:17.318832 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:17.318794 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" event={"ID":"66c2b256-36bb-495d-9d8f-bf65385f3fc9","Type":"ContainerStarted","Data":"e1e1582a1669285819ef2936617e24ea32bda56ff224e75985484650accbfa86"} Jul 02 17:28:18.050121 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:18.050084 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:28:18.050995 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:18.050970 2581 patch_prober.go:28] interesting pod/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 02 17:28:18.051101 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:18.051021 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" podUID="66c2b256-36bb-495d-9d8f-bf65385f3fc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 02 17:28:19.049628 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:19.049593 2581 patch_prober.go:28] interesting pod/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 02 17:28:19.050005 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:19.049657 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" podUID="66c2b256-36bb-495d-9d8f-bf65385f3fc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 02 17:28:20.049723 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:20.049690 2581 patch_prober.go:28] interesting pod/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 02 17:28:20.050119 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:20.049740 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" podUID="66c2b256-36bb-495d-9d8f-bf65385f3fc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 02 17:28:21.050078 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:21.050038 2581 patch_prober.go:28] interesting pod/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 02 17:28:21.050502 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:21.050124 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" podUID="66c2b256-36bb-495d-9d8f-bf65385f3fc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 02 17:28:22.053894 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:22.053864 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:28:22.054256 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:22.054126 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:28:22.054776 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:28:22.054757 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:29:34.164936 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:34.164903 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm"] Jul 02 17:29:34.165367 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:34.165109 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" podUID="66c2b256-36bb-495d-9d8f-bf65385f3fc9" containerName="istio-proxy" containerID="cri-o://e1e1582a1669285819ef2936617e24ea32bda56ff224e75985484650accbfa86" gracePeriod=30 Jul 02 17:29:37.056513 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:37.056476 2581 patch_prober.go:28] interesting pod/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 02 17:29:37.056937 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:37.056541 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" podUID="66c2b256-36bb-495d-9d8f-bf65385f3fc9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 17:29:39.403838 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.403813 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:29:39.458744 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.458669 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istiod-ca-cert\") pod \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " Jul 02 17:29:39.458744 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.458705 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-envoy\") pod \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " Jul 02 17:29:39.458744 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.458735 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-workload-socket\") pod \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " Jul 02 17:29:39.458969 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.458760 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-credential-socket\") pod \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " Jul 02 17:29:39.458969 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.458855 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-workload-certs\") pod \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " Jul 02 17:29:39.458969 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.458904 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-data\") pod \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " Jul 02 17:29:39.458969 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.458934 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-token\") pod \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " Jul 02 17:29:39.459173 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.458969 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-podinfo\") pod \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " Jul 02 17:29:39.459173 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.459007 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtg2s\" (UniqueName: \"kubernetes.io/projected/66c2b256-36bb-495d-9d8f-bf65385f3fc9-kube-api-access-wtg2s\") pod \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\" (UID: \"66c2b256-36bb-495d-9d8f-bf65385f3fc9\") " Jul 02 17:29:39.459173 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.459041 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "66c2b256-36bb-495d-9d8f-bf65385f3fc9" (UID: "66c2b256-36bb-495d-9d8f-bf65385f3fc9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:29:39.459173 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.459083 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "66c2b256-36bb-495d-9d8f-bf65385f3fc9" (UID: "66c2b256-36bb-495d-9d8f-bf65385f3fc9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:29:39.459173 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.459066 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "66c2b256-36bb-495d-9d8f-bf65385f3fc9" (UID: "66c2b256-36bb-495d-9d8f-bf65385f3fc9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:29:39.459438 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.459329 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istiod-ca-cert\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:29:39.459438 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.459346 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-workload-socket\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:29:39.459438 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.459359 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-credential-socket\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:29:39.459635 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.459488 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "66c2b256-36bb-495d-9d8f-bf65385f3fc9" (UID: "66c2b256-36bb-495d-9d8f-bf65385f3fc9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:29:39.459975 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.459948 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-data" (OuterVolumeSpecName: "istio-data") pod "66c2b256-36bb-495d-9d8f-bf65385f3fc9" (UID: "66c2b256-36bb-495d-9d8f-bf65385f3fc9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:29:39.461137 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.461099 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-token" (OuterVolumeSpecName: "istio-token") pod "66c2b256-36bb-495d-9d8f-bf65385f3fc9" (UID: "66c2b256-36bb-495d-9d8f-bf65385f3fc9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:29:39.461332 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.461311 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66c2b256-36bb-495d-9d8f-bf65385f3fc9-kube-api-access-wtg2s" (OuterVolumeSpecName: "kube-api-access-wtg2s") pod "66c2b256-36bb-495d-9d8f-bf65385f3fc9" (UID: "66c2b256-36bb-495d-9d8f-bf65385f3fc9"). InnerVolumeSpecName "kube-api-access-wtg2s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:29:39.461332 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.461312 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "66c2b256-36bb-495d-9d8f-bf65385f3fc9" (UID: "66c2b256-36bb-495d-9d8f-bf65385f3fc9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 17:29:39.461471 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.461314 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "66c2b256-36bb-495d-9d8f-bf65385f3fc9" (UID: "66c2b256-36bb-495d-9d8f-bf65385f3fc9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:29:39.560467 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.560436 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-envoy\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:29:39.560603 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.560483 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-workload-certs\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:29:39.560603 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.560498 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-data\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:29:39.560603 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.560508 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-token\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:29:39.560603 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.560519 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66c2b256-36bb-495d-9d8f-bf65385f3fc9-istio-podinfo\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:29:39.560603 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.560532 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtg2s\" (UniqueName: \"kubernetes.io/projected/66c2b256-36bb-495d-9d8f-bf65385f3fc9-kube-api-access-wtg2s\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:29:39.675056 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.675026 2581 generic.go:356] "Generic (PLEG): container finished" podID="66c2b256-36bb-495d-9d8f-bf65385f3fc9" containerID="e1e1582a1669285819ef2936617e24ea32bda56ff224e75985484650accbfa86" exitCode=0 Jul 02 17:29:39.675175 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.675084 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" Jul 02 17:29:39.675175 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.675104 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" event={"ID":"66c2b256-36bb-495d-9d8f-bf65385f3fc9","Type":"ContainerDied","Data":"e1e1582a1669285819ef2936617e24ea32bda56ff224e75985484650accbfa86"} Jul 02 17:29:39.675175 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.675165 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm" event={"ID":"66c2b256-36bb-495d-9d8f-bf65385f3fc9","Type":"ContainerDied","Data":"25d3b176849f0c1e78cdea0fd91286335f25332e20f0a252d15f5e866898f888"} Jul 02 17:29:39.675279 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.675189 2581 scope.go:117] "RemoveContainer" containerID="e1e1582a1669285819ef2936617e24ea32bda56ff224e75985484650accbfa86" Jul 02 17:29:39.683587 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.683571 2581 scope.go:117] "RemoveContainer" containerID="bc29e2f7ad110d76590c3fd4ded9def858a814dfadb194812426810cb91cdb9e" Jul 02 17:29:39.690676 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.690659 2581 scope.go:117] "RemoveContainer" containerID="e1e1582a1669285819ef2936617e24ea32bda56ff224e75985484650accbfa86" Jul 02 17:29:39.690920 ip-10-0-136-0 kubenswrapper[2581]: E0702 17:29:39.690901 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1e1582a1669285819ef2936617e24ea32bda56ff224e75985484650accbfa86\": container with ID starting with e1e1582a1669285819ef2936617e24ea32bda56ff224e75985484650accbfa86 not found: ID does not exist" containerID="e1e1582a1669285819ef2936617e24ea32bda56ff224e75985484650accbfa86" Jul 02 17:29:39.690978 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.690928 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1e1582a1669285819ef2936617e24ea32bda56ff224e75985484650accbfa86"} err="failed to get container status \"e1e1582a1669285819ef2936617e24ea32bda56ff224e75985484650accbfa86\": rpc error: code = NotFound desc = could not find container \"e1e1582a1669285819ef2936617e24ea32bda56ff224e75985484650accbfa86\": container with ID starting with e1e1582a1669285819ef2936617e24ea32bda56ff224e75985484650accbfa86 not found: ID does not exist" Jul 02 17:29:39.690978 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.690945 2581 scope.go:117] "RemoveContainer" containerID="bc29e2f7ad110d76590c3fd4ded9def858a814dfadb194812426810cb91cdb9e" Jul 02 17:29:39.691155 ip-10-0-136-0 kubenswrapper[2581]: E0702 17:29:39.691140 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc29e2f7ad110d76590c3fd4ded9def858a814dfadb194812426810cb91cdb9e\": container with ID starting with bc29e2f7ad110d76590c3fd4ded9def858a814dfadb194812426810cb91cdb9e not found: ID does not exist" containerID="bc29e2f7ad110d76590c3fd4ded9def858a814dfadb194812426810cb91cdb9e" Jul 02 17:29:39.691191 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.691159 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc29e2f7ad110d76590c3fd4ded9def858a814dfadb194812426810cb91cdb9e"} err="failed to get container status \"bc29e2f7ad110d76590c3fd4ded9def858a814dfadb194812426810cb91cdb9e\": rpc error: code = NotFound desc = could not find container \"bc29e2f7ad110d76590c3fd4ded9def858a814dfadb194812426810cb91cdb9e\": container with ID starting with bc29e2f7ad110d76590c3fd4ded9def858a814dfadb194812426810cb91cdb9e not found: ID does not exist" Jul 02 17:29:39.695626 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.695606 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm"] Jul 02 17:29:39.699248 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:39.699224 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-cfcf23f1-openshift-default-6c7b465c75-qwdbm"] Jul 02 17:29:41.245162 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:29:41.245130 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66c2b256-36bb-495d-9d8f-bf65385f3fc9" path="/var/lib/kubelet/pods/66c2b256-36bb-495d-9d8f-bf65385f3fc9/volumes" Jul 02 17:30:29.053407 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.053375 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq"] Jul 02 17:30:29.053839 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.053715 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66c2b256-36bb-495d-9d8f-bf65385f3fc9" containerName="istio-proxy" Jul 02 17:30:29.053839 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.053727 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="66c2b256-36bb-495d-9d8f-bf65385f3fc9" containerName="istio-proxy" Jul 02 17:30:29.053839 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.053736 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66c2b256-36bb-495d-9d8f-bf65385f3fc9" containerName="istio-proxy" Jul 02 17:30:29.053839 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.053742 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="66c2b256-36bb-495d-9d8f-bf65385f3fc9" containerName="istio-proxy" Jul 02 17:30:29.053839 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.053800 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="66c2b256-36bb-495d-9d8f-bf65385f3fc9" containerName="istio-proxy" Jul 02 17:30:29.053839 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.053808 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="176a07b7-2421-4225-bc2e-66414db74296" containerName="istio-proxy" Jul 02 17:30:29.056063 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.056044 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.058417 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.058390 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-ec100e-openshift-default-dockercfg-w9z8w\"" Jul 02 17:30:29.068449 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.068428 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq"] Jul 02 17:30:29.156961 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.156925 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-istio-envoy\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.156961 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.156962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9fb7578-d630-4628-9f44-545f02da4cde-istio-token\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.157196 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.156982 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b6dp\" (UniqueName: \"kubernetes.io/projected/f9fb7578-d630-4628-9f44-545f02da4cde-kube-api-access-8b6dp\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.157196 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.157073 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-istio-data\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.157196 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.157123 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-credential-socket\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.157196 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.157153 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9fb7578-d630-4628-9f44-545f02da4cde-istio-podinfo\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.157196 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.157178 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9fb7578-d630-4628-9f44-545f02da4cde-istiod-ca-cert\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.157196 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.157196 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-workload-socket\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.157477 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.157283 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-workload-certs\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.257844 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.257813 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-workload-certs\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.257844 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.257847 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-istio-envoy\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.258074 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.257869 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9fb7578-d630-4628-9f44-545f02da4cde-istio-token\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.258074 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.257884 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b6dp\" (UniqueName: \"kubernetes.io/projected/f9fb7578-d630-4628-9f44-545f02da4cde-kube-api-access-8b6dp\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.258074 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.257936 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-istio-data\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.258074 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.257967 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-credential-socket\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.258074 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.257995 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9fb7578-d630-4628-9f44-545f02da4cde-istio-podinfo\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.258074 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.258029 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9fb7578-d630-4628-9f44-545f02da4cde-istiod-ca-cert\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.258074 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.258053 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-workload-socket\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.258439 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.258231 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-workload-certs\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.258439 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.258412 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-istio-data\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.258439 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.258426 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-workload-socket\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.258587 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.258490 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-credential-socket\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.258794 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.258776 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9fb7578-d630-4628-9f44-545f02da4cde-istiod-ca-cert\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.260139 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.260118 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-istio-envoy\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.260381 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.260359 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9fb7578-d630-4628-9f44-545f02da4cde-istio-podinfo\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.265291 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.265265 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b6dp\" (UniqueName: \"kubernetes.io/projected/f9fb7578-d630-4628-9f44-545f02da4cde-kube-api-access-8b6dp\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.265291 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.265280 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9fb7578-d630-4628-9f44-545f02da4cde-istio-token\") pod \"e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.365661 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.365599 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:29.503420 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.503393 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq"] Jul 02 17:30:29.506034 ip-10-0-136-0 kubenswrapper[2581]: W0702 17:30:29.506007 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9fb7578_d630_4628_9f44_545f02da4cde.slice/crio-a3ce0784a3981e07c5abafa7456c2b4a514c12a7e3108a8a7e124b324f21fed1 WatchSource:0}: Error finding container a3ce0784a3981e07c5abafa7456c2b4a514c12a7e3108a8a7e124b324f21fed1: Status 404 returned error can't find the container with id a3ce0784a3981e07c5abafa7456c2b4a514c12a7e3108a8a7e124b324f21fed1 Jul 02 17:30:29.508090 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.508052 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:30:29.508152 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.508136 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:30:29.508195 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.508180 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:30:29.896146 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.896110 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" event={"ID":"f9fb7578-d630-4628-9f44-545f02da4cde","Type":"ContainerStarted","Data":"9f017ab4962fbc6ae5ecdbbb646d4511078d5728d82f75fb828b66630c38786d"} Jul 02 17:30:29.896320 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.896166 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" event={"ID":"f9fb7578-d630-4628-9f44-545f02da4cde","Type":"ContainerStarted","Data":"a3ce0784a3981e07c5abafa7456c2b4a514c12a7e3108a8a7e124b324f21fed1"} Jul 02 17:30:29.920174 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:29.920121 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" podStartSLOduration=0.920106389 podStartE2EDuration="920.106389ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:30:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:30:29.919220405 +0000 UTC m=+2009.109521564" watchObservedRunningTime="2026-07-02 17:30:29.920106389 +0000 UTC m=+2009.110407547" Jul 02 17:30:30.366542 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:30.366513 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:30.371647 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:30.371616 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:30.900228 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:30.900200 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:30.901170 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:30.901147 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:37.055400 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.055366 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j"] Jul 02 17:30:37.056030 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.055989 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="66c2b256-36bb-495d-9d8f-bf65385f3fc9" containerName="istio-proxy" Jul 02 17:30:37.058746 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.058722 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.061030 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.061012 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-fcb6e8-openshift-default-dockercfg-jpswd\"" Jul 02 17:30:37.071077 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.071057 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j"] Jul 02 17:30:37.119977 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.119946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90d766bc-a08a-4967-8b9b-980c4524f46e-istiod-ca-cert\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.119977 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.119977 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-workload-socket\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.120166 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.119995 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-workload-certs\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.120166 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.120010 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-podinfo\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.120166 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.120106 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-credential-socket\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.120166 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.120160 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-data\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.120387 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.120234 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-token\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.120387 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.120283 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzlvd\" (UniqueName: \"kubernetes.io/projected/90d766bc-a08a-4967-8b9b-980c4524f46e-kube-api-access-qzlvd\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.120387 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.120320 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-envoy\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.221553 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.221517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90d766bc-a08a-4967-8b9b-980c4524f46e-istiod-ca-cert\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.221553 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.221555 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-workload-socket\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.221801 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.221569 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-workload-certs\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.221801 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.221585 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-podinfo\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.221801 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.221616 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-credential-socket\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.221801 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.221641 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-data\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.221801 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.221676 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-token\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.221801 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.221696 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzlvd\" (UniqueName: \"kubernetes.io/projected/90d766bc-a08a-4967-8b9b-980c4524f46e-kube-api-access-qzlvd\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.221801 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.221724 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-envoy\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.222216 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.222015 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-workload-socket\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.222216 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.222052 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-workload-certs\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.222216 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.222205 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-data\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.222366 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.222270 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-credential-socket\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.222610 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.222589 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90d766bc-a08a-4967-8b9b-980c4524f46e-istiod-ca-cert\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.224054 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.224030 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-envoy\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.224379 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.224359 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-podinfo\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.232950 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.232923 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzlvd\" (UniqueName: \"kubernetes.io/projected/90d766bc-a08a-4967-8b9b-980c4524f46e-kube-api-access-qzlvd\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.233266 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.233243 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-token\") pod \"e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.369212 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.369133 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:37.504943 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.504916 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j"] Jul 02 17:30:37.507267 ip-10-0-136-0 kubenswrapper[2581]: W0702 17:30:37.507245 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90d766bc_a08a_4967_8b9b_980c4524f46e.slice/crio-913cad1cb3abf30f8b464a39dbdbbb03a1f8dd32bbbb35e6321967f72f69e914 WatchSource:0}: Error finding container 913cad1cb3abf30f8b464a39dbdbbb03a1f8dd32bbbb35e6321967f72f69e914: Status 404 returned error can't find the container with id 913cad1cb3abf30f8b464a39dbdbbb03a1f8dd32bbbb35e6321967f72f69e914 Jul 02 17:30:37.509469 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.509425 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:30:37.509573 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.509532 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:30:37.509637 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.509575 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:30:37.931140 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.931103 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" event={"ID":"90d766bc-a08a-4967-8b9b-980c4524f46e","Type":"ContainerStarted","Data":"12f762c7e996c4eb3390505400dca1b12da50098ffefde0cdd2aaad00deaeb33"} Jul 02 17:30:37.931332 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.931161 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" event={"ID":"90d766bc-a08a-4967-8b9b-980c4524f46e","Type":"ContainerStarted","Data":"913cad1cb3abf30f8b464a39dbdbbb03a1f8dd32bbbb35e6321967f72f69e914"} Jul 02 17:30:37.948596 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:37.948536 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" podStartSLOduration=0.948519642 podStartE2EDuration="948.519642ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:30:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:30:37.947831479 +0000 UTC m=+2017.138132637" watchObservedRunningTime="2026-07-02 17:30:37.948519642 +0000 UTC m=+2017.138820800" Jul 02 17:30:38.369754 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:38.369720 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:38.374118 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:38.374096 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:38.935564 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:38.935529 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:38.936547 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:38.936531 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:46.941668 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:46.941621 2581 patch_prober.go:28] interesting pod/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 02 17:30:46.942088 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:46.941707 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" podUID="f9fb7578-d630-4628-9f44-545f02da4cde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 02 17:30:48.984331 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:48.984300 2581 generic.go:356] "Generic (PLEG): container finished" podID="f9fb7578-d630-4628-9f44-545f02da4cde" containerID="9f017ab4962fbc6ae5ecdbbb646d4511078d5728d82f75fb828b66630c38786d" exitCode=0 Jul 02 17:30:48.984790 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:48.984383 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" event={"ID":"f9fb7578-d630-4628-9f44-545f02da4cde","Type":"ContainerDied","Data":"9f017ab4962fbc6ae5ecdbbb646d4511078d5728d82f75fb828b66630c38786d"} Jul 02 17:30:48.984790 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:48.984788 2581 scope.go:117] "RemoveContainer" containerID="9f017ab4962fbc6ae5ecdbbb646d4511078d5728d82f75fb828b66630c38786d" Jul 02 17:30:48.985839 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:48.985813 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:30:48.985894 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:48.985876 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:30:48.985947 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:48.985935 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:30:49.990845 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:49.990809 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" event={"ID":"f9fb7578-d630-4628-9f44-545f02da4cde","Type":"ContainerStarted","Data":"2ee6ebc574de8b9c30f7e610754f72c4028f74d1105bf9e9c98e9f4035154e83"} Jul 02 17:30:50.366259 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:50.366134 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:50.366399 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:50.366344 2581 patch_prober.go:28] interesting pod/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 02 17:30:50.366490 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:50.366403 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" podUID="f9fb7578-d630-4628-9f44-545f02da4cde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 02 17:30:51.366763 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:51.366713 2581 patch_prober.go:28] interesting pod/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 02 17:30:51.367143 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:51.366787 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" podUID="f9fb7578-d630-4628-9f44-545f02da4cde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 02 17:30:52.366859 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:52.366821 2581 patch_prober.go:28] interesting pod/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 02 17:30:52.367235 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:52.366887 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" podUID="f9fb7578-d630-4628-9f44-545f02da4cde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 02 17:30:53.366302 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:53.366260 2581 patch_prober.go:28] interesting pod/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 02 17:30:53.366491 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:53.366323 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" podUID="f9fb7578-d630-4628-9f44-545f02da4cde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 02 17:30:54.370712 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:54.370682 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:54.371147 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:54.370948 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:54.371860 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:54.371842 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:30:54.844072 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:54.843618 2581 patch_prober.go:28] interesting pod/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": read tcp 10.134.0.2:44636->10.134.0.37:15021: read: connection reset by peer" start-of-body= Jul 02 17:30:54.844072 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:54.843694 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" podUID="90d766bc-a08a-4967-8b9b-980c4524f46e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": read tcp 10.134.0.2:44636->10.134.0.37:15021: read: connection reset by peer" Jul 02 17:30:55.016127 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:55.016055 2581 generic.go:356] "Generic (PLEG): container finished" podID="90d766bc-a08a-4967-8b9b-980c4524f46e" containerID="12f762c7e996c4eb3390505400dca1b12da50098ffefde0cdd2aaad00deaeb33" exitCode=0 Jul 02 17:30:55.016270 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:55.016129 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" event={"ID":"90d766bc-a08a-4967-8b9b-980c4524f46e","Type":"ContainerDied","Data":"12f762c7e996c4eb3390505400dca1b12da50098ffefde0cdd2aaad00deaeb33"} Jul 02 17:30:55.016652 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:55.016637 2581 scope.go:117] "RemoveContainer" containerID="12f762c7e996c4eb3390505400dca1b12da50098ffefde0cdd2aaad00deaeb33" Jul 02 17:30:55.017568 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:55.017543 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:30:55.017635 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:55.017606 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:30:55.017679 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:55.017634 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:30:56.034161 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:56.034123 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" event={"ID":"90d766bc-a08a-4967-8b9b-980c4524f46e","Type":"ContainerStarted","Data":"82bb5f75eb6170219aed8fafdb00e7c3ce301c095806d78f79cbb887b98963c2"} Jul 02 17:30:56.370201 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:56.370109 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:30:56.370355 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:56.370309 2581 patch_prober.go:28] interesting pod/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 02 17:30:56.370397 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:56.370360 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" podUID="90d766bc-a08a-4967-8b9b-980c4524f46e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 02 17:30:57.370236 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:57.370204 2581 patch_prober.go:28] interesting pod/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 02 17:30:57.370658 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:57.370254 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" podUID="90d766bc-a08a-4967-8b9b-980c4524f46e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 02 17:30:58.369923 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:58.369888 2581 patch_prober.go:28] interesting pod/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 02 17:30:58.370103 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:58.369934 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" podUID="90d766bc-a08a-4967-8b9b-980c4524f46e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 02 17:30:59.370077 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:59.370040 2581 patch_prober.go:28] interesting pod/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 02 17:30:59.370496 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:30:59.370094 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" podUID="90d766bc-a08a-4967-8b9b-980c4524f46e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 02 17:31:00.373088 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:31:00.373060 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:31:00.373473 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:31:00.373338 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:31:00.374108 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:31:00.374093 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:31:01.400488 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:31:01.400439 2581 scope.go:117] "RemoveContainer" containerID="380609cfc7e5480a944bd3d602bd1357866f1848df32a55579f1cb3cca19f57c" Jul 02 17:32:01.341960 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:01.341924 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lln24_1f9623eb-d52b-45dc-ae42-3fd20e210c7f/ovn-acl-logging/0.log" Jul 02 17:32:01.354112 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:01.354081 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lln24_1f9623eb-d52b-45dc-ae42-3fd20e210c7f/ovn-acl-logging/0.log" Jul 02 17:32:11.128428 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:11.128396 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq"] Jul 02 17:32:11.128936 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:11.128685 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" podUID="f9fb7578-d630-4628-9f44-545f02da4cde" containerName="istio-proxy" containerID="cri-o://2ee6ebc574de8b9c30f7e610754f72c4028f74d1105bf9e9c98e9f4035154e83" gracePeriod=30 Jul 02 17:32:16.379832 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.379807 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:32:16.381743 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.381716 2581 generic.go:356] "Generic (PLEG): container finished" podID="f9fb7578-d630-4628-9f44-545f02da4cde" containerID="2ee6ebc574de8b9c30f7e610754f72c4028f74d1105bf9e9c98e9f4035154e83" exitCode=0 Jul 02 17:32:16.381840 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.381759 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" Jul 02 17:32:16.381840 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.381760 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" event={"ID":"f9fb7578-d630-4628-9f44-545f02da4cde","Type":"ContainerDied","Data":"2ee6ebc574de8b9c30f7e610754f72c4028f74d1105bf9e9c98e9f4035154e83"} Jul 02 17:32:16.381913 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.381841 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq" event={"ID":"f9fb7578-d630-4628-9f44-545f02da4cde","Type":"ContainerDied","Data":"a3ce0784a3981e07c5abafa7456c2b4a514c12a7e3108a8a7e124b324f21fed1"} Jul 02 17:32:16.381913 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.381865 2581 scope.go:117] "RemoveContainer" containerID="2ee6ebc574de8b9c30f7e610754f72c4028f74d1105bf9e9c98e9f4035154e83" Jul 02 17:32:16.389826 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.389805 2581 scope.go:117] "RemoveContainer" containerID="9f017ab4962fbc6ae5ecdbbb646d4511078d5728d82f75fb828b66630c38786d" Jul 02 17:32:16.398329 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.398263 2581 scope.go:117] "RemoveContainer" containerID="2ee6ebc574de8b9c30f7e610754f72c4028f74d1105bf9e9c98e9f4035154e83" Jul 02 17:32:16.398804 ip-10-0-136-0 kubenswrapper[2581]: E0702 17:32:16.398776 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ee6ebc574de8b9c30f7e610754f72c4028f74d1105bf9e9c98e9f4035154e83\": container with ID starting with 2ee6ebc574de8b9c30f7e610754f72c4028f74d1105bf9e9c98e9f4035154e83 not found: ID does not exist" containerID="2ee6ebc574de8b9c30f7e610754f72c4028f74d1105bf9e9c98e9f4035154e83" Jul 02 17:32:16.398917 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.398813 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ee6ebc574de8b9c30f7e610754f72c4028f74d1105bf9e9c98e9f4035154e83"} err="failed to get container status \"2ee6ebc574de8b9c30f7e610754f72c4028f74d1105bf9e9c98e9f4035154e83\": rpc error: code = NotFound desc = could not find container \"2ee6ebc574de8b9c30f7e610754f72c4028f74d1105bf9e9c98e9f4035154e83\": container with ID starting with 2ee6ebc574de8b9c30f7e610754f72c4028f74d1105bf9e9c98e9f4035154e83 not found: ID does not exist" Jul 02 17:32:16.398917 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.398837 2581 scope.go:117] "RemoveContainer" containerID="9f017ab4962fbc6ae5ecdbbb646d4511078d5728d82f75fb828b66630c38786d" Jul 02 17:32:16.399214 ip-10-0-136-0 kubenswrapper[2581]: E0702 17:32:16.399184 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f017ab4962fbc6ae5ecdbbb646d4511078d5728d82f75fb828b66630c38786d\": container with ID starting with 9f017ab4962fbc6ae5ecdbbb646d4511078d5728d82f75fb828b66630c38786d not found: ID does not exist" containerID="9f017ab4962fbc6ae5ecdbbb646d4511078d5728d82f75fb828b66630c38786d" Jul 02 17:32:16.399281 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.399212 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f017ab4962fbc6ae5ecdbbb646d4511078d5728d82f75fb828b66630c38786d"} err="failed to get container status \"9f017ab4962fbc6ae5ecdbbb646d4511078d5728d82f75fb828b66630c38786d\": rpc error: code = NotFound desc = could not find container \"9f017ab4962fbc6ae5ecdbbb646d4511078d5728d82f75fb828b66630c38786d\": container with ID starting with 9f017ab4962fbc6ae5ecdbbb646d4511078d5728d82f75fb828b66630c38786d not found: ID does not exist" Jul 02 17:32:16.468702 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.468675 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-workload-certs\") pod \"f9fb7578-d630-4628-9f44-545f02da4cde\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " Jul 02 17:32:16.468812 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.468733 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-workload-socket\") pod \"f9fb7578-d630-4628-9f44-545f02da4cde\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " Jul 02 17:32:16.468812 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.468781 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-istio-data\") pod \"f9fb7578-d630-4628-9f44-545f02da4cde\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " Jul 02 17:32:16.468925 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.468823 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-istio-envoy\") pod \"f9fb7578-d630-4628-9f44-545f02da4cde\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " Jul 02 17:32:16.468925 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.468848 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9fb7578-d630-4628-9f44-545f02da4cde-istio-podinfo\") pod \"f9fb7578-d630-4628-9f44-545f02da4cde\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " Jul 02 17:32:16.468925 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.468879 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-credential-socket\") pod \"f9fb7578-d630-4628-9f44-545f02da4cde\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " Jul 02 17:32:16.468925 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.468907 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9fb7578-d630-4628-9f44-545f02da4cde-istiod-ca-cert\") pod \"f9fb7578-d630-4628-9f44-545f02da4cde\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " Jul 02 17:32:16.468925 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.468910 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f9fb7578-d630-4628-9f44-545f02da4cde" (UID: "f9fb7578-d630-4628-9f44-545f02da4cde"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:32:16.469172 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.468952 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9fb7578-d630-4628-9f44-545f02da4cde-istio-token\") pod \"f9fb7578-d630-4628-9f44-545f02da4cde\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " Jul 02 17:32:16.469172 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.468987 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8b6dp\" (UniqueName: \"kubernetes.io/projected/f9fb7578-d630-4628-9f44-545f02da4cde-kube-api-access-8b6dp\") pod \"f9fb7578-d630-4628-9f44-545f02da4cde\" (UID: \"f9fb7578-d630-4628-9f44-545f02da4cde\") " Jul 02 17:32:16.469172 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.469054 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f9fb7578-d630-4628-9f44-545f02da4cde" (UID: "f9fb7578-d630-4628-9f44-545f02da4cde"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:32:16.469172 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.469130 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f9fb7578-d630-4628-9f44-545f02da4cde" (UID: "f9fb7578-d630-4628-9f44-545f02da4cde"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:32:16.469380 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.469305 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-workload-certs\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:16.469380 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.469325 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-workload-socket\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:16.469380 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.469337 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-credential-socket\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:16.469527 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.469506 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9fb7578-d630-4628-9f44-545f02da4cde-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f9fb7578-d630-4628-9f44-545f02da4cde" (UID: "f9fb7578-d630-4628-9f44-545f02da4cde"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:32:16.469754 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.469725 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-istio-data" (OuterVolumeSpecName: "istio-data") pod "f9fb7578-d630-4628-9f44-545f02da4cde" (UID: "f9fb7578-d630-4628-9f44-545f02da4cde"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:32:16.471044 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.471011 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f9fb7578-d630-4628-9f44-545f02da4cde" (UID: "f9fb7578-d630-4628-9f44-545f02da4cde"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:32:16.471135 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.471083 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9fb7578-d630-4628-9f44-545f02da4cde-istio-token" (OuterVolumeSpecName: "istio-token") pod "f9fb7578-d630-4628-9f44-545f02da4cde" (UID: "f9fb7578-d630-4628-9f44-545f02da4cde"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:32:16.471361 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.471343 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f9fb7578-d630-4628-9f44-545f02da4cde-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f9fb7578-d630-4628-9f44-545f02da4cde" (UID: "f9fb7578-d630-4628-9f44-545f02da4cde"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 17:32:16.471422 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.471367 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9fb7578-d630-4628-9f44-545f02da4cde-kube-api-access-8b6dp" (OuterVolumeSpecName: "kube-api-access-8b6dp") pod "f9fb7578-d630-4628-9f44-545f02da4cde" (UID: "f9fb7578-d630-4628-9f44-545f02da4cde"). InnerVolumeSpecName "kube-api-access-8b6dp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:32:16.569938 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.569904 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-istio-data\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:16.569938 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.569938 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9fb7578-d630-4628-9f44-545f02da4cde-istio-envoy\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:16.570079 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.569952 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9fb7578-d630-4628-9f44-545f02da4cde-istio-podinfo\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:16.570079 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.569964 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9fb7578-d630-4628-9f44-545f02da4cde-istiod-ca-cert\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:16.570079 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.569975 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9fb7578-d630-4628-9f44-545f02da4cde-istio-token\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:16.570079 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.569986 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8b6dp\" (UniqueName: \"kubernetes.io/projected/f9fb7578-d630-4628-9f44-545f02da4cde-kube-api-access-8b6dp\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:16.706352 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.706324 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq"] Jul 02 17:32:16.709253 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:16.709231 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-ec100e-openshift-default-6569cdb9df-xjrrq"] Jul 02 17:32:16.716243 ip-10-0-136-0 kubenswrapper[2581]: E0702 17:32:16.716213 2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9fb7578_d630_4628_9f44_545f02da4cde.slice/crio-a3ce0784a3981e07c5abafa7456c2b4a514c12a7e3108a8a7e124b324f21fed1\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9fb7578_d630_4628_9f44_545f02da4cde.slice\": RecentStats: unable to find data in memory cache]" Jul 02 17:32:17.243997 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:17.243961 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9fb7578-d630-4628-9f44-545f02da4cde" path="/var/lib/kubelet/pods/f9fb7578-d630-4628-9f44-545f02da4cde/volumes" Jul 02 17:32:18.033546 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:18.033514 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j"] Jul 02 17:32:18.033926 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:18.033737 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" podUID="90d766bc-a08a-4967-8b9b-980c4524f46e" containerName="istio-proxy" containerID="cri-o://82bb5f75eb6170219aed8fafdb00e7c3ce301c095806d78f79cbb887b98963c2" gracePeriod=30 Jul 02 17:32:18.909362 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:18.909331 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw"] Jul 02 17:32:18.909694 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:18.909680 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9fb7578-d630-4628-9f44-545f02da4cde" containerName="istio-proxy" Jul 02 17:32:18.909739 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:18.909696 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9fb7578-d630-4628-9f44-545f02da4cde" containerName="istio-proxy" Jul 02 17:32:18.909739 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:18.909716 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9fb7578-d630-4628-9f44-545f02da4cde" containerName="istio-proxy" Jul 02 17:32:18.909739 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:18.909722 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9fb7578-d630-4628-9f44-545f02da4cde" containerName="istio-proxy" Jul 02 17:32:18.909838 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:18.909799 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9fb7578-d630-4628-9f44-545f02da4cde" containerName="istio-proxy" Jul 02 17:32:18.909838 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:18.909808 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9fb7578-d630-4628-9f44-545f02da4cde" containerName="istio-proxy" Jul 02 17:32:18.912992 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:18.912976 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:18.917356 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:18.917333 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-19fdf3-openshift-default-dockercfg-sgsjf\"" Jul 02 17:32:18.934491 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:18.934449 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw"] Jul 02 17:32:18.992973 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:18.992940 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-podinfo\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:18.993133 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:18.992992 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-data\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:18.993133 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:18.993031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-workload-certs\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:18.993133 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:18.993065 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-workload-socket\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:18.993265 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:18.993158 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gsgb\" (UniqueName: \"kubernetes.io/projected/49e25a7d-05c7-43a9-ad73-327eaf8431ce-kube-api-access-7gsgb\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:18.993265 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:18.993218 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-credential-socket\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:18.993265 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:18.993260 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istiod-ca-cert\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:18.993391 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:18.993284 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-token\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:18.993391 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:18.993330 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-envoy\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:19.094475 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.094426 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-data\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:19.094886 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.094501 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-workload-certs\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:19.094886 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.094527 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-workload-socket\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:19.094886 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.094558 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gsgb\" (UniqueName: \"kubernetes.io/projected/49e25a7d-05c7-43a9-ad73-327eaf8431ce-kube-api-access-7gsgb\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:19.094886 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.094588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-credential-socket\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:19.094886 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.094629 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istiod-ca-cert\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:19.094886 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.094652 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-token\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:19.094886 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.094689 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-envoy\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:19.094886 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.094756 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-podinfo\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:19.095244 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.094967 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-workload-certs\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:19.095244 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.094978 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-workload-socket\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:19.095244 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.095097 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-credential-socket\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:19.095244 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.095114 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-data\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:19.095411 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.095391 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istiod-ca-cert\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:19.097063 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.097032 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-envoy\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:19.097186 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.097168 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-podinfo\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:19.102684 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.102659 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-token\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:19.103212 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.103188 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gsgb\" (UniqueName: \"kubernetes.io/projected/49e25a7d-05c7-43a9-ad73-327eaf8431ce-kube-api-access-7gsgb\") pod \"e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:19.223408 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.223349 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:19.355157 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.355128 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw"] Jul 02 17:32:19.356561 ip-10-0-136-0 kubenswrapper[2581]: W0702 17:32:19.356530 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49e25a7d_05c7_43a9_ad73_327eaf8431ce.slice/crio-707658d399026d2eed631a0d1d36b2a8d226b63ab6c0f44076d0e8c8ef9519f4 WatchSource:0}: Error finding container 707658d399026d2eed631a0d1d36b2a8d226b63ab6c0f44076d0e8c8ef9519f4: Status 404 returned error can't find the container with id 707658d399026d2eed631a0d1d36b2a8d226b63ab6c0f44076d0e8c8ef9519f4 Jul 02 17:32:19.358860 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.358824 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:32:19.358923 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.358907 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:32:19.358969 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.358948 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:32:19.396964 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:19.396938 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" event={"ID":"49e25a7d-05c7-43a9-ad73-327eaf8431ce","Type":"ContainerStarted","Data":"707658d399026d2eed631a0d1d36b2a8d226b63ab6c0f44076d0e8c8ef9519f4"} Jul 02 17:32:20.403238 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:20.403203 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" event={"ID":"49e25a7d-05c7-43a9-ad73-327eaf8431ce","Type":"ContainerStarted","Data":"228071e81ddb7908eb3d13a113ae046712aa49c4983c297973009f09aec058eb"} Jul 02 17:32:20.424488 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:20.424420 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" podStartSLOduration=2.424405361 podStartE2EDuration="2.424405361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:32:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:32:20.423099321 +0000 UTC m=+2119.613400469" watchObservedRunningTime="2026-07-02 17:32:20.424405361 +0000 UTC m=+2119.614706550" Jul 02 17:32:21.223824 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:21.223791 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:21.228294 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:21.228269 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:21.407908 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:21.407883 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:21.408695 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:21.408672 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:23.280629 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.280602 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:32:23.333715 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.333650 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-podinfo\") pod \"90d766bc-a08a-4967-8b9b-980c4524f46e\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " Jul 02 17:32:23.333715 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.333679 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-token\") pod \"90d766bc-a08a-4967-8b9b-980c4524f46e\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " Jul 02 17:32:23.333715 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.333707 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-envoy\") pod \"90d766bc-a08a-4967-8b9b-980c4524f46e\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " Jul 02 17:32:23.333906 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.333844 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-credential-socket\") pod \"90d766bc-a08a-4967-8b9b-980c4524f46e\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " Jul 02 17:32:23.333961 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.333901 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-data\") pod \"90d766bc-a08a-4967-8b9b-980c4524f46e\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " Jul 02 17:32:23.333961 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.333930 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzlvd\" (UniqueName: \"kubernetes.io/projected/90d766bc-a08a-4967-8b9b-980c4524f46e-kube-api-access-qzlvd\") pod \"90d766bc-a08a-4967-8b9b-980c4524f46e\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " Jul 02 17:32:23.334072 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.333985 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90d766bc-a08a-4967-8b9b-980c4524f46e-istiod-ca-cert\") pod \"90d766bc-a08a-4967-8b9b-980c4524f46e\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " Jul 02 17:32:23.334072 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.334023 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-workload-certs\") pod \"90d766bc-a08a-4967-8b9b-980c4524f46e\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " Jul 02 17:32:23.334168 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.334075 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-workload-socket\") pod \"90d766bc-a08a-4967-8b9b-980c4524f46e\" (UID: \"90d766bc-a08a-4967-8b9b-980c4524f46e\") " Jul 02 17:32:23.334168 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.334142 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "90d766bc-a08a-4967-8b9b-980c4524f46e" (UID: "90d766bc-a08a-4967-8b9b-980c4524f46e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:32:23.334442 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.334421 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90d766bc-a08a-4967-8b9b-980c4524f46e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "90d766bc-a08a-4967-8b9b-980c4524f46e" (UID: "90d766bc-a08a-4967-8b9b-980c4524f46e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:32:23.334664 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.334553 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "90d766bc-a08a-4967-8b9b-980c4524f46e" (UID: "90d766bc-a08a-4967-8b9b-980c4524f46e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:32:23.334754 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.334712 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "90d766bc-a08a-4967-8b9b-980c4524f46e" (UID: "90d766bc-a08a-4967-8b9b-980c4524f46e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:32:23.334837 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.334809 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-data" (OuterVolumeSpecName: "istio-data") pod "90d766bc-a08a-4967-8b9b-980c4524f46e" (UID: "90d766bc-a08a-4967-8b9b-980c4524f46e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:32:23.335020 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.334519 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-credential-socket\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:23.336026 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.335998 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "90d766bc-a08a-4967-8b9b-980c4524f46e" (UID: "90d766bc-a08a-4967-8b9b-980c4524f46e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 17:32:23.336370 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.336348 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "90d766bc-a08a-4967-8b9b-980c4524f46e" (UID: "90d766bc-a08a-4967-8b9b-980c4524f46e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:32:23.336370 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.336360 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-token" (OuterVolumeSpecName: "istio-token") pod "90d766bc-a08a-4967-8b9b-980c4524f46e" (UID: "90d766bc-a08a-4967-8b9b-980c4524f46e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:32:23.336944 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.336924 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90d766bc-a08a-4967-8b9b-980c4524f46e-kube-api-access-qzlvd" (OuterVolumeSpecName: "kube-api-access-qzlvd") pod "90d766bc-a08a-4967-8b9b-980c4524f46e" (UID: "90d766bc-a08a-4967-8b9b-980c4524f46e"). InnerVolumeSpecName "kube-api-access-qzlvd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:32:23.417899 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.417874 2581 generic.go:356] "Generic (PLEG): container finished" podID="90d766bc-a08a-4967-8b9b-980c4524f46e" containerID="82bb5f75eb6170219aed8fafdb00e7c3ce301c095806d78f79cbb887b98963c2" exitCode=0 Jul 02 17:32:23.417988 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.417918 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" Jul 02 17:32:23.417988 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.417937 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" event={"ID":"90d766bc-a08a-4967-8b9b-980c4524f46e","Type":"ContainerDied","Data":"82bb5f75eb6170219aed8fafdb00e7c3ce301c095806d78f79cbb887b98963c2"} Jul 02 17:32:23.418058 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.417985 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j" event={"ID":"90d766bc-a08a-4967-8b9b-980c4524f46e","Type":"ContainerDied","Data":"913cad1cb3abf30f8b464a39dbdbbb03a1f8dd32bbbb35e6321967f72f69e914"} Jul 02 17:32:23.418058 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.418014 2581 scope.go:117] "RemoveContainer" containerID="82bb5f75eb6170219aed8fafdb00e7c3ce301c095806d78f79cbb887b98963c2" Jul 02 17:32:23.426504 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.426486 2581 scope.go:117] "RemoveContainer" containerID="12f762c7e996c4eb3390505400dca1b12da50098ffefde0cdd2aaad00deaeb33" Jul 02 17:32:23.435425 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.435412 2581 scope.go:117] "RemoveContainer" containerID="82bb5f75eb6170219aed8fafdb00e7c3ce301c095806d78f79cbb887b98963c2" Jul 02 17:32:23.435831 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.435809 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-podinfo\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:23.435903 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.435835 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-token\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:23.435903 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.435847 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-envoy\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:23.435903 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.435858 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-istio-data\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:23.435903 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.435873 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzlvd\" (UniqueName: \"kubernetes.io/projected/90d766bc-a08a-4967-8b9b-980c4524f46e-kube-api-access-qzlvd\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:23.435903 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.435888 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90d766bc-a08a-4967-8b9b-980c4524f46e-istiod-ca-cert\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:23.435903 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.435898 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-workload-certs\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:23.436180 ip-10-0-136-0 kubenswrapper[2581]: E0702 17:32:23.435893 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82bb5f75eb6170219aed8fafdb00e7c3ce301c095806d78f79cbb887b98963c2\": container with ID starting with 82bb5f75eb6170219aed8fafdb00e7c3ce301c095806d78f79cbb887b98963c2 not found: ID does not exist" containerID="82bb5f75eb6170219aed8fafdb00e7c3ce301c095806d78f79cbb887b98963c2" Jul 02 17:32:23.436180 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.435931 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82bb5f75eb6170219aed8fafdb00e7c3ce301c095806d78f79cbb887b98963c2"} err="failed to get container status \"82bb5f75eb6170219aed8fafdb00e7c3ce301c095806d78f79cbb887b98963c2\": rpc error: code = NotFound desc = could not find container \"82bb5f75eb6170219aed8fafdb00e7c3ce301c095806d78f79cbb887b98963c2\": container with ID starting with 82bb5f75eb6170219aed8fafdb00e7c3ce301c095806d78f79cbb887b98963c2 not found: ID does not exist" Jul 02 17:32:23.436180 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.435952 2581 scope.go:117] "RemoveContainer" containerID="12f762c7e996c4eb3390505400dca1b12da50098ffefde0cdd2aaad00deaeb33" Jul 02 17:32:23.436180 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.435906 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d766bc-a08a-4967-8b9b-980c4524f46e-workload-socket\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:23.436327 ip-10-0-136-0 kubenswrapper[2581]: E0702 17:32:23.436206 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12f762c7e996c4eb3390505400dca1b12da50098ffefde0cdd2aaad00deaeb33\": container with ID starting with 12f762c7e996c4eb3390505400dca1b12da50098ffefde0cdd2aaad00deaeb33 not found: ID does not exist" containerID="12f762c7e996c4eb3390505400dca1b12da50098ffefde0cdd2aaad00deaeb33" Jul 02 17:32:23.436327 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.436223 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12f762c7e996c4eb3390505400dca1b12da50098ffefde0cdd2aaad00deaeb33"} err="failed to get container status \"12f762c7e996c4eb3390505400dca1b12da50098ffefde0cdd2aaad00deaeb33\": rpc error: code = NotFound desc = could not find container \"12f762c7e996c4eb3390505400dca1b12da50098ffefde0cdd2aaad00deaeb33\": container with ID starting with 12f762c7e996c4eb3390505400dca1b12da50098ffefde0cdd2aaad00deaeb33 not found: ID does not exist" Jul 02 17:32:23.444886 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.444862 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j"] Jul 02 17:32:23.449853 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:23.449833 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-fcb6e8-openshift-default-5499fffd47-hq89j"] Jul 02 17:32:25.245780 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:25.245742 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90d766bc-a08a-4967-8b9b-980c4524f46e" path="/var/lib/kubelet/pods/90d766bc-a08a-4967-8b9b-980c4524f46e/volumes" Jul 02 17:32:27.619484 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.619430 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl"] Jul 02 17:32:27.620620 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.620589 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90d766bc-a08a-4967-8b9b-980c4524f46e" containerName="istio-proxy" Jul 02 17:32:27.620769 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.620757 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="90d766bc-a08a-4967-8b9b-980c4524f46e" containerName="istio-proxy" Jul 02 17:32:27.620901 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.620889 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90d766bc-a08a-4967-8b9b-980c4524f46e" containerName="istio-proxy" Jul 02 17:32:27.621002 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.620991 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="90d766bc-a08a-4967-8b9b-980c4524f46e" containerName="istio-proxy" Jul 02 17:32:27.621216 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.621201 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="90d766bc-a08a-4967-8b9b-980c4524f46e" containerName="istio-proxy" Jul 02 17:32:27.626083 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.626066 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.629114 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.629094 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-5a4c4c-openshift-default-dockercfg-4c8k4\"" Jul 02 17:32:27.639155 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.639122 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl"] Jul 02 17:32:27.675872 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.675845 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-data\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.675978 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.675879 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-envoy\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.675978 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.675907 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-workload-certs\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.675978 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.675948 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-credential-socket\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.676086 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.676050 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-workload-socket\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.676121 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.676095 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-token\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.676163 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.676149 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt6zb\" (UniqueName: \"kubernetes.io/projected/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-kube-api-access-lt6zb\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.676203 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.676186 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-podinfo\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.676247 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.676209 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istiod-ca-cert\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.777225 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.777185 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-envoy\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.777225 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.777227 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-workload-certs\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.777445 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.777246 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-credential-socket\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.777445 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.777285 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-workload-socket\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.777445 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.777321 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-token\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.777445 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.777364 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt6zb\" (UniqueName: \"kubernetes.io/projected/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-kube-api-access-lt6zb\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.777703 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.777518 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-podinfo\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.777703 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.777673 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-workload-certs\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.777703 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.777689 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-workload-socket\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.777910 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.777771 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-credential-socket\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.777981 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.777962 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istiod-ca-cert\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.778056 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.778042 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-data\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.778289 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.778273 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-data\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.778792 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.778766 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istiod-ca-cert\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.779574 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.779552 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-envoy\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.780020 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.779997 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-podinfo\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.788710 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.788685 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-token\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.789001 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.788983 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt6zb\" (UniqueName: \"kubernetes.io/projected/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-kube-api-access-lt6zb\") pod \"e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:27.944233 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:27.944149 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:28.099845 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:28.099775 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl"] Jul 02 17:32:28.102195 ip-10-0-136-0 kubenswrapper[2581]: W0702 17:32:28.102167 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadceef5f_50b2_4f77_9abc_b83aaf71d6b4.slice/crio-ffb2e2c3a3a3459d38920da3eb1d315529be47f4c30586824f2aa3750af7f53f WatchSource:0}: Error finding container ffb2e2c3a3a3459d38920da3eb1d315529be47f4c30586824f2aa3750af7f53f: Status 404 returned error can't find the container with id ffb2e2c3a3a3459d38920da3eb1d315529be47f4c30586824f2aa3750af7f53f Jul 02 17:32:28.123484 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:28.123220 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:32:28.123484 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:28.123315 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:32:28.123484 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:28.123361 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:32:28.443415 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:28.443382 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" event={"ID":"adceef5f-50b2-4f77-9abc-b83aaf71d6b4","Type":"ContainerStarted","Data":"70383bb076a77d4bf4aab7644dc14da2e37ccf27e34792e27f43698328470fb2"} Jul 02 17:32:28.443621 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:28.443434 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" event={"ID":"adceef5f-50b2-4f77-9abc-b83aaf71d6b4","Type":"ContainerStarted","Data":"ffb2e2c3a3a3459d38920da3eb1d315529be47f4c30586824f2aa3750af7f53f"} Jul 02 17:32:28.464425 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:28.464373 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" podStartSLOduration=1.464359642 podStartE2EDuration="1.464359642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:32:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:32:28.462842675 +0000 UTC m=+2127.653143870" watchObservedRunningTime="2026-07-02 17:32:28.464359642 +0000 UTC m=+2127.654660799" Jul 02 17:32:28.944720 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:28.944676 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:29.972429 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:29.972353 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:30.452349 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:30.452322 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:30.453337 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:30.453316 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:33.466761 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:33.466733 2581 generic.go:356] "Generic (PLEG): container finished" podID="49e25a7d-05c7-43a9-ad73-327eaf8431ce" containerID="228071e81ddb7908eb3d13a113ae046712aa49c4983c297973009f09aec058eb" exitCode=0 Jul 02 17:32:33.467189 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:33.466818 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" event={"ID":"49e25a7d-05c7-43a9-ad73-327eaf8431ce","Type":"ContainerDied","Data":"228071e81ddb7908eb3d13a113ae046712aa49c4983c297973009f09aec058eb"} Jul 02 17:32:33.467189 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:33.467183 2581 scope.go:117] "RemoveContainer" containerID="228071e81ddb7908eb3d13a113ae046712aa49c4983c297973009f09aec058eb" Jul 02 17:32:33.468150 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:33.468121 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:32:33.468257 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:33.468201 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:32:33.468322 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:33.468258 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:32:34.476159 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:34.476127 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" event={"ID":"49e25a7d-05c7-43a9-ad73-327eaf8431ce","Type":"ContainerStarted","Data":"d73194899f349aafa7ec7eb7a8dfe4482824ac8ac73ee0ea4fc4dce58bc3a1c3"} Jul 02 17:32:35.224099 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:35.223996 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:35.225110 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:35.225077 2581 patch_prober.go:28] interesting pod/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 02 17:32:35.225262 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:35.225135 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" podUID="49e25a7d-05c7-43a9-ad73-327eaf8431ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 02 17:32:36.224691 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:36.224642 2581 patch_prober.go:28] interesting pod/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 02 17:32:36.225159 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:36.224714 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" podUID="49e25a7d-05c7-43a9-ad73-327eaf8431ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 02 17:32:36.408276 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:36.408236 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:37.224670 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:37.224630 2581 patch_prober.go:28] interesting pod/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 02 17:32:37.224955 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:37.224930 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" podUID="49e25a7d-05c7-43a9-ad73-327eaf8431ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 02 17:32:38.224669 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:38.224629 2581 patch_prober.go:28] interesting pod/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 02 17:32:38.224879 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:38.224700 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" podUID="49e25a7d-05c7-43a9-ad73-327eaf8431ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 02 17:32:39.227534 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:39.227506 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:39.228322 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:39.228305 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:46.493618 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:46.493580 2581 patch_prober.go:28] interesting pod/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 02 17:32:46.494001 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:46.493664 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" podUID="adceef5f-50b2-4f77-9abc-b83aaf71d6b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 02 17:32:47.545625 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:47.545590 2581 generic.go:356] "Generic (PLEG): container finished" podID="adceef5f-50b2-4f77-9abc-b83aaf71d6b4" containerID="70383bb076a77d4bf4aab7644dc14da2e37ccf27e34792e27f43698328470fb2" exitCode=0 Jul 02 17:32:47.546158 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:47.545665 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" event={"ID":"adceef5f-50b2-4f77-9abc-b83aaf71d6b4","Type":"ContainerDied","Data":"70383bb076a77d4bf4aab7644dc14da2e37ccf27e34792e27f43698328470fb2"} Jul 02 17:32:47.546231 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:47.546169 2581 scope.go:117] "RemoveContainer" containerID="70383bb076a77d4bf4aab7644dc14da2e37ccf27e34792e27f43698328470fb2" Jul 02 17:32:47.547208 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:47.547175 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:32:47.547306 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:47.547248 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:32:47.547345 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:47.547308 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:32:48.553612 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:48.553577 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" event={"ID":"adceef5f-50b2-4f77-9abc-b83aaf71d6b4","Type":"ContainerStarted","Data":"fe6b187c722dbef988f1d4029a5b713ea799f5930de0ecd9bb970b5e60549479"} Jul 02 17:32:48.945159 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:48.945066 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:48.945369 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:48.945332 2581 patch_prober.go:28] interesting pod/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 02 17:32:48.945447 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:48.945390 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" podUID="adceef5f-50b2-4f77-9abc-b83aaf71d6b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 02 17:32:49.445336 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:49.445298 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw"] Jul 02 17:32:49.445600 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:49.445574 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" podUID="49e25a7d-05c7-43a9-ad73-327eaf8431ce" containerName="istio-proxy" containerID="cri-o://d73194899f349aafa7ec7eb7a8dfe4482824ac8ac73ee0ea4fc4dce58bc3a1c3" gracePeriod=30 Jul 02 17:32:49.945529 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:49.945491 2581 patch_prober.go:28] interesting pod/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 02 17:32:49.945904 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:49.945544 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" podUID="adceef5f-50b2-4f77-9abc-b83aaf71d6b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 02 17:32:50.945186 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:50.945154 2581 patch_prober.go:28] interesting pod/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 02 17:32:50.945359 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:50.945208 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" podUID="adceef5f-50b2-4f77-9abc-b83aaf71d6b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 02 17:32:51.945271 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:51.945188 2581 patch_prober.go:28] interesting pod/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 02 17:32:51.945271 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:51.945246 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" podUID="adceef5f-50b2-4f77-9abc-b83aaf71d6b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 02 17:32:52.948403 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:52.948371 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:52.948886 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:52.948790 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:52.949499 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:52.949478 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:32:54.230317 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.230276 2581 patch_prober.go:28] interesting pod/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused Jul 02 17:32:54.230824 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.230327 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" podUID="49e25a7d-05c7-43a9-ad73-327eaf8431ce" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 17:32:54.586019 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.585990 2581 generic.go:356] "Generic (PLEG): container finished" podID="49e25a7d-05c7-43a9-ad73-327eaf8431ce" containerID="d73194899f349aafa7ec7eb7a8dfe4482824ac8ac73ee0ea4fc4dce58bc3a1c3" exitCode=0 Jul 02 17:32:54.586158 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.586068 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" event={"ID":"49e25a7d-05c7-43a9-ad73-327eaf8431ce","Type":"ContainerDied","Data":"d73194899f349aafa7ec7eb7a8dfe4482824ac8ac73ee0ea4fc4dce58bc3a1c3"} Jul 02 17:32:54.586158 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.586142 2581 scope.go:117] "RemoveContainer" containerID="228071e81ddb7908eb3d13a113ae046712aa49c4983c297973009f09aec058eb" Jul 02 17:32:54.707598 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.707573 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:54.720648 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.720625 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-podinfo\") pod \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " Jul 02 17:32:54.720765 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.720691 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-data\") pod \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " Jul 02 17:32:54.720765 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.720724 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istiod-ca-cert\") pod \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " Jul 02 17:32:54.720765 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.720748 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-workload-socket\") pod \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " Jul 02 17:32:54.720985 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.720773 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-envoy\") pod \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " Jul 02 17:32:54.720985 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.720815 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-token\") pod \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " Jul 02 17:32:54.720985 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.720856 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-workload-certs\") pod \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " Jul 02 17:32:54.720985 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.720884 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gsgb\" (UniqueName: \"kubernetes.io/projected/49e25a7d-05c7-43a9-ad73-327eaf8431ce-kube-api-access-7gsgb\") pod \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " Jul 02 17:32:54.720985 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.720934 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-credential-socket\") pod \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\" (UID: \"49e25a7d-05c7-43a9-ad73-327eaf8431ce\") " Jul 02 17:32:54.721230 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.720997 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "49e25a7d-05c7-43a9-ad73-327eaf8431ce" (UID: "49e25a7d-05c7-43a9-ad73-327eaf8431ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:32:54.721230 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.721079 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "49e25a7d-05c7-43a9-ad73-327eaf8431ce" (UID: "49e25a7d-05c7-43a9-ad73-327eaf8431ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:32:54.721230 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.721168 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "49e25a7d-05c7-43a9-ad73-327eaf8431ce" (UID: "49e25a7d-05c7-43a9-ad73-327eaf8431ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:32:54.721394 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.721266 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istiod-ca-cert\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:54.721394 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.721288 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-workload-socket\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:54.721394 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.721305 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-workload-certs\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:54.721394 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.721383 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "49e25a7d-05c7-43a9-ad73-327eaf8431ce" (UID: "49e25a7d-05c7-43a9-ad73-327eaf8431ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:32:54.721712 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.721688 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-data" (OuterVolumeSpecName: "istio-data") pod "49e25a7d-05c7-43a9-ad73-327eaf8431ce" (UID: "49e25a7d-05c7-43a9-ad73-327eaf8431ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:32:54.722925 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.722903 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "49e25a7d-05c7-43a9-ad73-327eaf8431ce" (UID: "49e25a7d-05c7-43a9-ad73-327eaf8431ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:32:54.723407 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.723375 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49e25a7d-05c7-43a9-ad73-327eaf8431ce-kube-api-access-7gsgb" (OuterVolumeSpecName: "kube-api-access-7gsgb") pod "49e25a7d-05c7-43a9-ad73-327eaf8431ce" (UID: "49e25a7d-05c7-43a9-ad73-327eaf8431ce"). InnerVolumeSpecName "kube-api-access-7gsgb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:32:54.723530 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.723426 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "49e25a7d-05c7-43a9-ad73-327eaf8431ce" (UID: "49e25a7d-05c7-43a9-ad73-327eaf8431ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 17:32:54.723530 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.723441 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "49e25a7d-05c7-43a9-ad73-327eaf8431ce" (UID: "49e25a7d-05c7-43a9-ad73-327eaf8431ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:32:54.822434 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.822367 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-data\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:54.822434 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.822392 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-envoy\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:54.822434 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.822404 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-token\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:54.822434 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.822415 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gsgb\" (UniqueName: \"kubernetes.io/projected/49e25a7d-05c7-43a9-ad73-327eaf8431ce-kube-api-access-7gsgb\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:54.822434 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.822429 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49e25a7d-05c7-43a9-ad73-327eaf8431ce-credential-socket\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:54.822691 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:54.822442 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49e25a7d-05c7-43a9-ad73-327eaf8431ce-istio-podinfo\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:32:55.591342 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:55.591261 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" Jul 02 17:32:55.591342 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:55.591301 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw" event={"ID":"49e25a7d-05c7-43a9-ad73-327eaf8431ce","Type":"ContainerDied","Data":"707658d399026d2eed631a0d1d36b2a8d226b63ab6c0f44076d0e8c8ef9519f4"} Jul 02 17:32:55.591814 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:55.591361 2581 scope.go:117] "RemoveContainer" containerID="d73194899f349aafa7ec7eb7a8dfe4482824ac8ac73ee0ea4fc4dce58bc3a1c3" Jul 02 17:32:55.615656 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:55.615632 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw"] Jul 02 17:32:55.630681 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:55.630661 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-19fdf3-openshift-default-fc6c8fd45-t74cw"] Jul 02 17:32:56.420862 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:56.420828 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl"] Jul 02 17:32:56.421087 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:56.421001 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" podUID="adceef5f-50b2-4f77-9abc-b83aaf71d6b4" containerName="istio-proxy" containerID="cri-o://fe6b187c722dbef988f1d4029a5b713ea799f5930de0ecd9bb970b5e60549479" gracePeriod=30 Jul 02 17:32:57.243253 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.243219 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49e25a7d-05c7-43a9-ad73-327eaf8431ce" path="/var/lib/kubelet/pods/49e25a7d-05c7-43a9-ad73-327eaf8431ce/volumes" Jul 02 17:32:57.320855 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.320817 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm"] Jul 02 17:32:57.321305 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.321288 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49e25a7d-05c7-43a9-ad73-327eaf8431ce" containerName="istio-proxy" Jul 02 17:32:57.321352 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.321309 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="49e25a7d-05c7-43a9-ad73-327eaf8431ce" containerName="istio-proxy" Jul 02 17:32:57.321352 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.321320 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49e25a7d-05c7-43a9-ad73-327eaf8431ce" containerName="istio-proxy" Jul 02 17:32:57.321352 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.321329 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="49e25a7d-05c7-43a9-ad73-327eaf8431ce" containerName="istio-proxy" Jul 02 17:32:57.321448 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.321405 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="90d766bc-a08a-4967-8b9b-980c4524f46e" containerName="istio-proxy" Jul 02 17:32:57.321448 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.321415 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="49e25a7d-05c7-43a9-ad73-327eaf8431ce" containerName="istio-proxy" Jul 02 17:32:57.321448 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.321427 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="49e25a7d-05c7-43a9-ad73-327eaf8431ce" containerName="istio-proxy" Jul 02 17:32:57.324578 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.324560 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.326816 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.326791 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-73dc61-openshift-default-dockercfg-bc52j\"" Jul 02 17:32:57.334197 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.334176 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm"] Jul 02 17:32:57.343151 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.343132 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-data\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.343242 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.343171 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-workload-socket\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.343242 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.343209 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-envoy\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.343242 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.343232 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-workload-certs\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.343396 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.343250 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-token\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.343396 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.343282 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istiod-ca-cert\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.343396 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.343330 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtsk7\" (UniqueName: \"kubernetes.io/projected/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-kube-api-access-wtsk7\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.343396 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.343374 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-credential-socket\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.343582 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.343406 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-podinfo\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.443906 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.443876 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istiod-ca-cert\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.444071 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.443910 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtsk7\" (UniqueName: \"kubernetes.io/projected/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-kube-api-access-wtsk7\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.444071 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.443935 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-credential-socket\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.444071 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.443952 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-podinfo\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.444071 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.444006 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-data\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.444071 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.444034 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-workload-socket\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.444071 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.444058 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-envoy\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.444407 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.444087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-workload-certs\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.444407 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.444108 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-token\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.444407 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.444376 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-workload-socket\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.444571 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.444351 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-credential-socket\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.444571 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.444439 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-data\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.444640 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.444617 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-workload-certs\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.444833 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.444813 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istiod-ca-cert\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.446311 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.446290 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-envoy\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.446576 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.446559 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-podinfo\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.451249 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.451227 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-token\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.451398 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.451380 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtsk7\" (UniqueName: \"kubernetes.io/projected/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-kube-api-access-wtsk7\") pod \"e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.635809 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.635735 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:57.769136 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.769108 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm"] Jul 02 17:32:57.771239 ip-10-0-136-0 kubenswrapper[2581]: W0702 17:32:57.771208 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00fca4c6_2d34_4eb5_9bab_d633b84d3ac8.slice/crio-d6ca610cdf361112e1628e57a4128c8d5158aa229a4503141d8867e91f377683 WatchSource:0}: Error finding container d6ca610cdf361112e1628e57a4128c8d5158aa229a4503141d8867e91f377683: Status 404 returned error can't find the container with id d6ca610cdf361112e1628e57a4128c8d5158aa229a4503141d8867e91f377683 Jul 02 17:32:57.773315 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.773288 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:32:57.773364 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.773345 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:32:57.773404 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:57.773376 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:32:58.606344 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:58.606300 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" event={"ID":"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8","Type":"ContainerStarted","Data":"7e74289bddf4f61323025252248b89361ab8162734becf8e3ea9b8ef2f8a49e6"} Jul 02 17:32:58.606806 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:58.606357 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" event={"ID":"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8","Type":"ContainerStarted","Data":"d6ca610cdf361112e1628e57a4128c8d5158aa229a4503141d8867e91f377683"} Jul 02 17:32:58.625546 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:58.625494 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" podStartSLOduration=1.625481671 podStartE2EDuration="1.625481671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:32:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:32:58.623805999 +0000 UTC m=+2157.814107193" watchObservedRunningTime="2026-07-02 17:32:58.625481671 +0000 UTC m=+2157.815782829" Jul 02 17:32:58.636905 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:58.636881 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:58.641549 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:58.641530 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:59.610899 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:59.610874 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:32:59.611877 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:32:59.611855 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:33:01.624029 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.623996 2581 generic.go:356] "Generic (PLEG): container finished" podID="adceef5f-50b2-4f77-9abc-b83aaf71d6b4" containerID="fe6b187c722dbef988f1d4029a5b713ea799f5930de0ecd9bb970b5e60549479" exitCode=0 Jul 02 17:33:01.624492 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.624085 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" event={"ID":"adceef5f-50b2-4f77-9abc-b83aaf71d6b4","Type":"ContainerDied","Data":"fe6b187c722dbef988f1d4029a5b713ea799f5930de0ecd9bb970b5e60549479"} Jul 02 17:33:01.624492 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.624154 2581 scope.go:117] "RemoveContainer" containerID="70383bb076a77d4bf4aab7644dc14da2e37ccf27e34792e27f43698328470fb2" Jul 02 17:33:01.674193 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.674167 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:33:01.784072 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.784044 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-token\") pod \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " Jul 02 17:33:01.784215 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.784111 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-workload-certs\") pod \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " Jul 02 17:33:01.784215 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.784144 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lt6zb\" (UniqueName: \"kubernetes.io/projected/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-kube-api-access-lt6zb\") pod \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " Jul 02 17:33:01.784215 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.784171 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istiod-ca-cert\") pod \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " Jul 02 17:33:01.784215 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.784201 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-data\") pod \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " Jul 02 17:33:01.784429 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.784242 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-credential-socket\") pod \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " Jul 02 17:33:01.784429 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.784315 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-podinfo\") pod \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " Jul 02 17:33:01.784429 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.784345 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-envoy\") pod \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " Jul 02 17:33:01.784429 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.784389 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-workload-socket\") pod \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\" (UID: \"adceef5f-50b2-4f77-9abc-b83aaf71d6b4\") " Jul 02 17:33:01.784659 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.784427 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "adceef5f-50b2-4f77-9abc-b83aaf71d6b4" (UID: "adceef5f-50b2-4f77-9abc-b83aaf71d6b4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:01.784659 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.784613 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "adceef5f-50b2-4f77-9abc-b83aaf71d6b4" (UID: "adceef5f-50b2-4f77-9abc-b83aaf71d6b4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:33:01.784759 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.784693 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-workload-certs\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:33:01.784759 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.784712 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istiod-ca-cert\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:33:01.784874 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.784854 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "adceef5f-50b2-4f77-9abc-b83aaf71d6b4" (UID: "adceef5f-50b2-4f77-9abc-b83aaf71d6b4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:01.784920 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.784904 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "adceef5f-50b2-4f77-9abc-b83aaf71d6b4" (UID: "adceef5f-50b2-4f77-9abc-b83aaf71d6b4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:01.785107 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.785080 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-data" (OuterVolumeSpecName: "istio-data") pod "adceef5f-50b2-4f77-9abc-b83aaf71d6b4" (UID: "adceef5f-50b2-4f77-9abc-b83aaf71d6b4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:01.786344 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.786284 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-token" (OuterVolumeSpecName: "istio-token") pod "adceef5f-50b2-4f77-9abc-b83aaf71d6b4" (UID: "adceef5f-50b2-4f77-9abc-b83aaf71d6b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:33:01.786344 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.786317 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-kube-api-access-lt6zb" (OuterVolumeSpecName: "kube-api-access-lt6zb") pod "adceef5f-50b2-4f77-9abc-b83aaf71d6b4" (UID: "adceef5f-50b2-4f77-9abc-b83aaf71d6b4"). InnerVolumeSpecName "kube-api-access-lt6zb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:33:01.786512 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.786370 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "adceef5f-50b2-4f77-9abc-b83aaf71d6b4" (UID: "adceef5f-50b2-4f77-9abc-b83aaf71d6b4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:01.786637 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.786621 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "adceef5f-50b2-4f77-9abc-b83aaf71d6b4" (UID: "adceef5f-50b2-4f77-9abc-b83aaf71d6b4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 17:33:01.885735 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.885712 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-podinfo\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:33:01.885735 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.885733 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-envoy\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:33:01.885875 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.885742 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-workload-socket\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:33:01.885875 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.885751 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-token\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:33:01.885875 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.885759 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lt6zb\" (UniqueName: \"kubernetes.io/projected/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-kube-api-access-lt6zb\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:33:01.885875 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.885767 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-istio-data\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:33:01.885875 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:01.885775 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adceef5f-50b2-4f77-9abc-b83aaf71d6b4-credential-socket\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:33:02.629637 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:02.629603 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" Jul 02 17:33:02.629637 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:02.629610 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl" event={"ID":"adceef5f-50b2-4f77-9abc-b83aaf71d6b4","Type":"ContainerDied","Data":"ffb2e2c3a3a3459d38920da3eb1d315529be47f4c30586824f2aa3750af7f53f"} Jul 02 17:33:02.630102 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:02.629675 2581 scope.go:117] "RemoveContainer" containerID="fe6b187c722dbef988f1d4029a5b713ea799f5930de0ecd9bb970b5e60549479" Jul 02 17:33:02.652909 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:02.652884 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl"] Jul 02 17:33:02.658982 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:02.658956 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-5a4c4c-openshift-default-5bfd5b88f-9dwbl"] Jul 02 17:33:03.244319 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:03.244291 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adceef5f-50b2-4f77-9abc-b83aaf71d6b4" path="/var/lib/kubelet/pods/adceef5f-50b2-4f77-9abc-b83aaf71d6b4/volumes" Jul 02 17:33:05.661406 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.661369 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf"] Jul 02 17:33:05.661833 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.661799 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adceef5f-50b2-4f77-9abc-b83aaf71d6b4" containerName="istio-proxy" Jul 02 17:33:05.661833 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.661812 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="adceef5f-50b2-4f77-9abc-b83aaf71d6b4" containerName="istio-proxy" Jul 02 17:33:05.661907 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.661878 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="adceef5f-50b2-4f77-9abc-b83aaf71d6b4" containerName="istio-proxy" Jul 02 17:33:05.664672 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.664651 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.667078 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.667059 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-b85f5a-openshift-default-dockercfg-6vqvr\"" Jul 02 17:33:05.676201 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.676180 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf"] Jul 02 17:33:05.715704 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.715679 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7f8c51e-3fb9-4890-b060-97fb50710e56-istiod-ca-cert\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.715795 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.715765 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-credential-socket\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.715795 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.715786 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwz65\" (UniqueName: \"kubernetes.io/projected/f7f8c51e-3fb9-4890-b060-97fb50710e56-kube-api-access-hwz65\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.715894 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.715804 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-workload-socket\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.715894 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.715833 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-data\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.715894 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.715866 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-envoy\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.715989 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.715894 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-workload-certs\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.715989 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.715915 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-token\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.715989 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.715935 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-podinfo\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.816441 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.816417 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-credential-socket\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.816565 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.816444 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwz65\" (UniqueName: \"kubernetes.io/projected/f7f8c51e-3fb9-4890-b060-97fb50710e56-kube-api-access-hwz65\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.816565 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.816483 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-workload-socket\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.816565 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.816513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-data\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.816565 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.816541 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-envoy\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.816774 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.816570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-workload-certs\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.816774 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.816602 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-token\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.816774 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.816628 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-podinfo\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.816774 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.816667 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7f8c51e-3fb9-4890-b060-97fb50710e56-istiod-ca-cert\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.816970 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.816824 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-credential-socket\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.816970 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.816886 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-workload-socket\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.817076 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.816999 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-workload-certs\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.817137 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.817103 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-data\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.817328 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.817304 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7f8c51e-3fb9-4890-b060-97fb50710e56-istiod-ca-cert\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.818833 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.818810 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-envoy\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.819151 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.819133 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-podinfo\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.827016 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.826996 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-token\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.827129 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.827048 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwz65\" (UniqueName: \"kubernetes.io/projected/f7f8c51e-3fb9-4890-b060-97fb50710e56-kube-api-access-hwz65\") pod \"e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:05.975578 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:05.975498 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:06.104363 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:06.104337 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf"] Jul 02 17:33:06.106000 ip-10-0-136-0 kubenswrapper[2581]: W0702 17:33:06.105974 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7f8c51e_3fb9_4890_b060_97fb50710e56.slice/crio-cb2a0daec7304f68f91678688edf36285b4a29b8fd2fe42f1b87e4152a29e643 WatchSource:0}: Error finding container cb2a0daec7304f68f91678688edf36285b4a29b8fd2fe42f1b87e4152a29e643: Status 404 returned error can't find the container with id cb2a0daec7304f68f91678688edf36285b4a29b8fd2fe42f1b87e4152a29e643 Jul 02 17:33:06.108134 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:06.108101 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:06.108237 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:06.108161 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:06.108237 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:06.108192 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:06.649754 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:06.649713 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" event={"ID":"f7f8c51e-3fb9-4890-b060-97fb50710e56","Type":"ContainerStarted","Data":"5041b1585f92b21e8026c58ed79f07e5d3b4a3088cf0db77d0ee8aad21003836"} Jul 02 17:33:06.649963 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:06.649782 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" event={"ID":"f7f8c51e-3fb9-4890-b060-97fb50710e56","Type":"ContainerStarted","Data":"cb2a0daec7304f68f91678688edf36285b4a29b8fd2fe42f1b87e4152a29e643"} Jul 02 17:33:06.670813 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:06.670771 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" podStartSLOduration=1.670757638 podStartE2EDuration="1.670757638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:33:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:33:06.668847936 +0000 UTC m=+2165.859149106" watchObservedRunningTime="2026-07-02 17:33:06.670757638 +0000 UTC m=+2165.861058851" Jul 02 17:33:06.976558 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:06.976479 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:07.981411 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:07.981381 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:08.658375 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:08.658343 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:08.659268 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:08.659247 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:13.682756 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:13.682722 2581 generic.go:356] "Generic (PLEG): container finished" podID="00fca4c6-2d34-4eb5-9bab-d633b84d3ac8" containerID="7e74289bddf4f61323025252248b89361ab8162734becf8e3ea9b8ef2f8a49e6" exitCode=0 Jul 02 17:33:13.683173 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:13.682798 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" event={"ID":"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8","Type":"ContainerDied","Data":"7e74289bddf4f61323025252248b89361ab8162734becf8e3ea9b8ef2f8a49e6"} Jul 02 17:33:13.683217 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:13.683183 2581 scope.go:117] "RemoveContainer" containerID="7e74289bddf4f61323025252248b89361ab8162734becf8e3ea9b8ef2f8a49e6" Jul 02 17:33:13.684163 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:13.684136 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:13.684244 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:13.684218 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:13.684283 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:13.684272 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:14.611900 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:14.611859 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:33:14.691354 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:14.691298 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" event={"ID":"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8","Type":"ContainerStarted","Data":"2c1f12db813aa486153720250cc26d297612101dc778e1373bd37ce81ecb0d79"} Jul 02 17:33:15.637082 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:15.637052 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:33:15.638301 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:15.638270 2581 patch_prober.go:28] interesting pod/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 02 17:33:15.638444 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:15.638350 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" podUID="00fca4c6-2d34-4eb5-9bab-d633b84d3ac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 02 17:33:16.637213 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:16.637176 2581 patch_prober.go:28] interesting pod/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 02 17:33:16.637842 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:16.637811 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" podUID="00fca4c6-2d34-4eb5-9bab-d633b84d3ac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 02 17:33:17.636151 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:17.636109 2581 patch_prober.go:28] interesting pod/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 02 17:33:17.636474 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:17.636416 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" podUID="00fca4c6-2d34-4eb5-9bab-d633b84d3ac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 02 17:33:18.637192 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:18.637133 2581 patch_prober.go:28] interesting pod/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 02 17:33:18.637729 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:18.637255 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" podUID="00fca4c6-2d34-4eb5-9bab-d633b84d3ac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 02 17:33:19.640999 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:19.640966 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:33:19.641503 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:19.641328 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:33:19.642123 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:19.642105 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:33:21.730254 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:21.730225 2581 generic.go:356] "Generic (PLEG): container finished" podID="f7f8c51e-3fb9-4890-b060-97fb50710e56" containerID="5041b1585f92b21e8026c58ed79f07e5d3b4a3088cf0db77d0ee8aad21003836" exitCode=0 Jul 02 17:33:21.730649 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:21.730297 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" event={"ID":"f7f8c51e-3fb9-4890-b060-97fb50710e56","Type":"ContainerDied","Data":"5041b1585f92b21e8026c58ed79f07e5d3b4a3088cf0db77d0ee8aad21003836"} Jul 02 17:33:21.730699 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:21.730679 2581 scope.go:117] "RemoveContainer" containerID="5041b1585f92b21e8026c58ed79f07e5d3b4a3088cf0db77d0ee8aad21003836" Jul 02 17:33:21.731606 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:21.731582 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:21.731666 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:21.731653 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:21.731701 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:21.731686 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:22.736948 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:22.736910 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" event={"ID":"f7f8c51e-3fb9-4890-b060-97fb50710e56","Type":"ContainerStarted","Data":"c46f136a257a7d9ee25238ba32b870e49cd9b089078969f530c21d6f32f2acf9"} Jul 02 17:33:22.976360 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:22.976326 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:22.977519 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:22.977495 2581 patch_prober.go:28] interesting pod/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 02 17:33:22.977582 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:22.977558 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" podUID="f7f8c51e-3fb9-4890-b060-97fb50710e56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 02 17:33:23.658822 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:23.658791 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:23.976673 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:23.976574 2581 patch_prober.go:28] interesting pod/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 02 17:33:23.976673 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:23.976633 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" podUID="f7f8c51e-3fb9-4890-b060-97fb50710e56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 02 17:33:24.976747 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:24.976715 2581 patch_prober.go:28] interesting pod/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 02 17:33:24.977110 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:24.976763 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" podUID="f7f8c51e-3fb9-4890-b060-97fb50710e56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 02 17:33:25.976534 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:25.976500 2581 patch_prober.go:28] interesting pod/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 02 17:33:25.976711 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:25.976552 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" podUID="f7f8c51e-3fb9-4890-b060-97fb50710e56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 02 17:33:26.979678 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:26.979651 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:33:26.980438 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:33:26.980417 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:37:01.367600 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:37:01.367569 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lln24_1f9623eb-d52b-45dc-ae42-3fd20e210c7f/ovn-acl-logging/0.log" Jul 02 17:37:01.381414 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:37:01.381391 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lln24_1f9623eb-d52b-45dc-ae42-3fd20e210c7f/ovn-acl-logging/0.log" Jul 02 17:39:12.845068 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:12.845039 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm"] Jul 02 17:39:12.845532 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:12.845236 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" podUID="00fca4c6-2d34-4eb5-9bab-d633b84d3ac8" containerName="istio-proxy" containerID="cri-o://2c1f12db813aa486153720250cc26d297612101dc778e1373bd37ce81ecb0d79" gracePeriod=30 Jul 02 17:39:18.099210 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.099187 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:39:18.111565 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.111509 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-workload-certs\") pod \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " Jul 02 17:39:18.111565 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.111561 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-token\") pod \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " Jul 02 17:39:18.111709 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.111589 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istiod-ca-cert\") pod \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " Jul 02 17:39:18.111709 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.111613 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-podinfo\") pod \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " Jul 02 17:39:18.111709 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.111646 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtsk7\" (UniqueName: \"kubernetes.io/projected/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-kube-api-access-wtsk7\") pod \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " Jul 02 17:39:18.111863 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.111725 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-envoy\") pod \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " Jul 02 17:39:18.111863 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.111742 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-workload-socket\") pod \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " Jul 02 17:39:18.111863 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.111762 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-data\") pod \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " Jul 02 17:39:18.111863 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.111763 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "00fca4c6-2d34-4eb5-9bab-d633b84d3ac8" (UID: "00fca4c6-2d34-4eb5-9bab-d633b84d3ac8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:39:18.111863 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.111790 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-credential-socket\") pod \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\" (UID: \"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8\") " Jul 02 17:39:18.112116 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.112016 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "00fca4c6-2d34-4eb5-9bab-d633b84d3ac8" (UID: "00fca4c6-2d34-4eb5-9bab-d633b84d3ac8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:39:18.112116 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.112103 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-workload-socket\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:39:18.112227 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.112126 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-workload-certs\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:39:18.112227 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.112192 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "00fca4c6-2d34-4eb5-9bab-d633b84d3ac8" (UID: "00fca4c6-2d34-4eb5-9bab-d633b84d3ac8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:39:18.112423 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.112395 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "00fca4c6-2d34-4eb5-9bab-d633b84d3ac8" (UID: "00fca4c6-2d34-4eb5-9bab-d633b84d3ac8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:39:18.112743 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.112720 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-data" (OuterVolumeSpecName: "istio-data") pod "00fca4c6-2d34-4eb5-9bab-d633b84d3ac8" (UID: "00fca4c6-2d34-4eb5-9bab-d633b84d3ac8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:39:18.114238 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.114205 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-kube-api-access-wtsk7" (OuterVolumeSpecName: "kube-api-access-wtsk7") pod "00fca4c6-2d34-4eb5-9bab-d633b84d3ac8" (UID: "00fca4c6-2d34-4eb5-9bab-d633b84d3ac8"). InnerVolumeSpecName "kube-api-access-wtsk7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:39:18.114337 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.114204 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "00fca4c6-2d34-4eb5-9bab-d633b84d3ac8" (UID: "00fca4c6-2d34-4eb5-9bab-d633b84d3ac8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 17:39:18.114395 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.114340 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "00fca4c6-2d34-4eb5-9bab-d633b84d3ac8" (UID: "00fca4c6-2d34-4eb5-9bab-d633b84d3ac8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:39:18.114468 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.114432 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-token" (OuterVolumeSpecName: "istio-token") pod "00fca4c6-2d34-4eb5-9bab-d633b84d3ac8" (UID: "00fca4c6-2d34-4eb5-9bab-d633b84d3ac8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:39:18.213185 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.213159 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-envoy\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:39:18.213185 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.213182 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-data\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:39:18.213320 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.213191 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-credential-socket\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:39:18.213320 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.213200 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-token\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:39:18.213320 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.213208 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istiod-ca-cert\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:39:18.213320 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.213215 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-istio-podinfo\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:39:18.213320 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.213222 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtsk7\" (UniqueName: \"kubernetes.io/projected/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8-kube-api-access-wtsk7\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:39:18.286771 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.286737 2581 generic.go:356] "Generic (PLEG): container finished" podID="00fca4c6-2d34-4eb5-9bab-d633b84d3ac8" containerID="2c1f12db813aa486153720250cc26d297612101dc778e1373bd37ce81ecb0d79" exitCode=0 Jul 02 17:39:18.286931 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.286791 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" Jul 02 17:39:18.286931 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.286818 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" event={"ID":"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8","Type":"ContainerDied","Data":"2c1f12db813aa486153720250cc26d297612101dc778e1373bd37ce81ecb0d79"} Jul 02 17:39:18.286931 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.286869 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm" event={"ID":"00fca4c6-2d34-4eb5-9bab-d633b84d3ac8","Type":"ContainerDied","Data":"d6ca610cdf361112e1628e57a4128c8d5158aa229a4503141d8867e91f377683"} Jul 02 17:39:18.286931 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.286890 2581 scope.go:117] "RemoveContainer" containerID="2c1f12db813aa486153720250cc26d297612101dc778e1373bd37ce81ecb0d79" Jul 02 17:39:18.295629 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.295612 2581 scope.go:117] "RemoveContainer" containerID="7e74289bddf4f61323025252248b89361ab8162734becf8e3ea9b8ef2f8a49e6" Jul 02 17:39:18.305025 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.305006 2581 scope.go:117] "RemoveContainer" containerID="2c1f12db813aa486153720250cc26d297612101dc778e1373bd37ce81ecb0d79" Jul 02 17:39:18.305538 ip-10-0-136-0 kubenswrapper[2581]: E0702 17:39:18.305518 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c1f12db813aa486153720250cc26d297612101dc778e1373bd37ce81ecb0d79\": container with ID starting with 2c1f12db813aa486153720250cc26d297612101dc778e1373bd37ce81ecb0d79 not found: ID does not exist" containerID="2c1f12db813aa486153720250cc26d297612101dc778e1373bd37ce81ecb0d79" Jul 02 17:39:18.305606 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.305545 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c1f12db813aa486153720250cc26d297612101dc778e1373bd37ce81ecb0d79"} err="failed to get container status \"2c1f12db813aa486153720250cc26d297612101dc778e1373bd37ce81ecb0d79\": rpc error: code = NotFound desc = could not find container \"2c1f12db813aa486153720250cc26d297612101dc778e1373bd37ce81ecb0d79\": container with ID starting with 2c1f12db813aa486153720250cc26d297612101dc778e1373bd37ce81ecb0d79 not found: ID does not exist" Jul 02 17:39:18.305606 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.305563 2581 scope.go:117] "RemoveContainer" containerID="7e74289bddf4f61323025252248b89361ab8162734becf8e3ea9b8ef2f8a49e6" Jul 02 17:39:18.305825 ip-10-0-136-0 kubenswrapper[2581]: E0702 17:39:18.305805 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e74289bddf4f61323025252248b89361ab8162734becf8e3ea9b8ef2f8a49e6\": container with ID starting with 7e74289bddf4f61323025252248b89361ab8162734becf8e3ea9b8ef2f8a49e6 not found: ID does not exist" containerID="7e74289bddf4f61323025252248b89361ab8162734becf8e3ea9b8ef2f8a49e6" Jul 02 17:39:18.305887 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.305834 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e74289bddf4f61323025252248b89361ab8162734becf8e3ea9b8ef2f8a49e6"} err="failed to get container status \"7e74289bddf4f61323025252248b89361ab8162734becf8e3ea9b8ef2f8a49e6\": rpc error: code = NotFound desc = could not find container \"7e74289bddf4f61323025252248b89361ab8162734becf8e3ea9b8ef2f8a49e6\": container with ID starting with 7e74289bddf4f61323025252248b89361ab8162734becf8e3ea9b8ef2f8a49e6 not found: ID does not exist" Jul 02 17:39:18.309377 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.309357 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm"] Jul 02 17:39:18.314135 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:18.314116 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-73dc61-openshift-default-598d7f696c-68klm"] Jul 02 17:39:19.244430 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:19.244390 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00fca4c6-2d34-4eb5-9bab-d633b84d3ac8" path="/var/lib/kubelet/pods/00fca4c6-2d34-4eb5-9bab-d633b84d3ac8/volumes" Jul 02 17:39:20.227687 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:20.227648 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf"] Jul 02 17:39:20.227932 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:20.227893 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" podUID="f7f8c51e-3fb9-4890-b060-97fb50710e56" containerName="istio-proxy" containerID="cri-o://c46f136a257a7d9ee25238ba32b870e49cd9b089078969f530c21d6f32f2acf9" gracePeriod=30 Jul 02 17:39:25.468224 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.468200 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:39:25.573711 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.573682 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-credential-socket\") pod \"f7f8c51e-3fb9-4890-b060-97fb50710e56\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " Jul 02 17:39:25.573878 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.573734 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-workload-socket\") pod \"f7f8c51e-3fb9-4890-b060-97fb50710e56\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " Jul 02 17:39:25.573878 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.573764 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-envoy\") pod \"f7f8c51e-3fb9-4890-b060-97fb50710e56\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " Jul 02 17:39:25.573878 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.573792 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-data\") pod \"f7f8c51e-3fb9-4890-b060-97fb50710e56\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " Jul 02 17:39:25.573878 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.573824 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-token\") pod \"f7f8c51e-3fb9-4890-b060-97fb50710e56\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " Jul 02 17:39:25.573878 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.573840 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7f8c51e-3fb9-4890-b060-97fb50710e56-istiod-ca-cert\") pod \"f7f8c51e-3fb9-4890-b060-97fb50710e56\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " Jul 02 17:39:25.573878 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.573873 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwz65\" (UniqueName: \"kubernetes.io/projected/f7f8c51e-3fb9-4890-b060-97fb50710e56-kube-api-access-hwz65\") pod \"f7f8c51e-3fb9-4890-b060-97fb50710e56\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " Jul 02 17:39:25.574188 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.573959 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-workload-certs\") pod \"f7f8c51e-3fb9-4890-b060-97fb50710e56\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " Jul 02 17:39:25.574188 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.573979 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f7f8c51e-3fb9-4890-b060-97fb50710e56" (UID: "f7f8c51e-3fb9-4890-b060-97fb50710e56"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:39:25.574188 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.574031 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f7f8c51e-3fb9-4890-b060-97fb50710e56" (UID: "f7f8c51e-3fb9-4890-b060-97fb50710e56"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:39:25.574188 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.574048 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-podinfo\") pod \"f7f8c51e-3fb9-4890-b060-97fb50710e56\" (UID: \"f7f8c51e-3fb9-4890-b060-97fb50710e56\") " Jul 02 17:39:25.574449 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.574322 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-credential-socket\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:39:25.574449 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.574340 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-workload-socket\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:39:25.574710 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.574687 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f7f8c51e-3fb9-4890-b060-97fb50710e56" (UID: "f7f8c51e-3fb9-4890-b060-97fb50710e56"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:39:25.574779 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.574707 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7f8c51e-3fb9-4890-b060-97fb50710e56-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f7f8c51e-3fb9-4890-b060-97fb50710e56" (UID: "f7f8c51e-3fb9-4890-b060-97fb50710e56"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:39:25.575149 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.575127 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-data" (OuterVolumeSpecName: "istio-data") pod "f7f8c51e-3fb9-4890-b060-97fb50710e56" (UID: "f7f8c51e-3fb9-4890-b060-97fb50710e56"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:39:25.576574 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.576546 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7f8c51e-3fb9-4890-b060-97fb50710e56-kube-api-access-hwz65" (OuterVolumeSpecName: "kube-api-access-hwz65") pod "f7f8c51e-3fb9-4890-b060-97fb50710e56" (UID: "f7f8c51e-3fb9-4890-b060-97fb50710e56"). InnerVolumeSpecName "kube-api-access-hwz65". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:39:25.576683 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.576605 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f7f8c51e-3fb9-4890-b060-97fb50710e56" (UID: "f7f8c51e-3fb9-4890-b060-97fb50710e56"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 17:39:25.576836 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.576814 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f7f8c51e-3fb9-4890-b060-97fb50710e56" (UID: "f7f8c51e-3fb9-4890-b060-97fb50710e56"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:39:25.576836 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.576826 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-token" (OuterVolumeSpecName: "istio-token") pod "f7f8c51e-3fb9-4890-b060-97fb50710e56" (UID: "f7f8c51e-3fb9-4890-b060-97fb50710e56"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:39:25.674916 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.674885 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-envoy\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:39:25.674916 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.674914 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-data\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:39:25.674916 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.674923 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-token\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:39:25.675080 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.674931 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7f8c51e-3fb9-4890-b060-97fb50710e56-istiod-ca-cert\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:39:25.675080 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.674939 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwz65\" (UniqueName: \"kubernetes.io/projected/f7f8c51e-3fb9-4890-b060-97fb50710e56-kube-api-access-hwz65\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:39:25.675080 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.674947 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7f8c51e-3fb9-4890-b060-97fb50710e56-workload-certs\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:39:25.675080 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:25.674955 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7f8c51e-3fb9-4890-b060-97fb50710e56-istio-podinfo\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 02 17:39:26.329937 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:26.329906 2581 generic.go:356] "Generic (PLEG): container finished" podID="f7f8c51e-3fb9-4890-b060-97fb50710e56" containerID="c46f136a257a7d9ee25238ba32b870e49cd9b089078969f530c21d6f32f2acf9" exitCode=0 Jul 02 17:39:26.330112 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:26.329955 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" Jul 02 17:39:26.330112 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:26.330001 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" event={"ID":"f7f8c51e-3fb9-4890-b060-97fb50710e56","Type":"ContainerDied","Data":"c46f136a257a7d9ee25238ba32b870e49cd9b089078969f530c21d6f32f2acf9"} Jul 02 17:39:26.330112 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:26.330061 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf" event={"ID":"f7f8c51e-3fb9-4890-b060-97fb50710e56","Type":"ContainerDied","Data":"cb2a0daec7304f68f91678688edf36285b4a29b8fd2fe42f1b87e4152a29e643"} Jul 02 17:39:26.330112 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:26.330090 2581 scope.go:117] "RemoveContainer" containerID="c46f136a257a7d9ee25238ba32b870e49cd9b089078969f530c21d6f32f2acf9" Jul 02 17:39:26.338628 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:26.338606 2581 scope.go:117] "RemoveContainer" containerID="5041b1585f92b21e8026c58ed79f07e5d3b4a3088cf0db77d0ee8aad21003836" Jul 02 17:39:26.346236 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:26.346092 2581 scope.go:117] "RemoveContainer" containerID="c46f136a257a7d9ee25238ba32b870e49cd9b089078969f530c21d6f32f2acf9" Jul 02 17:39:26.346341 ip-10-0-136-0 kubenswrapper[2581]: E0702 17:39:26.346320 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c46f136a257a7d9ee25238ba32b870e49cd9b089078969f530c21d6f32f2acf9\": container with ID starting with c46f136a257a7d9ee25238ba32b870e49cd9b089078969f530c21d6f32f2acf9 not found: ID does not exist" containerID="c46f136a257a7d9ee25238ba32b870e49cd9b089078969f530c21d6f32f2acf9" Jul 02 17:39:26.346397 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:26.346348 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c46f136a257a7d9ee25238ba32b870e49cd9b089078969f530c21d6f32f2acf9"} err="failed to get container status \"c46f136a257a7d9ee25238ba32b870e49cd9b089078969f530c21d6f32f2acf9\": rpc error: code = NotFound desc = could not find container \"c46f136a257a7d9ee25238ba32b870e49cd9b089078969f530c21d6f32f2acf9\": container with ID starting with c46f136a257a7d9ee25238ba32b870e49cd9b089078969f530c21d6f32f2acf9 not found: ID does not exist" Jul 02 17:39:26.346397 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:26.346365 2581 scope.go:117] "RemoveContainer" containerID="5041b1585f92b21e8026c58ed79f07e5d3b4a3088cf0db77d0ee8aad21003836" Jul 02 17:39:26.346623 ip-10-0-136-0 kubenswrapper[2581]: E0702 17:39:26.346605 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5041b1585f92b21e8026c58ed79f07e5d3b4a3088cf0db77d0ee8aad21003836\": container with ID starting with 5041b1585f92b21e8026c58ed79f07e5d3b4a3088cf0db77d0ee8aad21003836 not found: ID does not exist" containerID="5041b1585f92b21e8026c58ed79f07e5d3b4a3088cf0db77d0ee8aad21003836" Jul 02 17:39:26.346674 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:26.346628 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5041b1585f92b21e8026c58ed79f07e5d3b4a3088cf0db77d0ee8aad21003836"} err="failed to get container status \"5041b1585f92b21e8026c58ed79f07e5d3b4a3088cf0db77d0ee8aad21003836\": rpc error: code = NotFound desc = could not find container \"5041b1585f92b21e8026c58ed79f07e5d3b4a3088cf0db77d0ee8aad21003836\": container with ID starting with 5041b1585f92b21e8026c58ed79f07e5d3b4a3088cf0db77d0ee8aad21003836 not found: ID does not exist" Jul 02 17:39:26.350403 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:26.350380 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf"] Jul 02 17:39:26.355893 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:26.355871 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-b85f5a-openshift-default-8656dccc5f-k58vf"] Jul 02 17:39:26.896105 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:26.896076 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8b6c9f55f-lxqfd_9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9/copy-manifests/0.log" Jul 02 17:39:26.903645 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:26.903616 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8b6c9f55f-lxqfd_9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9/manager/0.log" Jul 02 17:39:27.243825 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:27.243797 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7f8c51e-3fb9-4890-b060-97fb50710e56" path="/var/lib/kubelet/pods/f7f8c51e-3fb9-4890-b060-97fb50710e56/volumes" Jul 02 17:39:29.692241 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:29.692210 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6784p5pn_194bd771-1018-4159-a5f5-f003f0750d14/istio-proxy/0.log" Jul 02 17:39:29.813278 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:29.813255 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-fx6kt_7c6764f6-5ea4-4730-97dd-7d466d48ffd9/discovery/0.log" Jul 02 17:39:30.195258 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:30.195229 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-zzg6s_0be034e3-6428-4046-b808-d14667af765d/istio-proxy/1.log" Jul 02 17:39:31.477289 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:31.477251 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-zg2mp_d2af2f4a-eba5-47e0-9b78-ee5c3881508c/main/0.log" Jul 02 17:39:39.245276 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:39.245243 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ttr6p_5a84fd75-a938-4cbb-9493-85d680bad63b/global-pull-secret-syncer/0.log" Jul 02 17:39:39.434296 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:39.434269 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nqz99_c30ff467-6c6e-49b4-b994-87a9ee61553d/konnectivity-agent/0.log" Jul 02 17:39:39.513302 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:39.513233 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-0.ec2.internal_608c73c3a8e2a463a8943d59c528dfdc/haproxy/0.log" Jul 02 17:39:46.877258 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:46.877185 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-qpplk_1ef99d90-0d60-4628-852a-072abc39d2c7/cluster-monitoring-operator/0.log" Jul 02 17:39:46.969034 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:46.969009 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-8476989897-v9wf4_22836475-c8d0-4330-ad79-1ab78d3fe123/metrics-server/0.log" Jul 02 17:39:46.993072 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:46.993049 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-qbhsg_3e0d6f99-8dd7-4488-ad82-f76e85f61870/monitoring-plugin/0.log" Jul 02 17:39:47.026897 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:47.026865 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7lzwr_c3cfa74c-f9d4-4908-9ce6-b39874418a24/node-exporter/0.log" Jul 02 17:39:47.051878 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:47.051856 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7lzwr_c3cfa74c-f9d4-4908-9ce6-b39874418a24/kube-rbac-proxy/0.log" Jul 02 17:39:47.073541 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:47.073522 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7lzwr_c3cfa74c-f9d4-4908-9ce6-b39874418a24/init-textfile/0.log" Jul 02 17:39:47.398231 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:47.398199 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa54d365-bb74-4e2b-8886-ee3888816de9/prometheus/0.log" Jul 02 17:39:47.436161 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:47.436131 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa54d365-bb74-4e2b-8886-ee3888816de9/config-reloader/0.log" Jul 02 17:39:47.458754 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:47.458729 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa54d365-bb74-4e2b-8886-ee3888816de9/thanos-sidecar/0.log" Jul 02 17:39:47.478809 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:47.478786 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa54d365-bb74-4e2b-8886-ee3888816de9/kube-rbac-proxy-web/0.log" Jul 02 17:39:47.499887 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:47.499867 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa54d365-bb74-4e2b-8886-ee3888816de9/kube-rbac-proxy/0.log" Jul 02 17:39:47.522052 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:47.522032 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa54d365-bb74-4e2b-8886-ee3888816de9/kube-rbac-proxy-thanos/0.log" Jul 02 17:39:47.545007 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:47.544988 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa54d365-bb74-4e2b-8886-ee3888816de9/init-config-reloader/0.log" Jul 02 17:39:48.981086 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:48.981050 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf"] Jul 02 17:39:48.981492 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:48.981360 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00fca4c6-2d34-4eb5-9bab-d633b84d3ac8" containerName="istio-proxy" Jul 02 17:39:48.981492 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:48.981373 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="00fca4c6-2d34-4eb5-9bab-d633b84d3ac8" containerName="istio-proxy" Jul 02 17:39:48.981492 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:48.981385 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7f8c51e-3fb9-4890-b060-97fb50710e56" containerName="istio-proxy" Jul 02 17:39:48.981492 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:48.981391 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7f8c51e-3fb9-4890-b060-97fb50710e56" containerName="istio-proxy" Jul 02 17:39:48.981492 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:48.981400 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7f8c51e-3fb9-4890-b060-97fb50710e56" containerName="istio-proxy" Jul 02 17:39:48.981492 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:48.981405 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7f8c51e-3fb9-4890-b060-97fb50710e56" containerName="istio-proxy" Jul 02 17:39:48.981492 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:48.981417 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adceef5f-50b2-4f77-9abc-b83aaf71d6b4" containerName="istio-proxy" Jul 02 17:39:48.981492 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:48.981423 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="adceef5f-50b2-4f77-9abc-b83aaf71d6b4" containerName="istio-proxy" Jul 02 17:39:48.981492 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:48.981493 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7f8c51e-3fb9-4890-b060-97fb50710e56" containerName="istio-proxy" Jul 02 17:39:48.981776 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:48.981503 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7f8c51e-3fb9-4890-b060-97fb50710e56" containerName="istio-proxy" Jul 02 17:39:48.981776 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:48.981511 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="00fca4c6-2d34-4eb5-9bab-d633b84d3ac8" containerName="istio-proxy" Jul 02 17:39:48.981776 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:48.981518 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="adceef5f-50b2-4f77-9abc-b83aaf71d6b4" containerName="istio-proxy" Jul 02 17:39:48.981776 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:48.981523 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="00fca4c6-2d34-4eb5-9bab-d633b84d3ac8" containerName="istio-proxy" Jul 02 17:39:48.983725 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:48.983701 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf" Jul 02 17:39:48.986488 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:48.986448 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-55pg4\"/\"default-dockercfg-9kgtg\"" Jul 02 17:39:48.986597 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:48.986494 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-55pg4\"/\"kube-root-ca.crt\"" Jul 02 17:39:48.987290 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:48.987276 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-55pg4\"/\"openshift-service-ca.crt\"" Jul 02 17:39:48.995261 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:48.995240 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf"] Jul 02 17:39:49.068619 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:49.068597 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b30149e8-151c-4bb1-9f7b-cfcd8f343ad3-podres\") pod \"perf-node-gather-daemonset-ck6tf\" (UID: \"b30149e8-151c-4bb1-9f7b-cfcd8f343ad3\") " pod="openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf" Jul 02 17:39:49.068728 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:49.068632 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b30149e8-151c-4bb1-9f7b-cfcd8f343ad3-proc\") pod \"perf-node-gather-daemonset-ck6tf\" (UID: \"b30149e8-151c-4bb1-9f7b-cfcd8f343ad3\") " pod="openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf" Jul 02 17:39:49.068728 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:49.068661 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k2hw\" (UniqueName: \"kubernetes.io/projected/b30149e8-151c-4bb1-9f7b-cfcd8f343ad3-kube-api-access-7k2hw\") pod \"perf-node-gather-daemonset-ck6tf\" (UID: \"b30149e8-151c-4bb1-9f7b-cfcd8f343ad3\") " pod="openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf" Jul 02 17:39:49.068728 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:49.068724 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b30149e8-151c-4bb1-9f7b-cfcd8f343ad3-sys\") pod \"perf-node-gather-daemonset-ck6tf\" (UID: \"b30149e8-151c-4bb1-9f7b-cfcd8f343ad3\") " pod="openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf" Jul 02 17:39:49.068847 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:49.068754 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b30149e8-151c-4bb1-9f7b-cfcd8f343ad3-lib-modules\") pod \"perf-node-gather-daemonset-ck6tf\" (UID: \"b30149e8-151c-4bb1-9f7b-cfcd8f343ad3\") " pod="openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf" Jul 02 17:39:49.169742 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:49.169717 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b30149e8-151c-4bb1-9f7b-cfcd8f343ad3-sys\") pod \"perf-node-gather-daemonset-ck6tf\" (UID: \"b30149e8-151c-4bb1-9f7b-cfcd8f343ad3\") " pod="openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf" Jul 02 17:39:49.169853 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:49.169750 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b30149e8-151c-4bb1-9f7b-cfcd8f343ad3-lib-modules\") pod \"perf-node-gather-daemonset-ck6tf\" (UID: \"b30149e8-151c-4bb1-9f7b-cfcd8f343ad3\") " pod="openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf" Jul 02 17:39:49.169853 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:49.169784 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b30149e8-151c-4bb1-9f7b-cfcd8f343ad3-podres\") pod \"perf-node-gather-daemonset-ck6tf\" (UID: \"b30149e8-151c-4bb1-9f7b-cfcd8f343ad3\") " pod="openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf" Jul 02 17:39:49.169971 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:49.169846 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b30149e8-151c-4bb1-9f7b-cfcd8f343ad3-sys\") pod \"perf-node-gather-daemonset-ck6tf\" (UID: \"b30149e8-151c-4bb1-9f7b-cfcd8f343ad3\") " pod="openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf" Jul 02 17:39:49.169971 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:49.169870 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b30149e8-151c-4bb1-9f7b-cfcd8f343ad3-podres\") pod \"perf-node-gather-daemonset-ck6tf\" (UID: \"b30149e8-151c-4bb1-9f7b-cfcd8f343ad3\") " pod="openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf" Jul 02 17:39:49.169971 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:49.169875 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b30149e8-151c-4bb1-9f7b-cfcd8f343ad3-lib-modules\") pod \"perf-node-gather-daemonset-ck6tf\" (UID: \"b30149e8-151c-4bb1-9f7b-cfcd8f343ad3\") " pod="openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf" Jul 02 17:39:49.169971 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:49.169898 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b30149e8-151c-4bb1-9f7b-cfcd8f343ad3-proc\") pod \"perf-node-gather-daemonset-ck6tf\" (UID: \"b30149e8-151c-4bb1-9f7b-cfcd8f343ad3\") " pod="openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf" Jul 02 17:39:49.169971 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:49.169951 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k2hw\" (UniqueName: \"kubernetes.io/projected/b30149e8-151c-4bb1-9f7b-cfcd8f343ad3-kube-api-access-7k2hw\") pod \"perf-node-gather-daemonset-ck6tf\" (UID: \"b30149e8-151c-4bb1-9f7b-cfcd8f343ad3\") " pod="openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf" Jul 02 17:39:49.170214 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:49.169984 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b30149e8-151c-4bb1-9f7b-cfcd8f343ad3-proc\") pod \"perf-node-gather-daemonset-ck6tf\" (UID: \"b30149e8-151c-4bb1-9f7b-cfcd8f343ad3\") " pod="openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf" Jul 02 17:39:49.177471 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:49.177436 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k2hw\" (UniqueName: \"kubernetes.io/projected/b30149e8-151c-4bb1-9f7b-cfcd8f343ad3-kube-api-access-7k2hw\") pod \"perf-node-gather-daemonset-ck6tf\" (UID: \"b30149e8-151c-4bb1-9f7b-cfcd8f343ad3\") " pod="openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf" Jul 02 17:39:49.293875 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:49.293854 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf" Jul 02 17:39:49.420282 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:49.420216 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf"] Jul 02 17:39:49.424095 ip-10-0-136-0 kubenswrapper[2581]: W0702 17:39:49.424067 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb30149e8_151c_4bb1_9f7b_cfcd8f343ad3.slice/crio-0a805c4a837bcd9e7c88847747b1eb0fdbeb114ec84b9cd00e9f50daa7a04b5a WatchSource:0}: Error finding container 0a805c4a837bcd9e7c88847747b1eb0fdbeb114ec84b9cd00e9f50daa7a04b5a: Status 404 returned error can't find the container with id 0a805c4a837bcd9e7c88847747b1eb0fdbeb114ec84b9cd00e9f50daa7a04b5a Jul 02 17:39:49.431483 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:49.431443 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf" event={"ID":"b30149e8-151c-4bb1-9f7b-cfcd8f343ad3","Type":"ContainerStarted","Data":"0a805c4a837bcd9e7c88847747b1eb0fdbeb114ec84b9cd00e9f50daa7a04b5a"} Jul 02 17:39:50.116244 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:50.116218 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b89bdbb4b-gsq5r_66f3d901-b858-4a08-8297-9c31959087b4/console/0.log" Jul 02 17:39:50.439836 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:50.439751 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf" event={"ID":"b30149e8-151c-4bb1-9f7b-cfcd8f343ad3","Type":"ContainerStarted","Data":"b48475bcb34e793f9193931748be6a9788d441d8ecb07e83dcc3d87bc4644578"} Jul 02 17:39:50.439978 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:50.439834 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf" Jul 02 17:39:50.455646 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:50.455600 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf" podStartSLOduration=2.455587195 podStartE2EDuration="2.455587195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:39:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:39:50.454192948 +0000 UTC m=+2569.644494120" watchObservedRunningTime="2026-07-02 17:39:50.455587195 +0000 UTC m=+2569.645888353" Jul 02 17:39:51.897617 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:51.897587 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vj7s5_effa5ec3-b115-43eb-8cbd-8d12a3b1785b/dns/0.log" Jul 02 17:39:51.916607 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:51.916581 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vj7s5_effa5ec3-b115-43eb-8cbd-8d12a3b1785b/kube-rbac-proxy/0.log" Jul 02 17:39:51.982507 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:51.982485 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rwcwq_da991979-8409-483d-8bb2-b63217ebaf2b/dns-node-resolver/0.log" Jul 02 17:39:52.509971 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:52.509937 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6c4f695bc5-rkmbt_8ff10ecb-8890-42f1-8938-85d24bb7c11a/registry/0.log" Jul 02 17:39:52.560102 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:52.560073 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cwtmc_80bb48b9-f232-4e0f-9fe4-2bc70ad76edc/node-ca/0.log" Jul 02 17:39:53.498201 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:53.498171 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6784p5pn_194bd771-1018-4159-a5f5-f003f0750d14/istio-proxy/0.log" Jul 02 17:39:53.689230 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:53.689201 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-fx6kt_7c6764f6-5ea4-4730-97dd-7d466d48ffd9/discovery/0.log" Jul 02 17:39:53.761962 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:53.761819 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-zzg6s_0be034e3-6428-4046-b808-d14667af765d/istio-proxy/0.log" Jul 02 17:39:53.825282 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:53.825252 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-zzg6s_0be034e3-6428-4046-b808-d14667af765d/istio-proxy/1.log" Jul 02 17:39:54.638321 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:54.638290 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n5rjx_ad81f415-2238-465c-aa67-12486b816585/serve-healthcheck-canary/0.log" Jul 02 17:39:55.211250 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:55.211221 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5fstr_fcd99657-53a6-4660-a45a-9af6d2d9ab92/kube-rbac-proxy/0.log" Jul 02 17:39:55.231995 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:55.231969 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5fstr_fcd99657-53a6-4660-a45a-9af6d2d9ab92/exporter/0.log" Jul 02 17:39:55.253759 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:55.253730 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5fstr_fcd99657-53a6-4660-a45a-9af6d2d9ab92/extractor/0.log" Jul 02 17:39:56.455358 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:56.455331 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-55pg4/perf-node-gather-daemonset-ck6tf" Jul 02 17:39:58.121698 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:58.121646 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8b6c9f55f-lxqfd_9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9/manager/0.log" Jul 02 17:39:58.142290 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:58.142269 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8b6c9f55f-lxqfd_9f0eb97f-865d-4ca0-b4e8-e61f97ecfcf9/copy-manifests/0.log" Jul 02 17:39:59.904731 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:39:59.904705 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6784p5pn_194bd771-1018-4159-a5f5-f003f0750d14/istio-proxy/0.log" Jul 02 17:40:00.003972 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:40:00.003933 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6f677bc8d7-65486_c80aa4b9-55ad-4028-b5f3-3401562bbdfb/manager/0.log" Jul 02 17:40:00.093909 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:40:00.093878 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-fx6kt_7c6764f6-5ea4-4730-97dd-7d466d48ffd9/discovery/0.log" Jul 02 17:40:00.145248 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:40:00.145222 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-zzg6s_0be034e3-6428-4046-b808-d14667af765d/istio-proxy/0.log" Jul 02 17:40:00.209038 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:40:00.209013 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-zzg6s_0be034e3-6428-4046-b808-d14667af765d/istio-proxy/1.log" Jul 02 17:40:01.542553 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:40:01.542521 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6784p5pn_194bd771-1018-4159-a5f5-f003f0750d14/istio-proxy/0.log" Jul 02 17:40:01.733295 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:40:01.733265 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-fx6kt_7c6764f6-5ea4-4730-97dd-7d466d48ffd9/discovery/0.log" Jul 02 17:40:01.815044 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:40:01.815007 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-zzg6s_0be034e3-6428-4046-b808-d14667af765d/istio-proxy/0.log" Jul 02 17:40:01.882167 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:40:01.882140 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-zzg6s_0be034e3-6428-4046-b808-d14667af765d/istio-proxy/1.log" Jul 02 17:40:04.984415 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:40:04.984381 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-qb8gt_5b898a26-1564-43c9-9867-d3ea306542d8/migrator/0.log" Jul 02 17:40:05.003856 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:40:05.003832 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-qb8gt_5b898a26-1564-43c9-9867-d3ea306542d8/graceful-termination/0.log" Jul 02 17:40:06.745351 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:40:06.745324 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w5v9t_eb5365f4-38af-4aff-8dbe-73cc522fb645/kube-multus-additional-cni-plugins/0.log" Jul 02 17:40:06.765364 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:40:06.765336 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w5v9t_eb5365f4-38af-4aff-8dbe-73cc522fb645/egress-router-binary-copy/0.log" Jul 02 17:40:06.785197 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:40:06.785172 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w5v9t_eb5365f4-38af-4aff-8dbe-73cc522fb645/cni-plugins/0.log" Jul 02 17:40:06.804983 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:40:06.804955 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w5v9t_eb5365f4-38af-4aff-8dbe-73cc522fb645/bond-cni-plugin/0.log" Jul 02 17:40:06.824793 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:40:06.824770 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w5v9t_eb5365f4-38af-4aff-8dbe-73cc522fb645/routeoverride-cni/0.log" Jul 02 17:40:06.844055 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:40:06.844036 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w5v9t_eb5365f4-38af-4aff-8dbe-73cc522fb645/whereabouts-cni-bincopy/0.log" Jul 02 17:40:06.863298 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:40:06.863271 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w5v9t_eb5365f4-38af-4aff-8dbe-73cc522fb645/whereabouts-cni/0.log" Jul 02 17:40:06.900869 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:40:06.900842 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-b96cv_34514e3e-e8f3-4500-b52c-77c91e341f02/kube-multus/0.log" Jul 02 17:40:06.960825 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:40:06.960805 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6h8hw_ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa/network-metrics-daemon/0.log" Jul 02 17:40:06.978502 ip-10-0-136-0 kubenswrapper[2581]: I0702 17:40:06.978481 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6h8hw_ae1c7b38-01e0-4ce7-ae9f-3f6701a140fa/kube-rbac-proxy/0.log"