Jul 06 18:52:57.136463 ip-10-0-139-154 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 18:52:57.136478 ip-10-0-139-154 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 18:52:57.136488 ip-10-0-139-154 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 18:52:57.136948 ip-10-0-139-154 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 18:53:06.340404 ip-10-0-139-154 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 18:53:06.340420 ip-10-0-139-154 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e8a73d86de134aa2981bce75b043f22c -- Jul 06 18:54:51.946738 ip-10-0-139-154 systemd[1]: Starting Kubernetes Kubelet... Jul 06 18:54:52.379251 ip-10-0-139-154 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 18:54:52.379251 ip-10-0-139-154 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 18:54:52.379251 ip-10-0-139-154 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 18:54:52.379251 ip-10-0-139-154 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 18:54:52.379251 ip-10-0-139-154 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 18:54:52.381164 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.381044 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 18:54:52.385829 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385813 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 18:54:52.385829 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385828 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 18:54:52.385898 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385832 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 18:54:52.385898 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385836 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 18:54:52.385898 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385839 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 18:54:52.385898 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385842 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 18:54:52.385898 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385845 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 18:54:52.385898 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385851 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 18:54:52.385898 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385856 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 18:54:52.385898 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385860 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 18:54:52.385898 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385863 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 18:54:52.385898 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385866 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 18:54:52.385898 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385869 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 18:54:52.385898 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385872 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 18:54:52.385898 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385876 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 18:54:52.385898 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385879 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 18:54:52.385898 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385883 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 18:54:52.385898 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385886 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 18:54:52.385898 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385889 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 18:54:52.385898 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385892 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 18:54:52.385898 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385895 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 18:54:52.386387 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385898 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 18:54:52.386387 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385901 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 18:54:52.386387 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385904 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 18:54:52.386387 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385907 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 18:54:52.386387 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385910 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 18:54:52.386387 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385913 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 18:54:52.386387 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385916 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 18:54:52.386387 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385919 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 18:54:52.386387 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385921 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 18:54:52.386387 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385925 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 18:54:52.386387 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385927 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 18:54:52.386387 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385930 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 18:54:52.386387 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385932 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 18:54:52.386387 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385935 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 18:54:52.386387 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385937 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 18:54:52.386387 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385940 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 18:54:52.386387 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385943 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 18:54:52.386387 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385945 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 18:54:52.386387 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385948 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 18:54:52.386387 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385950 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 18:54:52.386953 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385953 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 18:54:52.386953 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385956 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 18:54:52.386953 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385958 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 18:54:52.386953 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385961 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 18:54:52.386953 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385964 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 06 18:54:52.386953 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385966 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 18:54:52.386953 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385969 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 18:54:52.386953 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385972 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 18:54:52.386953 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385982 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 18:54:52.386953 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385985 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 18:54:52.386953 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385988 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 18:54:52.386953 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385990 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 18:54:52.386953 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385993 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 18:54:52.386953 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385996 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 18:54:52.386953 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.385999 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 18:54:52.386953 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386002 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 18:54:52.386953 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386005 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 18:54:52.386953 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386008 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 18:54:52.386953 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386011 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 18:54:52.386953 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386013 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 18:54:52.387469 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386016 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 18:54:52.387469 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386019 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 18:54:52.387469 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386022 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 18:54:52.387469 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386024 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 18:54:52.387469 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386027 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 18:54:52.387469 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386030 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 18:54:52.387469 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386032 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 18:54:52.387469 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386035 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 18:54:52.387469 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386039 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 18:54:52.387469 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386042 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 18:54:52.387469 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386044 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 18:54:52.387469 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386047 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 18:54:52.387469 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386050 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 18:54:52.387469 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386053 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 18:54:52.387469 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386055 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 18:54:52.387469 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386058 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 18:54:52.387469 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386062 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 18:54:52.387469 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386067 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 18:54:52.387469 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386070 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 18:54:52.387966 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386073 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 18:54:52.387966 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386076 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 18:54:52.387966 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386079 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 18:54:52.387966 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386082 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 18:54:52.387966 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386084 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 18:54:52.387966 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386087 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 18:54:52.387966 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386091 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 18:54:52.387966 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386094 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 18:54:52.387966 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386097 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 18:54:52.387966 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386099 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 18:54:52.387966 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386102 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 18:54:52.387966 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386105 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 18:54:52.387966 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386108 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 18:54:52.387966 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386111 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 18:54:52.387966 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386114 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 18:54:52.387966 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386116 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 18:54:52.387966 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386120 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 18:54:52.387966 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386124 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 18:54:52.387966 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.386128 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 18:54:52.388751 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388737 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 18:54:52.388751 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388750 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 18:54:52.388814 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388754 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 18:54:52.388814 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388762 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 18:54:52.388814 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388765 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 18:54:52.388814 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388768 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 18:54:52.388814 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388771 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 18:54:52.388814 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388775 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 18:54:52.388814 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388777 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 18:54:52.388814 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388780 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 18:54:52.388814 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388783 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 18:54:52.388814 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388786 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 18:54:52.388814 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388788 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 18:54:52.388814 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388791 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 18:54:52.388814 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388795 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 18:54:52.388814 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388799 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 18:54:52.388814 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388802 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 18:54:52.388814 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388805 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 18:54:52.388814 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388808 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 18:54:52.388814 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388811 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 18:54:52.388814 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388814 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 18:54:52.389305 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388816 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 18:54:52.389305 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388819 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 18:54:52.389305 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388824 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 18:54:52.389305 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388828 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 18:54:52.389305 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388831 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 18:54:52.389305 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388834 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 18:54:52.389305 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388838 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 18:54:52.389305 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388841 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 18:54:52.389305 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388843 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 18:54:52.389305 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388846 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 18:54:52.389305 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388850 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 18:54:52.389305 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388852 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 18:54:52.389305 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388855 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 18:54:52.389305 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388858 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 18:54:52.389305 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388861 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 18:54:52.389305 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388864 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 18:54:52.389305 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388867 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 18:54:52.389305 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388869 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 18:54:52.389305 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388872 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 18:54:52.389857 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388875 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 18:54:52.389857 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388877 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 18:54:52.389857 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388880 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 18:54:52.389857 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388883 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 18:54:52.389857 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388885 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 18:54:52.389857 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388888 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 18:54:52.389857 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388890 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 18:54:52.389857 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388894 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 18:54:52.389857 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388897 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 18:54:52.389857 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388899 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 18:54:52.389857 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388902 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 18:54:52.389857 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388904 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 18:54:52.389857 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388907 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 18:54:52.389857 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388910 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 18:54:52.389857 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388913 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 18:54:52.389857 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388916 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 18:54:52.389857 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388919 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 18:54:52.389857 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388922 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 18:54:52.389857 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388925 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 18:54:52.389857 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388928 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 18:54:52.390400 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388931 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 18:54:52.390400 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388933 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 18:54:52.390400 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388936 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 18:54:52.390400 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388938 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 18:54:52.390400 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388941 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 18:54:52.390400 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388944 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 18:54:52.390400 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388946 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 18:54:52.390400 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388949 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 18:54:52.390400 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388951 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 18:54:52.390400 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388954 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 18:54:52.390400 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388957 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 18:54:52.390400 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388960 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 18:54:52.390400 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388962 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 18:54:52.390400 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388965 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 18:54:52.390400 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388968 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 18:54:52.390400 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388970 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 18:54:52.390400 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388973 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 06 18:54:52.390400 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388976 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 18:54:52.390400 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388978 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 18:54:52.390400 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388981 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 18:54:52.390948 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388984 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 18:54:52.390948 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388986 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 18:54:52.390948 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388991 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 18:54:52.390948 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388994 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 18:54:52.390948 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388997 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 18:54:52.390948 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.388999 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 18:54:52.390948 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.389003 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 18:54:52.390948 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.389006 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 18:54:52.390948 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.389008 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 18:54:52.390948 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.389011 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 18:54:52.390948 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.389014 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 18:54:52.390948 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.389018 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 18:54:52.390948 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.389021 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 18:54:52.390948 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.389024 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 18:54:52.390948 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.389027 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 18:54:52.390948 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.389030 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 18:54:52.390948 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.389033 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 18:54:52.390948 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.389036 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 18:54:52.390948 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.389039 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 18:54:52.391431 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390033 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 18:54:52.391431 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390041 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 18:54:52.391431 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390045 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 18:54:52.391431 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390048 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 18:54:52.391431 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390051 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 18:54:52.391431 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390054 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 18:54:52.391431 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390057 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 18:54:52.391431 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390059 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 18:54:52.391431 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390064 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 18:54:52.391431 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390068 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 18:54:52.391431 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390072 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 18:54:52.391431 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390075 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 18:54:52.391431 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390078 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 18:54:52.391431 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390081 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 18:54:52.391431 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390084 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 18:54:52.391431 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390087 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 18:54:52.391431 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390089 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 18:54:52.391431 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390092 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 18:54:52.391431 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390095 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 18:54:52.391927 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390098 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 18:54:52.391927 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390101 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 18:54:52.391927 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390104 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 18:54:52.391927 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390107 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 18:54:52.391927 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390109 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 18:54:52.391927 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390112 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 18:54:52.391927 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390115 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 18:54:52.391927 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390118 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 18:54:52.391927 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390120 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 18:54:52.391927 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390123 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 18:54:52.391927 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390125 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 18:54:52.391927 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390128 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 18:54:52.391927 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390131 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 18:54:52.391927 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390134 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 18:54:52.391927 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390136 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 18:54:52.391927 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390139 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 18:54:52.391927 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390143 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 18:54:52.391927 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390145 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 18:54:52.391927 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390148 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 18:54:52.391927 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390151 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 18:54:52.392454 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390153 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 18:54:52.392454 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390156 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 18:54:52.392454 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390159 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 18:54:52.392454 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390162 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 18:54:52.392454 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390165 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 18:54:52.392454 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390167 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 18:54:52.392454 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390170 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 18:54:52.392454 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390173 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 18:54:52.392454 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390176 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 18:54:52.392454 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390178 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 18:54:52.392454 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390181 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 18:54:52.392454 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390183 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 18:54:52.392454 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390187 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 18:54:52.392454 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390192 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 18:54:52.392454 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390195 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 18:54:52.392454 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390198 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 18:54:52.392454 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390201 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 18:54:52.392454 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390204 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 18:54:52.392454 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390207 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 18:54:52.392979 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390209 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 18:54:52.392979 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390212 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 18:54:52.392979 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390215 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 18:54:52.392979 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390217 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 18:54:52.392979 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390220 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 18:54:52.392979 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390223 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 18:54:52.392979 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390226 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 18:54:52.392979 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390228 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 18:54:52.392979 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390231 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 18:54:52.392979 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390233 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 18:54:52.392979 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390236 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 18:54:52.392979 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390239 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 18:54:52.392979 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390242 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 18:54:52.392979 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390245 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 18:54:52.392979 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390248 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 18:54:52.392979 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390250 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 18:54:52.392979 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390253 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 18:54:52.392979 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390256 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 18:54:52.392979 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390258 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 18:54:52.392979 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390261 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 18:54:52.393499 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390264 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 18:54:52.393499 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390267 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 18:54:52.393499 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390270 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 18:54:52.393499 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390273 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 18:54:52.393499 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390278 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 18:54:52.393499 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390281 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 18:54:52.393499 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390284 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 18:54:52.393499 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390287 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 18:54:52.393499 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390290 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 18:54:52.393499 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390292 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 18:54:52.393499 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390295 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 18:54:52.393499 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390298 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 18:54:52.393499 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390301 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 18:54:52.393499 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390303 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 06 18:54:52.393499 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390306 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 18:54:52.393499 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390308 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 18:54:52.393499 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390311 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 18:54:52.393499 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390314 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 18:54:52.393499 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390317 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 18:54:52.393499 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390319 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.390322 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390389 2567 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390397 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390405 2567 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390409 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390414 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390417 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390422 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390427 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390430 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390433 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390437 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390441 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390444 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390447 2567 flags.go:64] FLAG: --cgroup-root="" Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390450 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390453 2567 flags.go:64] FLAG: --client-ca-file="" Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390457 2567 flags.go:64] FLAG: --cloud-provider="external" Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390460 2567 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390464 2567 flags.go:64] FLAG: --cluster-domain="" Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390467 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390471 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 18:54:52.394039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390474 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390478 2567 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390482 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390485 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390489 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390492 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390495 2567 flags.go:64] FLAG: --contention-profiling="false" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390498 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390501 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390504 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390508 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390512 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390515 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390518 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390522 2567 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390526 2567 flags.go:64] FLAG: --enable-server="true" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390529 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390534 2567 flags.go:64] FLAG: --event-burst="100" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390538 2567 flags.go:64] FLAG: --event-qps="50" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390541 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390544 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390563 2567 flags.go:64] FLAG: --eviction-hard="" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390567 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390570 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390573 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 18:54:52.394653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390577 2567 flags.go:64] FLAG: --eviction-soft="" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390579 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390582 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390585 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390588 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390591 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390594 2567 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390597 2567 flags.go:64] FLAG: --feature-gates="" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390601 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390604 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390607 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390610 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390614 2567 flags.go:64] FLAG: --healthz-port="10248" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390617 2567 flags.go:64] FLAG: --help="false" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390619 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-139-154.ec2.internal" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390623 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390626 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390629 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390632 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390636 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390639 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390641 2567 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390645 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 18:54:52.395281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390648 2567 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390654 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390658 2567 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390661 2567 flags.go:64] FLAG: --kube-reserved="" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390665 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390668 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390671 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390674 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390677 2567 flags.go:64] FLAG: --lock-file="" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390680 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390683 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390687 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390693 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390697 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390701 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390706 2567 flags.go:64] FLAG: --logging-format="text" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390710 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390715 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390718 2567 flags.go:64] FLAG: --manifest-url="" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390721 2567 flags.go:64] FLAG: --manifest-url-header="" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390725 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390729 2567 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390733 2567 flags.go:64] FLAG: --max-pods="110" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390736 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390739 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 18:54:52.395983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390744 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390747 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390751 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390754 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390757 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390764 2567 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390767 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390771 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390778 2567 flags.go:64] FLAG: --pod-cidr="" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390781 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390801 2567 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390805 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390809 2567 flags.go:64] FLAG: --pods-per-core="0" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390812 2567 flags.go:64] FLAG: --port="10250" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390815 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390819 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fdbe293e32efeb77" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390822 2567 flags.go:64] FLAG: --qos-reserved="" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390825 2567 flags.go:64] FLAG: --read-only-port="10255" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390828 2567 flags.go:64] FLAG: --register-node="true" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390832 2567 flags.go:64] FLAG: --register-with-taints="" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390835 2567 flags.go:64] FLAG: --registry-burst="10" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390838 2567 flags.go:64] FLAG: --registry-qps="5" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390841 2567 flags.go:64] FLAG: --reserved-cpus="" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390845 2567 flags.go:64] FLAG: --reserved-memory="" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390849 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 18:54:52.396647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390852 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390855 2567 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390858 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390861 2567 flags.go:64] FLAG: --runonce="false" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390864 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390867 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390870 2567 flags.go:64] FLAG: --seccomp-default="false" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390875 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390878 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390881 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390884 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390888 2567 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390891 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390894 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390897 2567 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390901 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390906 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390909 2567 flags.go:64] FLAG: --system-cgroups="" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390912 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390917 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390920 2567 flags.go:64] FLAG: --tls-cert-file="" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390923 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390928 2567 flags.go:64] FLAG: --tls-min-version="" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390930 2567 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390933 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 18:54:52.397345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390937 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 18:54:52.398042 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390940 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 18:54:52.398042 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390943 2567 flags.go:64] FLAG: --v="2" Jul 06 18:54:52.398042 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390947 2567 flags.go:64] FLAG: --version="false" Jul 06 18:54:52.398042 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390951 2567 flags.go:64] FLAG: --vmodule="" Jul 06 18:54:52.398042 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390955 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 18:54:52.398042 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.390959 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 18:54:52.398042 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391080 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 18:54:52.398042 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391085 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 18:54:52.398042 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391088 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 18:54:52.398042 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391091 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 18:54:52.398042 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391096 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 18:54:52.398042 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391100 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 18:54:52.398042 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391103 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 18:54:52.398042 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391108 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 18:54:52.398042 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391111 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 18:54:52.398042 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391114 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 18:54:52.398042 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391117 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 18:54:52.398042 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391120 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 18:54:52.398042 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391123 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 18:54:52.398042 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391125 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 18:54:52.398635 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391128 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 18:54:52.398635 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391131 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 18:54:52.398635 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391136 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 18:54:52.398635 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391139 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 18:54:52.398635 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391142 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 18:54:52.398635 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391145 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 18:54:52.398635 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391150 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 18:54:52.398635 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391154 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 18:54:52.398635 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391157 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 18:54:52.398635 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391160 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 18:54:52.398635 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391163 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 18:54:52.398635 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391166 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 18:54:52.398635 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391169 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 18:54:52.398635 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391171 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 18:54:52.398635 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391174 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 18:54:52.398635 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391177 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 18:54:52.398635 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391180 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 18:54:52.398635 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391183 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 18:54:52.398635 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391186 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 18:54:52.399132 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391188 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 18:54:52.399132 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391191 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 18:54:52.399132 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391194 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 18:54:52.399132 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391197 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 18:54:52.399132 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391200 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 18:54:52.399132 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391203 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 18:54:52.399132 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391207 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 18:54:52.399132 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391210 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 18:54:52.399132 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391213 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 18:54:52.399132 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391215 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 18:54:52.399132 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391218 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 18:54:52.399132 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391221 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 18:54:52.399132 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391224 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 18:54:52.399132 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391226 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 18:54:52.399132 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391229 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 18:54:52.399132 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391234 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 18:54:52.399132 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391237 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 18:54:52.399132 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391240 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 18:54:52.399132 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391243 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 18:54:52.399132 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391245 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 18:54:52.399713 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391248 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 18:54:52.399713 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391251 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 18:54:52.399713 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391253 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 18:54:52.399713 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391256 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 18:54:52.399713 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391259 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 18:54:52.399713 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391261 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 18:54:52.399713 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391264 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 18:54:52.399713 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391267 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 18:54:52.399713 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391270 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 18:54:52.399713 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391275 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 18:54:52.399713 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391278 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 18:54:52.399713 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391281 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 18:54:52.399713 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391284 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 18:54:52.399713 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391287 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 18:54:52.399713 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391290 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 18:54:52.399713 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391292 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 18:54:52.399713 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391295 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 18:54:52.399713 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391297 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 18:54:52.399713 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391302 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 18:54:52.400192 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391305 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 18:54:52.400192 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391307 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 18:54:52.400192 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391310 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 18:54:52.400192 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391313 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 18:54:52.400192 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391316 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 18:54:52.400192 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391318 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 18:54:52.400192 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391321 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 18:54:52.400192 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391324 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 18:54:52.400192 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391328 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 18:54:52.400192 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391331 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 18:54:52.400192 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391334 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 18:54:52.400192 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391337 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 18:54:52.400192 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391339 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 18:54:52.400192 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391342 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 18:54:52.400192 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391345 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 18:54:52.400192 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391348 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 18:54:52.400192 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391350 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 18:54:52.400192 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391353 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 06 18:54:52.400192 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391356 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 18:54:52.400192 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391358 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 18:54:52.400729 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391361 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 18:54:52.400729 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391364 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 18:54:52.400729 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391367 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 18:54:52.400729 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391369 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 18:54:52.400729 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391372 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 18:54:52.400729 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391375 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 18:54:52.400729 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.391377 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 18:54:52.400729 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.391968 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 18:54:52.400729 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.399238 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 18:54:52.400729 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.399254 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 18:54:52.400729 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.399276 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 18:54:52.400729 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.399282 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 18:54:52.400729 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399346 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 18:54:52.400729 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399351 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 18:54:52.401104 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399355 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 18:54:52.401104 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399358 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 18:54:52.401104 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399361 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 18:54:52.401104 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399364 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 18:54:52.401104 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399367 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 18:54:52.401104 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399370 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 18:54:52.401104 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399373 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 18:54:52.401104 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399376 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 18:54:52.401104 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399379 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 18:54:52.401104 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399382 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 18:54:52.401104 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399385 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 18:54:52.401104 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399387 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 18:54:52.401104 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399390 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 18:54:52.401104 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399393 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 18:54:52.401104 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399395 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 18:54:52.401104 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399398 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 18:54:52.401104 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399401 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 18:54:52.401104 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399404 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 18:54:52.401104 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399406 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 18:54:52.401947 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399409 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 18:54:52.401947 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399411 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 18:54:52.401947 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399414 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 18:54:52.401947 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399417 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 18:54:52.401947 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399419 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 18:54:52.401947 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399422 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 18:54:52.401947 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399425 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 18:54:52.401947 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399428 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 18:54:52.401947 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399432 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 18:54:52.401947 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399435 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 18:54:52.401947 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399438 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 18:54:52.401947 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399441 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 18:54:52.401947 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399444 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 18:54:52.401947 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399446 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 18:54:52.401947 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399449 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 18:54:52.401947 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399451 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 18:54:52.401947 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399454 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 18:54:52.401947 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399457 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 18:54:52.401947 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399459 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 18:54:52.401947 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399462 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 18:54:52.402686 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399466 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 18:54:52.402686 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399470 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 18:54:52.402686 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399473 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 18:54:52.402686 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399476 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 18:54:52.402686 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399479 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 18:54:52.402686 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399482 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 18:54:52.402686 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399485 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 18:54:52.402686 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399487 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 18:54:52.402686 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399490 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 18:54:52.402686 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399493 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 18:54:52.402686 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399495 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 18:54:52.402686 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399498 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 18:54:52.402686 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399501 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 18:54:52.402686 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399504 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 06 18:54:52.402686 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399507 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 18:54:52.402686 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399510 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 18:54:52.402686 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399513 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 18:54:52.402686 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399515 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 18:54:52.402686 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399518 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 18:54:52.402686 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399521 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 18:54:52.403240 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399524 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 18:54:52.403240 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399527 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 18:54:52.403240 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399530 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 18:54:52.403240 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399533 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 18:54:52.403240 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399536 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 18:54:52.403240 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399538 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 18:54:52.403240 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399541 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 18:54:52.403240 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399544 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 18:54:52.403240 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399565 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 18:54:52.403240 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399571 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 18:54:52.403240 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399574 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 18:54:52.403240 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399577 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 18:54:52.403240 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399580 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 18:54:52.403240 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399584 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 18:54:52.403240 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399586 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 18:54:52.403240 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399590 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 18:54:52.403240 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399594 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 18:54:52.403240 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399599 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 18:54:52.403240 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399602 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 18:54:52.403783 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399605 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 18:54:52.403783 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399607 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 18:54:52.403783 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399610 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 18:54:52.403783 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399613 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 18:54:52.403783 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399615 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 18:54:52.403783 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399619 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 18:54:52.403783 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399621 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 18:54:52.403783 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399624 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 18:54:52.403783 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399627 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 18:54:52.403783 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399630 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 18:54:52.403783 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399634 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 18:54:52.403783 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399637 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 18:54:52.403783 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399640 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 18:54:52.403783 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399645 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 18:54:52.403783 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399648 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 18:54:52.403783 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399651 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 18:54:52.403783 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399653 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 18:54:52.403783 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399656 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 18:54:52.403783 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399659 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 18:54:52.404280 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.399665 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 18:54:52.404280 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399788 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 18:54:52.404280 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399793 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 18:54:52.404280 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399796 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 18:54:52.404280 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399799 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 18:54:52.404280 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399802 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 18:54:52.404280 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399805 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 18:54:52.404280 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399808 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 18:54:52.404280 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399811 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 18:54:52.404280 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399813 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 18:54:52.404280 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399816 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 18:54:52.404280 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399819 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 18:54:52.404280 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399822 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 18:54:52.404280 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399824 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 18:54:52.404280 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399827 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 18:54:52.404770 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399830 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 18:54:52.404770 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399833 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 18:54:52.404770 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399835 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 18:54:52.404770 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399838 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 18:54:52.404770 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399840 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 18:54:52.404770 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399843 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 18:54:52.404770 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399846 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 18:54:52.404770 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399849 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 18:54:52.404770 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399851 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 18:54:52.404770 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399854 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 18:54:52.404770 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399857 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 18:54:52.404770 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399859 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 18:54:52.404770 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399863 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 18:54:52.404770 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399866 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 18:54:52.404770 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399869 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 18:54:52.404770 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399871 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 18:54:52.404770 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399874 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 18:54:52.404770 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399876 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 18:54:52.404770 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399879 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 18:54:52.404770 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399882 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 18:54:52.405304 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399884 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 18:54:52.405304 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399886 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 18:54:52.405304 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399889 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 18:54:52.405304 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399892 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 18:54:52.405304 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399895 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 18:54:52.405304 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399897 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 18:54:52.405304 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399900 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 18:54:52.405304 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399903 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 18:54:52.405304 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399906 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 18:54:52.405304 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399909 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 18:54:52.405304 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399911 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 18:54:52.405304 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399914 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 18:54:52.405304 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399916 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 18:54:52.405304 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399919 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 18:54:52.405304 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399923 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 18:54:52.405304 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399926 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 18:54:52.405304 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399930 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 18:54:52.405304 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399933 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 18:54:52.405304 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399936 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 18:54:52.405810 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399939 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 18:54:52.405810 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399941 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 18:54:52.405810 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399944 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 18:54:52.405810 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399946 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 18:54:52.405810 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399949 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 18:54:52.405810 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399952 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 18:54:52.405810 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399954 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 18:54:52.405810 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399957 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 18:54:52.405810 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399959 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 18:54:52.405810 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399962 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 18:54:52.405810 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399965 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 18:54:52.405810 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399967 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 18:54:52.405810 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399970 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 18:54:52.405810 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399973 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 18:54:52.405810 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399975 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 18:54:52.405810 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399978 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 18:54:52.405810 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399982 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 18:54:52.405810 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399986 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 18:54:52.405810 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399988 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 18:54:52.405810 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399991 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 06 18:54:52.406348 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399994 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 18:54:52.406348 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.399997 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 18:54:52.406348 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400000 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 18:54:52.406348 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400003 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 18:54:52.406348 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400005 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 18:54:52.406348 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400008 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 18:54:52.406348 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400011 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 18:54:52.406348 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400014 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 18:54:52.406348 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400018 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 18:54:52.406348 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400021 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 18:54:52.406348 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400024 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 18:54:52.406348 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400028 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 18:54:52.406348 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400030 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 18:54:52.406348 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400033 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 18:54:52.406348 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400036 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 18:54:52.406348 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400038 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 18:54:52.406348 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400041 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 18:54:52.406348 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400044 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 18:54:52.406348 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400047 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 18:54:52.406348 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400049 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 18:54:52.406900 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400052 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 18:54:52.406900 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400055 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 18:54:52.406900 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400057 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 18:54:52.406900 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400060 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 18:54:52.406900 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400062 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 18:54:52.406900 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:52.400065 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 18:54:52.406900 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.400070 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 18:54:52.406900 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.400172 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 18:54:52.406900 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.403844 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 18:54:52.406900 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.405203 2567 server.go:1019] "Starting client certificate rotation" Jul 06 18:54:52.406900 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.405306 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 18:54:52.406900 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.405348 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 18:54:52.408296 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.408280 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 18:54:52.409599 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.409581 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 18:54:52.419331 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.419313 2567 log.go:25] "Validated CRI v1 runtime API" Jul 06 18:54:52.421359 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.421343 2567 log.go:25] "Validated CRI v1 image API" Jul 06 18:54:52.425132 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.425114 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 18:54:52.428039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.428016 2567 fs.go:135] Filesystem UUIDs: map[09e6bf1f-c2e3-45cc-96a2-8fac6946ca44:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 85d22be6-0290-4be1-bd4f-538ea2fab051:/dev/nvme0n1p3] Jul 06 18:54:52.428090 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.428039 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 18:54:52.433655 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.433526 2567 manager.go:216] Machine: {Timestamp:2026-07-06 18:54:52.432997689 +0000 UTC m=+0.359432233 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3076999 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dcdf5fdb904f292b21c57ac839892 SystemUUID:ec2dcdf5-fdb9-04f2-92b2-1c57ac839892 BootID:e8a73d86-de13-4aa2-981b-ce75b043f22c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:16:9c:e7:4c:fd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:16:9c:e7:4c:fd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:e5:cd:3b:d4:f7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 18:54:52.433655 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.433653 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 18:54:52.433764 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.433734 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 18:54:52.437256 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.437228 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 18:54:52.437407 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.437260 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-154.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 18:54:52.437956 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.437945 2567 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 18:54:52.437990 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.437960 2567 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 18:54:52.437990 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.437968 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 18:54:52.437990 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.437978 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 18:54:52.439306 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.439293 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 18:54:52.440441 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.440425 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 18:54:52.442721 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.442708 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 06 18:54:52.442863 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.442853 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 18:54:52.442916 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.442908 2567 kubelet.go:486] "Attempting to sync node with API server" Jul 06 18:54:52.442951 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.442931 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 18:54:52.442981 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.442961 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 18:54:52.443011 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.442990 2567 kubelet.go:398] "Adding apiserver pod source" Jul 06 18:54:52.443011 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.443004 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 18:54:52.443451 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.443437 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 18:54:52.443519 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.443462 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 18:54:52.448292 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.448273 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 18:54:52.450322 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.450305 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 18:54:52.450403 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.450347 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 18:54:52.451422 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.451408 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 18:54:52.451492 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.451430 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 18:54:52.451492 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.451440 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 18:54:52.451492 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.451446 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 18:54:52.451492 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.451455 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 18:54:52.451492 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.451464 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 18:54:52.451492 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.451476 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 18:54:52.451492 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.451485 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 18:54:52.451492 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.451494 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 18:54:52.451735 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.451501 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 18:54:52.451735 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.451510 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 18:54:52.451735 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.451515 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 18:54:52.452259 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.452248 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 18:54:52.452299 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.452262 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 18:54:52.455963 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.455949 2567 server.go:1268] "Started kubelet" Jul 06 18:54:52.456174 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.456051 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 18:54:52.456294 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.456056 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 18:54:52.456412 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:52.456380 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-154.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 18:54:52.456412 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.456407 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 18:54:52.456603 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:52.456454 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 18:54:52.456603 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.456590 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-154.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 18:54:52.456911 ip-10-0-139-154 systemd[1]: Started Kubernetes Kubelet. Jul 06 18:54:52.458961 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.458946 2567 server.go:310] "Adding debug handlers to kubelet server" Jul 06 18:54:52.460487 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.460461 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 18:54:52.462185 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:52.462165 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 18:54:52.465134 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:52.463911 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-154.ec2.internal.18bfc8318405a697 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-154.ec2.internal,UID:ip-10-0-139-154.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-154.ec2.internal,},FirstTimestamp:2026-07-06 18:54:52.455921303 +0000 UTC m=+0.382355845,LastTimestamp:2026-07-06 18:54:52.455921303 +0000 UTC m=+0.382355845,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-154.ec2.internal,}" Jul 06 18:54:52.466513 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.466488 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 18:54:52.466513 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.466494 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 18:54:52.466698 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:52.466590 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-154.ec2.internal\" not found" Jul 06 18:54:52.467356 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.467334 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 18:54:52.467446 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.467376 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 18:54:52.467446 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.467391 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 18:54:52.467446 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.467394 2567 factory.go:55] Registering systemd factory Jul 06 18:54:52.467446 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.467414 2567 factory.go:223] Registration of the systemd container factory successfully Jul 06 18:54:52.467662 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.467499 2567 reconstruct.go:97] "Volume reconstruction finished" Jul 06 18:54:52.467662 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.467510 2567 reconciler.go:29] "Reconciler: start to sync state" Jul 06 18:54:52.467767 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.467727 2567 factory.go:153] Registering CRI-O factory Jul 06 18:54:52.467767 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.467742 2567 factory.go:223] Registration of the crio container factory successfully Jul 06 18:54:52.467976 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.467953 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 18:54:52.468036 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.467994 2567 factory.go:103] Registering Raw factory Jul 06 18:54:52.468036 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.468010 2567 manager.go:1196] Started watching for new ooms in manager Jul 06 18:54:52.468456 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.468439 2567 manager.go:349] Starting recovery of all containers Jul 06 18:54:52.471007 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:52.470977 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-154.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 18:54:52.471181 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:52.471157 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 18:54:52.480349 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.480324 2567 manager.go:354] Recovery completed Jul 06 18:54:52.485291 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.485278 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:54:52.487264 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.487246 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-154.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:54:52.487330 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.487278 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-154.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:54:52.487330 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.487289 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-154.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:54:52.487902 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.487885 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 18:54:52.487902 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.487895 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:54:52.487902 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.487900 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 18:54:52.488081 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.487917 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 06 18:54:52.488686 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.488670 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-154.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:54:52.488777 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.488703 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-154.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:54:52.488777 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.488718 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-154.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:54:52.489192 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.489178 2567 policy_none.go:49] "None policy: Start" Jul 06 18:54:52.489274 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.489196 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 18:54:52.489274 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.489207 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 18:54:52.489736 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:52.489668 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-154.ec2.internal.18bfc83185e3e1b0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-154.ec2.internal,UID:ip-10-0-139-154.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-154.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-154.ec2.internal,},FirstTimestamp:2026-07-06 18:54:52.48726264 +0000 UTC m=+0.413697185,LastTimestamp:2026-07-06 18:54:52.48726264 +0000 UTC m=+0.413697185,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-154.ec2.internal,}" Jul 06 18:54:52.490351 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.490337 2567 policy_none.go:47] "Start" Jul 06 18:54:52.491184 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.491168 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wcdqj" Jul 06 18:54:52.500353 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.500334 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wcdqj" Jul 06 18:54:52.501545 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:52.501447 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-154.ec2.internal.18bfc83185e43413 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-154.ec2.internal,UID:ip-10-0-139-154.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-154.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-154.ec2.internal,},FirstTimestamp:2026-07-06 18:54:52.487283731 +0000 UTC m=+0.413718277,LastTimestamp:2026-07-06 18:54:52.487283731 +0000 UTC m=+0.413718277,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-154.ec2.internal,}" Jul 06 18:54:52.524175 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.524156 2567 manager.go:337] "Starting Device Plugin manager" Jul 06 18:54:52.524257 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:52.524189 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 18:54:52.524257 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.524200 2567 server.go:87] "Starting device plugin registration server" Jul 06 18:54:52.524481 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.524467 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 18:54:52.524548 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.524487 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 18:54:52.524603 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.524558 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 18:54:52.524698 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.524661 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 18:54:52.524698 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.524673 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 18:54:52.525224 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:52.525205 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 18:54:52.525310 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:52.525251 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-154.ec2.internal\" not found" Jul 06 18:54:52.567531 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.567503 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 18:54:52.568878 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.568860 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 18:54:52.568968 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.568896 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 18:54:52.568968 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.568917 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 18:54:52.568968 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:52.568954 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 18:54:52.571653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.571622 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 18:54:52.626255 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.626164 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:54:52.628036 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.628019 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-154.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:54:52.628121 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.628051 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-154.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:54:52.628121 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.628063 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-154.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:54:52.628121 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.628096 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-154.ec2.internal" Jul 06 18:54:52.638134 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.638116 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-154.ec2.internal" Jul 06 18:54:52.638187 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:52.638138 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-154.ec2.internal\": node \"ip-10-0-139-154.ec2.internal\" not found" Jul 06 18:54:52.670062 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:52.670040 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-154.ec2.internal\" not found" Jul 06 18:54:52.670627 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.669931 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-154.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-154.ec2.internal"] Jul 06 18:54:52.670675 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.670668 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:54:52.672033 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.672014 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-154.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:54:52.672122 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.672051 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-154.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:54:52.672122 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.672067 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-154.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:54:52.673356 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.673340 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:54:52.673472 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.673456 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-154.ec2.internal" Jul 06 18:54:52.673531 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.673502 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:54:52.674151 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.674135 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-154.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:54:52.674204 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.674137 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-154.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:54:52.674204 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.674194 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-154.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:54:52.674271 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.674208 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-154.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:54:52.674271 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.674170 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-154.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:54:52.674271 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.674250 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-154.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:54:52.675501 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.675487 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-154.ec2.internal" Jul 06 18:54:52.675572 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.675521 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:54:52.676311 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.676294 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-154.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:54:52.676393 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.676318 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-154.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:54:52.676393 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.676329 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-154.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:54:52.707410 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:52.707230 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-154.ec2.internal\" not found" node="ip-10-0-139-154.ec2.internal" Jul 06 18:54:52.712033 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:52.712016 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-154.ec2.internal\" not found" node="ip-10-0-139-154.ec2.internal" Jul 06 18:54:52.769739 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.769713 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eebd8c9c2aac021424bbe7455e90313b-config\") pod \"kube-apiserver-proxy-ip-10-0-139-154.ec2.internal\" (UID: \"eebd8c9c2aac021424bbe7455e90313b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-154.ec2.internal" Jul 06 18:54:52.769739 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.769739 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1e9de4cbe007773b79f990a8bf188c39-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-154.ec2.internal\" (UID: \"1e9de4cbe007773b79f990a8bf188c39\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-154.ec2.internal" Jul 06 18:54:52.769872 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.769759 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e9de4cbe007773b79f990a8bf188c39-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-154.ec2.internal\" (UID: \"1e9de4cbe007773b79f990a8bf188c39\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-154.ec2.internal" Jul 06 18:54:52.770838 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:52.770822 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-154.ec2.internal\" not found" Jul 06 18:54:52.872919 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:52.872891 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-154.ec2.internal\" not found" Jul 06 18:54:52.873034 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.872961 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eebd8c9c2aac021424bbe7455e90313b-config\") pod \"kube-apiserver-proxy-ip-10-0-139-154.ec2.internal\" (UID: \"eebd8c9c2aac021424bbe7455e90313b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-154.ec2.internal" Jul 06 18:54:52.873034 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.872989 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1e9de4cbe007773b79f990a8bf188c39-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-154.ec2.internal\" (UID: \"1e9de4cbe007773b79f990a8bf188c39\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-154.ec2.internal" Jul 06 18:54:52.873034 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.873007 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e9de4cbe007773b79f990a8bf188c39-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-154.ec2.internal\" (UID: \"1e9de4cbe007773b79f990a8bf188c39\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-154.ec2.internal" Jul 06 18:54:52.873146 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.873073 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e9de4cbe007773b79f990a8bf188c39-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-154.ec2.internal\" (UID: \"1e9de4cbe007773b79f990a8bf188c39\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-154.ec2.internal" Jul 06 18:54:52.873146 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.873123 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eebd8c9c2aac021424bbe7455e90313b-config\") pod \"kube-apiserver-proxy-ip-10-0-139-154.ec2.internal\" (UID: \"eebd8c9c2aac021424bbe7455e90313b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-154.ec2.internal" Jul 06 18:54:52.873211 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:52.873151 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1e9de4cbe007773b79f990a8bf188c39-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-154.ec2.internal\" (UID: \"1e9de4cbe007773b79f990a8bf188c39\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-154.ec2.internal" Jul 06 18:54:52.973064 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:52.973029 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-154.ec2.internal\" not found" Jul 06 18:54:53.013339 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.013299 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-154.ec2.internal" Jul 06 18:54:53.015561 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.015536 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-154.ec2.internal" Jul 06 18:54:53.073290 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:53.073257 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-154.ec2.internal\" not found" Jul 06 18:54:53.174106 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:53.174085 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-154.ec2.internal\" not found" Jul 06 18:54:53.274462 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:53.274368 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-154.ec2.internal\" not found" Jul 06 18:54:53.374919 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:53.374891 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-154.ec2.internal\" not found" Jul 06 18:54:53.389332 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.389310 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 18:54:53.404971 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.404939 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 18:54:53.405071 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.405054 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 18:54:53.405143 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.405117 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 18:54:53.443758 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.443738 2567 apiserver.go:52] "Watching apiserver" Jul 06 18:54:53.451255 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.451232 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 18:54:53.455295 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.455276 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 18:54:53.455813 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.455779 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-mwp57","openshift-dns/node-resolver-c58dn","openshift-network-diagnostics/network-check-target-d94p2","openshift-network-operator/iptables-alerter-qs88h","openshift-ovn-kubernetes/ovnkube-node-hpztn","kube-system/global-pull-secret-syncer-s8pd7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8","openshift-cluster-node-tuning-operator/tuned-97m7v","openshift-image-registry/node-ca-zg5fq","openshift-multus/multus-9w8kj","openshift-multus/multus-additional-cni-plugins-lqqtw","openshift-multus/network-metrics-daemon-h9gnx"] Jul 06 18:54:53.458572 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.458552 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mwp57" Jul 06 18:54:53.459826 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.459805 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c58dn" Jul 06 18:54:53.460979 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.460963 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 18:54:53.461050 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.460980 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 18:54:53.461050 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.460969 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2bzrn\"" Jul 06 18:54:53.461143 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.461117 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:54:53.461226 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:53.461191 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94p2" podUID="e5fa32e0-5190-4738-b813-732443056605" Jul 06 18:54:53.462110 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.462094 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 18:54:53.462300 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.462274 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 18:54:53.462379 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.462300 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jgkxq\"" Jul 06 18:54:53.462464 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.462445 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qs88h" Jul 06 18:54:53.463885 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.463866 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.464645 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.464624 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 18:54:53.464795 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.464682 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sdvsd\"" Jul 06 18:54:53.464850 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.464798 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 18:54:53.464850 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.464798 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 18:54:53.465124 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.465110 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:54:53.465190 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:53.465173 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8pd7" podUID="e1283903-625e-49c4-a176-83b147859bd7" Jul 06 18:54:53.465908 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.465885 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 18:54:53.466018 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.465961 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 18:54:53.466343 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.466316 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 18:54:53.466566 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.466550 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.466615 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.466579 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 18:54:53.466615 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.466597 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 18:54:53.466701 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.466692 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-154.ec2.internal" Jul 06 18:54:53.466768 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.466552 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 18:54:53.467030 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.467016 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rbhcb\"" Jul 06 18:54:53.467387 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.467367 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 18:54:53.467889 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.467876 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.468645 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.468631 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zdq77\"" Jul 06 18:54:53.468869 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.468853 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 18:54:53.468950 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.468867 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 18:54:53.468950 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.468907 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 18:54:53.469306 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.469291 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zg5fq" Jul 06 18:54:53.470066 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.470048 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 18:54:53.470171 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.470086 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-flw4g\"" Jul 06 18:54:53.470171 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.470104 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 18:54:53.470511 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.470495 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.471570 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.471530 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 18:54:53.471655 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.471606 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 18:54:53.471758 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.471736 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-75r2r\"" Jul 06 18:54:53.471873 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.471811 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 18:54:53.471873 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.471852 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.472688 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.472671 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 18:54:53.472797 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.472690 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4lq47\"" Jul 06 18:54:53.472797 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.472761 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 18:54:53.473001 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.472988 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 18:54:53.473076 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.473059 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 18:54:53.473146 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.473128 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:54:53.473215 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:53.473196 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9gnx" podUID="d8841ac5-94d5-4604-9576-0ea7bd6c3750" Jul 06 18:54:53.474091 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.474074 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nx285\"" Jul 06 18:54:53.474160 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.474074 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 18:54:53.474201 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.474170 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 18:54:53.475255 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.475233 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-run-ovn\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.475345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.475269 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88l5x\" (UniqueName: \"kubernetes.io/projected/87615484-d40e-482e-81c0-73387e5eedaa-kube-api-access-88l5x\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.475345 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.475295 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/91acad80-e6c9-4bf5-816c-a6b89d0b611e-hosts-file\") pod \"node-resolver-c58dn\" (UID: \"91acad80-e6c9-4bf5-816c-a6b89d0b611e\") " pod="openshift-dns/node-resolver-c58dn" Jul 06 18:54:53.475438 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.475336 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91acad80-e6c9-4bf5-816c-a6b89d0b611e-tmp-dir\") pod \"node-resolver-c58dn\" (UID: \"91acad80-e6c9-4bf5-816c-a6b89d0b611e\") " pod="openshift-dns/node-resolver-c58dn" Jul 06 18:54:53.475438 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.475370 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0bf5584-7798-4010-a555-cfc72bcad8c2-socket-dir\") pod \"aws-ebs-csi-driver-node-m5sh8\" (UID: \"d0bf5584-7798-4010-a555-cfc72bcad8c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.475438 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.475389 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.475438 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.475417 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzwcj\" (UniqueName: \"kubernetes.io/projected/20580915-5810-4b0d-a204-d80772eb5769-kube-api-access-kzwcj\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.475657 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.475441 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-host\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.475657 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.475464 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-host-run-netns\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.475657 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.475524 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-node-log\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.475657 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.475561 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1283903-625e-49c4-a176-83b147859bd7-kubelet-config\") pod \"global-pull-secret-syncer-s8pd7\" (UID: \"e1283903-625e-49c4-a176-83b147859bd7\") " pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:54:53.475657 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.475593 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-etc-sysconfig\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.475657 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.475619 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-etc-kubernetes\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.475657 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.475645 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-etc-sysctl-d\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.476025 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.475670 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-lib-modules\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.476192 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476177 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/87615484-d40e-482e-81c0-73387e5eedaa-etc-tuned\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.476257 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476210 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjlj4\" (UniqueName: \"kubernetes.io/projected/d0bf5584-7798-4010-a555-cfc72bcad8c2-kube-api-access-sjlj4\") pod \"aws-ebs-csi-driver-node-m5sh8\" (UID: \"d0bf5584-7798-4010-a555-cfc72bcad8c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.476257 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476244 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f1ddfd3-95c0-4399-b0d1-2dca83227aa9-iptables-alerter-script\") pod \"iptables-alerter-qs88h\" (UID: \"8f1ddfd3-95c0-4399-b0d1-2dca83227aa9\") " pod="openshift-network-operator/iptables-alerter-qs88h" Jul 06 18:54:53.476356 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476268 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f1ddfd3-95c0-4399-b0d1-2dca83227aa9-host-slash\") pod \"iptables-alerter-qs88h\" (UID: \"8f1ddfd3-95c0-4399-b0d1-2dca83227aa9\") " pod="openshift-network-operator/iptables-alerter-qs88h" Jul 06 18:54:53.476356 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476335 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-run-systemd\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.476467 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476368 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-log-socket\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.476467 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476402 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-host-run-ovn-kubernetes\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.476467 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476429 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-host-cni-bin\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.476467 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476453 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-etc-systemd\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.476687 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476474 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fc86ae6c-8718-437d-915d-6940c8be493f-konnectivity-ca\") pod \"konnectivity-agent-mwp57\" (UID: \"fc86ae6c-8718-437d-915d-6940c8be493f\") " pod="kube-system/konnectivity-agent-mwp57" Jul 06 18:54:53.476687 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476516 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-host-kubelet\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.476687 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476538 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-systemd-units\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.476687 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476563 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-var-lib-openvswitch\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.476687 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476587 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-etc-openvswitch\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.476687 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476624 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-host-cni-netd\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.476687 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476656 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1283903-625e-49c4-a176-83b147859bd7-dbus\") pod \"global-pull-secret-syncer-s8pd7\" (UID: \"e1283903-625e-49c4-a176-83b147859bd7\") " pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:54:53.476953 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476700 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-run-openvswitch\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.476953 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476735 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret\") pod \"global-pull-secret-syncer-s8pd7\" (UID: \"e1283903-625e-49c4-a176-83b147859bd7\") " pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:54:53.476953 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476772 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-etc-modprobe-d\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.476953 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476818 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-sys\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.476953 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476864 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-var-lib-kubelet\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.476953 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476896 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6brk\" (UniqueName: \"kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk\") pod \"network-check-target-d94p2\" (UID: \"e5fa32e0-5190-4738-b813-732443056605\") " pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:54:53.476953 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476916 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0bf5584-7798-4010-a555-cfc72bcad8c2-registration-dir\") pod \"aws-ebs-csi-driver-node-m5sh8\" (UID: \"d0bf5584-7798-4010-a555-cfc72bcad8c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.476953 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476934 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0bf5584-7798-4010-a555-cfc72bcad8c2-device-dir\") pod \"aws-ebs-csi-driver-node-m5sh8\" (UID: \"d0bf5584-7798-4010-a555-cfc72bcad8c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.477247 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.476999 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0bf5584-7798-4010-a555-cfc72bcad8c2-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5sh8\" (UID: \"d0bf5584-7798-4010-a555-cfc72bcad8c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.477247 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.477025 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/20580915-5810-4b0d-a204-d80772eb5769-ovnkube-config\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.477247 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.477042 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/20580915-5810-4b0d-a204-d80772eb5769-env-overrides\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.477247 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.477057 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-run\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.477247 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.477074 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9k84\" (UniqueName: \"kubernetes.io/projected/91acad80-e6c9-4bf5-816c-a6b89d0b611e-kube-api-access-b9k84\") pod \"node-resolver-c58dn\" (UID: \"91acad80-e6c9-4bf5-816c-a6b89d0b611e\") " pod="openshift-dns/node-resolver-c58dn" Jul 06 18:54:53.477247 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.477097 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/20580915-5810-4b0d-a204-d80772eb5769-ovn-node-metrics-cert\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.477247 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.477128 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/20580915-5810-4b0d-a204-d80772eb5769-ovnkube-script-lib\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.477247 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.477144 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-etc-sysctl-conf\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.477247 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.477158 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87615484-d40e-482e-81c0-73387e5eedaa-tmp\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.477247 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.477182 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fc86ae6c-8718-437d-915d-6940c8be493f-agent-certs\") pod \"konnectivity-agent-mwp57\" (UID: \"fc86ae6c-8718-437d-915d-6940c8be493f\") " pod="kube-system/konnectivity-agent-mwp57" Jul 06 18:54:53.477247 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.477198 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0bf5584-7798-4010-a555-cfc72bcad8c2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5sh8\" (UID: \"d0bf5584-7798-4010-a555-cfc72bcad8c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.477247 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.477230 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0bf5584-7798-4010-a555-cfc72bcad8c2-sys-fs\") pod \"aws-ebs-csi-driver-node-m5sh8\" (UID: \"d0bf5584-7798-4010-a555-cfc72bcad8c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.477247 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.477247 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5gs6\" (UniqueName: \"kubernetes.io/projected/8f1ddfd3-95c0-4399-b0d1-2dca83227aa9-kube-api-access-f5gs6\") pod \"iptables-alerter-qs88h\" (UID: \"8f1ddfd3-95c0-4399-b0d1-2dca83227aa9\") " pod="openshift-network-operator/iptables-alerter-qs88h" Jul 06 18:54:53.477662 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.477266 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-host-slash\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.478234 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.478211 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 18:54:53.483516 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.483500 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 18:54:53.483646 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.483607 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-154.ec2.internal" Jul 06 18:54:53.483914 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.483894 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-154.ec2.internal"] Jul 06 18:54:53.492179 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.492158 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 18:54:53.492269 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.492209 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-154.ec2.internal"] Jul 06 18:54:53.501809 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.501789 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7w6wk" Jul 06 18:54:53.502213 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.502072 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 18:49:53 +0000 UTC" deadline="2028-01-22 05:33:22.896414508 +0000 UTC" Jul 06 18:54:53.502213 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.502137 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13546h38m29.394281942s" Jul 06 18:54:53.510164 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.510144 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7w6wk" Jul 06 18:54:53.568946 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.568920 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 18:54:53.577449 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.577420 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-run\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.577578 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.577468 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55a4de5a-b33e-4eec-aa0b-27a98feac09f-multus-daemon-config\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.577578 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.577513 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-host-run-multus-certs\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.577578 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.577540 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93e145b9-cc69-47ba-8b68-cd22bc6668bd-system-cni-dir\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.577578 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.577571 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/20580915-5810-4b0d-a204-d80772eb5769-ovn-node-metrics-cert\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.577777 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.577597 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/20580915-5810-4b0d-a204-d80772eb5769-ovnkube-script-lib\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.577777 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.577620 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-etc-sysctl-conf\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.577777 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.577648 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-multus-socket-dir-parent\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.577777 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.577674 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93e145b9-cc69-47ba-8b68-cd22bc6668bd-os-release\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.577777 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.577709 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0bf5584-7798-4010-a555-cfc72bcad8c2-sys-fs\") pod \"aws-ebs-csi-driver-node-m5sh8\" (UID: \"d0bf5584-7798-4010-a555-cfc72bcad8c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.577777 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.577734 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5gs6\" (UniqueName: \"kubernetes.io/projected/8f1ddfd3-95c0-4399-b0d1-2dca83227aa9-kube-api-access-f5gs6\") pod \"iptables-alerter-qs88h\" (UID: \"8f1ddfd3-95c0-4399-b0d1-2dca83227aa9\") " pod="openshift-network-operator/iptables-alerter-qs88h" Jul 06 18:54:53.577777 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.577759 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-run-ovn\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.578209 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.577802 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/91acad80-e6c9-4bf5-816c-a6b89d0b611e-hosts-file\") pod \"node-resolver-c58dn\" (UID: \"91acad80-e6c9-4bf5-816c-a6b89d0b611e\") " pod="openshift-dns/node-resolver-c58dn" Jul 06 18:54:53.578209 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.577832 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzwcj\" (UniqueName: \"kubernetes.io/projected/20580915-5810-4b0d-a204-d80772eb5769-kube-api-access-kzwcj\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.578209 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.577848 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0bf5584-7798-4010-a555-cfc72bcad8c2-sys-fs\") pod \"aws-ebs-csi-driver-node-m5sh8\" (UID: \"d0bf5584-7798-4010-a555-cfc72bcad8c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.578209 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.577852 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-run-ovn\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.578209 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.577862 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-etc-sysconfig\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.578209 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.577901 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-etc-kubernetes\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.578209 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.577909 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/91acad80-e6c9-4bf5-816c-a6b89d0b611e-hosts-file\") pod \"node-resolver-c58dn\" (UID: \"91acad80-e6c9-4bf5-816c-a6b89d0b611e\") " pod="openshift-dns/node-resolver-c58dn" Jul 06 18:54:53.578209 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.577935 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-lib-modules\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.578209 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.577967 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-etc-sysctl-conf\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.578209 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578003 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-etc-sysconfig\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.578209 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578075 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-etc-kubernetes\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.578209 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578011 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-multus-cni-dir\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.578209 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578110 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-lib-modules\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.578209 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578120 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-host-var-lib-kubelet\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.578209 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578205 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-run\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.579043 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578219 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjlj4\" (UniqueName: \"kubernetes.io/projected/d0bf5584-7798-4010-a555-cfc72bcad8c2-kube-api-access-sjlj4\") pod \"aws-ebs-csi-driver-node-m5sh8\" (UID: \"d0bf5584-7798-4010-a555-cfc72bcad8c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.579043 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578257 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-host-cni-bin\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.579043 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578264 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 18:54:53.579043 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578409 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-etc-systemd\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.579043 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578445 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-host-run-k8s-cni-cncf-io\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.579043 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578535 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-etc-systemd\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.579043 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578539 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-host-cni-bin\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.579043 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578563 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-host-var-lib-cni-bin\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.579043 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578621 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-var-lib-openvswitch\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.579043 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578671 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-etc-openvswitch\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.579043 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578675 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-var-lib-openvswitch\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.579043 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578704 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-host-cni-netd\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.579043 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578731 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-etc-openvswitch\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.579043 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578768 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1283903-625e-49c4-a176-83b147859bd7-dbus\") pod \"global-pull-secret-syncer-s8pd7\" (UID: \"e1283903-625e-49c4-a176-83b147859bd7\") " pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:54:53.579043 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578770 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/20580915-5810-4b0d-a204-d80772eb5769-ovnkube-script-lib\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.579043 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578798 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret\") pod \"global-pull-secret-syncer-s8pd7\" (UID: \"e1283903-625e-49c4-a176-83b147859bd7\") " pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:54:53.579043 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578831 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-host-cni-netd\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.579043 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578840 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-var-lib-kubelet\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.579866 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578870 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-multus-conf-dir\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.579866 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578887 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-var-lib-kubelet\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.579866 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578898 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-hostroot\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.579866 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:53.578907 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 18:54:53.579866 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578930 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-etc-kubernetes\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.579866 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:53.578981 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret podName:e1283903-625e-49c4-a176-83b147859bd7 nodeName:}" failed. No retries permitted until 2026-07-06 18:54:54.078957088 +0000 UTC m=+2.005391620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret") pod "global-pull-secret-syncer-s8pd7" (UID: "e1283903-625e-49c4-a176-83b147859bd7") : object "kube-system"/"original-pull-secret" not registered Jul 06 18:54:53.579866 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.578986 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1283903-625e-49c4-a176-83b147859bd7-dbus\") pod \"global-pull-secret-syncer-s8pd7\" (UID: \"e1283903-625e-49c4-a176-83b147859bd7\") " pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:54:53.579866 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579049 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93e145b9-cc69-47ba-8b68-cd22bc6668bd-cnibin\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.579866 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579096 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxnxv\" (UniqueName: \"kubernetes.io/projected/d8841ac5-94d5-4604-9576-0ea7bd6c3750-kube-api-access-mxnxv\") pod \"network-metrics-daemon-h9gnx\" (UID: \"d8841ac5-94d5-4604-9576-0ea7bd6c3750\") " pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:54:53.579866 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579130 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6brk\" (UniqueName: \"kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk\") pod \"network-check-target-d94p2\" (UID: \"e5fa32e0-5190-4738-b813-732443056605\") " pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:54:53.579866 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579155 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0bf5584-7798-4010-a555-cfc72bcad8c2-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5sh8\" (UID: \"d0bf5584-7798-4010-a555-cfc72bcad8c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.579866 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579178 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87615484-d40e-482e-81c0-73387e5eedaa-tmp\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.579866 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579274 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-cnibin\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.579866 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579281 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0bf5584-7798-4010-a555-cfc72bcad8c2-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5sh8\" (UID: \"d0bf5584-7798-4010-a555-cfc72bcad8c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.579866 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579320 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-os-release\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.579866 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579350 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-host-run-netns\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.579866 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579376 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93e145b9-cc69-47ba-8b68-cd22bc6668bd-cni-binary-copy\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.580586 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579406 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9k84\" (UniqueName: \"kubernetes.io/projected/91acad80-e6c9-4bf5-816c-a6b89d0b611e-kube-api-access-b9k84\") pod \"node-resolver-c58dn\" (UID: \"91acad80-e6c9-4bf5-816c-a6b89d0b611e\") " pod="openshift-dns/node-resolver-c58dn" Jul 06 18:54:53.580586 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579432 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f7face8-df08-4e4c-afa4-e028aa2a95fe-host\") pod \"node-ca-zg5fq\" (UID: \"7f7face8-df08-4e4c-afa4-e028aa2a95fe\") " pod="openshift-image-registry/node-ca-zg5fq" Jul 06 18:54:53.580586 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579456 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fc86ae6c-8718-437d-915d-6940c8be493f-agent-certs\") pod \"konnectivity-agent-mwp57\" (UID: \"fc86ae6c-8718-437d-915d-6940c8be493f\") " pod="kube-system/konnectivity-agent-mwp57" Jul 06 18:54:53.580586 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579527 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0bf5584-7798-4010-a555-cfc72bcad8c2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5sh8\" (UID: \"d0bf5584-7798-4010-a555-cfc72bcad8c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.580586 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579552 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-host-slash\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.580586 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579576 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88l5x\" (UniqueName: \"kubernetes.io/projected/87615484-d40e-482e-81c0-73387e5eedaa-kube-api-access-88l5x\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.580586 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579603 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-host-var-lib-cni-multus\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.580586 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579645 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-host-slash\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.580586 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579657 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0bf5584-7798-4010-a555-cfc72bcad8c2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5sh8\" (UID: \"d0bf5584-7798-4010-a555-cfc72bcad8c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.580586 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579693 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f7face8-df08-4e4c-afa4-e028aa2a95fe-serviceca\") pod \"node-ca-zg5fq\" (UID: \"7f7face8-df08-4e4c-afa4-e028aa2a95fe\") " pod="openshift-image-registry/node-ca-zg5fq" Jul 06 18:54:53.580586 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579724 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91acad80-e6c9-4bf5-816c-a6b89d0b611e-tmp-dir\") pod \"node-resolver-c58dn\" (UID: \"91acad80-e6c9-4bf5-816c-a6b89d0b611e\") " pod="openshift-dns/node-resolver-c58dn" Jul 06 18:54:53.580586 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579749 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0bf5584-7798-4010-a555-cfc72bcad8c2-socket-dir\") pod \"aws-ebs-csi-driver-node-m5sh8\" (UID: \"d0bf5584-7798-4010-a555-cfc72bcad8c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.580586 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579779 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.580586 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579805 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-host\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.580586 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579829 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55a4de5a-b33e-4eec-aa0b-27a98feac09f-cni-binary-copy\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.580586 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579852 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf9ps\" (UniqueName: \"kubernetes.io/projected/55a4de5a-b33e-4eec-aa0b-27a98feac09f-kube-api-access-gf9ps\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.580586 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579877 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/93e145b9-cc69-47ba-8b68-cd22bc6668bd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.581438 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579906 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0bf5584-7798-4010-a555-cfc72bcad8c2-socket-dir\") pod \"aws-ebs-csi-driver-node-m5sh8\" (UID: \"d0bf5584-7798-4010-a555-cfc72bcad8c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.581438 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579905 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nch6\" (UniqueName: \"kubernetes.io/projected/93e145b9-cc69-47ba-8b68-cd22bc6668bd-kube-api-access-6nch6\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.581438 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579957 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-host-run-netns\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.581438 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579987 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-node-log\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.581438 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580000 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-host\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.581438 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580035 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1283903-625e-49c4-a176-83b147859bd7-kubelet-config\") pod \"global-pull-secret-syncer-s8pd7\" (UID: \"e1283903-625e-49c4-a176-83b147859bd7\") " pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:54:53.581438 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580069 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91acad80-e6c9-4bf5-816c-a6b89d0b611e-tmp-dir\") pod \"node-resolver-c58dn\" (UID: \"91acad80-e6c9-4bf5-816c-a6b89d0b611e\") " pod="openshift-dns/node-resolver-c58dn" Jul 06 18:54:53.581438 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580112 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-node-log\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.581438 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580074 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-host-run-netns\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.581438 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580071 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-etc-sysctl-d\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.581438 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580147 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1283903-625e-49c4-a176-83b147859bd7-kubelet-config\") pod \"global-pull-secret-syncer-s8pd7\" (UID: \"e1283903-625e-49c4-a176-83b147859bd7\") " pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:54:53.581438 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.579957 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.581438 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580167 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/87615484-d40e-482e-81c0-73387e5eedaa-etc-tuned\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.581438 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580162 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-etc-sysctl-d\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.581438 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580197 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f1ddfd3-95c0-4399-b0d1-2dca83227aa9-iptables-alerter-script\") pod \"iptables-alerter-qs88h\" (UID: \"8f1ddfd3-95c0-4399-b0d1-2dca83227aa9\") " pod="openshift-network-operator/iptables-alerter-qs88h" Jul 06 18:54:53.581438 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580226 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f1ddfd3-95c0-4399-b0d1-2dca83227aa9-host-slash\") pod \"iptables-alerter-qs88h\" (UID: \"8f1ddfd3-95c0-4399-b0d1-2dca83227aa9\") " pod="openshift-network-operator/iptables-alerter-qs88h" Jul 06 18:54:53.581438 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580253 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-run-systemd\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.582276 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580300 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f1ddfd3-95c0-4399-b0d1-2dca83227aa9-host-slash\") pod \"iptables-alerter-qs88h\" (UID: \"8f1ddfd3-95c0-4399-b0d1-2dca83227aa9\") " pod="openshift-network-operator/iptables-alerter-qs88h" Jul 06 18:54:53.582276 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580327 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-log-socket\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.582276 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580351 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-host-run-ovn-kubernetes\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.582276 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580408 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-system-cni-dir\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.582276 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580435 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fc86ae6c-8718-437d-915d-6940c8be493f-konnectivity-ca\") pod \"konnectivity-agent-mwp57\" (UID: \"fc86ae6c-8718-437d-915d-6940c8be493f\") " pod="kube-system/konnectivity-agent-mwp57" Jul 06 18:54:53.582276 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580462 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-host-kubelet\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.582276 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580490 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-host-run-ovn-kubernetes\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.582276 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580486 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-systemd-units\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.582276 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580537 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-etc-modprobe-d\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.582276 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580570 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-log-socket\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.582276 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580609 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93e145b9-cc69-47ba-8b68-cd22bc6668bd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.582276 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580638 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs\") pod \"network-metrics-daemon-h9gnx\" (UID: \"d8841ac5-94d5-4604-9576-0ea7bd6c3750\") " pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:54:53.582276 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580677 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-run-openvswitch\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.582276 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580707 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-sys\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.582276 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580733 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/93e145b9-cc69-47ba-8b68-cd22bc6668bd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.582276 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580761 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krcml\" (UniqueName: \"kubernetes.io/projected/7f7face8-df08-4e4c-afa4-e028aa2a95fe-kube-api-access-krcml\") pod \"node-ca-zg5fq\" (UID: \"7f7face8-df08-4e4c-afa4-e028aa2a95fe\") " pod="openshift-image-registry/node-ca-zg5fq" Jul 06 18:54:53.582276 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580778 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-host-kubelet\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.582963 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580788 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0bf5584-7798-4010-a555-cfc72bcad8c2-registration-dir\") pod \"aws-ebs-csi-driver-node-m5sh8\" (UID: \"d0bf5584-7798-4010-a555-cfc72bcad8c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.582963 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580819 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0bf5584-7798-4010-a555-cfc72bcad8c2-device-dir\") pod \"aws-ebs-csi-driver-node-m5sh8\" (UID: \"d0bf5584-7798-4010-a555-cfc72bcad8c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.582963 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580836 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-systemd-units\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.582963 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580844 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/20580915-5810-4b0d-a204-d80772eb5769-ovnkube-config\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.582963 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580867 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/20580915-5810-4b0d-a204-d80772eb5769-env-overrides\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.582963 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580928 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-etc-modprobe-d\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.582963 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580963 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f1ddfd3-95c0-4399-b0d1-2dca83227aa9-iptables-alerter-script\") pod \"iptables-alerter-qs88h\" (UID: \"8f1ddfd3-95c0-4399-b0d1-2dca83227aa9\") " pod="openshift-network-operator/iptables-alerter-qs88h" Jul 06 18:54:53.582963 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.580991 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-run-openvswitch\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.582963 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.581026 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/20580915-5810-4b0d-a204-d80772eb5769-run-systemd\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.582963 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.581040 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87615484-d40e-482e-81c0-73387e5eedaa-sys\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.582963 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.581101 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0bf5584-7798-4010-a555-cfc72bcad8c2-device-dir\") pod \"aws-ebs-csi-driver-node-m5sh8\" (UID: \"d0bf5584-7798-4010-a555-cfc72bcad8c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.582963 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.581101 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0bf5584-7798-4010-a555-cfc72bcad8c2-registration-dir\") pod \"aws-ebs-csi-driver-node-m5sh8\" (UID: \"d0bf5584-7798-4010-a555-cfc72bcad8c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.582963 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.581117 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fc86ae6c-8718-437d-915d-6940c8be493f-konnectivity-ca\") pod \"konnectivity-agent-mwp57\" (UID: \"fc86ae6c-8718-437d-915d-6940c8be493f\") " pod="kube-system/konnectivity-agent-mwp57" Jul 06 18:54:53.582963 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.581297 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/20580915-5810-4b0d-a204-d80772eb5769-env-overrides\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.582963 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.582133 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/20580915-5810-4b0d-a204-d80772eb5769-ovnkube-config\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.582963 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.582318 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87615484-d40e-482e-81c0-73387e5eedaa-tmp\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.582963 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.582395 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/20580915-5810-4b0d-a204-d80772eb5769-ovn-node-metrics-cert\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.583588 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.582771 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fc86ae6c-8718-437d-915d-6940c8be493f-agent-certs\") pod \"konnectivity-agent-mwp57\" (UID: \"fc86ae6c-8718-437d-915d-6940c8be493f\") " pod="kube-system/konnectivity-agent-mwp57" Jul 06 18:54:53.583588 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.583047 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/87615484-d40e-482e-81c0-73387e5eedaa-etc-tuned\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.590507 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:53.589634 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 18:54:53.590507 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:53.589659 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 18:54:53.590507 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:53.589675 2567 projected.go:196] Error preparing data for projected volume kube-api-access-l6brk for pod openshift-network-diagnostics/network-check-target-d94p2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:54:53.590507 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:53.589778 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk podName:e5fa32e0-5190-4738-b813-732443056605 nodeName:}" failed. No retries permitted until 2026-07-06 18:54:54.089756793 +0000 UTC m=+2.016191341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l6brk" (UniqueName: "kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk") pod "network-check-target-d94p2" (UID: "e5fa32e0-5190-4738-b813-732443056605") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:54:53.591290 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.591262 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9k84\" (UniqueName: \"kubernetes.io/projected/91acad80-e6c9-4bf5-816c-a6b89d0b611e-kube-api-access-b9k84\") pod \"node-resolver-c58dn\" (UID: \"91acad80-e6c9-4bf5-816c-a6b89d0b611e\") " pod="openshift-dns/node-resolver-c58dn" Jul 06 18:54:53.591884 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.591857 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzwcj\" (UniqueName: \"kubernetes.io/projected/20580915-5810-4b0d-a204-d80772eb5769-kube-api-access-kzwcj\") pod \"ovnkube-node-hpztn\" (UID: \"20580915-5810-4b0d-a204-d80772eb5769\") " pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.592001 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.591980 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88l5x\" (UniqueName: \"kubernetes.io/projected/87615484-d40e-482e-81c0-73387e5eedaa-kube-api-access-88l5x\") pod \"tuned-97m7v\" (UID: \"87615484-d40e-482e-81c0-73387e5eedaa\") " pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.592070 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.592000 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5gs6\" (UniqueName: \"kubernetes.io/projected/8f1ddfd3-95c0-4399-b0d1-2dca83227aa9-kube-api-access-f5gs6\") pod \"iptables-alerter-qs88h\" (UID: \"8f1ddfd3-95c0-4399-b0d1-2dca83227aa9\") " pod="openshift-network-operator/iptables-alerter-qs88h" Jul 06 18:54:53.592202 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.592185 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjlj4\" (UniqueName: \"kubernetes.io/projected/d0bf5584-7798-4010-a555-cfc72bcad8c2-kube-api-access-sjlj4\") pod \"aws-ebs-csi-driver-node-m5sh8\" (UID: \"d0bf5584-7798-4010-a555-cfc72bcad8c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.667197 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:53.667129 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeebd8c9c2aac021424bbe7455e90313b.slice/crio-f9602a2791fa0ed6f3e5099c2634beb68143967ef21f72a24f6a4af4ae9e3afe WatchSource:0}: Error finding container f9602a2791fa0ed6f3e5099c2634beb68143967ef21f72a24f6a4af4ae9e3afe: Status 404 returned error can't find the container with id f9602a2791fa0ed6f3e5099c2634beb68143967ef21f72a24f6a4af4ae9e3afe Jul 06 18:54:53.667465 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:53.667443 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e9de4cbe007773b79f990a8bf188c39.slice/crio-8fd07e14c426c99796b5fd8726d2bbca209ab1b71638253d76cc95412cb21f73 WatchSource:0}: Error finding container 8fd07e14c426c99796b5fd8726d2bbca209ab1b71638253d76cc95412cb21f73: Status 404 returned error can't find the container with id 8fd07e14c426c99796b5fd8726d2bbca209ab1b71638253d76cc95412cb21f73 Jul 06 18:54:53.670846 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.670829 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 18:54:53.681623 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.681600 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-system-cni-dir\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.681731 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.681638 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93e145b9-cc69-47ba-8b68-cd22bc6668bd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.681731 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.681667 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs\") pod \"network-metrics-daemon-h9gnx\" (UID: \"d8841ac5-94d5-4604-9576-0ea7bd6c3750\") " pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:54:53.681731 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.681694 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/93e145b9-cc69-47ba-8b68-cd22bc6668bd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.681731 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.681719 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krcml\" (UniqueName: \"kubernetes.io/projected/7f7face8-df08-4e4c-afa4-e028aa2a95fe-kube-api-access-krcml\") pod \"node-ca-zg5fq\" (UID: \"7f7face8-df08-4e4c-afa4-e028aa2a95fe\") " pod="openshift-image-registry/node-ca-zg5fq" Jul 06 18:54:53.681950 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.681746 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55a4de5a-b33e-4eec-aa0b-27a98feac09f-multus-daemon-config\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.681950 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.681815 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-system-cni-dir\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.681950 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.681817 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93e145b9-cc69-47ba-8b68-cd22bc6668bd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.681950 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.681849 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-host-run-multus-certs\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.681950 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.681893 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-host-run-multus-certs\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.681950 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:53.681904 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:54:53.681950 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.681901 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93e145b9-cc69-47ba-8b68-cd22bc6668bd-system-cni-dir\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.682423 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:53.681964 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs podName:d8841ac5-94d5-4604-9576-0ea7bd6c3750 nodeName:}" failed. No retries permitted until 2026-07-06 18:54:54.181943341 +0000 UTC m=+2.108377877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs") pod "network-metrics-daemon-h9gnx" (UID: "d8841ac5-94d5-4604-9576-0ea7bd6c3750") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:54:53.682423 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.681977 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93e145b9-cc69-47ba-8b68-cd22bc6668bd-system-cni-dir\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.682423 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.681987 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-multus-socket-dir-parent\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.682423 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682018 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93e145b9-cc69-47ba-8b68-cd22bc6668bd-os-release\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.682423 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682053 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-multus-cni-dir\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.682423 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682056 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-multus-socket-dir-parent\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.682423 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682078 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-host-var-lib-kubelet\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.682423 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682108 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-host-run-k8s-cni-cncf-io\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.682423 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682131 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-multus-cni-dir\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.682423 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682131 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93e145b9-cc69-47ba-8b68-cd22bc6668bd-os-release\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.682423 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682133 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-host-var-lib-cni-bin\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.682423 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682177 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-host-var-lib-cni-bin\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.682423 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682193 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-multus-conf-dir\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.682423 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682218 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-host-var-lib-kubelet\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.682423 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682222 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-hostroot\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.682423 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682255 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-hostroot\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.682423 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682255 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-etc-kubernetes\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.683175 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682263 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-multus-conf-dir\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.683175 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682193 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-host-run-k8s-cni-cncf-io\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.683175 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682287 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-etc-kubernetes\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.683175 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682307 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/93e145b9-cc69-47ba-8b68-cd22bc6668bd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.683175 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682323 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93e145b9-cc69-47ba-8b68-cd22bc6668bd-cnibin\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.683175 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682356 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxnxv\" (UniqueName: \"kubernetes.io/projected/d8841ac5-94d5-4604-9576-0ea7bd6c3750-kube-api-access-mxnxv\") pod \"network-metrics-daemon-h9gnx\" (UID: \"d8841ac5-94d5-4604-9576-0ea7bd6c3750\") " pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:54:53.683175 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682378 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93e145b9-cc69-47ba-8b68-cd22bc6668bd-cnibin\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.683175 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682385 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55a4de5a-b33e-4eec-aa0b-27a98feac09f-multus-daemon-config\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.683175 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682404 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-cnibin\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.683175 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682431 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-os-release\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.683175 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682457 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-host-run-netns\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.683175 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682481 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93e145b9-cc69-47ba-8b68-cd22bc6668bd-cni-binary-copy\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.683175 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682533 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f7face8-df08-4e4c-afa4-e028aa2a95fe-host\") pod \"node-ca-zg5fq\" (UID: \"7f7face8-df08-4e4c-afa4-e028aa2a95fe\") " pod="openshift-image-registry/node-ca-zg5fq" Jul 06 18:54:53.683175 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682558 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-cnibin\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.683175 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682564 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-os-release\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.683175 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682570 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-host-var-lib-cni-multus\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.683175 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682598 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f7face8-df08-4e4c-afa4-e028aa2a95fe-serviceca\") pod \"node-ca-zg5fq\" (UID: \"7f7face8-df08-4e4c-afa4-e028aa2a95fe\") " pod="openshift-image-registry/node-ca-zg5fq" Jul 06 18:54:53.683175 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682599 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-host-run-netns\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.683802 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682619 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f7face8-df08-4e4c-afa4-e028aa2a95fe-host\") pod \"node-ca-zg5fq\" (UID: \"7f7face8-df08-4e4c-afa4-e028aa2a95fe\") " pod="openshift-image-registry/node-ca-zg5fq" Jul 06 18:54:53.683802 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682633 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55a4de5a-b33e-4eec-aa0b-27a98feac09f-host-var-lib-cni-multus\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.683802 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682717 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55a4de5a-b33e-4eec-aa0b-27a98feac09f-cni-binary-copy\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.683802 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682754 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf9ps\" (UniqueName: \"kubernetes.io/projected/55a4de5a-b33e-4eec-aa0b-27a98feac09f-kube-api-access-gf9ps\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.683802 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682863 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/93e145b9-cc69-47ba-8b68-cd22bc6668bd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.683802 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682894 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nch6\" (UniqueName: \"kubernetes.io/projected/93e145b9-cc69-47ba-8b68-cd22bc6668bd-kube-api-access-6nch6\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.683802 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.682981 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93e145b9-cc69-47ba-8b68-cd22bc6668bd-cni-binary-copy\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.683802 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.683038 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f7face8-df08-4e4c-afa4-e028aa2a95fe-serviceca\") pod \"node-ca-zg5fq\" (UID: \"7f7face8-df08-4e4c-afa4-e028aa2a95fe\") " pod="openshift-image-registry/node-ca-zg5fq" Jul 06 18:54:53.683802 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.683194 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55a4de5a-b33e-4eec-aa0b-27a98feac09f-cni-binary-copy\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.683802 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.683294 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/93e145b9-cc69-47ba-8b68-cd22bc6668bd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.690616 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.690594 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krcml\" (UniqueName: \"kubernetes.io/projected/7f7face8-df08-4e4c-afa4-e028aa2a95fe-kube-api-access-krcml\") pod \"node-ca-zg5fq\" (UID: \"7f7face8-df08-4e4c-afa4-e028aa2a95fe\") " pod="openshift-image-registry/node-ca-zg5fq" Jul 06 18:54:53.691118 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.691096 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxnxv\" (UniqueName: \"kubernetes.io/projected/d8841ac5-94d5-4604-9576-0ea7bd6c3750-kube-api-access-mxnxv\") pod \"network-metrics-daemon-h9gnx\" (UID: \"d8841ac5-94d5-4604-9576-0ea7bd6c3750\") " pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:54:53.691313 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.691296 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nch6\" (UniqueName: \"kubernetes.io/projected/93e145b9-cc69-47ba-8b68-cd22bc6668bd-kube-api-access-6nch6\") pod \"multus-additional-cni-plugins-lqqtw\" (UID: \"93e145b9-cc69-47ba-8b68-cd22bc6668bd\") " pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.691446 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.691428 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf9ps\" (UniqueName: \"kubernetes.io/projected/55a4de5a-b33e-4eec-aa0b-27a98feac09f-kube-api-access-gf9ps\") pod \"multus-9w8kj\" (UID: \"55a4de5a-b33e-4eec-aa0b-27a98feac09f\") " pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.734289 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.734267 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 18:54:53.783489 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.783447 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mwp57" Jul 06 18:54:53.794144 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:53.794117 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc86ae6c_8718_437d_915d_6940c8be493f.slice/crio-9fd3c82550b7578e774712972b9839feb74b9944c65abeed0e9f36507acfd4aa WatchSource:0}: Error finding container 9fd3c82550b7578e774712972b9839feb74b9944c65abeed0e9f36507acfd4aa: Status 404 returned error can't find the container with id 9fd3c82550b7578e774712972b9839feb74b9944c65abeed0e9f36507acfd4aa Jul 06 18:54:53.800514 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.800496 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c58dn" Jul 06 18:54:53.809465 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:53.809439 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91acad80_e6c9_4bf5_816c_a6b89d0b611e.slice/crio-d0d2c6dc4101c99f82e523062793608c4575f9a1c53d3e49a8972480b31a45d9 WatchSource:0}: Error finding container d0d2c6dc4101c99f82e523062793608c4575f9a1c53d3e49a8972480b31a45d9: Status 404 returned error can't find the container with id d0d2c6dc4101c99f82e523062793608c4575f9a1c53d3e49a8972480b31a45d9 Jul 06 18:54:53.823571 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.823553 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qs88h" Jul 06 18:54:53.832071 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:53.832050 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f1ddfd3_95c0_4399_b0d1_2dca83227aa9.slice/crio-03628b2cac47d6930a366cb65fea916d10ecb96b42caa74200956ee1ed7a4c50 WatchSource:0}: Error finding container 03628b2cac47d6930a366cb65fea916d10ecb96b42caa74200956ee1ed7a4c50: Status 404 returned error can't find the container with id 03628b2cac47d6930a366cb65fea916d10ecb96b42caa74200956ee1ed7a4c50 Jul 06 18:54:53.839583 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.839240 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:54:53.847512 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:53.847460 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20580915_5810_4b0d_a204_d80772eb5769.slice/crio-9c6b2b86e6c4b7bce97871bf0be68b384a74c8838f1dfeaf0d18794e24494a07 WatchSource:0}: Error finding container 9c6b2b86e6c4b7bce97871bf0be68b384a74c8838f1dfeaf0d18794e24494a07: Status 404 returned error can't find the container with id 9c6b2b86e6c4b7bce97871bf0be68b384a74c8838f1dfeaf0d18794e24494a07 Jul 06 18:54:53.853167 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.853150 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" Jul 06 18:54:53.861516 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:53.861461 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0bf5584_7798_4010_a555_cfc72bcad8c2.slice/crio-50c6dc843cc94cb45f3ebe6a0af537d6ae13b969d3f8a61837b2cf8e7080823c WatchSource:0}: Error finding container 50c6dc843cc94cb45f3ebe6a0af537d6ae13b969d3f8a61837b2cf8e7080823c: Status 404 returned error can't find the container with id 50c6dc843cc94cb45f3ebe6a0af537d6ae13b969d3f8a61837b2cf8e7080823c Jul 06 18:54:53.870973 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.870950 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-97m7v" Jul 06 18:54:53.878883 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:53.878862 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87615484_d40e_482e_81c0_73387e5eedaa.slice/crio-b768f87687544ad8c88fc4cd9aacc56ffb86123a4a3082f75e64ea0b26a3df05 WatchSource:0}: Error finding container b768f87687544ad8c88fc4cd9aacc56ffb86123a4a3082f75e64ea0b26a3df05: Status 404 returned error can't find the container with id b768f87687544ad8c88fc4cd9aacc56ffb86123a4a3082f75e64ea0b26a3df05 Jul 06 18:54:53.883071 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.883053 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zg5fq" Jul 06 18:54:53.891677 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:53.891655 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f7face8_df08_4e4c_afa4_e028aa2a95fe.slice/crio-42d9fbdefc9d5406adbc254d0660c4ef6035b38552a77118e31578e53c2b62b4 WatchSource:0}: Error finding container 42d9fbdefc9d5406adbc254d0660c4ef6035b38552a77118e31578e53c2b62b4: Status 404 returned error can't find the container with id 42d9fbdefc9d5406adbc254d0660c4ef6035b38552a77118e31578e53c2b62b4 Jul 06 18:54:53.909274 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.909255 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9w8kj" Jul 06 18:54:53.914270 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:53.914256 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lqqtw" Jul 06 18:54:53.917433 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:53.917408 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55a4de5a_b33e_4eec_aa0b_27a98feac09f.slice/crio-b16114275d3e04216d6a545c303e4f202026fd2a65739f4294d0b5012cccfe65 WatchSource:0}: Error finding container b16114275d3e04216d6a545c303e4f202026fd2a65739f4294d0b5012cccfe65: Status 404 returned error can't find the container with id b16114275d3e04216d6a545c303e4f202026fd2a65739f4294d0b5012cccfe65 Jul 06 18:54:53.923228 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:54:53.923210 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e145b9_cc69_47ba_8b68_cd22bc6668bd.slice/crio-754d983ceea710b4180e635abb225c31f01a26a36ff865229383f1e7cb11fd5c WatchSource:0}: Error finding container 754d983ceea710b4180e635abb225c31f01a26a36ff865229383f1e7cb11fd5c: Status 404 returned error can't find the container with id 754d983ceea710b4180e635abb225c31f01a26a36ff865229383f1e7cb11fd5c Jul 06 18:54:54.086117 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:54.086014 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret\") pod \"global-pull-secret-syncer-s8pd7\" (UID: \"e1283903-625e-49c4-a176-83b147859bd7\") " pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:54:54.086277 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:54.086148 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 18:54:54.086277 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:54.086207 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret podName:e1283903-625e-49c4-a176-83b147859bd7 nodeName:}" failed. No retries permitted until 2026-07-06 18:54:55.086193954 +0000 UTC m=+3.012628483 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret") pod "global-pull-secret-syncer-s8pd7" (UID: "e1283903-625e-49c4-a176-83b147859bd7") : object "kube-system"/"original-pull-secret" not registered Jul 06 18:54:54.187227 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:54.187189 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs\") pod \"network-metrics-daemon-h9gnx\" (UID: \"d8841ac5-94d5-4604-9576-0ea7bd6c3750\") " pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:54:54.187428 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:54.187280 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6brk\" (UniqueName: \"kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk\") pod \"network-check-target-d94p2\" (UID: \"e5fa32e0-5190-4738-b813-732443056605\") " pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:54:54.187428 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:54.187353 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:54:54.187428 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:54.187425 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 18:54:54.187663 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:54.187448 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 18:54:54.187663 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:54.187462 2567 projected.go:196] Error preparing data for projected volume kube-api-access-l6brk for pod openshift-network-diagnostics/network-check-target-d94p2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:54:54.187663 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:54.187430 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs podName:d8841ac5-94d5-4604-9576-0ea7bd6c3750 nodeName:}" failed. No retries permitted until 2026-07-06 18:54:55.187409897 +0000 UTC m=+3.113844441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs") pod "network-metrics-daemon-h9gnx" (UID: "d8841ac5-94d5-4604-9576-0ea7bd6c3750") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:54:54.187663 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:54.187578 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk podName:e5fa32e0-5190-4738-b813-732443056605 nodeName:}" failed. No retries permitted until 2026-07-06 18:54:55.187558934 +0000 UTC m=+3.113993469 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6brk" (UniqueName: "kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk") pod "network-check-target-d94p2" (UID: "e5fa32e0-5190-4738-b813-732443056605") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:54:54.363440 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:54.363353 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 18:54:54.512687 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:54.512633 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 18:49:54 +0000 UTC" deadline="2028-04-05 04:07:15.191630374 +0000 UTC" Jul 06 18:54:54.512687 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:54.512671 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15321h12m20.678964532s" Jul 06 18:54:54.569235 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:54.569180 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:54:54.569431 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:54.569342 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94p2" podUID="e5fa32e0-5190-4738-b813-732443056605" Jul 06 18:54:54.585114 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:54.585014 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-154.ec2.internal" event={"ID":"eebd8c9c2aac021424bbe7455e90313b","Type":"ContainerStarted","Data":"f9602a2791fa0ed6f3e5099c2634beb68143967ef21f72a24f6a4af4ae9e3afe"} Jul 06 18:54:54.607803 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:54.607762 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lqqtw" event={"ID":"93e145b9-cc69-47ba-8b68-cd22bc6668bd","Type":"ContainerStarted","Data":"754d983ceea710b4180e635abb225c31f01a26a36ff865229383f1e7cb11fd5c"} Jul 06 18:54:54.613538 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:54.613466 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-97m7v" event={"ID":"87615484-d40e-482e-81c0-73387e5eedaa","Type":"ContainerStarted","Data":"b768f87687544ad8c88fc4cd9aacc56ffb86123a4a3082f75e64ea0b26a3df05"} Jul 06 18:54:54.624879 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:54.624847 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" event={"ID":"d0bf5584-7798-4010-a555-cfc72bcad8c2","Type":"ContainerStarted","Data":"50c6dc843cc94cb45f3ebe6a0af537d6ae13b969d3f8a61837b2cf8e7080823c"} Jul 06 18:54:54.630444 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:54.630418 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qs88h" event={"ID":"8f1ddfd3-95c0-4399-b0d1-2dca83227aa9","Type":"ContainerStarted","Data":"03628b2cac47d6930a366cb65fea916d10ecb96b42caa74200956ee1ed7a4c50"} Jul 06 18:54:54.633476 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:54.633410 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c58dn" event={"ID":"91acad80-e6c9-4bf5-816c-a6b89d0b611e","Type":"ContainerStarted","Data":"d0d2c6dc4101c99f82e523062793608c4575f9a1c53d3e49a8972480b31a45d9"} Jul 06 18:54:54.636288 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:54.636260 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-154.ec2.internal" event={"ID":"1e9de4cbe007773b79f990a8bf188c39","Type":"ContainerStarted","Data":"8fd07e14c426c99796b5fd8726d2bbca209ab1b71638253d76cc95412cb21f73"} Jul 06 18:54:54.638998 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:54.638972 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9w8kj" event={"ID":"55a4de5a-b33e-4eec-aa0b-27a98feac09f","Type":"ContainerStarted","Data":"b16114275d3e04216d6a545c303e4f202026fd2a65739f4294d0b5012cccfe65"} Jul 06 18:54:54.644653 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:54.644518 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zg5fq" event={"ID":"7f7face8-df08-4e4c-afa4-e028aa2a95fe","Type":"ContainerStarted","Data":"42d9fbdefc9d5406adbc254d0660c4ef6035b38552a77118e31578e53c2b62b4"} Jul 06 18:54:54.649648 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:54.649442 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" event={"ID":"20580915-5810-4b0d-a204-d80772eb5769","Type":"ContainerStarted","Data":"9c6b2b86e6c4b7bce97871bf0be68b384a74c8838f1dfeaf0d18794e24494a07"} Jul 06 18:54:54.653284 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:54.653259 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mwp57" event={"ID":"fc86ae6c-8718-437d-915d-6940c8be493f","Type":"ContainerStarted","Data":"9fd3c82550b7578e774712972b9839feb74b9944c65abeed0e9f36507acfd4aa"} Jul 06 18:54:55.096482 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:55.096442 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret\") pod \"global-pull-secret-syncer-s8pd7\" (UID: \"e1283903-625e-49c4-a176-83b147859bd7\") " pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:54:55.096696 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:55.096657 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 18:54:55.096761 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:55.096726 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret podName:e1283903-625e-49c4-a176-83b147859bd7 nodeName:}" failed. No retries permitted until 2026-07-06 18:54:57.096703464 +0000 UTC m=+5.023138009 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret") pod "global-pull-secret-syncer-s8pd7" (UID: "e1283903-625e-49c4-a176-83b147859bd7") : object "kube-system"/"original-pull-secret" not registered Jul 06 18:54:55.197882 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:55.197845 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs\") pod \"network-metrics-daemon-h9gnx\" (UID: \"d8841ac5-94d5-4604-9576-0ea7bd6c3750\") " pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:54:55.198055 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:55.197944 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6brk\" (UniqueName: \"kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk\") pod \"network-check-target-d94p2\" (UID: \"e5fa32e0-5190-4738-b813-732443056605\") " pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:54:55.198055 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:55.198036 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:54:55.198172 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:55.198112 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 18:54:55.198172 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:55.198131 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 18:54:55.198172 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:55.198146 2567 projected.go:196] Error preparing data for projected volume kube-api-access-l6brk for pod openshift-network-diagnostics/network-check-target-d94p2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:54:55.198329 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:55.198114 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs podName:d8841ac5-94d5-4604-9576-0ea7bd6c3750 nodeName:}" failed. No retries permitted until 2026-07-06 18:54:57.198093403 +0000 UTC m=+5.124527935 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs") pod "network-metrics-daemon-h9gnx" (UID: "d8841ac5-94d5-4604-9576-0ea7bd6c3750") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:54:55.198329 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:55.198209 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk podName:e5fa32e0-5190-4738-b813-732443056605 nodeName:}" failed. No retries permitted until 2026-07-06 18:54:57.198193056 +0000 UTC m=+5.124627588 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6brk" (UniqueName: "kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk") pod "network-check-target-d94p2" (UID: "e5fa32e0-5190-4738-b813-732443056605") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:54:55.336783 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:55.336735 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 18:54:55.513777 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:55.513728 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 18:49:54 +0000 UTC" deadline="2028-02-15 19:19:25.428088769 +0000 UTC" Jul 06 18:54:55.513777 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:55.513774 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14136h24m29.914319228s" Jul 06 18:54:55.569417 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:55.569376 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:54:55.569647 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:55.569551 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9gnx" podUID="d8841ac5-94d5-4604-9576-0ea7bd6c3750" Jul 06 18:54:55.570017 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:55.569976 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:54:55.570114 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:55.570075 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8pd7" podUID="e1283903-625e-49c4-a176-83b147859bd7" Jul 06 18:54:56.572109 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:56.572076 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:54:56.572743 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:56.572203 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94p2" podUID="e5fa32e0-5190-4738-b813-732443056605" Jul 06 18:54:57.114406 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:57.113705 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret\") pod \"global-pull-secret-syncer-s8pd7\" (UID: \"e1283903-625e-49c4-a176-83b147859bd7\") " pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:54:57.114406 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:57.113916 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 18:54:57.114406 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:57.113987 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret podName:e1283903-625e-49c4-a176-83b147859bd7 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:01.113966384 +0000 UTC m=+9.040400919 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret") pod "global-pull-secret-syncer-s8pd7" (UID: "e1283903-625e-49c4-a176-83b147859bd7") : object "kube-system"/"original-pull-secret" not registered Jul 06 18:54:57.215455 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:57.214514 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs\") pod \"network-metrics-daemon-h9gnx\" (UID: \"d8841ac5-94d5-4604-9576-0ea7bd6c3750\") " pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:54:57.215455 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:57.214601 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6brk\" (UniqueName: \"kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk\") pod \"network-check-target-d94p2\" (UID: \"e5fa32e0-5190-4738-b813-732443056605\") " pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:54:57.215455 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:57.214829 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 18:54:57.215455 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:57.214850 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 18:54:57.215455 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:57.214863 2567 projected.go:196] Error preparing data for projected volume kube-api-access-l6brk for pod openshift-network-diagnostics/network-check-target-d94p2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:54:57.215455 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:57.214922 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk podName:e5fa32e0-5190-4738-b813-732443056605 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:01.214902428 +0000 UTC m=+9.141336960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6brk" (UniqueName: "kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk") pod "network-check-target-d94p2" (UID: "e5fa32e0-5190-4738-b813-732443056605") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:54:57.215455 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:57.215322 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:54:57.215455 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:57.215377 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs podName:d8841ac5-94d5-4604-9576-0ea7bd6c3750 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:01.215359545 +0000 UTC m=+9.141794077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs") pod "network-metrics-daemon-h9gnx" (UID: "d8841ac5-94d5-4604-9576-0ea7bd6c3750") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:54:57.569634 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:57.569574 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:54:57.569811 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:57.569730 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9gnx" podUID="d8841ac5-94d5-4604-9576-0ea7bd6c3750" Jul 06 18:54:57.570410 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:57.570155 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:54:57.570410 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:57.570270 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8pd7" podUID="e1283903-625e-49c4-a176-83b147859bd7" Jul 06 18:54:58.570243 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:58.570209 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:54:58.570768 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:58.570356 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94p2" podUID="e5fa32e0-5190-4738-b813-732443056605" Jul 06 18:54:59.570785 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:59.570128 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:54:59.570785 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:59.570278 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9gnx" podUID="d8841ac5-94d5-4604-9576-0ea7bd6c3750" Jul 06 18:54:59.570785 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:54:59.570328 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:54:59.570785 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:54:59.570415 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8pd7" podUID="e1283903-625e-49c4-a176-83b147859bd7" Jul 06 18:55:00.569808 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:00.569772 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:55:00.570054 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:00.569953 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94p2" podUID="e5fa32e0-5190-4738-b813-732443056605" Jul 06 18:55:01.147359 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:01.147306 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret\") pod \"global-pull-secret-syncer-s8pd7\" (UID: \"e1283903-625e-49c4-a176-83b147859bd7\") " pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:55:01.147853 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:01.147538 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 18:55:01.147853 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:01.147645 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret podName:e1283903-625e-49c4-a176-83b147859bd7 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:09.147619973 +0000 UTC m=+17.074054502 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret") pod "global-pull-secret-syncer-s8pd7" (UID: "e1283903-625e-49c4-a176-83b147859bd7") : object "kube-system"/"original-pull-secret" not registered Jul 06 18:55:01.249228 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:01.248756 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs\") pod \"network-metrics-daemon-h9gnx\" (UID: \"d8841ac5-94d5-4604-9576-0ea7bd6c3750\") " pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:55:01.249228 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:01.248863 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6brk\" (UniqueName: \"kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk\") pod \"network-check-target-d94p2\" (UID: \"e5fa32e0-5190-4738-b813-732443056605\") " pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:55:01.249228 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:01.249033 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 18:55:01.249228 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:01.249102 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 18:55:01.249228 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:01.249119 2567 projected.go:196] Error preparing data for projected volume kube-api-access-l6brk for pod openshift-network-diagnostics/network-check-target-d94p2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:55:01.249228 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:01.249186 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk podName:e5fa32e0-5190-4738-b813-732443056605 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:09.249165385 +0000 UTC m=+17.175599918 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6brk" (UniqueName: "kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk") pod "network-check-target-d94p2" (UID: "e5fa32e0-5190-4738-b813-732443056605") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:55:01.249739 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:01.249271 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:55:01.249739 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:01.249350 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs podName:d8841ac5-94d5-4604-9576-0ea7bd6c3750 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:09.249330764 +0000 UTC m=+17.175765311 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs") pod "network-metrics-daemon-h9gnx" (UID: "d8841ac5-94d5-4604-9576-0ea7bd6c3750") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:55:01.569957 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:01.569698 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:55:01.569957 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:01.569754 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:55:01.569957 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:01.569864 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9gnx" podUID="d8841ac5-94d5-4604-9576-0ea7bd6c3750" Jul 06 18:55:01.569957 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:01.569962 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8pd7" podUID="e1283903-625e-49c4-a176-83b147859bd7" Jul 06 18:55:02.569373 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:02.569334 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:55:02.569867 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:02.569477 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94p2" podUID="e5fa32e0-5190-4738-b813-732443056605" Jul 06 18:55:03.569213 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:03.569183 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:55:03.569393 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:03.569314 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8pd7" podUID="e1283903-625e-49c4-a176-83b147859bd7" Jul 06 18:55:03.569825 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:03.569717 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:55:03.569888 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:03.569821 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9gnx" podUID="d8841ac5-94d5-4604-9576-0ea7bd6c3750" Jul 06 18:55:04.569421 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:04.569385 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:55:04.569873 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:04.569543 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94p2" podUID="e5fa32e0-5190-4738-b813-732443056605" Jul 06 18:55:05.570035 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:05.569996 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:55:05.570491 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:05.570002 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:55:05.570491 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:05.570163 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9gnx" podUID="d8841ac5-94d5-4604-9576-0ea7bd6c3750" Jul 06 18:55:05.570491 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:05.570221 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8pd7" podUID="e1283903-625e-49c4-a176-83b147859bd7" Jul 06 18:55:06.569860 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:06.569828 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:55:06.570034 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:06.569950 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94p2" podUID="e5fa32e0-5190-4738-b813-732443056605" Jul 06 18:55:07.569492 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:07.569451 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:55:07.569959 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:07.569503 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:55:07.569959 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:07.569602 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8pd7" podUID="e1283903-625e-49c4-a176-83b147859bd7" Jul 06 18:55:07.569959 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:07.569719 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9gnx" podUID="d8841ac5-94d5-4604-9576-0ea7bd6c3750" Jul 06 18:55:08.569871 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:08.569840 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:55:08.570249 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:08.569957 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94p2" podUID="e5fa32e0-5190-4738-b813-732443056605" Jul 06 18:55:09.209045 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:09.209000 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret\") pod \"global-pull-secret-syncer-s8pd7\" (UID: \"e1283903-625e-49c4-a176-83b147859bd7\") " pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:55:09.209253 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:09.209213 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 18:55:09.209321 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:09.209292 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret podName:e1283903-625e-49c4-a176-83b147859bd7 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:25.209271088 +0000 UTC m=+33.135705638 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret") pod "global-pull-secret-syncer-s8pd7" (UID: "e1283903-625e-49c4-a176-83b147859bd7") : object "kube-system"/"original-pull-secret" not registered Jul 06 18:55:09.309932 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:09.309891 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6brk\" (UniqueName: \"kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk\") pod \"network-check-target-d94p2\" (UID: \"e5fa32e0-5190-4738-b813-732443056605\") " pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:55:09.309932 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:09.309942 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs\") pod \"network-metrics-daemon-h9gnx\" (UID: \"d8841ac5-94d5-4604-9576-0ea7bd6c3750\") " pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:55:09.310159 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:09.310133 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 18:55:09.310159 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:09.310159 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 18:55:09.310246 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:09.310172 2567 projected.go:196] Error preparing data for projected volume kube-api-access-l6brk for pod openshift-network-diagnostics/network-check-target-d94p2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:55:09.310246 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:09.310183 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:55:09.310246 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:09.310236 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk podName:e5fa32e0-5190-4738-b813-732443056605 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:25.310217142 +0000 UTC m=+33.236651674 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6brk" (UniqueName: "kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk") pod "network-check-target-d94p2" (UID: "e5fa32e0-5190-4738-b813-732443056605") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:55:09.310348 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:09.310257 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs podName:d8841ac5-94d5-4604-9576-0ea7bd6c3750 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:25.310246743 +0000 UTC m=+33.236681272 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs") pod "network-metrics-daemon-h9gnx" (UID: "d8841ac5-94d5-4604-9576-0ea7bd6c3750") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:55:09.569790 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:09.569712 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:55:09.569947 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:09.569831 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9gnx" podUID="d8841ac5-94d5-4604-9576-0ea7bd6c3750" Jul 06 18:55:09.569947 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:09.569897 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:55:09.570310 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:09.570034 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8pd7" podUID="e1283903-625e-49c4-a176-83b147859bd7" Jul 06 18:55:10.569314 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:10.569281 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:55:10.569539 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:10.569446 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94p2" podUID="e5fa32e0-5190-4738-b813-732443056605" Jul 06 18:55:11.569699 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:11.569666 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:55:11.570151 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:11.569667 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:55:11.570151 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:11.569784 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9gnx" podUID="d8841ac5-94d5-4604-9576-0ea7bd6c3750" Jul 06 18:55:11.570151 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:11.569831 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8pd7" podUID="e1283903-625e-49c4-a176-83b147859bd7" Jul 06 18:55:12.570816 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:12.570784 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:55:12.571245 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:12.570885 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94p2" podUID="e5fa32e0-5190-4738-b813-732443056605" Jul 06 18:55:13.569143 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:13.569106 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:55:13.569326 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:13.569119 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:55:13.569326 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:13.569225 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8pd7" podUID="e1283903-625e-49c4-a176-83b147859bd7" Jul 06 18:55:13.569431 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:13.569331 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9gnx" podUID="d8841ac5-94d5-4604-9576-0ea7bd6c3750" Jul 06 18:55:14.569499 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:14.569462 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:55:14.569784 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:14.569599 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94p2" podUID="e5fa32e0-5190-4738-b813-732443056605" Jul 06 18:55:14.711383 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:14.711181 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-154.ec2.internal" event={"ID":"eebd8c9c2aac021424bbe7455e90313b","Type":"ContainerStarted","Data":"c4aef37dc0d2b19f7d775fda19832a12bb1dae1f92c144e5eb6a34816b2c1c8e"} Jul 06 18:55:15.570231 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.570000 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:55:15.570926 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.570033 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:55:15.570926 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:15.570283 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9gnx" podUID="d8841ac5-94d5-4604-9576-0ea7bd6c3750" Jul 06 18:55:15.570926 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:15.570317 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8pd7" podUID="e1283903-625e-49c4-a176-83b147859bd7" Jul 06 18:55:15.714747 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.714718 2567 generic.go:356] "Generic (PLEG): container finished" podID="93e145b9-cc69-47ba-8b68-cd22bc6668bd" containerID="3e1745437326d419a97e79aa828916100cdfe4a7d480df854595159d0b625557" exitCode=0 Jul 06 18:55:15.714905 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.714794 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lqqtw" event={"ID":"93e145b9-cc69-47ba-8b68-cd22bc6668bd","Type":"ContainerDied","Data":"3e1745437326d419a97e79aa828916100cdfe4a7d480df854595159d0b625557"} Jul 06 18:55:15.716410 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.716305 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-97m7v" event={"ID":"87615484-d40e-482e-81c0-73387e5eedaa","Type":"ContainerStarted","Data":"db9d20a0267e3d35d83d6ad14b5786cbb94a8b65bd5e95a5f2a09083a0775f6d"} Jul 06 18:55:15.717866 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.717845 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" event={"ID":"d0bf5584-7798-4010-a555-cfc72bcad8c2","Type":"ContainerStarted","Data":"d6b54391f4b2aaa898da56a71da5e06f599a6dd9019addf62c5d960160d6ff6f"} Jul 06 18:55:15.719122 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.719103 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c58dn" event={"ID":"91acad80-e6c9-4bf5-816c-a6b89d0b611e","Type":"ContainerStarted","Data":"d9b4171ec53fc81029890da384d62c0cef9d450b7e538d85512a66370f0912bd"} Jul 06 18:55:15.720588 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.720556 2567 generic.go:356] "Generic (PLEG): container finished" podID="1e9de4cbe007773b79f990a8bf188c39" containerID="ff91218935d630e058d22140e50bd5e9f13c5691adcd1ae0c1eb13c181996eaa" exitCode=0 Jul 06 18:55:15.720681 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.720635 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-154.ec2.internal" event={"ID":"1e9de4cbe007773b79f990a8bf188c39","Type":"ContainerDied","Data":"ff91218935d630e058d22140e50bd5e9f13c5691adcd1ae0c1eb13c181996eaa"} Jul 06 18:55:15.722567 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.722540 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9w8kj" event={"ID":"55a4de5a-b33e-4eec-aa0b-27a98feac09f","Type":"ContainerStarted","Data":"0ea56dc1d0dc852cfd39e2a536833b494dd7b8793d37e3ee783f1fa9a9034fcd"} Jul 06 18:55:15.724007 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.723985 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zg5fq" event={"ID":"7f7face8-df08-4e4c-afa4-e028aa2a95fe","Type":"ContainerStarted","Data":"66ccc2895335b49329fad44847ae151b22c6d010c634ddc71fc3527d88d3a240"} Jul 06 18:55:15.726619 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.726601 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" event={"ID":"20580915-5810-4b0d-a204-d80772eb5769","Type":"ContainerStarted","Data":"902464320dedd778a3dc0bd14f2237f5b7a51f554ecf66b497513228f36b2ed2"} Jul 06 18:55:15.726721 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.726672 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" event={"ID":"20580915-5810-4b0d-a204-d80772eb5769","Type":"ContainerStarted","Data":"aade656c0cd2dac43e4d141cb55d325f74a1b2bd045ac0de599a51fc738ab940"} Jul 06 18:55:15.726721 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.726714 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" event={"ID":"20580915-5810-4b0d-a204-d80772eb5769","Type":"ContainerStarted","Data":"f731253dae10f428154c6678d85d7aa50e65ba072bb16eb305f3ff5006e548f5"} Jul 06 18:55:15.726828 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.726744 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" event={"ID":"20580915-5810-4b0d-a204-d80772eb5769","Type":"ContainerStarted","Data":"409f4d688a2787c16db620f6fe0979a368935b2ed4717a4aca2f8b64e6875a5f"} Jul 06 18:55:15.726828 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.726790 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" event={"ID":"20580915-5810-4b0d-a204-d80772eb5769","Type":"ContainerStarted","Data":"7b884bfa782ecffc81254efabc4352af7df90c8bd4df5c08bac4578e58257240"} Jul 06 18:55:15.726901 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.726833 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" event={"ID":"20580915-5810-4b0d-a204-d80772eb5769","Type":"ContainerStarted","Data":"c0f55d3ac04d9efdb28ca457150fbfb45a056da178d29d645002de9af2085200"} Jul 06 18:55:15.727834 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.727813 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mwp57" event={"ID":"fc86ae6c-8718-437d-915d-6940c8be493f","Type":"ContainerStarted","Data":"f57ccdccf3f53b103a44317a92343313fb350d498fb49a6b10e21c9ce892f367"} Jul 06 18:55:15.754344 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.754297 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mwp57" podStartSLOduration=1.943799479 podStartE2EDuration="22.754281995s" totalImagesPullingTime="20.810482516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:55:15.754011094 +0000 UTC m=+23.680445655" watchObservedRunningTime="2026-07-06 18:55:15.754281995 +0000 UTC m=+23.680716546" Jul 06 18:55:15.771023 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.770977 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-97m7v" podStartSLOduration=2.044338212 podStartE2EDuration="22.770964592s" totalImagesPullingTime="20.72662638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:55:15.770755731 +0000 UTC m=+23.697190290" watchObservedRunningTime="2026-07-06 18:55:15.770964592 +0000 UTC m=+23.697399142" Jul 06 18:55:15.786383 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.786345 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zg5fq" podStartSLOduration=2.105805749 podStartE2EDuration="22.786328854s" totalImagesPullingTime="20.680523105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:55:15.785972614 +0000 UTC m=+23.712407187" watchObservedRunningTime="2026-07-06 18:55:15.786328854 +0000 UTC m=+23.712763406" Jul 06 18:55:15.821570 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.821350 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c58dn" podStartSLOduration=6.210295209 podStartE2EDuration="22.821332383s" totalImagesPullingTime="16.611037174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:55:15.821307451 +0000 UTC m=+23.747742000" watchObservedRunningTime="2026-07-06 18:55:15.821332383 +0000 UTC m=+23.747766934" Jul 06 18:55:15.840803 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.840765 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9w8kj" podStartSLOduration=2.087323412 podStartE2EDuration="22.840751906s" totalImagesPullingTime="20.753428494s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:55:15.840672875 +0000 UTC m=+23.767107425" watchObservedRunningTime="2026-07-06 18:55:15.840751906 +0000 UTC m=+23.767186455" Jul 06 18:55:15.862133 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:15.862027 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-154.ec2.internal" podStartSLOduration=21.862010732 podStartE2EDuration="21.862010732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:54:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:55:15.861325904 +0000 UTC m=+23.787760455" watchObservedRunningTime="2026-07-06 18:55:15.862010732 +0000 UTC m=+23.788445282" Jul 06 18:55:16.569295 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:16.569262 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:55:16.569459 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:16.569366 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94p2" podUID="e5fa32e0-5190-4738-b813-732443056605" Jul 06 18:55:16.729692 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:16.729668 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 18:55:16.732325 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:16.732298 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" event={"ID":"d0bf5584-7798-4010-a555-cfc72bcad8c2","Type":"ContainerStarted","Data":"c478c2581bedb9542d048715b3595108cbc82e74b037e0a97923f47edb9a90d0"} Jul 06 18:55:16.733937 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:16.733912 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qs88h" event={"ID":"8f1ddfd3-95c0-4399-b0d1-2dca83227aa9","Type":"ContainerStarted","Data":"66e45524be57356fc402d1a287cc47cbdd1c5eaf9f566b709bbf276acf0297ec"} Jul 06 18:55:16.736097 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:16.736023 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-154.ec2.internal" event={"ID":"1e9de4cbe007773b79f990a8bf188c39","Type":"ContainerStarted","Data":"83f3394fb6d6e96b0002791f85b948ebbdbbb79bad01bef9408f37b9189670c7"} Jul 06 18:55:16.761153 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:16.761111 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-154.ec2.internal" podStartSLOduration=22.761097917 podStartE2EDuration="22.761097917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:54:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:55:16.760984592 +0000 UTC m=+24.687419152" watchObservedRunningTime="2026-07-06 18:55:16.761097917 +0000 UTC m=+24.687532466" Jul 06 18:55:16.761780 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:16.761746 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qs88h" podStartSLOduration=2.988837877 podStartE2EDuration="23.761735059s" totalImagesPullingTime="20.772897182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:55:16.747642099 +0000 UTC m=+24.674076648" watchObservedRunningTime="2026-07-06 18:55:16.761735059 +0000 UTC m=+24.688169610" Jul 06 18:55:17.537778 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:17.537626 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T18:55:16.729688677Z","UUID":"499e6690-a2e9-4777-b216-5f98483464c9","Handler":null,"Name":"","Endpoint":""} Jul 06 18:55:17.539409 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:17.539385 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 18:55:17.539537 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:17.539444 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 18:55:17.569823 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:17.569797 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:55:17.569823 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:17.569818 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:55:17.570030 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:17.569925 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9gnx" podUID="d8841ac5-94d5-4604-9576-0ea7bd6c3750" Jul 06 18:55:17.570082 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:17.570020 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8pd7" podUID="e1283903-625e-49c4-a176-83b147859bd7" Jul 06 18:55:17.742010 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:17.741973 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" event={"ID":"20580915-5810-4b0d-a204-d80772eb5769","Type":"ContainerStarted","Data":"8718ff56c647aa898174f3d912d627205c2f659ea3f645996513f8f9d5dca9e1"} Jul 06 18:55:18.132646 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:18.132618 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mwp57" Jul 06 18:55:18.133215 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:18.133185 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mwp57" Jul 06 18:55:18.569334 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:18.569302 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:55:18.569532 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:18.569424 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94p2" podUID="e5fa32e0-5190-4738-b813-732443056605" Jul 06 18:55:18.749061 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:18.749018 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" event={"ID":"d0bf5584-7798-4010-a555-cfc72bcad8c2","Type":"ContainerStarted","Data":"5b252109df56d837c250d58339f5bfb873d8144bf1b2929989d5a9e72f025c72"} Jul 06 18:55:18.749645 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:18.749289 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mwp57" Jul 06 18:55:18.750046 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:18.750025 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mwp57" Jul 06 18:55:18.767186 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:18.767137 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5sh8" podStartSLOduration=2.446480076 podStartE2EDuration="25.767120921s" totalImagesPullingTime="23.320640845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:54:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:55:18.766454647 +0000 UTC m=+26.692889197" watchObservedRunningTime="2026-07-06 18:55:18.767120921 +0000 UTC m=+26.693555474" Jul 06 18:55:19.570268 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:19.569933 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:55:19.570268 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:19.569980 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:55:19.570268 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:19.570237 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9gnx" podUID="d8841ac5-94d5-4604-9576-0ea7bd6c3750" Jul 06 18:55:19.570573 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:19.570316 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8pd7" podUID="e1283903-625e-49c4-a176-83b147859bd7" Jul 06 18:55:19.756071 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:19.756002 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" event={"ID":"20580915-5810-4b0d-a204-d80772eb5769","Type":"ContainerStarted","Data":"e01b7f8a5433c23a5a64c5b2e17d4f71f43df133494fefc49c50998e79806fe6"} Jul 06 18:55:19.789584 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:19.789526 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" podStartSLOduration=6.01893178 podStartE2EDuration="26.78950938s" totalImagesPullingTime="20.7705776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:55:19.789170581 +0000 UTC m=+27.715605168" watchObservedRunningTime="2026-07-06 18:55:19.78950938 +0000 UTC m=+27.715943927" Jul 06 18:55:20.569445 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:20.569415 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:55:20.569640 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:20.569571 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94p2" podUID="e5fa32e0-5190-4738-b813-732443056605" Jul 06 18:55:20.759543 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:20.759502 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:55:20.760119 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:20.759604 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:55:20.760119 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:20.759654 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:55:20.780385 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:20.779205 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:55:20.780385 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:20.779657 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:55:21.570008 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:21.569974 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:55:21.570008 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:21.569999 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:55:21.570186 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:21.570122 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9gnx" podUID="d8841ac5-94d5-4604-9576-0ea7bd6c3750" Jul 06 18:55:21.570261 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:21.570214 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8pd7" podUID="e1283903-625e-49c4-a176-83b147859bd7" Jul 06 18:55:21.762860 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:21.762783 2567 generic.go:356] "Generic (PLEG): container finished" podID="93e145b9-cc69-47ba-8b68-cd22bc6668bd" containerID="108c2ce9992e63ff92d7a44cad8657c7f28644b9f36a525d985fcbfc28486a8f" exitCode=0 Jul 06 18:55:21.763458 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:21.762869 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lqqtw" event={"ID":"93e145b9-cc69-47ba-8b68-cd22bc6668bd","Type":"ContainerDied","Data":"108c2ce9992e63ff92d7a44cad8657c7f28644b9f36a525d985fcbfc28486a8f"} Jul 06 18:55:21.901931 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:21.901898 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d94p2"] Jul 06 18:55:21.902059 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:21.902026 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:55:21.902152 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:21.902132 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94p2" podUID="e5fa32e0-5190-4738-b813-732443056605" Jul 06 18:55:21.905759 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:21.905736 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s8pd7"] Jul 06 18:55:21.905896 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:21.905814 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:55:21.905991 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:21.905910 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8pd7" podUID="e1283903-625e-49c4-a176-83b147859bd7" Jul 06 18:55:21.906433 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:21.906406 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h9gnx"] Jul 06 18:55:21.906543 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:21.906517 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:55:21.906621 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:21.906602 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9gnx" podUID="d8841ac5-94d5-4604-9576-0ea7bd6c3750" Jul 06 18:55:23.570287 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:23.570098 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:55:23.570708 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:23.570150 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:55:23.570708 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:23.570361 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8pd7" podUID="e1283903-625e-49c4-a176-83b147859bd7" Jul 06 18:55:23.570708 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:23.570449 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9gnx" podUID="d8841ac5-94d5-4604-9576-0ea7bd6c3750" Jul 06 18:55:23.570708 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:23.570150 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:55:23.570708 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:23.570583 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94p2" podUID="e5fa32e0-5190-4738-b813-732443056605" Jul 06 18:55:23.769606 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:23.769528 2567 generic.go:356] "Generic (PLEG): container finished" podID="93e145b9-cc69-47ba-8b68-cd22bc6668bd" containerID="a16ffbb0ea1bb5c05b658f485e7dd9d7ce218364aba9bb0950cd355ec7f8f811" exitCode=0 Jul 06 18:55:23.769606 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:23.769582 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lqqtw" event={"ID":"93e145b9-cc69-47ba-8b68-cd22bc6668bd","Type":"ContainerDied","Data":"a16ffbb0ea1bb5c05b658f485e7dd9d7ce218364aba9bb0950cd355ec7f8f811"} Jul 06 18:55:24.773777 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:24.773743 2567 generic.go:356] "Generic (PLEG): container finished" podID="93e145b9-cc69-47ba-8b68-cd22bc6668bd" containerID="f73e04c574ed3c23e39a994d98c9033af84361e6ce382ee9c419c55173de963b" exitCode=0 Jul 06 18:55:24.774207 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:24.773797 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lqqtw" event={"ID":"93e145b9-cc69-47ba-8b68-cd22bc6668bd","Type":"ContainerDied","Data":"f73e04c574ed3c23e39a994d98c9033af84361e6ce382ee9c419c55173de963b"} Jul 06 18:55:25.235590 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:25.235554 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret\") pod \"global-pull-secret-syncer-s8pd7\" (UID: \"e1283903-625e-49c4-a176-83b147859bd7\") " pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:55:25.235770 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:25.235676 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 18:55:25.235770 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:25.235739 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret podName:e1283903-625e-49c4-a176-83b147859bd7 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:57.23572377 +0000 UTC m=+65.162158311 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret") pod "global-pull-secret-syncer-s8pd7" (UID: "e1283903-625e-49c4-a176-83b147859bd7") : object "kube-system"/"original-pull-secret" not registered Jul 06 18:55:25.335856 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:25.335823 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs\") pod \"network-metrics-daemon-h9gnx\" (UID: \"d8841ac5-94d5-4604-9576-0ea7bd6c3750\") " pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:55:25.336034 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:25.335883 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6brk\" (UniqueName: \"kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk\") pod \"network-check-target-d94p2\" (UID: \"e5fa32e0-5190-4738-b813-732443056605\") " pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:55:25.336034 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:25.335997 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 18:55:25.336034 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:25.336014 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 18:55:25.336034 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:25.336024 2567 projected.go:196] Error preparing data for projected volume kube-api-access-l6brk for pod openshift-network-diagnostics/network-check-target-d94p2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:55:25.336251 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:25.336073 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk podName:e5fa32e0-5190-4738-b813-732443056605 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:57.336057062 +0000 UTC m=+65.262491595 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6brk" (UniqueName: "kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk") pod "network-check-target-d94p2" (UID: "e5fa32e0-5190-4738-b813-732443056605") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:55:25.336251 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:25.335993 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:55:25.336251 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:25.336163 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs podName:d8841ac5-94d5-4604-9576-0ea7bd6c3750 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:57.336141155 +0000 UTC m=+65.262575686 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs") pod "network-metrics-daemon-h9gnx" (UID: "d8841ac5-94d5-4604-9576-0ea7bd6c3750") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:55:25.570211 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:25.570145 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:55:25.570211 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:25.570193 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:55:25.570402 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:25.570273 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:55:25.570402 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:25.570286 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94p2" podUID="e5fa32e0-5190-4738-b813-732443056605" Jul 06 18:55:25.570535 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:25.570397 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9gnx" podUID="d8841ac5-94d5-4604-9576-0ea7bd6c3750" Jul 06 18:55:25.570535 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:25.570463 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8pd7" podUID="e1283903-625e-49c4-a176-83b147859bd7" Jul 06 18:55:27.203121 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.203086 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-154.ec2.internal" event="NodeReady" Jul 06 18:55:27.203459 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.203241 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 18:55:27.239177 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.239143 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6db87cfddf-pjkbq"] Jul 06 18:55:27.244280 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.244259 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.246897 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.246877 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 18:55:27.247384 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.247356 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-48zcw\"" Jul 06 18:55:27.247494 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.247360 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 18:55:27.247494 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.247410 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 18:55:27.255037 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.254999 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6db87cfddf-pjkbq"] Jul 06 18:55:27.255146 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.255006 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 18:55:27.260742 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.260722 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-888gm"] Jul 06 18:55:27.264333 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.264313 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-888gm" Jul 06 18:55:27.265406 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.265376 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jh7tn"] Jul 06 18:55:27.266890 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.266871 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2ljct\"" Jul 06 18:55:27.267099 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.267079 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 18:55:27.267178 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.267102 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 18:55:27.269645 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.269621 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kpxk9"] Jul 06 18:55:27.271772 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.271306 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jh7tn" Jul 06 18:55:27.273742 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.273719 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vlffp"] Jul 06 18:55:27.273926 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.273887 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kpxk9" Jul 06 18:55:27.274656 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.274640 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 18:55:27.274988 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.274951 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 18:55:27.274988 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.274967 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-lkhz6\"" Jul 06 18:55:27.275130 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.274971 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 18:55:27.275377 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.275273 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 18:55:27.276862 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.276842 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 18:55:27.276991 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.276892 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4rjh\"" Jul 06 18:55:27.276991 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.276921 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-qsln6"] Jul 06 18:55:27.277129 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.277113 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vlffp" Jul 06 18:55:27.277581 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.277548 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 18:55:27.279246 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.279227 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 18:55:27.279525 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.279504 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 18:55:27.279609 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.279547 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 18:55:27.279671 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.279604 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 18:55:27.280734 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.280715 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8w4v8\"" Jul 06 18:55:27.281258 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.281132 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc"] Jul 06 18:55:27.285293 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.281215 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-qsln6" Jul 06 18:55:27.288770 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.288669 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 18:55:27.288770 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.288721 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-4mlll\"" Jul 06 18:55:27.289001 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.288944 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 18:55:27.289171 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.289151 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-888gm"] Jul 06 18:55:27.289329 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.289310 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc" Jul 06 18:55:27.289467 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.289451 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kpxk9"] Jul 06 18:55:27.289628 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.289614 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-n4qsl"] Jul 06 18:55:27.290103 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.289231 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 18:55:27.290412 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.290394 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 18:55:27.293253 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.293234 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rhd87"] Jul 06 18:55:27.293357 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.293343 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-n4qsl" Jul 06 18:55:27.293829 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.293766 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 18:55:27.294638 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.294589 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 18:55:27.296011 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.295987 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 18:55:27.296251 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.296207 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 18:55:27.296333 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.296293 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 18:55:27.296442 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.296407 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 18:55:27.296540 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.296526 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 18:55:27.296685 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.296658 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6n5hj\"" Jul 06 18:55:27.297698 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.297002 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lnwhf\"" Jul 06 18:55:27.298157 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.298138 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6dc846bc67-j8qgm"] Jul 06 18:55:27.299289 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.298695 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rhd87" Jul 06 18:55:27.302194 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.302170 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-zcpj7"] Jul 06 18:55:27.302521 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.302463 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:27.302959 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.302753 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 18:55:27.303839 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.302815 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 18:55:27.305013 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.303050 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ft894\"" Jul 06 18:55:27.305195 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.303109 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 18:55:27.305654 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.305638 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7f2wj"] Jul 06 18:55:27.307078 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.307052 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 18:55:27.307635 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.307618 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 18:55:27.308024 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.307649 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 18:55:27.308172 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.307664 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 18:55:27.308396 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.307824 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 18:55:27.308515 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.308498 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 18:55:27.308587 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.308082 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-x7rtr\"" Jul 06 18:55:27.308647 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.308089 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" Jul 06 18:55:27.311108 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.311091 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jh7tn"] Jul 06 18:55:27.311246 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.311233 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vlffp"] Jul 06 18:55:27.311349 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.311339 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc"] Jul 06 18:55:27.311443 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.311434 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-n4qsl"] Jul 06 18:55:27.311565 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.311554 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rhd87"] Jul 06 18:55:27.311677 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.311549 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 18:55:27.311754 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.311743 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7f2wj" Jul 06 18:55:27.311875 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.311856 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 06 18:55:27.311989 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.311977 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-qsln6"] Jul 06 18:55:27.312095 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.312083 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6dc846bc67-j8qgm"] Jul 06 18:55:27.312195 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.312152 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 18:55:27.312710 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.312691 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 06 18:55:27.312839 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.312730 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-zcpj7"] Jul 06 18:55:27.314523 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.314441 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dxkbr\"" Jul 06 18:55:27.317145 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.315854 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 18:55:27.317145 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.316819 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 18:55:27.317145 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.317036 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zlnnt\"" Jul 06 18:55:27.317145 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.317088 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7f2wj"] Jul 06 18:55:27.317400 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.317266 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 18:55:27.321808 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.321788 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 06 18:55:27.351426 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.351340 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.351426 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.351384 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7f6l\" (UniqueName: \"kubernetes.io/projected/74de0b59-0831-45cb-91be-776aaabedf5d-kube-api-access-m7f6l\") pod \"volume-data-source-validator-5d456fdbcd-888gm\" (UID: \"74de0b59-0831-45cb-91be-776aaabedf5d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-888gm" Jul 06 18:55:27.351426 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.351421 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-bound-sa-token\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.351843 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.351491 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-certificates\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.351843 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.351522 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjpv4\" (UniqueName: \"kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-kube-api-access-tjpv4\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.351843 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.351552 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e4f8630-04c0-411a-881f-514f0cd4c6d6-ca-trust-extracted\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.351843 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.351659 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e4f8630-04c0-411a-881f-514f0cd4c6d6-trusted-ca\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.351843 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.351762 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e4f8630-04c0-411a-881f-514f0cd4c6d6-image-registry-private-configuration\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.352212 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.352187 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e4f8630-04c0-411a-881f-514f0cd4c6d6-installation-pull-secrets\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.428387 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.428353 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:27.452779 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.452747 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/31a1816c-63a0-47a9-93fc-b76fda98725c-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-vlffp\" (UID: \"31a1816c-63a0-47a9-93fc-b76fda98725c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vlffp" Jul 06 18:55:27.452933 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.452793 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c2b88852-6092-4980-905d-8801e95abd38-serving-cert\") pod \"insights-operator-5c847dcfc4-zcpj7\" (UID: \"c2b88852-6092-4980-905d-8801e95abd38\") " pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" Jul 06 18:55:27.452933 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.452857 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjpv4\" (UniqueName: \"kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-kube-api-access-tjpv4\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.452933 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.452895 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99tvl\" (UniqueName: \"kubernetes.io/projected/cb67cfb2-0530-4e08-9207-bd56efc53129-kube-api-access-99tvl\") pod \"network-check-source-989f8b8dc-n4qsl\" (UID: \"cb67cfb2-0530-4e08-9207-bd56efc53129\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-n4qsl" Jul 06 18:55:27.453051 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.452931 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e4f8630-04c0-411a-881f-514f0cd4c6d6-ca-trust-extracted\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.453051 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.452958 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e2b0f1e-6d00-4ad8-a194-a4604a728b56-serving-cert\") pod \"console-operator-68b757fb67-qsln6\" (UID: \"3e2b0f1e-6d00-4ad8-a194-a4604a728b56\") " pod="openshift-console-operator/console-operator-68b757fb67-qsln6" Jul 06 18:55:27.453051 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.452982 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe134beb-34fb-4394-9365-d9ade5e9dd2a-cert\") pod \"ingress-canary-rhd87\" (UID: \"fe134beb-34fb-4394-9365-d9ade5e9dd2a\") " pod="openshift-ingress-canary/ingress-canary-rhd87" Jul 06 18:55:27.453051 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453005 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a645ee26-3516-4de3-99f2-603d7cb6914c-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-jh7tn\" (UID: \"a645ee26-3516-4de3-99f2-603d7cb6914c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jh7tn" Jul 06 18:55:27.453051 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453027 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2p6t\" (UniqueName: \"kubernetes.io/projected/55ac808a-57f8-4960-aa3f-a86dd1e8b034-kube-api-access-r2p6t\") pod \"cluster-monitoring-operator-64786d9cbb-2nscc\" (UID: \"55ac808a-57f8-4960-aa3f-a86dd1e8b034\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc" Jul 06 18:55:27.453257 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453053 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krjbk\" (UniqueName: \"kubernetes.io/projected/31a1816c-63a0-47a9-93fc-b76fda98725c-kube-api-access-krjbk\") pod \"service-ca-operator-5d46d9ffd4-vlffp\" (UID: \"31a1816c-63a0-47a9-93fc-b76fda98725c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vlffp" Jul 06 18:55:27.453257 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453081 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68ba2b4e-a36a-4b28-9485-bf70a371f48a-metrics-tls\") pod \"dns-default-kpxk9\" (UID: \"68ba2b4e-a36a-4b28-9485-bf70a371f48a\") " pod="openshift-dns/dns-default-kpxk9" Jul 06 18:55:27.453257 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453108 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jk48\" (UniqueName: \"kubernetes.io/projected/68ba2b4e-a36a-4b28-9485-bf70a371f48a-kube-api-access-7jk48\") pod \"dns-default-kpxk9\" (UID: \"68ba2b4e-a36a-4b28-9485-bf70a371f48a\") " pod="openshift-dns/dns-default-kpxk9" Jul 06 18:55:27.453257 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453197 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e2b0f1e-6d00-4ad8-a194-a4604a728b56-trusted-ca\") pod \"console-operator-68b757fb67-qsln6\" (UID: \"3e2b0f1e-6d00-4ad8-a194-a4604a728b56\") " pod="openshift-console-operator/console-operator-68b757fb67-qsln6" Jul 06 18:55:27.453257 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453239 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-metrics-certs\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:27.453488 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453268 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db1453d2-3908-419b-95af-f46d2ccfd011-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7f2wj\" (UID: \"db1453d2-3908-419b-95af-f46d2ccfd011\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7f2wj" Jul 06 18:55:27.453488 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453299 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e4f8630-04c0-411a-881f-514f0cd4c6d6-ca-trust-extracted\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.453488 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453304 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wd6t\" (UniqueName: \"kubernetes.io/projected/c2b88852-6092-4980-905d-8801e95abd38-kube-api-access-5wd6t\") pod \"insights-operator-5c847dcfc4-zcpj7\" (UID: \"c2b88852-6092-4980-905d-8801e95abd38\") " pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" Jul 06 18:55:27.453488 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453360 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e4f8630-04c0-411a-881f-514f0cd4c6d6-installation-pull-secrets\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.453488 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453383 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c2b88852-6092-4980-905d-8801e95abd38-snapshots\") pod \"insights-operator-5c847dcfc4-zcpj7\" (UID: \"c2b88852-6092-4980-905d-8801e95abd38\") " pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" Jul 06 18:55:27.453488 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453411 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/55ac808a-57f8-4960-aa3f-a86dd1e8b034-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-2nscc\" (UID: \"55ac808a-57f8-4960-aa3f-a86dd1e8b034\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc" Jul 06 18:55:27.453488 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453443 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7f6l\" (UniqueName: \"kubernetes.io/projected/74de0b59-0831-45cb-91be-776aaabedf5d-kube-api-access-m7f6l\") pod \"volume-data-source-validator-5d456fdbcd-888gm\" (UID: \"74de0b59-0831-45cb-91be-776aaabedf5d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-888gm" Jul 06 18:55:27.453830 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453508 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16edd98b-f15f-4300-b2b1-4da848b6d588-service-ca-bundle\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:27.453830 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453550 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-bound-sa-token\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.453830 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453581 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a645ee26-3516-4de3-99f2-603d7cb6914c-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-jh7tn\" (UID: \"a645ee26-3516-4de3-99f2-603d7cb6914c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jh7tn" Jul 06 18:55:27.453830 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453609 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj7nq\" (UniqueName: \"kubernetes.io/projected/db1453d2-3908-419b-95af-f46d2ccfd011-kube-api-access-jj7nq\") pod \"cluster-samples-operator-56fcf86bf-7f2wj\" (UID: \"db1453d2-3908-419b-95af-f46d2ccfd011\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7f2wj" Jul 06 18:55:27.453830 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453641 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-certificates\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.453830 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453667 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68ba2b4e-a36a-4b28-9485-bf70a371f48a-tmp-dir\") pod \"dns-default-kpxk9\" (UID: \"68ba2b4e-a36a-4b28-9485-bf70a371f48a\") " pod="openshift-dns/dns-default-kpxk9" Jul 06 18:55:27.453830 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453689 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2b88852-6092-4980-905d-8801e95abd38-tmp\") pod \"insights-operator-5c847dcfc4-zcpj7\" (UID: \"c2b88852-6092-4980-905d-8801e95abd38\") " pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" Jul 06 18:55:27.453830 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453723 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwrd2\" (UniqueName: \"kubernetes.io/projected/3e2b0f1e-6d00-4ad8-a194-a4604a728b56-kube-api-access-hwrd2\") pod \"console-operator-68b757fb67-qsln6\" (UID: \"3e2b0f1e-6d00-4ad8-a194-a4604a728b56\") " pod="openshift-console-operator/console-operator-68b757fb67-qsln6" Jul 06 18:55:27.453830 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453751 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-default-certificate\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:27.453830 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453776 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2b88852-6092-4980-905d-8801e95abd38-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-zcpj7\" (UID: \"c2b88852-6092-4980-905d-8801e95abd38\") " pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" Jul 06 18:55:27.453830 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453804 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96t2c\" (UniqueName: \"kubernetes.io/projected/fe134beb-34fb-4394-9365-d9ade5e9dd2a-kube-api-access-96t2c\") pod \"ingress-canary-rhd87\" (UID: \"fe134beb-34fb-4394-9365-d9ade5e9dd2a\") " pod="openshift-ingress-canary/ingress-canary-rhd87" Jul 06 18:55:27.453830 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453833 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/31a1816c-63a0-47a9-93fc-b76fda98725c-config\") pod \"service-ca-operator-5d46d9ffd4-vlffp\" (UID: \"31a1816c-63a0-47a9-93fc-b76fda98725c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vlffp" Jul 06 18:55:27.454380 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453863 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5twp\" (UniqueName: \"kubernetes.io/projected/16edd98b-f15f-4300-b2b1-4da848b6d588-kube-api-access-m5twp\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:27.454380 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453894 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e4f8630-04c0-411a-881f-514f0cd4c6d6-trusted-ca\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.454380 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453922 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2b88852-6092-4980-905d-8801e95abd38-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-zcpj7\" (UID: \"c2b88852-6092-4980-905d-8801e95abd38\") " pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" Jul 06 18:55:27.454380 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453948 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ldxs\" (UniqueName: \"kubernetes.io/projected/a645ee26-3516-4de3-99f2-603d7cb6914c-kube-api-access-4ldxs\") pod \"kube-storage-version-migrator-operator-846bf668f7-jh7tn\" (UID: \"a645ee26-3516-4de3-99f2-603d7cb6914c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jh7tn" Jul 06 18:55:27.454380 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.453985 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-stats-auth\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:27.454380 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.454015 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e2b0f1e-6d00-4ad8-a194-a4604a728b56-config\") pod \"console-operator-68b757fb67-qsln6\" (UID: \"3e2b0f1e-6d00-4ad8-a194-a4604a728b56\") " pod="openshift-console-operator/console-operator-68b757fb67-qsln6" Jul 06 18:55:27.454380 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.454064 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e4f8630-04c0-411a-881f-514f0cd4c6d6-image-registry-private-configuration\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.454380 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.454088 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68ba2b4e-a36a-4b28-9485-bf70a371f48a-config-volume\") pod \"dns-default-kpxk9\" (UID: \"68ba2b4e-a36a-4b28-9485-bf70a371f48a\") " pod="openshift-dns/dns-default-kpxk9" Jul 06 18:55:27.454380 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.454120 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.454380 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.454145 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/55ac808a-57f8-4960-aa3f-a86dd1e8b034-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2nscc\" (UID: \"55ac808a-57f8-4960-aa3f-a86dd1e8b034\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc" Jul 06 18:55:27.454380 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:27.454190 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 18:55:27.454380 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:27.454205 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db87cfddf-pjkbq: secret "image-registry-tls" not found Jul 06 18:55:27.454380 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:27.454255 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls podName:2e4f8630-04c0-411a-881f-514f0cd4c6d6 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:27.954240302 +0000 UTC m=+35.880674829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls") pod "image-registry-6db87cfddf-pjkbq" (UID: "2e4f8630-04c0-411a-881f-514f0cd4c6d6") : secret "image-registry-tls" not found Jul 06 18:55:27.454932 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.454620 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-certificates\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.455154 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.455129 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e4f8630-04c0-411a-881f-514f0cd4c6d6-trusted-ca\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.458945 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.458837 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e4f8630-04c0-411a-881f-514f0cd4c6d6-installation-pull-secrets\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.459059 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.458875 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e4f8630-04c0-411a-881f-514f0cd4c6d6-image-registry-private-configuration\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.466745 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.466714 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjpv4\" (UniqueName: \"kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-kube-api-access-tjpv4\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.467250 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.467224 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-bound-sa-token\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.468342 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.468320 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7f6l\" (UniqueName: \"kubernetes.io/projected/74de0b59-0831-45cb-91be-776aaabedf5d-kube-api-access-m7f6l\") pod \"volume-data-source-validator-5d456fdbcd-888gm\" (UID: \"74de0b59-0831-45cb-91be-776aaabedf5d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-888gm" Jul 06 18:55:27.512765 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.512709 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:27.554498 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.554463 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68ba2b4e-a36a-4b28-9485-bf70a371f48a-metrics-tls\") pod \"dns-default-kpxk9\" (UID: \"68ba2b4e-a36a-4b28-9485-bf70a371f48a\") " pod="openshift-dns/dns-default-kpxk9" Jul 06 18:55:27.554663 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.554503 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jk48\" (UniqueName: \"kubernetes.io/projected/68ba2b4e-a36a-4b28-9485-bf70a371f48a-kube-api-access-7jk48\") pod \"dns-default-kpxk9\" (UID: \"68ba2b4e-a36a-4b28-9485-bf70a371f48a\") " pod="openshift-dns/dns-default-kpxk9" Jul 06 18:55:27.554663 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.554539 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e2b0f1e-6d00-4ad8-a194-a4604a728b56-trusted-ca\") pod \"console-operator-68b757fb67-qsln6\" (UID: \"3e2b0f1e-6d00-4ad8-a194-a4604a728b56\") " pod="openshift-console-operator/console-operator-68b757fb67-qsln6" Jul 06 18:55:27.554663 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.554560 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-metrics-certs\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:27.554663 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.554590 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db1453d2-3908-419b-95af-f46d2ccfd011-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7f2wj\" (UID: \"db1453d2-3908-419b-95af-f46d2ccfd011\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7f2wj" Jul 06 18:55:27.554663 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.554613 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wd6t\" (UniqueName: \"kubernetes.io/projected/c2b88852-6092-4980-905d-8801e95abd38-kube-api-access-5wd6t\") pod \"insights-operator-5c847dcfc4-zcpj7\" (UID: \"c2b88852-6092-4980-905d-8801e95abd38\") " pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" Jul 06 18:55:27.554663 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.554638 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c2b88852-6092-4980-905d-8801e95abd38-snapshots\") pod \"insights-operator-5c847dcfc4-zcpj7\" (UID: \"c2b88852-6092-4980-905d-8801e95abd38\") " pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" Jul 06 18:55:27.554945 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:27.554663 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 18:55:27.554945 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:27.554719 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 18:55:27.554945 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:27.554739 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68ba2b4e-a36a-4b28-9485-bf70a371f48a-metrics-tls podName:68ba2b4e-a36a-4b28-9485-bf70a371f48a nodeName:}" failed. No retries permitted until 2026-07-06 18:55:28.054719341 +0000 UTC m=+35.981153883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68ba2b4e-a36a-4b28-9485-bf70a371f48a-metrics-tls") pod "dns-default-kpxk9" (UID: "68ba2b4e-a36a-4b28-9485-bf70a371f48a") : secret "dns-default-metrics-tls" not found Jul 06 18:55:27.554945 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.554667 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/55ac808a-57f8-4960-aa3f-a86dd1e8b034-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-2nscc\" (UID: \"55ac808a-57f8-4960-aa3f-a86dd1e8b034\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc" Jul 06 18:55:27.554945 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:27.554775 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-metrics-certs podName:16edd98b-f15f-4300-b2b1-4da848b6d588 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:28.054756933 +0000 UTC m=+35.981191464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-metrics-certs") pod "router-default-6dc846bc67-j8qgm" (UID: "16edd98b-f15f-4300-b2b1-4da848b6d588") : secret "router-metrics-certs-default" not found Jul 06 18:55:27.554945 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.554813 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16edd98b-f15f-4300-b2b1-4da848b6d588-service-ca-bundle\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:27.554945 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.554842 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a645ee26-3516-4de3-99f2-603d7cb6914c-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-jh7tn\" (UID: \"a645ee26-3516-4de3-99f2-603d7cb6914c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jh7tn" Jul 06 18:55:27.554945 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.554870 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj7nq\" (UniqueName: \"kubernetes.io/projected/db1453d2-3908-419b-95af-f46d2ccfd011-kube-api-access-jj7nq\") pod \"cluster-samples-operator-56fcf86bf-7f2wj\" (UID: \"db1453d2-3908-419b-95af-f46d2ccfd011\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7f2wj" Jul 06 18:55:27.554945 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.554900 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68ba2b4e-a36a-4b28-9485-bf70a371f48a-tmp-dir\") pod \"dns-default-kpxk9\" (UID: \"68ba2b4e-a36a-4b28-9485-bf70a371f48a\") " pod="openshift-dns/dns-default-kpxk9" Jul 06 18:55:27.554945 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.554923 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2b88852-6092-4980-905d-8801e95abd38-tmp\") pod \"insights-operator-5c847dcfc4-zcpj7\" (UID: \"c2b88852-6092-4980-905d-8801e95abd38\") " pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" Jul 06 18:55:27.555417 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.554955 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwrd2\" (UniqueName: \"kubernetes.io/projected/3e2b0f1e-6d00-4ad8-a194-a4604a728b56-kube-api-access-hwrd2\") pod \"console-operator-68b757fb67-qsln6\" (UID: \"3e2b0f1e-6d00-4ad8-a194-a4604a728b56\") " pod="openshift-console-operator/console-operator-68b757fb67-qsln6" Jul 06 18:55:27.555417 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:27.554967 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 18:55:27.555417 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.554982 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-default-certificate\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:27.555417 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.555008 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2b88852-6092-4980-905d-8801e95abd38-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-zcpj7\" (UID: \"c2b88852-6092-4980-905d-8801e95abd38\") " pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" Jul 06 18:55:27.555417 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:27.555029 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db1453d2-3908-419b-95af-f46d2ccfd011-samples-operator-tls podName:db1453d2-3908-419b-95af-f46d2ccfd011 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:28.05501322 +0000 UTC m=+35.981447770 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db1453d2-3908-419b-95af-f46d2ccfd011-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-7f2wj" (UID: "db1453d2-3908-419b-95af-f46d2ccfd011") : secret "samples-operator-tls" not found Jul 06 18:55:27.555417 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:27.555061 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16edd98b-f15f-4300-b2b1-4da848b6d588-service-ca-bundle podName:16edd98b-f15f-4300-b2b1-4da848b6d588 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:28.055051948 +0000 UTC m=+35.981486476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/16edd98b-f15f-4300-b2b1-4da848b6d588-service-ca-bundle") pod "router-default-6dc846bc67-j8qgm" (UID: "16edd98b-f15f-4300-b2b1-4da848b6d588") : configmap references non-existent config key: service-ca.crt Jul 06 18:55:27.555417 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.555092 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96t2c\" (UniqueName: \"kubernetes.io/projected/fe134beb-34fb-4394-9365-d9ade5e9dd2a-kube-api-access-96t2c\") pod \"ingress-canary-rhd87\" (UID: \"fe134beb-34fb-4394-9365-d9ade5e9dd2a\") " pod="openshift-ingress-canary/ingress-canary-rhd87" Jul 06 18:55:27.555417 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.555121 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/31a1816c-63a0-47a9-93fc-b76fda98725c-config\") pod \"service-ca-operator-5d46d9ffd4-vlffp\" (UID: \"31a1816c-63a0-47a9-93fc-b76fda98725c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vlffp" Jul 06 18:55:27.555417 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.555383 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/55ac808a-57f8-4960-aa3f-a86dd1e8b034-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-2nscc\" (UID: \"55ac808a-57f8-4960-aa3f-a86dd1e8b034\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc" Jul 06 18:55:27.555887 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.555530 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68ba2b4e-a36a-4b28-9485-bf70a371f48a-tmp-dir\") pod \"dns-default-kpxk9\" (UID: \"68ba2b4e-a36a-4b28-9485-bf70a371f48a\") " pod="openshift-dns/dns-default-kpxk9" Jul 06 18:55:27.555887 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.555568 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e2b0f1e-6d00-4ad8-a194-a4604a728b56-trusted-ca\") pod \"console-operator-68b757fb67-qsln6\" (UID: \"3e2b0f1e-6d00-4ad8-a194-a4604a728b56\") " pod="openshift-console-operator/console-operator-68b757fb67-qsln6" Jul 06 18:55:27.555887 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.555573 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c2b88852-6092-4980-905d-8801e95abd38-snapshots\") pod \"insights-operator-5c847dcfc4-zcpj7\" (UID: \"c2b88852-6092-4980-905d-8801e95abd38\") " pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" Jul 06 18:55:27.555887 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.555649 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2b88852-6092-4980-905d-8801e95abd38-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-zcpj7\" (UID: \"c2b88852-6092-4980-905d-8801e95abd38\") " pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" Jul 06 18:55:27.555887 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.555694 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5twp\" (UniqueName: \"kubernetes.io/projected/16edd98b-f15f-4300-b2b1-4da848b6d588-kube-api-access-m5twp\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:27.555887 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.555732 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2b88852-6092-4980-905d-8801e95abd38-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-zcpj7\" (UID: \"c2b88852-6092-4980-905d-8801e95abd38\") " pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" Jul 06 18:55:27.555887 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.555760 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/31a1816c-63a0-47a9-93fc-b76fda98725c-config\") pod \"service-ca-operator-5d46d9ffd4-vlffp\" (UID: \"31a1816c-63a0-47a9-93fc-b76fda98725c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vlffp" Jul 06 18:55:27.555887 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.555768 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ldxs\" (UniqueName: \"kubernetes.io/projected/a645ee26-3516-4de3-99f2-603d7cb6914c-kube-api-access-4ldxs\") pod \"kube-storage-version-migrator-operator-846bf668f7-jh7tn\" (UID: \"a645ee26-3516-4de3-99f2-603d7cb6914c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jh7tn" Jul 06 18:55:27.555887 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.555796 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-stats-auth\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:27.555887 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.555823 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e2b0f1e-6d00-4ad8-a194-a4604a728b56-config\") pod \"console-operator-68b757fb67-qsln6\" (UID: \"3e2b0f1e-6d00-4ad8-a194-a4604a728b56\") " pod="openshift-console-operator/console-operator-68b757fb67-qsln6" Jul 06 18:55:27.555887 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.555851 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2b88852-6092-4980-905d-8801e95abd38-tmp\") pod \"insights-operator-5c847dcfc4-zcpj7\" (UID: \"c2b88852-6092-4980-905d-8801e95abd38\") " pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" Jul 06 18:55:27.555887 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.555867 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68ba2b4e-a36a-4b28-9485-bf70a371f48a-config-volume\") pod \"dns-default-kpxk9\" (UID: \"68ba2b4e-a36a-4b28-9485-bf70a371f48a\") " pod="openshift-dns/dns-default-kpxk9" Jul 06 18:55:27.556530 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.555911 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/55ac808a-57f8-4960-aa3f-a86dd1e8b034-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2nscc\" (UID: \"55ac808a-57f8-4960-aa3f-a86dd1e8b034\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc" Jul 06 18:55:27.556530 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.555941 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/31a1816c-63a0-47a9-93fc-b76fda98725c-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-vlffp\" (UID: \"31a1816c-63a0-47a9-93fc-b76fda98725c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vlffp" Jul 06 18:55:27.556530 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.556441 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68ba2b4e-a36a-4b28-9485-bf70a371f48a-config-volume\") pod \"dns-default-kpxk9\" (UID: \"68ba2b4e-a36a-4b28-9485-bf70a371f48a\") " pod="openshift-dns/dns-default-kpxk9" Jul 06 18:55:27.556530 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.556507 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c2b88852-6092-4980-905d-8801e95abd38-serving-cert\") pod \"insights-operator-5c847dcfc4-zcpj7\" (UID: \"c2b88852-6092-4980-905d-8801e95abd38\") " pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" Jul 06 18:55:27.556718 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.556540 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2b88852-6092-4980-905d-8801e95abd38-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-zcpj7\" (UID: \"c2b88852-6092-4980-905d-8801e95abd38\") " pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" Jul 06 18:55:27.556718 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.556561 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99tvl\" (UniqueName: \"kubernetes.io/projected/cb67cfb2-0530-4e08-9207-bd56efc53129-kube-api-access-99tvl\") pod \"network-check-source-989f8b8dc-n4qsl\" (UID: \"cb67cfb2-0530-4e08-9207-bd56efc53129\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-n4qsl" Jul 06 18:55:27.556718 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.556595 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e2b0f1e-6d00-4ad8-a194-a4604a728b56-serving-cert\") pod \"console-operator-68b757fb67-qsln6\" (UID: \"3e2b0f1e-6d00-4ad8-a194-a4604a728b56\") " pod="openshift-console-operator/console-operator-68b757fb67-qsln6" Jul 06 18:55:27.556718 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.556620 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe134beb-34fb-4394-9365-d9ade5e9dd2a-cert\") pod \"ingress-canary-rhd87\" (UID: \"fe134beb-34fb-4394-9365-d9ade5e9dd2a\") " pod="openshift-ingress-canary/ingress-canary-rhd87" Jul 06 18:55:27.556718 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.556644 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a645ee26-3516-4de3-99f2-603d7cb6914c-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-jh7tn\" (UID: \"a645ee26-3516-4de3-99f2-603d7cb6914c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jh7tn" Jul 06 18:55:27.556718 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.556653 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e2b0f1e-6d00-4ad8-a194-a4604a728b56-config\") pod \"console-operator-68b757fb67-qsln6\" (UID: \"3e2b0f1e-6d00-4ad8-a194-a4604a728b56\") " pod="openshift-console-operator/console-operator-68b757fb67-qsln6" Jul 06 18:55:27.556718 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.556669 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2p6t\" (UniqueName: \"kubernetes.io/projected/55ac808a-57f8-4960-aa3f-a86dd1e8b034-kube-api-access-r2p6t\") pod \"cluster-monitoring-operator-64786d9cbb-2nscc\" (UID: \"55ac808a-57f8-4960-aa3f-a86dd1e8b034\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc" Jul 06 18:55:27.556718 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.556712 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krjbk\" (UniqueName: \"kubernetes.io/projected/31a1816c-63a0-47a9-93fc-b76fda98725c-kube-api-access-krjbk\") pod \"service-ca-operator-5d46d9ffd4-vlffp\" (UID: \"31a1816c-63a0-47a9-93fc-b76fda98725c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vlffp" Jul 06 18:55:27.557102 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:27.556757 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 18:55:27.557102 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:27.556831 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55ac808a-57f8-4960-aa3f-a86dd1e8b034-cluster-monitoring-operator-tls podName:55ac808a-57f8-4960-aa3f-a86dd1e8b034 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:28.056814104 +0000 UTC m=+35.983248649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/55ac808a-57f8-4960-aa3f-a86dd1e8b034-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2nscc" (UID: "55ac808a-57f8-4960-aa3f-a86dd1e8b034") : secret "cluster-monitoring-operator-tls" not found Jul 06 18:55:27.557586 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.557491 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a645ee26-3516-4de3-99f2-603d7cb6914c-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-jh7tn\" (UID: \"a645ee26-3516-4de3-99f2-603d7cb6914c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jh7tn" Jul 06 18:55:27.558651 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.558631 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/31a1816c-63a0-47a9-93fc-b76fda98725c-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-vlffp\" (UID: \"31a1816c-63a0-47a9-93fc-b76fda98725c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vlffp" Jul 06 18:55:27.558923 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.558902 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-default-certificate\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:27.559378 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.559358 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e2b0f1e-6d00-4ad8-a194-a4604a728b56-serving-cert\") pod \"console-operator-68b757fb67-qsln6\" (UID: \"3e2b0f1e-6d00-4ad8-a194-a4604a728b56\") " pod="openshift-console-operator/console-operator-68b757fb67-qsln6" Jul 06 18:55:27.559667 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.559618 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c2b88852-6092-4980-905d-8801e95abd38-serving-cert\") pod \"insights-operator-5c847dcfc4-zcpj7\" (UID: \"c2b88852-6092-4980-905d-8801e95abd38\") " pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" Jul 06 18:55:27.559865 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.559830 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe134beb-34fb-4394-9365-d9ade5e9dd2a-cert\") pod \"ingress-canary-rhd87\" (UID: \"fe134beb-34fb-4394-9365-d9ade5e9dd2a\") " pod="openshift-ingress-canary/ingress-canary-rhd87" Jul 06 18:55:27.560144 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.560124 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a645ee26-3516-4de3-99f2-603d7cb6914c-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-jh7tn\" (UID: \"a645ee26-3516-4de3-99f2-603d7cb6914c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jh7tn" Jul 06 18:55:27.560678 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.560207 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-stats-auth\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:27.565401 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.565296 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wd6t\" (UniqueName: \"kubernetes.io/projected/c2b88852-6092-4980-905d-8801e95abd38-kube-api-access-5wd6t\") pod \"insights-operator-5c847dcfc4-zcpj7\" (UID: \"c2b88852-6092-4980-905d-8801e95abd38\") " pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" Jul 06 18:55:27.565401 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.565317 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5twp\" (UniqueName: \"kubernetes.io/projected/16edd98b-f15f-4300-b2b1-4da848b6d588-kube-api-access-m5twp\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:27.567436 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.566784 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96t2c\" (UniqueName: \"kubernetes.io/projected/fe134beb-34fb-4394-9365-d9ade5e9dd2a-kube-api-access-96t2c\") pod \"ingress-canary-rhd87\" (UID: \"fe134beb-34fb-4394-9365-d9ade5e9dd2a\") " pod="openshift-ingress-canary/ingress-canary-rhd87" Jul 06 18:55:27.567436 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.567206 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ldxs\" (UniqueName: \"kubernetes.io/projected/a645ee26-3516-4de3-99f2-603d7cb6914c-kube-api-access-4ldxs\") pod \"kube-storage-version-migrator-operator-846bf668f7-jh7tn\" (UID: \"a645ee26-3516-4de3-99f2-603d7cb6914c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jh7tn" Jul 06 18:55:27.567436 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.567384 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jk48\" (UniqueName: \"kubernetes.io/projected/68ba2b4e-a36a-4b28-9485-bf70a371f48a-kube-api-access-7jk48\") pod \"dns-default-kpxk9\" (UID: \"68ba2b4e-a36a-4b28-9485-bf70a371f48a\") " pod="openshift-dns/dns-default-kpxk9" Jul 06 18:55:27.568333 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.567724 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj7nq\" (UniqueName: \"kubernetes.io/projected/db1453d2-3908-419b-95af-f46d2ccfd011-kube-api-access-jj7nq\") pod \"cluster-samples-operator-56fcf86bf-7f2wj\" (UID: \"db1453d2-3908-419b-95af-f46d2ccfd011\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7f2wj" Jul 06 18:55:27.568333 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.568085 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2p6t\" (UniqueName: \"kubernetes.io/projected/55ac808a-57f8-4960-aa3f-a86dd1e8b034-kube-api-access-r2p6t\") pod \"cluster-monitoring-operator-64786d9cbb-2nscc\" (UID: \"55ac808a-57f8-4960-aa3f-a86dd1e8b034\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc" Jul 06 18:55:27.568333 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.568134 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwrd2\" (UniqueName: \"kubernetes.io/projected/3e2b0f1e-6d00-4ad8-a194-a4604a728b56-kube-api-access-hwrd2\") pod \"console-operator-68b757fb67-qsln6\" (UID: \"3e2b0f1e-6d00-4ad8-a194-a4604a728b56\") " pod="openshift-console-operator/console-operator-68b757fb67-qsln6" Jul 06 18:55:27.569292 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.569242 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99tvl\" (UniqueName: \"kubernetes.io/projected/cb67cfb2-0530-4e08-9207-bd56efc53129-kube-api-access-99tvl\") pod \"network-check-source-989f8b8dc-n4qsl\" (UID: \"cb67cfb2-0530-4e08-9207-bd56efc53129\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-n4qsl" Jul 06 18:55:27.569585 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.569554 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:55:27.569806 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.569704 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krjbk\" (UniqueName: \"kubernetes.io/projected/31a1816c-63a0-47a9-93fc-b76fda98725c-kube-api-access-krjbk\") pod \"service-ca-operator-5d46d9ffd4-vlffp\" (UID: \"31a1816c-63a0-47a9-93fc-b76fda98725c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vlffp" Jul 06 18:55:27.569806 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.569799 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:55:27.570114 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.570083 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:55:27.572517 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.572498 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w7zz5\"" Jul 06 18:55:27.572666 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.572647 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 18:55:27.572750 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.572733 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gk8fr\"" Jul 06 18:55:27.572937 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.572922 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 18:55:27.579718 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.579701 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-888gm" Jul 06 18:55:27.590796 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.590777 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jh7tn" Jul 06 18:55:27.614121 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.614054 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vlffp" Jul 06 18:55:27.624021 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.624001 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-qsln6" Jul 06 18:55:27.639011 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.638992 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-n4qsl" Jul 06 18:55:27.647859 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.647838 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rhd87" Jul 06 18:55:27.663730 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.663711 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" Jul 06 18:55:27.960674 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:27.960640 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:27.960871 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:27.960810 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 18:55:27.960871 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:27.960831 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db87cfddf-pjkbq: secret "image-registry-tls" not found Jul 06 18:55:27.960980 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:27.960889 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls podName:2e4f8630-04c0-411a-881f-514f0cd4c6d6 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:28.960869671 +0000 UTC m=+36.887304202 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls") pod "image-registry-6db87cfddf-pjkbq" (UID: "2e4f8630-04c0-411a-881f-514f0cd4c6d6") : secret "image-registry-tls" not found Jul 06 18:55:28.061934 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:28.061894 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/55ac808a-57f8-4960-aa3f-a86dd1e8b034-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2nscc\" (UID: \"55ac808a-57f8-4960-aa3f-a86dd1e8b034\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc" Jul 06 18:55:28.062114 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:28.061966 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68ba2b4e-a36a-4b28-9485-bf70a371f48a-metrics-tls\") pod \"dns-default-kpxk9\" (UID: \"68ba2b4e-a36a-4b28-9485-bf70a371f48a\") " pod="openshift-dns/dns-default-kpxk9" Jul 06 18:55:28.062114 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:28.062003 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-metrics-certs\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:28.062114 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:28.062020 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db1453d2-3908-419b-95af-f46d2ccfd011-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7f2wj\" (UID: \"db1453d2-3908-419b-95af-f46d2ccfd011\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7f2wj" Jul 06 18:55:28.062114 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:28.062059 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16edd98b-f15f-4300-b2b1-4da848b6d588-service-ca-bundle\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:28.062114 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:28.062063 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 18:55:28.062362 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:28.062123 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 18:55:28.062362 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:28.062134 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 18:55:28.062362 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:28.062141 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55ac808a-57f8-4960-aa3f-a86dd1e8b034-cluster-monitoring-operator-tls podName:55ac808a-57f8-4960-aa3f-a86dd1e8b034 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:29.062119905 +0000 UTC m=+36.988554436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/55ac808a-57f8-4960-aa3f-a86dd1e8b034-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2nscc" (UID: "55ac808a-57f8-4960-aa3f-a86dd1e8b034") : secret "cluster-monitoring-operator-tls" not found Jul 06 18:55:28.062362 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:28.062145 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 18:55:28.062362 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:28.062173 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68ba2b4e-a36a-4b28-9485-bf70a371f48a-metrics-tls podName:68ba2b4e-a36a-4b28-9485-bf70a371f48a nodeName:}" failed. No retries permitted until 2026-07-06 18:55:29.062159838 +0000 UTC m=+36.988594380 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68ba2b4e-a36a-4b28-9485-bf70a371f48a-metrics-tls") pod "dns-default-kpxk9" (UID: "68ba2b4e-a36a-4b28-9485-bf70a371f48a") : secret "dns-default-metrics-tls" not found Jul 06 18:55:28.062362 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:28.062195 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-metrics-certs podName:16edd98b-f15f-4300-b2b1-4da848b6d588 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:29.062180965 +0000 UTC m=+36.988615501 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-metrics-certs") pod "router-default-6dc846bc67-j8qgm" (UID: "16edd98b-f15f-4300-b2b1-4da848b6d588") : secret "router-metrics-certs-default" not found Jul 06 18:55:28.062362 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:28.062214 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16edd98b-f15f-4300-b2b1-4da848b6d588-service-ca-bundle podName:16edd98b-f15f-4300-b2b1-4da848b6d588 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:29.062204976 +0000 UTC m=+36.988639503 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/16edd98b-f15f-4300-b2b1-4da848b6d588-service-ca-bundle") pod "router-default-6dc846bc67-j8qgm" (UID: "16edd98b-f15f-4300-b2b1-4da848b6d588") : configmap references non-existent config key: service-ca.crt Jul 06 18:55:28.062362 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:28.062235 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db1453d2-3908-419b-95af-f46d2ccfd011-samples-operator-tls podName:db1453d2-3908-419b-95af-f46d2ccfd011 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:29.062226797 +0000 UTC m=+36.988661329 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db1453d2-3908-419b-95af-f46d2ccfd011-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-7f2wj" (UID: "db1453d2-3908-419b-95af-f46d2ccfd011") : secret "samples-operator-tls" not found Jul 06 18:55:28.973157 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:28.971747 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:28.973157 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:28.971951 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 18:55:28.973157 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:28.971966 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db87cfddf-pjkbq: secret "image-registry-tls" not found Jul 06 18:55:28.973157 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:28.972029 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls podName:2e4f8630-04c0-411a-881f-514f0cd4c6d6 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:30.972007025 +0000 UTC m=+38.898441569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls") pod "image-registry-6db87cfddf-pjkbq" (UID: "2e4f8630-04c0-411a-881f-514f0cd4c6d6") : secret "image-registry-tls" not found Jul 06 18:55:29.073912 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:29.072257 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-metrics-certs\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:29.073912 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:29.072309 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db1453d2-3908-419b-95af-f46d2ccfd011-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7f2wj\" (UID: \"db1453d2-3908-419b-95af-f46d2ccfd011\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7f2wj" Jul 06 18:55:29.073912 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:29.072395 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16edd98b-f15f-4300-b2b1-4da848b6d588-service-ca-bundle\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:29.073912 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:29.072771 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/55ac808a-57f8-4960-aa3f-a86dd1e8b034-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2nscc\" (UID: \"55ac808a-57f8-4960-aa3f-a86dd1e8b034\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc" Jul 06 18:55:29.073912 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:29.072843 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68ba2b4e-a36a-4b28-9485-bf70a371f48a-metrics-tls\") pod \"dns-default-kpxk9\" (UID: \"68ba2b4e-a36a-4b28-9485-bf70a371f48a\") " pod="openshift-dns/dns-default-kpxk9" Jul 06 18:55:29.073912 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:29.072994 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 18:55:29.073912 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:29.073057 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68ba2b4e-a36a-4b28-9485-bf70a371f48a-metrics-tls podName:68ba2b4e-a36a-4b28-9485-bf70a371f48a nodeName:}" failed. No retries permitted until 2026-07-06 18:55:31.073038072 +0000 UTC m=+38.999472619 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68ba2b4e-a36a-4b28-9485-bf70a371f48a-metrics-tls") pod "dns-default-kpxk9" (UID: "68ba2b4e-a36a-4b28-9485-bf70a371f48a") : secret "dns-default-metrics-tls" not found Jul 06 18:55:29.073912 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:29.073553 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 18:55:29.073912 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:29.073606 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-metrics-certs podName:16edd98b-f15f-4300-b2b1-4da848b6d588 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:31.073589991 +0000 UTC m=+39.000024537 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-metrics-certs") pod "router-default-6dc846bc67-j8qgm" (UID: "16edd98b-f15f-4300-b2b1-4da848b6d588") : secret "router-metrics-certs-default" not found Jul 06 18:55:29.073912 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:29.073665 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 18:55:29.073912 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:29.073700 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db1453d2-3908-419b-95af-f46d2ccfd011-samples-operator-tls podName:db1453d2-3908-419b-95af-f46d2ccfd011 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:31.073688836 +0000 UTC m=+39.000123378 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db1453d2-3908-419b-95af-f46d2ccfd011-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-7f2wj" (UID: "db1453d2-3908-419b-95af-f46d2ccfd011") : secret "samples-operator-tls" not found Jul 06 18:55:29.073912 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:29.073764 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16edd98b-f15f-4300-b2b1-4da848b6d588-service-ca-bundle podName:16edd98b-f15f-4300-b2b1-4da848b6d588 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:31.07375357 +0000 UTC m=+39.000188112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/16edd98b-f15f-4300-b2b1-4da848b6d588-service-ca-bundle") pod "router-default-6dc846bc67-j8qgm" (UID: "16edd98b-f15f-4300-b2b1-4da848b6d588") : configmap references non-existent config key: service-ca.crt Jul 06 18:55:29.073912 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:29.073829 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 18:55:29.073912 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:29.073861 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55ac808a-57f8-4960-aa3f-a86dd1e8b034-cluster-monitoring-operator-tls podName:55ac808a-57f8-4960-aa3f-a86dd1e8b034 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:31.073850502 +0000 UTC m=+39.000285033 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/55ac808a-57f8-4960-aa3f-a86dd1e8b034-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2nscc" (UID: "55ac808a-57f8-4960-aa3f-a86dd1e8b034") : secret "cluster-monitoring-operator-tls" not found Jul 06 18:55:29.086415 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:29.086343 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jh7tn"] Jul 06 18:55:29.091992 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:29.091434 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rhd87"] Jul 06 18:55:29.093848 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:55:29.092856 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe134beb_34fb_4394_9365_d9ade5e9dd2a.slice/crio-c67c46609671cfc3bd3b0bf788a2eee1bcce1106ff3314c1e47c4ec6faa848f3 WatchSource:0}: Error finding container c67c46609671cfc3bd3b0bf788a2eee1bcce1106ff3314c1e47c4ec6faa848f3: Status 404 returned error can't find the container with id c67c46609671cfc3bd3b0bf788a2eee1bcce1106ff3314c1e47c4ec6faa848f3 Jul 06 18:55:29.100851 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:29.100794 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-qsln6"] Jul 06 18:55:29.103987 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:29.103901 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-zcpj7"] Jul 06 18:55:29.104724 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:55:29.104664 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e2b0f1e_6d00_4ad8_a194_a4604a728b56.slice/crio-dfdac1241ce89b0654601d3241e6b6434bde40c410b350d63cd671ee8e0adeff WatchSource:0}: Error finding container dfdac1241ce89b0654601d3241e6b6434bde40c410b350d63cd671ee8e0adeff: Status 404 returned error can't find the container with id dfdac1241ce89b0654601d3241e6b6434bde40c410b350d63cd671ee8e0adeff Jul 06 18:55:29.106997 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:55:29.106968 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b88852_6092_4980_905d_8801e95abd38.slice/crio-f469b717074218dd8ceff8ef580ad6f7b56fbac84564b9e45d2e7e008812e425 WatchSource:0}: Error finding container f469b717074218dd8ceff8ef580ad6f7b56fbac84564b9e45d2e7e008812e425: Status 404 returned error can't find the container with id f469b717074218dd8ceff8ef580ad6f7b56fbac84564b9e45d2e7e008812e425 Jul 06 18:55:29.115578 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:29.115555 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-888gm"] Jul 06 18:55:29.118490 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:29.118456 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vlffp"] Jul 06 18:55:29.119703 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:55:29.119679 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74de0b59_0831_45cb_91be_776aaabedf5d.slice/crio-3146cfdc1810e46bf3be53981155e67fa7d40b6c444951002357d40912faaa6e WatchSource:0}: Error finding container 3146cfdc1810e46bf3be53981155e67fa7d40b6c444951002357d40912faaa6e: Status 404 returned error can't find the container with id 3146cfdc1810e46bf3be53981155e67fa7d40b6c444951002357d40912faaa6e Jul 06 18:55:29.120915 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:55:29.120899 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a1816c_63a0_47a9_93fc_b76fda98725c.slice/crio-781a73dab718d225a8d733a1463c9a5aac8cf424721e03f1bd50c89efc8927d4 WatchSource:0}: Error finding container 781a73dab718d225a8d733a1463c9a5aac8cf424721e03f1bd50c89efc8927d4: Status 404 returned error can't find the container with id 781a73dab718d225a8d733a1463c9a5aac8cf424721e03f1bd50c89efc8927d4 Jul 06 18:55:29.125673 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:29.125616 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-n4qsl"] Jul 06 18:55:29.128822 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:55:29.128803 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb67cfb2_0530_4e08_9207_bd56efc53129.slice/crio-2adbd7ae9804cef6d4f8fd4055ce7a63d658c475b65ae9fb9fbf8abca4f8219b WatchSource:0}: Error finding container 2adbd7ae9804cef6d4f8fd4055ce7a63d658c475b65ae9fb9fbf8abca4f8219b: Status 404 returned error can't find the container with id 2adbd7ae9804cef6d4f8fd4055ce7a63d658c475b65ae9fb9fbf8abca4f8219b Jul 06 18:55:29.794620 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:29.794239 2567 generic.go:356] "Generic (PLEG): container finished" podID="93e145b9-cc69-47ba-8b68-cd22bc6668bd" containerID="f6456ebd307d7c20aab013746481d1a62f357892dfa5f3ba0dcb661441b49e2e" exitCode=0 Jul 06 18:55:29.794620 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:29.794559 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lqqtw" event={"ID":"93e145b9-cc69-47ba-8b68-cd22bc6668bd","Type":"ContainerDied","Data":"f6456ebd307d7c20aab013746481d1a62f357892dfa5f3ba0dcb661441b49e2e"} Jul 06 18:55:29.796681 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:29.796651 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" event={"ID":"c2b88852-6092-4980-905d-8801e95abd38","Type":"ContainerStarted","Data":"f469b717074218dd8ceff8ef580ad6f7b56fbac84564b9e45d2e7e008812e425"} Jul 06 18:55:29.799021 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:29.798776 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jh7tn" event={"ID":"a645ee26-3516-4de3-99f2-603d7cb6914c","Type":"ContainerStarted","Data":"263e6461cbf483d0bb95c59a7d8f5c7fdaccd76e7a4299952821afda7d97bfc9"} Jul 06 18:55:29.806244 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:29.806222 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-qsln6" event={"ID":"3e2b0f1e-6d00-4ad8-a194-a4604a728b56","Type":"ContainerStarted","Data":"dfdac1241ce89b0654601d3241e6b6434bde40c410b350d63cd671ee8e0adeff"} Jul 06 18:55:29.808991 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:29.808925 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-n4qsl" event={"ID":"cb67cfb2-0530-4e08-9207-bd56efc53129","Type":"ContainerStarted","Data":"2adbd7ae9804cef6d4f8fd4055ce7a63d658c475b65ae9fb9fbf8abca4f8219b"} Jul 06 18:55:29.811029 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:29.810974 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rhd87" event={"ID":"fe134beb-34fb-4394-9365-d9ade5e9dd2a","Type":"ContainerStarted","Data":"c67c46609671cfc3bd3b0bf788a2eee1bcce1106ff3314c1e47c4ec6faa848f3"} Jul 06 18:55:29.812628 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:29.812584 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vlffp" event={"ID":"31a1816c-63a0-47a9-93fc-b76fda98725c","Type":"ContainerStarted","Data":"781a73dab718d225a8d733a1463c9a5aac8cf424721e03f1bd50c89efc8927d4"} Jul 06 18:55:29.814420 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:29.814352 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-888gm" event={"ID":"74de0b59-0831-45cb-91be-776aaabedf5d","Type":"ContainerStarted","Data":"3146cfdc1810e46bf3be53981155e67fa7d40b6c444951002357d40912faaa6e"} Jul 06 18:55:30.829224 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:30.829184 2567 generic.go:356] "Generic (PLEG): container finished" podID="93e145b9-cc69-47ba-8b68-cd22bc6668bd" containerID="72a4c064b4009f804ed445c0f20f0a507b71d081c8dff1c18e91544d2c13980d" exitCode=0 Jul 06 18:55:30.829746 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:30.829264 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lqqtw" event={"ID":"93e145b9-cc69-47ba-8b68-cd22bc6668bd","Type":"ContainerDied","Data":"72a4c064b4009f804ed445c0f20f0a507b71d081c8dff1c18e91544d2c13980d"} Jul 06 18:55:30.992988 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:30.992948 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:30.993984 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:30.993961 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 18:55:30.993984 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:30.993986 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db87cfddf-pjkbq: secret "image-registry-tls" not found Jul 06 18:55:30.994147 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:30.994099 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls podName:2e4f8630-04c0-411a-881f-514f0cd4c6d6 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:34.99402389 +0000 UTC m=+42.920458422 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls") pod "image-registry-6db87cfddf-pjkbq" (UID: "2e4f8630-04c0-411a-881f-514f0cd4c6d6") : secret "image-registry-tls" not found Jul 06 18:55:31.094861 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:31.093657 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68ba2b4e-a36a-4b28-9485-bf70a371f48a-metrics-tls\") pod \"dns-default-kpxk9\" (UID: \"68ba2b4e-a36a-4b28-9485-bf70a371f48a\") " pod="openshift-dns/dns-default-kpxk9" Jul 06 18:55:31.094861 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:31.093730 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-metrics-certs\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:31.094861 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:31.093759 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db1453d2-3908-419b-95af-f46d2ccfd011-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7f2wj\" (UID: \"db1453d2-3908-419b-95af-f46d2ccfd011\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7f2wj" Jul 06 18:55:31.094861 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:31.093802 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16edd98b-f15f-4300-b2b1-4da848b6d588-service-ca-bundle\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:31.094861 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:31.093888 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/55ac808a-57f8-4960-aa3f-a86dd1e8b034-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2nscc\" (UID: \"55ac808a-57f8-4960-aa3f-a86dd1e8b034\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc" Jul 06 18:55:31.094861 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:31.094029 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 18:55:31.094861 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:31.094093 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55ac808a-57f8-4960-aa3f-a86dd1e8b034-cluster-monitoring-operator-tls podName:55ac808a-57f8-4960-aa3f-a86dd1e8b034 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:35.094076163 +0000 UTC m=+43.020510710 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/55ac808a-57f8-4960-aa3f-a86dd1e8b034-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2nscc" (UID: "55ac808a-57f8-4960-aa3f-a86dd1e8b034") : secret "cluster-monitoring-operator-tls" not found Jul 06 18:55:31.094861 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:31.094154 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 18:55:31.094861 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:31.094189 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68ba2b4e-a36a-4b28-9485-bf70a371f48a-metrics-tls podName:68ba2b4e-a36a-4b28-9485-bf70a371f48a nodeName:}" failed. No retries permitted until 2026-07-06 18:55:35.094177841 +0000 UTC m=+43.020612369 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68ba2b4e-a36a-4b28-9485-bf70a371f48a-metrics-tls") pod "dns-default-kpxk9" (UID: "68ba2b4e-a36a-4b28-9485-bf70a371f48a") : secret "dns-default-metrics-tls" not found Jul 06 18:55:31.094861 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:31.094246 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 18:55:31.094861 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:31.094277 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-metrics-certs podName:16edd98b-f15f-4300-b2b1-4da848b6d588 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:35.094267703 +0000 UTC m=+43.020702231 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-metrics-certs") pod "router-default-6dc846bc67-j8qgm" (UID: "16edd98b-f15f-4300-b2b1-4da848b6d588") : secret "router-metrics-certs-default" not found Jul 06 18:55:31.094861 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:31.094328 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 18:55:31.094861 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:31.094361 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db1453d2-3908-419b-95af-f46d2ccfd011-samples-operator-tls podName:db1453d2-3908-419b-95af-f46d2ccfd011 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:35.094351415 +0000 UTC m=+43.020785955 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db1453d2-3908-419b-95af-f46d2ccfd011-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-7f2wj" (UID: "db1453d2-3908-419b-95af-f46d2ccfd011") : secret "samples-operator-tls" not found Jul 06 18:55:31.094861 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:31.094428 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16edd98b-f15f-4300-b2b1-4da848b6d588-service-ca-bundle podName:16edd98b-f15f-4300-b2b1-4da848b6d588 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:35.094419117 +0000 UTC m=+43.020853663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/16edd98b-f15f-4300-b2b1-4da848b6d588-service-ca-bundle") pod "router-default-6dc846bc67-j8qgm" (UID: "16edd98b-f15f-4300-b2b1-4da848b6d588") : configmap references non-existent config key: service-ca.crt Jul 06 18:55:31.205743 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:31.205580 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:31.263983 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:31.263880 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:32.841389 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:32.841351 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:32.902724 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:32.902685 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:35.033094 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:35.033052 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:35.033534 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:35.033202 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 18:55:35.033534 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:35.033222 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db87cfddf-pjkbq: secret "image-registry-tls" not found Jul 06 18:55:35.033534 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:35.033285 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls podName:2e4f8630-04c0-411a-881f-514f0cd4c6d6 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:43.033269446 +0000 UTC m=+50.959703973 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls") pod "image-registry-6db87cfddf-pjkbq" (UID: "2e4f8630-04c0-411a-881f-514f0cd4c6d6") : secret "image-registry-tls" not found Jul 06 18:55:35.133703 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:35.133668 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/55ac808a-57f8-4960-aa3f-a86dd1e8b034-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2nscc\" (UID: \"55ac808a-57f8-4960-aa3f-a86dd1e8b034\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc" Jul 06 18:55:35.133918 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:35.133719 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68ba2b4e-a36a-4b28-9485-bf70a371f48a-metrics-tls\") pod \"dns-default-kpxk9\" (UID: \"68ba2b4e-a36a-4b28-9485-bf70a371f48a\") " pod="openshift-dns/dns-default-kpxk9" Jul 06 18:55:35.133918 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:35.133756 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-metrics-certs\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:35.133918 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:35.133775 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db1453d2-3908-419b-95af-f46d2ccfd011-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7f2wj\" (UID: \"db1453d2-3908-419b-95af-f46d2ccfd011\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7f2wj" Jul 06 18:55:35.133918 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:35.133801 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16edd98b-f15f-4300-b2b1-4da848b6d588-service-ca-bundle\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:35.133918 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:35.133841 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 18:55:35.134163 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:35.133930 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 18:55:35.134163 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:35.133938 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 18:55:35.134163 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:35.133932 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55ac808a-57f8-4960-aa3f-a86dd1e8b034-cluster-monitoring-operator-tls podName:55ac808a-57f8-4960-aa3f-a86dd1e8b034 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:43.133909748 +0000 UTC m=+51.060344300 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/55ac808a-57f8-4960-aa3f-a86dd1e8b034-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2nscc" (UID: "55ac808a-57f8-4960-aa3f-a86dd1e8b034") : secret "cluster-monitoring-operator-tls" not found Jul 06 18:55:35.134163 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:35.133975 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16edd98b-f15f-4300-b2b1-4da848b6d588-service-ca-bundle podName:16edd98b-f15f-4300-b2b1-4da848b6d588 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:43.133963633 +0000 UTC m=+51.060398161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/16edd98b-f15f-4300-b2b1-4da848b6d588-service-ca-bundle") pod "router-default-6dc846bc67-j8qgm" (UID: "16edd98b-f15f-4300-b2b1-4da848b6d588") : configmap references non-existent config key: service-ca.crt Jul 06 18:55:35.134163 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:35.133929 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 18:55:35.134163 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:35.133985 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-metrics-certs podName:16edd98b-f15f-4300-b2b1-4da848b6d588 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:43.133979737 +0000 UTC m=+51.060414264 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-metrics-certs") pod "router-default-6dc846bc67-j8qgm" (UID: "16edd98b-f15f-4300-b2b1-4da848b6d588") : secret "router-metrics-certs-default" not found Jul 06 18:55:35.134163 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:35.134025 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db1453d2-3908-419b-95af-f46d2ccfd011-samples-operator-tls podName:db1453d2-3908-419b-95af-f46d2ccfd011 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:43.134014502 +0000 UTC m=+51.060449029 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db1453d2-3908-419b-95af-f46d2ccfd011-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-7f2wj" (UID: "db1453d2-3908-419b-95af-f46d2ccfd011") : secret "samples-operator-tls" not found Jul 06 18:55:35.134163 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:35.134037 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68ba2b4e-a36a-4b28-9485-bf70a371f48a-metrics-tls podName:68ba2b4e-a36a-4b28-9485-bf70a371f48a nodeName:}" failed. No retries permitted until 2026-07-06 18:55:43.134030986 +0000 UTC m=+51.060465513 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68ba2b4e-a36a-4b28-9485-bf70a371f48a-metrics-tls") pod "dns-default-kpxk9" (UID: "68ba2b4e-a36a-4b28-9485-bf70a371f48a") : secret "dns-default-metrics-tls" not found Jul 06 18:55:36.748267 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:36.748196 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:36.846952 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:36.846919 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-888gm" event={"ID":"74de0b59-0831-45cb-91be-776aaabedf5d","Type":"ContainerStarted","Data":"7d98eb23a254c3920b479df0c2b83c1db00d482ed24bec9f8c0ba234e821c2af"} Jul 06 18:55:36.858735 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:36.858673 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lqqtw" event={"ID":"93e145b9-cc69-47ba-8b68-cd22bc6668bd","Type":"ContainerStarted","Data":"70665f07572494ecf7b70c74f5c725be056db04c4ac3120d769cda78be0260ef"} Jul 06 18:55:36.860406 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:36.860357 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jh7tn" event={"ID":"a645ee26-3516-4de3-99f2-603d7cb6914c","Type":"ContainerStarted","Data":"5b8fabb3ad39ff16a1b929116513148189fb55e1589f3b5db400b425549cafd7"} Jul 06 18:55:36.864751 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:36.864380 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-888gm" podStartSLOduration=12.437977558 podStartE2EDuration="19.86436284s" totalImagesPullingTime="7.426385282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:55:36.863452427 +0000 UTC m=+44.789886977" watchObservedRunningTime="2026-07-06 18:55:36.86436284 +0000 UTC m=+44.790797390" Jul 06 18:55:36.892750 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:36.889652 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lqqtw" podStartSLOduration=11.55281383 podStartE2EDuration="43.889627012s" totalImagesPullingTime="32.336813182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:54:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:55:36.888012654 +0000 UTC m=+44.814447204" watchObservedRunningTime="2026-07-06 18:55:36.889627012 +0000 UTC m=+44.816061562" Jul 06 18:55:36.910210 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:36.909385 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jh7tn" podStartSLOduration=12.411330815 podStartE2EDuration="19.909366119s" totalImagesPullingTime="7.498035304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:55:36.907011641 +0000 UTC m=+44.833446185" watchObservedRunningTime="2026-07-06 18:55:36.909366119 +0000 UTC m=+44.835800670" Jul 06 18:55:37.016263 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:37.016184 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:37.113551 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:37.113505 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:37.194235 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:37.194173 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:37.329879 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:37.329796 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:37.429901 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:37.429863 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:37.631160 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:37.631089 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:37.866949 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:37.866910 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" event={"ID":"c2b88852-6092-4980-905d-8801e95abd38","Type":"ContainerStarted","Data":"30e0a6f665e99a26f05663077ad50adb7ea51f1f5bf207dda7552d95e5642b71"} Jul 06 18:55:37.868706 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:37.868682 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/0.log" Jul 06 18:55:37.868826 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:37.868727 2567 generic.go:356] "Generic (PLEG): container finished" podID="3e2b0f1e-6d00-4ad8-a194-a4604a728b56" containerID="3cfb0251b012d0b5411e5da479a5c693cf699362dc8da69da66cb1786388d4be" exitCode=255 Jul 06 18:55:37.868826 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:37.868759 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-qsln6" event={"ID":"3e2b0f1e-6d00-4ad8-a194-a4604a728b56","Type":"ContainerDied","Data":"3cfb0251b012d0b5411e5da479a5c693cf699362dc8da69da66cb1786388d4be"} Jul 06 18:55:37.869025 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:37.869010 2567 scope.go:117] "RemoveContainer" containerID="3cfb0251b012d0b5411e5da479a5c693cf699362dc8da69da66cb1786388d4be" Jul 06 18:55:37.870620 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:37.870585 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-n4qsl" event={"ID":"cb67cfb2-0530-4e08-9207-bd56efc53129","Type":"ContainerStarted","Data":"24cb5fd37a117c3b64cff32b1b66ee8e11e80ad9db032d13b5433a8e86ef24d9"} Jul 06 18:55:37.872977 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:37.872960 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rhd87" event={"ID":"fe134beb-34fb-4394-9365-d9ade5e9dd2a","Type":"ContainerStarted","Data":"5e224d9de59fcee3e49a7b895680b5c5dec0017fef8abc66f3a517e95116d115"} Jul 06 18:55:37.874716 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:37.874696 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vlffp" event={"ID":"31a1816c-63a0-47a9-93fc-b76fda98725c","Type":"ContainerStarted","Data":"7dc27a0e7b78f0b3a4a5caba01f05c741e8a380f9e18a3c12d320d0181140ad2"} Jul 06 18:55:37.885513 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:37.885425 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" podStartSLOduration=13.401932558 podStartE2EDuration="20.885411763s" totalImagesPullingTime="7.483479205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:55:37.884665758 +0000 UTC m=+45.811100308" watchObservedRunningTime="2026-07-06 18:55:37.885411763 +0000 UTC m=+45.811846313" Jul 06 18:55:37.923234 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:37.923182 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vlffp" podStartSLOduration=13.452926671 podStartE2EDuration="20.923158723s" totalImagesPullingTime="7.470232052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:55:37.90270476 +0000 UTC m=+45.829139311" watchObservedRunningTime="2026-07-06 18:55:37.923158723 +0000 UTC m=+45.849593277" Jul 06 18:55:37.938712 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:37.938659 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-n4qsl" podStartSLOduration=13.246717884 podStartE2EDuration="20.938638578s" totalImagesPullingTime="7.691920694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:55:37.936505461 +0000 UTC m=+45.862940005" watchObservedRunningTime="2026-07-06 18:55:37.938638578 +0000 UTC m=+45.865073128" Jul 06 18:55:37.952748 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:37.952702 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rhd87" podStartSLOduration=3.448676564 podStartE2EDuration="10.952686181s" totalImagesPullingTime="7.504009617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:55:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:55:37.951436896 +0000 UTC m=+45.877871445" watchObservedRunningTime="2026-07-06 18:55:37.952686181 +0000 UTC m=+45.879120759" Jul 06 18:55:37.989026 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:37.987852 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2sx62"] Jul 06 18:55:38.008555 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.008526 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2sx62"] Jul 06 18:55:38.008855 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.008840 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:38.012022 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.011842 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tlz5r\"" Jul 06 18:55:38.012168 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.012142 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 18:55:38.012439 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.012420 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 18:55:38.061951 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.061914 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3662c723-7767-47c2-8aeb-d928b031d441-crio-socket\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:38.062125 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.062022 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wwtp\" (UniqueName: \"kubernetes.io/projected/3662c723-7767-47c2-8aeb-d928b031d441-kube-api-access-2wwtp\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:38.062125 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.062060 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3662c723-7767-47c2-8aeb-d928b031d441-data-volume\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:38.062239 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.062177 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3662c723-7767-47c2-8aeb-d928b031d441-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:38.062312 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.062259 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3662c723-7767-47c2-8aeb-d928b031d441-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:38.099577 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.099395 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:38.163351 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.163265 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3662c723-7767-47c2-8aeb-d928b031d441-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:38.163351 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.163330 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3662c723-7767-47c2-8aeb-d928b031d441-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:38.163579 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.163401 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3662c723-7767-47c2-8aeb-d928b031d441-crio-socket\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:38.163579 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:38.163404 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 18:55:38.163579 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:38.163504 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3662c723-7767-47c2-8aeb-d928b031d441-insights-runtime-extractor-tls podName:3662c723-7767-47c2-8aeb-d928b031d441 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:38.66345809 +0000 UTC m=+46.589892622 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3662c723-7767-47c2-8aeb-d928b031d441-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2sx62" (UID: "3662c723-7767-47c2-8aeb-d928b031d441") : secret "insights-runtime-extractor-tls" not found Jul 06 18:55:38.163579 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.163531 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wwtp\" (UniqueName: \"kubernetes.io/projected/3662c723-7767-47c2-8aeb-d928b031d441-kube-api-access-2wwtp\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:38.163579 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.163573 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3662c723-7767-47c2-8aeb-d928b031d441-data-volume\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:38.163827 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:38.163581 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 18:55:38.163827 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:38.163636 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3662c723-7767-47c2-8aeb-d928b031d441-kube-rbac-proxy-cm podName:3662c723-7767-47c2-8aeb-d928b031d441 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:38.663623136 +0000 UTC m=+46.590057663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3662c723-7767-47c2-8aeb-d928b031d441-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2sx62" (UID: "3662c723-7767-47c2-8aeb-d928b031d441") : configmap "kube-rbac-proxy" not found Jul 06 18:55:38.163827 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.163642 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3662c723-7767-47c2-8aeb-d928b031d441-crio-socket\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:38.163948 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.163918 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3662c723-7767-47c2-8aeb-d928b031d441-data-volume\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:38.180856 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.180830 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wwtp\" (UniqueName: \"kubernetes.io/projected/3662c723-7767-47c2-8aeb-d928b031d441-kube-api-access-2wwtp\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:38.249014 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.248974 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:38.319440 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.319404 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:38.531387 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.531342 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:38.631446 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.631411 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:38.669795 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.669763 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3662c723-7767-47c2-8aeb-d928b031d441-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:38.669928 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.669805 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3662c723-7767-47c2-8aeb-d928b031d441-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:38.669928 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:38.669872 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 18:55:38.669928 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:38.669909 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 18:55:38.669928 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:38.669920 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3662c723-7767-47c2-8aeb-d928b031d441-kube-rbac-proxy-cm podName:3662c723-7767-47c2-8aeb-d928b031d441 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:39.669907425 +0000 UTC m=+47.596341952 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3662c723-7767-47c2-8aeb-d928b031d441-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2sx62" (UID: "3662c723-7767-47c2-8aeb-d928b031d441") : configmap "kube-rbac-proxy" not found Jul 06 18:55:38.670064 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:38.669961 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3662c723-7767-47c2-8aeb-d928b031d441-insights-runtime-extractor-tls podName:3662c723-7767-47c2-8aeb-d928b031d441 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:39.669948037 +0000 UTC m=+47.596382565 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3662c723-7767-47c2-8aeb-d928b031d441-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2sx62" (UID: "3662c723-7767-47c2-8aeb-d928b031d441") : secret "insights-runtime-extractor-tls" not found Jul 06 18:55:38.871889 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.871805 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:38.879835 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.879815 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/1.log" Jul 06 18:55:38.880181 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.880167 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/0.log" Jul 06 18:55:38.880234 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.880199 2567 generic.go:356] "Generic (PLEG): container finished" podID="3e2b0f1e-6d00-4ad8-a194-a4604a728b56" containerID="614cb59a5cd6283d95cf581676e75173dc6e90fc414709daba2e04e7f76c2d9e" exitCode=255 Jul 06 18:55:38.880279 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.880253 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-qsln6" event={"ID":"3e2b0f1e-6d00-4ad8-a194-a4604a728b56","Type":"ContainerDied","Data":"614cb59a5cd6283d95cf581676e75173dc6e90fc414709daba2e04e7f76c2d9e"} Jul 06 18:55:38.880354 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.880341 2567 scope.go:117] "RemoveContainer" containerID="3cfb0251b012d0b5411e5da479a5c693cf699362dc8da69da66cb1786388d4be" Jul 06 18:55:38.880597 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.880578 2567 scope.go:117] "RemoveContainer" containerID="614cb59a5cd6283d95cf581676e75173dc6e90fc414709daba2e04e7f76c2d9e" Jul 06 18:55:38.880801 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:38.880767 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-qsln6_openshift-console-operator(3e2b0f1e-6d00-4ad8-a194-a4604a728b56)\"" pod="openshift-console-operator/console-operator-68b757fb67-qsln6" podUID="3e2b0f1e-6d00-4ad8-a194-a4604a728b56" Jul 06 18:55:38.972802 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:38.972772 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:39.599487 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:39.599445 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c58dn_91acad80-e6c9-4bf5-816c-a6b89d0b611e/dns-node-resolver/0.log" Jul 06 18:55:39.679003 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:39.678970 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3662c723-7767-47c2-8aeb-d928b031d441-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:39.679152 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:39.679016 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3662c723-7767-47c2-8aeb-d928b031d441-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:39.679152 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:39.679087 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 18:55:39.679152 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:39.679117 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 18:55:39.679253 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:39.679172 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3662c723-7767-47c2-8aeb-d928b031d441-insights-runtime-extractor-tls podName:3662c723-7767-47c2-8aeb-d928b031d441 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:41.679157542 +0000 UTC m=+49.605592068 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3662c723-7767-47c2-8aeb-d928b031d441-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2sx62" (UID: "3662c723-7767-47c2-8aeb-d928b031d441") : secret "insights-runtime-extractor-tls" not found Jul 06 18:55:39.679253 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:39.679185 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3662c723-7767-47c2-8aeb-d928b031d441-kube-rbac-proxy-cm podName:3662c723-7767-47c2-8aeb-d928b031d441 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:41.679179384 +0000 UTC m=+49.605613911 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3662c723-7767-47c2-8aeb-d928b031d441-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2sx62" (UID: "3662c723-7767-47c2-8aeb-d928b031d441") : configmap "kube-rbac-proxy" not found Jul 06 18:55:39.885174 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:39.885104 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/1.log" Jul 06 18:55:39.885551 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:39.885442 2567 scope.go:117] "RemoveContainer" containerID="614cb59a5cd6283d95cf581676e75173dc6e90fc414709daba2e04e7f76c2d9e" Jul 06 18:55:39.885643 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:39.885623 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-qsln6_openshift-console-operator(3e2b0f1e-6d00-4ad8-a194-a4604a728b56)\"" pod="openshift-console-operator/console-operator-68b757fb67-qsln6" podUID="3e2b0f1e-6d00-4ad8-a194-a4604a728b56" Jul 06 18:55:40.484643 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:40.484611 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:40.587314 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:40.587275 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:40.799150 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:40.799087 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zg5fq_7f7face8-df08-4e4c-afa4-e028aa2a95fe/node-ca/0.log" Jul 06 18:55:41.402772 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:41.402738 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rhd87_fe134beb-34fb-4394-9365-d9ade5e9dd2a/serve-healthcheck-canary/0.log" Jul 06 18:55:41.417685 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:41.417640 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" limit=1024 Jul 06 18:55:41.697006 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:41.696976 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3662c723-7767-47c2-8aeb-d928b031d441-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:41.697165 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:41.697032 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3662c723-7767-47c2-8aeb-d928b031d441-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:41.697165 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:41.697132 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 18:55:41.697230 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:41.697197 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3662c723-7767-47c2-8aeb-d928b031d441-insights-runtime-extractor-tls podName:3662c723-7767-47c2-8aeb-d928b031d441 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:45.697182406 +0000 UTC m=+53.623616934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3662c723-7767-47c2-8aeb-d928b031d441-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2sx62" (UID: "3662c723-7767-47c2-8aeb-d928b031d441") : secret "insights-runtime-extractor-tls" not found Jul 06 18:55:41.697230 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:41.697132 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 18:55:41.697310 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:41.697261 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3662c723-7767-47c2-8aeb-d928b031d441-kube-rbac-proxy-cm podName:3662c723-7767-47c2-8aeb-d928b031d441 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:45.697247779 +0000 UTC m=+53.623682318 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3662c723-7767-47c2-8aeb-d928b031d441-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2sx62" (UID: "3662c723-7767-47c2-8aeb-d928b031d441") : configmap "kube-rbac-proxy" not found Jul 06 18:55:43.109871 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:43.109834 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:43.110248 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:43.109959 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 18:55:43.110248 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:43.109971 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db87cfddf-pjkbq: secret "image-registry-tls" not found Jul 06 18:55:43.110248 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:43.110016 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls podName:2e4f8630-04c0-411a-881f-514f0cd4c6d6 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:59.110003024 +0000 UTC m=+67.036437551 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls") pod "image-registry-6db87cfddf-pjkbq" (UID: "2e4f8630-04c0-411a-881f-514f0cd4c6d6") : secret "image-registry-tls" not found Jul 06 18:55:43.210496 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:43.210441 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/55ac808a-57f8-4960-aa3f-a86dd1e8b034-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2nscc\" (UID: \"55ac808a-57f8-4960-aa3f-a86dd1e8b034\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc" Jul 06 18:55:43.210694 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:43.210526 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68ba2b4e-a36a-4b28-9485-bf70a371f48a-metrics-tls\") pod \"dns-default-kpxk9\" (UID: \"68ba2b4e-a36a-4b28-9485-bf70a371f48a\") " pod="openshift-dns/dns-default-kpxk9" Jul 06 18:55:43.210694 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:43.210557 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-metrics-certs\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:43.210694 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:43.210578 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db1453d2-3908-419b-95af-f46d2ccfd011-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7f2wj\" (UID: \"db1453d2-3908-419b-95af-f46d2ccfd011\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7f2wj" Jul 06 18:55:43.210694 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:43.210604 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 18:55:43.210694 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:43.210676 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 18:55:43.210694 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:43.210616 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16edd98b-f15f-4300-b2b1-4da848b6d588-service-ca-bundle\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:43.210694 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:43.210683 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 18:55:43.210954 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:43.210708 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 18:55:43.210954 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:43.210694 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55ac808a-57f8-4960-aa3f-a86dd1e8b034-cluster-monitoring-operator-tls podName:55ac808a-57f8-4960-aa3f-a86dd1e8b034 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:59.210672608 +0000 UTC m=+67.137107159 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/55ac808a-57f8-4960-aa3f-a86dd1e8b034-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2nscc" (UID: "55ac808a-57f8-4960-aa3f-a86dd1e8b034") : secret "cluster-monitoring-operator-tls" not found Jul 06 18:55:43.210954 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:43.210788 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16edd98b-f15f-4300-b2b1-4da848b6d588-service-ca-bundle podName:16edd98b-f15f-4300-b2b1-4da848b6d588 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:59.210774573 +0000 UTC m=+67.137209113 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/16edd98b-f15f-4300-b2b1-4da848b6d588-service-ca-bundle") pod "router-default-6dc846bc67-j8qgm" (UID: "16edd98b-f15f-4300-b2b1-4da848b6d588") : configmap references non-existent config key: service-ca.crt Jul 06 18:55:43.210954 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:43.210804 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68ba2b4e-a36a-4b28-9485-bf70a371f48a-metrics-tls podName:68ba2b4e-a36a-4b28-9485-bf70a371f48a nodeName:}" failed. No retries permitted until 2026-07-06 18:55:59.210794849 +0000 UTC m=+67.137229378 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68ba2b4e-a36a-4b28-9485-bf70a371f48a-metrics-tls") pod "dns-default-kpxk9" (UID: "68ba2b4e-a36a-4b28-9485-bf70a371f48a") : secret "dns-default-metrics-tls" not found Jul 06 18:55:43.210954 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:43.210818 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-metrics-certs podName:16edd98b-f15f-4300-b2b1-4da848b6d588 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:59.210810819 +0000 UTC m=+67.137245354 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-metrics-certs") pod "router-default-6dc846bc67-j8qgm" (UID: "16edd98b-f15f-4300-b2b1-4da848b6d588") : secret "router-metrics-certs-default" not found Jul 06 18:55:43.210954 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:43.210831 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db1453d2-3908-419b-95af-f46d2ccfd011-samples-operator-tls podName:db1453d2-3908-419b-95af-f46d2ccfd011 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:59.210824021 +0000 UTC m=+67.137258547 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db1453d2-3908-419b-95af-f46d2ccfd011-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-7f2wj" (UID: "db1453d2-3908-419b-95af-f46d2ccfd011") : secret "samples-operator-tls" not found Jul 06 18:55:45.734206 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:45.734171 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3662c723-7767-47c2-8aeb-d928b031d441-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:45.734724 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:45.734233 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3662c723-7767-47c2-8aeb-d928b031d441-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:45.734724 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:45.734339 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 18:55:45.734724 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:45.734420 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3662c723-7767-47c2-8aeb-d928b031d441-insights-runtime-extractor-tls podName:3662c723-7767-47c2-8aeb-d928b031d441 nodeName:}" failed. No retries permitted until 2026-07-06 18:55:53.734400985 +0000 UTC m=+61.660835512 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3662c723-7767-47c2-8aeb-d928b031d441-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2sx62" (UID: "3662c723-7767-47c2-8aeb-d928b031d441") : secret "insights-runtime-extractor-tls" not found Jul 06 18:55:45.734913 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:45.734895 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3662c723-7767-47c2-8aeb-d928b031d441-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:47.624854 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:47.624822 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-qsln6" Jul 06 18:55:47.624854 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:47.624866 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-qsln6" Jul 06 18:55:47.625330 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:47.625185 2567 scope.go:117] "RemoveContainer" containerID="614cb59a5cd6283d95cf581676e75173dc6e90fc414709daba2e04e7f76c2d9e" Jul 06 18:55:47.625375 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:55:47.625332 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-qsln6_openshift-console-operator(3e2b0f1e-6d00-4ad8-a194-a4604a728b56)\"" pod="openshift-console-operator/console-operator-68b757fb67-qsln6" podUID="3e2b0f1e-6d00-4ad8-a194-a4604a728b56" Jul 06 18:55:52.779187 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:52.779161 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hpztn" Jul 06 18:55:53.805507 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:53.805455 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3662c723-7767-47c2-8aeb-d928b031d441-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:53.807737 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:53.807718 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3662c723-7767-47c2-8aeb-d928b031d441-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2sx62\" (UID: \"3662c723-7767-47c2-8aeb-d928b031d441\") " pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:53.923788 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:53.923760 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tlz5r\"" Jul 06 18:55:53.932414 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:53.932393 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2sx62" Jul 06 18:55:54.056798 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:54.056713 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2sx62"] Jul 06 18:55:54.060346 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:55:54.060317 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3662c723_7767_47c2_8aeb_d928b031d441.slice/crio-f116830800ebb07cd5a5e9650ce5dd227ca8940863381749e019369a008d3780 WatchSource:0}: Error finding container f116830800ebb07cd5a5e9650ce5dd227ca8940863381749e019369a008d3780: Status 404 returned error can't find the container with id f116830800ebb07cd5a5e9650ce5dd227ca8940863381749e019369a008d3780 Jul 06 18:55:54.934515 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:54.934451 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2sx62" event={"ID":"3662c723-7767-47c2-8aeb-d928b031d441","Type":"ContainerStarted","Data":"f116830800ebb07cd5a5e9650ce5dd227ca8940863381749e019369a008d3780"} Jul 06 18:55:57.237957 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:57.237919 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret\") pod \"global-pull-secret-syncer-s8pd7\" (UID: \"e1283903-625e-49c4-a176-83b147859bd7\") " pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:55:57.240834 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:57.240807 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 18:55:57.251391 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:57.251370 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1283903-625e-49c4-a176-83b147859bd7-original-pull-secret\") pod \"global-pull-secret-syncer-s8pd7\" (UID: \"e1283903-625e-49c4-a176-83b147859bd7\") " pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:55:57.283640 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:57.283615 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8pd7" Jul 06 18:55:57.339431 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:57.339398 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs\") pod \"network-metrics-daemon-h9gnx\" (UID: \"d8841ac5-94d5-4604-9576-0ea7bd6c3750\") " pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:55:57.339657 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:57.339638 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6brk\" (UniqueName: \"kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk\") pod \"network-check-target-d94p2\" (UID: \"e5fa32e0-5190-4738-b813-732443056605\") " pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:55:57.342023 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:57.342000 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 18:55:57.342380 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:57.342361 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6brk\" (UniqueName: \"kubernetes.io/projected/e5fa32e0-5190-4738-b813-732443056605-kube-api-access-l6brk\") pod \"network-check-target-d94p2\" (UID: \"e5fa32e0-5190-4738-b813-732443056605\") " pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:55:57.352196 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:57.352172 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8841ac5-94d5-4604-9576-0ea7bd6c3750-metrics-certs\") pod \"network-metrics-daemon-h9gnx\" (UID: \"d8841ac5-94d5-4604-9576-0ea7bd6c3750\") " pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:55:57.593698 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:57.593589 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gk8fr\"" Jul 06 18:55:57.598870 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:57.598845 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w7zz5\"" Jul 06 18:55:57.601756 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:57.601732 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:55:57.606853 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:57.606820 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9gnx" Jul 06 18:55:57.769816 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:57.769643 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s8pd7"] Jul 06 18:55:57.772951 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:55:57.772923 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1283903_625e_49c4_a176_83b147859bd7.slice/crio-137d9fd6db0eeadbb6f8e2589606fbbf36c3418f34b2b9842e8c2e1bb7062386 WatchSource:0}: Error finding container 137d9fd6db0eeadbb6f8e2589606fbbf36c3418f34b2b9842e8c2e1bb7062386: Status 404 returned error can't find the container with id 137d9fd6db0eeadbb6f8e2589606fbbf36c3418f34b2b9842e8c2e1bb7062386 Jul 06 18:55:57.946354 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:57.946327 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2sx62" event={"ID":"3662c723-7767-47c2-8aeb-d928b031d441","Type":"ContainerStarted","Data":"0a1ddbd06dc9c96afa76a27fb6d5fe4e06c174da32b5c349b727507227f13832"} Jul 06 18:55:57.947359 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:57.947336 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s8pd7" event={"ID":"e1283903-625e-49c4-a176-83b147859bd7","Type":"ContainerStarted","Data":"137d9fd6db0eeadbb6f8e2589606fbbf36c3418f34b2b9842e8c2e1bb7062386"} Jul 06 18:55:57.993883 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:57.993857 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d94p2"] Jul 06 18:55:57.996677 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:55:57.996651 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5fa32e0_5190_4738_b813_732443056605.slice/crio-07c351a8a976890fd366d9619ba3225d0de9dc78f04bf5841ca431e0c35d6ecd WatchSource:0}: Error finding container 07c351a8a976890fd366d9619ba3225d0de9dc78f04bf5841ca431e0c35d6ecd: Status 404 returned error can't find the container with id 07c351a8a976890fd366d9619ba3225d0de9dc78f04bf5841ca431e0c35d6ecd Jul 06 18:55:57.997003 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:57.996984 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h9gnx"] Jul 06 18:55:57.999509 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:55:57.999469 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8841ac5_94d5_4604_9576_0ea7bd6c3750.slice/crio-91052243cc21f0414b29c6267ddea2312ea767213b13d5bbbe7a4fc43b35efbe WatchSource:0}: Error finding container 91052243cc21f0414b29c6267ddea2312ea767213b13d5bbbe7a4fc43b35efbe: Status 404 returned error can't find the container with id 91052243cc21f0414b29c6267ddea2312ea767213b13d5bbbe7a4fc43b35efbe Jul 06 18:55:58.955493 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:58.955425 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2sx62" event={"ID":"3662c723-7767-47c2-8aeb-d928b031d441","Type":"ContainerStarted","Data":"e78625fd9f3ad37d9f33a399be3d2412f58d903a93140ecc868491d4c7487e81"} Jul 06 18:55:58.957135 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:58.957107 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h9gnx" event={"ID":"d8841ac5-94d5-4604-9576-0ea7bd6c3750","Type":"ContainerStarted","Data":"91052243cc21f0414b29c6267ddea2312ea767213b13d5bbbe7a4fc43b35efbe"} Jul 06 18:55:58.959761 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:58.959200 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d94p2" event={"ID":"e5fa32e0-5190-4738-b813-732443056605","Type":"ContainerStarted","Data":"6e002887190c5839833d5bf77d26c4ab2caec8cfb14b1fa7a7c7c02ee7756733"} Jul 06 18:55:58.959761 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:58.959247 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d94p2" event={"ID":"e5fa32e0-5190-4738-b813-732443056605","Type":"ContainerStarted","Data":"07c351a8a976890fd366d9619ba3225d0de9dc78f04bf5841ca431e0c35d6ecd"} Jul 06 18:55:58.959761 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:58.959616 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:55:58.981308 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:58.980878 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-d94p2" podStartSLOduration=65.980855702 podStartE2EDuration="1m5.980855702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:54:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:55:58.980090524 +0000 UTC m=+66.906525076" watchObservedRunningTime="2026-07-06 18:55:58.980855702 +0000 UTC m=+66.907290252" Jul 06 18:55:59.156068 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.155646 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:59.159322 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.159289 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls\") pod \"image-registry-6db87cfddf-pjkbq\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:59.257055 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.257020 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68ba2b4e-a36a-4b28-9485-bf70a371f48a-metrics-tls\") pod \"dns-default-kpxk9\" (UID: \"68ba2b4e-a36a-4b28-9485-bf70a371f48a\") " pod="openshift-dns/dns-default-kpxk9" Jul 06 18:55:59.257200 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.257076 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-metrics-certs\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:59.257200 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.257105 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db1453d2-3908-419b-95af-f46d2ccfd011-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7f2wj\" (UID: \"db1453d2-3908-419b-95af-f46d2ccfd011\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7f2wj" Jul 06 18:55:59.257200 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.257148 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16edd98b-f15f-4300-b2b1-4da848b6d588-service-ca-bundle\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:59.257367 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.257213 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/55ac808a-57f8-4960-aa3f-a86dd1e8b034-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2nscc\" (UID: \"55ac808a-57f8-4960-aa3f-a86dd1e8b034\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc" Jul 06 18:55:59.258551 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.258499 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16edd98b-f15f-4300-b2b1-4da848b6d588-service-ca-bundle\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:59.259814 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.259784 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68ba2b4e-a36a-4b28-9485-bf70a371f48a-metrics-tls\") pod \"dns-default-kpxk9\" (UID: \"68ba2b4e-a36a-4b28-9485-bf70a371f48a\") " pod="openshift-dns/dns-default-kpxk9" Jul 06 18:55:59.260493 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.260429 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16edd98b-f15f-4300-b2b1-4da848b6d588-metrics-certs\") pod \"router-default-6dc846bc67-j8qgm\" (UID: \"16edd98b-f15f-4300-b2b1-4da848b6d588\") " pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:59.260595 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.260513 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/55ac808a-57f8-4960-aa3f-a86dd1e8b034-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2nscc\" (UID: \"55ac808a-57f8-4960-aa3f-a86dd1e8b034\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc" Jul 06 18:55:59.262001 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.261974 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db1453d2-3908-419b-95af-f46d2ccfd011-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7f2wj\" (UID: \"db1453d2-3908-419b-95af-f46d2ccfd011\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7f2wj" Jul 06 18:55:59.360268 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.360104 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-48zcw\"" Jul 06 18:55:59.368239 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.368128 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:59.404123 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.404016 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4rjh\"" Jul 06 18:55:59.412809 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.412625 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kpxk9" Jul 06 18:55:59.433509 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.433396 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6n5hj\"" Jul 06 18:55:59.441781 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.441760 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc" Jul 06 18:55:59.465069 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.464830 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-x7rtr\"" Jul 06 18:55:59.468266 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.468240 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:55:59.473151 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.473128 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zlnnt\"" Jul 06 18:55:59.481742 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.481677 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7f2wj" Jul 06 18:55:59.564370 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.562118 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6db87cfddf-pjkbq"] Jul 06 18:55:59.567778 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:55:59.567745 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e4f8630_04c0_411a_881f_514f0cd4c6d6.slice/crio-aa34dd19326ce4af3e7b22b761e2a337bf16b7aab15517d6065bf1ed0dcfa42a WatchSource:0}: Error finding container aa34dd19326ce4af3e7b22b761e2a337bf16b7aab15517d6065bf1ed0dcfa42a: Status 404 returned error can't find the container with id aa34dd19326ce4af3e7b22b761e2a337bf16b7aab15517d6065bf1ed0dcfa42a Jul 06 18:55:59.570736 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.570330 2567 scope.go:117] "RemoveContainer" containerID="614cb59a5cd6283d95cf581676e75173dc6e90fc414709daba2e04e7f76c2d9e" Jul 06 18:55:59.626855 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.623926 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kpxk9"] Jul 06 18:55:59.656357 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.656250 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc"] Jul 06 18:55:59.693841 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.693773 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6dc846bc67-j8qgm"] Jul 06 18:55:59.700235 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:55:59.700207 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16edd98b_f15f_4300_b2b1_4da848b6d588.slice/crio-1e5d20fd4d44d026b1f1c67a37a22b80cf2ee03246f622c453b944dfb14571da WatchSource:0}: Error finding container 1e5d20fd4d44d026b1f1c67a37a22b80cf2ee03246f622c453b944dfb14571da: Status 404 returned error can't find the container with id 1e5d20fd4d44d026b1f1c67a37a22b80cf2ee03246f622c453b944dfb14571da Jul 06 18:55:59.718090 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.718015 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7f2wj"] Jul 06 18:55:59.969190 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.969106 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/1.log" Jul 06 18:55:59.969587 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.969212 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-qsln6" event={"ID":"3e2b0f1e-6d00-4ad8-a194-a4604a728b56","Type":"ContainerStarted","Data":"52cf7fcb24a39e74329f9ccec8457f3e8feaf34bcc71228d26a81ab53662f971"} Jul 06 18:55:59.970385 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.970185 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-qsln6" Jul 06 18:55:59.972885 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.972830 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc" event={"ID":"55ac808a-57f8-4960-aa3f-a86dd1e8b034","Type":"ContainerStarted","Data":"6dc62c91dd345e2547b7542ad6b915e597e4fadc7414874d301bdc9400255d3a"} Jul 06 18:55:59.978430 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.977839 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" event={"ID":"2e4f8630-04c0-411a-881f-514f0cd4c6d6","Type":"ContainerStarted","Data":"6251449e766fb467ad772d86e70001823d3e185be2b27c9ccac9cd30c772d7ec"} Jul 06 18:55:59.978430 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.977888 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" event={"ID":"2e4f8630-04c0-411a-881f-514f0cd4c6d6","Type":"ContainerStarted","Data":"aa34dd19326ce4af3e7b22b761e2a337bf16b7aab15517d6065bf1ed0dcfa42a"} Jul 06 18:55:59.978430 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.978386 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:55:59.980794 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.980774 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h9gnx" event={"ID":"d8841ac5-94d5-4604-9576-0ea7bd6c3750","Type":"ContainerStarted","Data":"d2c13503d33dc2cd1587ec4727cfce8b978fedcc52dd4eaa8072edc06e91cc2e"} Jul 06 18:55:59.980892 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.980811 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h9gnx" event={"ID":"d8841ac5-94d5-4604-9576-0ea7bd6c3750","Type":"ContainerStarted","Data":"b78865367f7725dc11c10c5a3346b4069306d0170542155c8565c69588c25908"} Jul 06 18:55:59.982172 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.982113 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7f2wj" event={"ID":"db1453d2-3908-419b-95af-f46d2ccfd011","Type":"ContainerStarted","Data":"83e46c4a26189546b5662a109c40a718f86dc48e33e6ca4a0ad4f23a71138797"} Jul 06 18:55:59.984111 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.983935 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6dc846bc67-j8qgm" event={"ID":"16edd98b-f15f-4300-b2b1-4da848b6d588","Type":"ContainerStarted","Data":"18db63b3d9d34cee0d309d6dd2288629f952706612d9591825ba9cf2eeebe44d"} Jul 06 18:55:59.984111 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.983978 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6dc846bc67-j8qgm" event={"ID":"16edd98b-f15f-4300-b2b1-4da848b6d588","Type":"ContainerStarted","Data":"1e5d20fd4d44d026b1f1c67a37a22b80cf2ee03246f622c453b944dfb14571da"} Jul 06 18:55:59.985957 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.985936 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kpxk9" event={"ID":"68ba2b4e-a36a-4b28-9485-bf70a371f48a","Type":"ContainerStarted","Data":"7bd4a55a54e21c378ad748b06576e516222e397c67bbc0d352936b299069367c"} Jul 06 18:55:59.989578 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:55:59.989308 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-qsln6" podStartSLOduration=35.504024786 podStartE2EDuration="42.989290923s" totalImagesPullingTime="7.485266137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:55:59.987739551 +0000 UTC m=+67.914174113" watchObservedRunningTime="2026-07-06 18:55:59.989290923 +0000 UTC m=+67.915725472" Jul 06 18:56:00.025254 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:00.024538 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6dc846bc67-j8qgm" podStartSLOduration=43.024514121 podStartE2EDuration="43.024514121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:55:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:56:00.006856432 +0000 UTC m=+67.933290982" watchObservedRunningTime="2026-07-06 18:56:00.024514121 +0000 UTC m=+67.950948670" Jul 06 18:56:00.046215 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:00.044934 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-h9gnx" podStartSLOduration=65.898971959 podStartE2EDuration="1m7.044914623s" totalImagesPullingTime="1.145942664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:56:00.025094035 +0000 UTC m=+67.951528584" watchObservedRunningTime="2026-07-06 18:56:00.044914623 +0000 UTC m=+67.971349173" Jul 06 18:56:00.046215 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:00.045824 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" podStartSLOduration=67.045811792 podStartE2EDuration="1m7.045811792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:54:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:56:00.044214975 +0000 UTC m=+67.970649529" watchObservedRunningTime="2026-07-06 18:56:00.045811792 +0000 UTC m=+67.972246343" Jul 06 18:56:00.469571 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:00.469522 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:56:00.473262 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:00.473050 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:56:00.970498 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:00.970092 2567 patch_prober.go:28] interesting pod/console-operator-68b757fb67-qsln6 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.15:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 06 18:56:00.970498 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:00.970158 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-qsln6" podUID="3e2b0f1e-6d00-4ad8-a194-a4604a728b56" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.15:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Jul 06 18:56:00.997889 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:00.997857 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:56:00.999640 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:00.999430 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6dc846bc67-j8qgm" Jul 06 18:56:01.998161 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:01.998121 2567 patch_prober.go:28] interesting pod/console-operator-68b757fb67-qsln6 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.15:8443/readyz\": context deadline exceeded" start-of-body= Jul 06 18:56:01.998623 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:01.998187 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-qsln6" podUID="3e2b0f1e-6d00-4ad8-a194-a4604a728b56" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.15:8443/readyz\": context deadline exceeded" Jul 06 18:56:05.016532 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.016488 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7f2wj" event={"ID":"db1453d2-3908-419b-95af-f46d2ccfd011","Type":"ContainerStarted","Data":"7a0f4d4a7289dec14b8659a0f2c6fc4333be409c5191c2a6de2bf9c5805e25f5"} Jul 06 18:56:05.017006 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.016563 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7f2wj" event={"ID":"db1453d2-3908-419b-95af-f46d2ccfd011","Type":"ContainerStarted","Data":"27ef31c10b26902a631ea9e6ef8b11f4d318c5f3eb39869b0406e5d98bdb279a"} Jul 06 18:56:05.019017 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.018994 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2sx62" event={"ID":"3662c723-7767-47c2-8aeb-d928b031d441","Type":"ContainerStarted","Data":"e1db752b020a8f3d4fd77c505a0c177ddac5f6dc747c855ac88847ea91835fd5"} Jul 06 18:56:05.021077 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.021048 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kpxk9" event={"ID":"68ba2b4e-a36a-4b28-9485-bf70a371f48a","Type":"ContainerStarted","Data":"081b1904485dac043d81e0e819ae8451e8a753385e108ff9b21bf3539cab2f9b"} Jul 06 18:56:05.021188 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.021100 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kpxk9" event={"ID":"68ba2b4e-a36a-4b28-9485-bf70a371f48a","Type":"ContainerStarted","Data":"86af25d50dfe1decbd50bec2ff44e8473d94baa49d40d669d17111c03d72ff1b"} Jul 06 18:56:05.021188 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.021130 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kpxk9" Jul 06 18:56:05.022796 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.022761 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s8pd7" event={"ID":"e1283903-625e-49c4-a176-83b147859bd7","Type":"ContainerStarted","Data":"b5bd0c8d3503819cb1c53fa59b4d6b9cdf1b881364c670604601a4388faf1409"} Jul 06 18:56:05.024498 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.024443 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc" event={"ID":"55ac808a-57f8-4960-aa3f-a86dd1e8b034","Type":"ContainerStarted","Data":"06d041b404b316e6985301b1f0ca6e20a27eff7f4a29b381cb7d2635e43ac54a"} Jul 06 18:56:05.041389 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.041349 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7f2wj" podStartSLOduration=43.124388729 podStartE2EDuration="48.041326978s" totalImagesPullingTime="4.916938249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:56:05.040979587 +0000 UTC m=+72.967414166" watchObservedRunningTime="2026-07-06 18:56:05.041326978 +0000 UTC m=+72.967761530" Jul 06 18:56:05.061955 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.061260 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kpxk9" podStartSLOduration=33.056578489 podStartE2EDuration="38.061242647s" totalImagesPullingTime="5.004664158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:55:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:56:05.060121852 +0000 UTC m=+72.986556402" watchObservedRunningTime="2026-07-06 18:56:05.061242647 +0000 UTC m=+72.987677197" Jul 06 18:56:05.098560 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.098512 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2nscc" podStartSLOduration=43.117346263 podStartE2EDuration="48.098498493s" totalImagesPullingTime="4.98115223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:56:05.097733145 +0000 UTC m=+73.024167693" watchObservedRunningTime="2026-07-06 18:56:05.098498493 +0000 UTC m=+73.024933033" Jul 06 18:56:05.098690 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.098632 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s8pd7" podStartSLOduration=65.223343657 podStartE2EDuration="1m12.098626628s" totalImagesPullingTime="6.875282971s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:56:05.080201091 +0000 UTC m=+73.006635641" watchObservedRunningTime="2026-07-06 18:56:05.098626628 +0000 UTC m=+73.025061179" Jul 06 18:56:05.116541 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.116503 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2sx62" podStartSLOduration=17.656163214 podStartE2EDuration="28.116464154s" totalImagesPullingTime="10.46030094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:55:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:56:05.115683297 +0000 UTC m=+73.042117847" watchObservedRunningTime="2026-07-06 18:56:05.116464154 +0000 UTC m=+73.042898704" Jul 06 18:56:05.716330 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.716296 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kss42"] Jul 06 18:56:05.721435 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.721413 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kss42" Jul 06 18:56:05.725039 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.724989 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-8jh5g\"" Jul 06 18:56:05.725309 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.725293 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 18:56:05.726722 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.726699 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-59zcr"] Jul 06 18:56:05.730003 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.729981 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-59zcr" Jul 06 18:56:05.743713 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.743685 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kss42"] Jul 06 18:56:05.744294 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.744276 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 18:56:05.744383 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.744285 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 18:56:05.744383 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.744338 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-dz2w5\"" Jul 06 18:56:05.788051 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.787981 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-59zcr"] Jul 06 18:56:05.819635 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.819598 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c0eb13d0-1064-4703-a575-71649e01a93e-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-kss42\" (UID: \"c0eb13d0-1064-4703-a575-71649e01a93e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kss42" Jul 06 18:56:05.819794 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.819650 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-264np\" (UniqueName: \"kubernetes.io/projected/901fa5ce-e25c-4616-926d-d7b0aa724797-kube-api-access-264np\") pod \"downloads-685bfb5f64-59zcr\" (UID: \"901fa5ce-e25c-4616-926d-d7b0aa724797\") " pod="openshift-console/downloads-685bfb5f64-59zcr" Jul 06 18:56:05.920614 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.920576 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-264np\" (UniqueName: \"kubernetes.io/projected/901fa5ce-e25c-4616-926d-d7b0aa724797-kube-api-access-264np\") pod \"downloads-685bfb5f64-59zcr\" (UID: \"901fa5ce-e25c-4616-926d-d7b0aa724797\") " pod="openshift-console/downloads-685bfb5f64-59zcr" Jul 06 18:56:05.920771 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.920656 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c0eb13d0-1064-4703-a575-71649e01a93e-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-kss42\" (UID: \"c0eb13d0-1064-4703-a575-71649e01a93e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kss42" Jul 06 18:56:05.923181 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.923145 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c0eb13d0-1064-4703-a575-71649e01a93e-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-kss42\" (UID: \"c0eb13d0-1064-4703-a575-71649e01a93e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kss42" Jul 06 18:56:05.932963 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:05.932932 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-264np\" (UniqueName: \"kubernetes.io/projected/901fa5ce-e25c-4616-926d-d7b0aa724797-kube-api-access-264np\") pod \"downloads-685bfb5f64-59zcr\" (UID: \"901fa5ce-e25c-4616-926d-d7b0aa724797\") " pod="openshift-console/downloads-685bfb5f64-59zcr" Jul 06 18:56:06.031561 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:06.031530 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kss42" Jul 06 18:56:06.037642 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:06.037617 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-59zcr" Jul 06 18:56:06.173156 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:06.173126 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kss42"] Jul 06 18:56:06.176569 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:56:06.176542 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0eb13d0_1064_4703_a575_71649e01a93e.slice/crio-0f50e7be9c939460643001f5ee0c7922b090dba492d68f2091ff7c00f882ae31 WatchSource:0}: Error finding container 0f50e7be9c939460643001f5ee0c7922b090dba492d68f2091ff7c00f882ae31: Status 404 returned error can't find the container with id 0f50e7be9c939460643001f5ee0c7922b090dba492d68f2091ff7c00f882ae31 Jul 06 18:56:06.201883 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:06.201863 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-59zcr"] Jul 06 18:56:06.204149 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:56:06.204122 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod901fa5ce_e25c_4616_926d_d7b0aa724797.slice/crio-fe3c6e2f3b4754eab5c87cee2f80ce79485e2ddf620e608e0297271964a49ebf WatchSource:0}: Error finding container fe3c6e2f3b4754eab5c87cee2f80ce79485e2ddf620e608e0297271964a49ebf: Status 404 returned error can't find the container with id fe3c6e2f3b4754eab5c87cee2f80ce79485e2ddf620e608e0297271964a49ebf Jul 06 18:56:07.034539 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:07.034499 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-59zcr" event={"ID":"901fa5ce-e25c-4616-926d-d7b0aa724797","Type":"ContainerStarted","Data":"fe3c6e2f3b4754eab5c87cee2f80ce79485e2ddf620e608e0297271964a49ebf"} Jul 06 18:56:07.036136 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:07.036099 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kss42" event={"ID":"c0eb13d0-1064-4703-a575-71649e01a93e","Type":"ContainerStarted","Data":"0f50e7be9c939460643001f5ee0c7922b090dba492d68f2091ff7c00f882ae31"} Jul 06 18:56:08.041291 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:08.041257 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kss42" event={"ID":"c0eb13d0-1064-4703-a575-71649e01a93e","Type":"ContainerStarted","Data":"fc49c0d30332fc4326b44587c1bda1652adf90065e40b3be8df543b51ffd10aa"} Jul 06 18:56:08.041705 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:08.041415 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kss42" Jul 06 18:56:08.046050 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:08.046007 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kss42" Jul 06 18:56:08.058617 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:08.058568 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kss42" podStartSLOduration=1.439015179 podStartE2EDuration="3.058551758s" totalImagesPullingTime="1.619536579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:56:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:56:08.057250087 +0000 UTC m=+75.983684638" watchObservedRunningTime="2026-07-06 18:56:08.058551758 +0000 UTC m=+75.984986310" Jul 06 18:56:08.355672 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:08.355587 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-jm55c"] Jul 06 18:56:08.376194 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:08.376157 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-jm55c"] Jul 06 18:56:08.376350 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:08.376278 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jm55c" Jul 06 18:56:08.379181 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:08.379160 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 06 18:56:08.380213 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:08.380195 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 18:56:08.380756 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:08.380731 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zbdhb\"" Jul 06 18:56:08.380853 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:08.380734 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 06 18:56:08.541237 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:08.541204 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7cc9be6-b284-4148-8573-0523a52a026b-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-jm55c\" (UID: \"f7cc9be6-b284-4148-8573-0523a52a026b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jm55c" Jul 06 18:56:08.541419 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:08.541257 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7cc9be6-b284-4148-8573-0523a52a026b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-jm55c\" (UID: \"f7cc9be6-b284-4148-8573-0523a52a026b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jm55c" Jul 06 18:56:08.541419 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:08.541284 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tgqt\" (UniqueName: \"kubernetes.io/projected/f7cc9be6-b284-4148-8573-0523a52a026b-kube-api-access-7tgqt\") pod \"prometheus-operator-567f7b8b7c-jm55c\" (UID: \"f7cc9be6-b284-4148-8573-0523a52a026b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jm55c" Jul 06 18:56:08.541419 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:08.541367 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7cc9be6-b284-4148-8573-0523a52a026b-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-jm55c\" (UID: \"f7cc9be6-b284-4148-8573-0523a52a026b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jm55c" Jul 06 18:56:08.641804 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:08.641729 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7cc9be6-b284-4148-8573-0523a52a026b-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-jm55c\" (UID: \"f7cc9be6-b284-4148-8573-0523a52a026b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jm55c" Jul 06 18:56:08.641804 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:08.641786 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7cc9be6-b284-4148-8573-0523a52a026b-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-jm55c\" (UID: \"f7cc9be6-b284-4148-8573-0523a52a026b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jm55c" Jul 06 18:56:08.641971 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:08.641823 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7cc9be6-b284-4148-8573-0523a52a026b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-jm55c\" (UID: \"f7cc9be6-b284-4148-8573-0523a52a026b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jm55c" Jul 06 18:56:08.641971 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:08.641845 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tgqt\" (UniqueName: \"kubernetes.io/projected/f7cc9be6-b284-4148-8573-0523a52a026b-kube-api-access-7tgqt\") pod \"prometheus-operator-567f7b8b7c-jm55c\" (UID: \"f7cc9be6-b284-4148-8573-0523a52a026b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jm55c" Jul 06 18:56:08.641971 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:56:08.641874 2567 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 06 18:56:08.641971 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:56:08.641952 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7cc9be6-b284-4148-8573-0523a52a026b-prometheus-operator-tls podName:f7cc9be6-b284-4148-8573-0523a52a026b nodeName:}" failed. No retries permitted until 2026-07-06 18:56:09.141930793 +0000 UTC m=+77.068365323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/f7cc9be6-b284-4148-8573-0523a52a026b-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-jm55c" (UID: "f7cc9be6-b284-4148-8573-0523a52a026b") : secret "prometheus-operator-tls" not found Jul 06 18:56:08.642562 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:08.642535 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7cc9be6-b284-4148-8573-0523a52a026b-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-jm55c\" (UID: \"f7cc9be6-b284-4148-8573-0523a52a026b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jm55c" Jul 06 18:56:08.644176 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:08.644154 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7cc9be6-b284-4148-8573-0523a52a026b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-jm55c\" (UID: \"f7cc9be6-b284-4148-8573-0523a52a026b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jm55c" Jul 06 18:56:08.650841 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:08.650820 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tgqt\" (UniqueName: \"kubernetes.io/projected/f7cc9be6-b284-4148-8573-0523a52a026b-kube-api-access-7tgqt\") pod \"prometheus-operator-567f7b8b7c-jm55c\" (UID: \"f7cc9be6-b284-4148-8573-0523a52a026b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jm55c" Jul 06 18:56:09.145687 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:09.145621 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7cc9be6-b284-4148-8573-0523a52a026b-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-jm55c\" (UID: \"f7cc9be6-b284-4148-8573-0523a52a026b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jm55c" Jul 06 18:56:09.148141 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:09.148116 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7cc9be6-b284-4148-8573-0523a52a026b-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-jm55c\" (UID: \"f7cc9be6-b284-4148-8573-0523a52a026b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jm55c" Jul 06 18:56:09.286551 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:09.286515 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jm55c" Jul 06 18:56:09.443920 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:09.443893 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-jm55c"] Jul 06 18:56:09.446627 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:56:09.446596 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7cc9be6_b284_4148_8573_0523a52a026b.slice/crio-0c636ed362db9e1eac8ecd14e6cc2bbc0bf0ed251787d611865b913e44984620 WatchSource:0}: Error finding container 0c636ed362db9e1eac8ecd14e6cc2bbc0bf0ed251787d611865b913e44984620: Status 404 returned error can't find the container with id 0c636ed362db9e1eac8ecd14e6cc2bbc0bf0ed251787d611865b913e44984620 Jul 06 18:56:10.051311 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:10.051272 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jm55c" event={"ID":"f7cc9be6-b284-4148-8573-0523a52a026b","Type":"ContainerStarted","Data":"0c636ed362db9e1eac8ecd14e6cc2bbc0bf0ed251787d611865b913e44984620"} Jul 06 18:56:11.002310 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:11.002282 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-qsln6" Jul 06 18:56:12.062185 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:12.062147 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jm55c" event={"ID":"f7cc9be6-b284-4148-8573-0523a52a026b","Type":"ContainerStarted","Data":"41af9e86cd450ec8121d939f768791dabcc484babf21cc3cd4d51850ed46ad20"} Jul 06 18:56:12.062619 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:12.062209 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jm55c" event={"ID":"f7cc9be6-b284-4148-8573-0523a52a026b","Type":"ContainerStarted","Data":"afa3926a020b60f19aca20bff0f80227c5bd58ad046ec34e162be1db00149908"} Jul 06 18:56:12.079140 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:12.078859 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jm55c" podStartSLOduration=2.194654802 podStartE2EDuration="4.078838231s" totalImagesPullingTime="1.884183429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:56:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:56:12.078718621 +0000 UTC m=+80.005153171" watchObservedRunningTime="2026-07-06 18:56:12.078838231 +0000 UTC m=+80.005272783" Jul 06 18:56:13.808922 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:13.808889 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sjxqx"] Jul 06 18:56:13.811589 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:13.811558 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:13.814086 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:13.814053 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 18:56:13.814224 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:13.814111 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-s2prm\"" Jul 06 18:56:13.814224 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:13.814113 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 18:56:13.814332 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:13.814323 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 18:56:13.990162 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:13.990125 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37abe973-b5d8-4271-9269-95a4ecbd28e2-sys\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:13.990162 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:13.990171 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/37abe973-b5d8-4271-9269-95a4ecbd28e2-node-exporter-textfile\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:13.990384 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:13.990272 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/37abe973-b5d8-4271-9269-95a4ecbd28e2-node-exporter-tls\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:13.990384 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:13.990305 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37abe973-b5d8-4271-9269-95a4ecbd28e2-metrics-client-ca\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:13.990384 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:13.990374 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/37abe973-b5d8-4271-9269-95a4ecbd28e2-root\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:13.990557 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:13.990435 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37abe973-b5d8-4271-9269-95a4ecbd28e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:13.990557 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:13.990463 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/37abe973-b5d8-4271-9269-95a4ecbd28e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:13.990557 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:13.990522 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7r8m\" (UniqueName: \"kubernetes.io/projected/37abe973-b5d8-4271-9269-95a4ecbd28e2-kube-api-access-z7r8m\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:13.990557 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:13.990553 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/37abe973-b5d8-4271-9269-95a4ecbd28e2-node-exporter-wtmp\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:14.091311 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:14.091224 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7r8m\" (UniqueName: \"kubernetes.io/projected/37abe973-b5d8-4271-9269-95a4ecbd28e2-kube-api-access-z7r8m\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:14.091311 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:14.091265 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/37abe973-b5d8-4271-9269-95a4ecbd28e2-node-exporter-wtmp\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:14.091551 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:14.091448 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/37abe973-b5d8-4271-9269-95a4ecbd28e2-node-exporter-wtmp\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:14.091551 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:14.091465 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37abe973-b5d8-4271-9269-95a4ecbd28e2-sys\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:14.091551 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:14.091532 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/37abe973-b5d8-4271-9269-95a4ecbd28e2-node-exporter-textfile\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:14.091709 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:14.091582 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/37abe973-b5d8-4271-9269-95a4ecbd28e2-node-exporter-tls\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:14.091709 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:14.091600 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37abe973-b5d8-4271-9269-95a4ecbd28e2-metrics-client-ca\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:14.091709 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:14.091606 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37abe973-b5d8-4271-9269-95a4ecbd28e2-sys\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:14.091709 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:14.091635 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/37abe973-b5d8-4271-9269-95a4ecbd28e2-root\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:14.091709 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:14.091666 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37abe973-b5d8-4271-9269-95a4ecbd28e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:14.091936 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:56:14.091713 2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 18:56:14.091936 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:14.091727 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/37abe973-b5d8-4271-9269-95a4ecbd28e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:14.091936 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:56:14.091771 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37abe973-b5d8-4271-9269-95a4ecbd28e2-node-exporter-tls podName:37abe973-b5d8-4271-9269-95a4ecbd28e2 nodeName:}" failed. No retries permitted until 2026-07-06 18:56:14.591752614 +0000 UTC m=+82.518187157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/37abe973-b5d8-4271-9269-95a4ecbd28e2-node-exporter-tls") pod "node-exporter-sjxqx" (UID: "37abe973-b5d8-4271-9269-95a4ecbd28e2") : secret "node-exporter-tls" not found Jul 06 18:56:14.091936 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:14.091874 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/37abe973-b5d8-4271-9269-95a4ecbd28e2-node-exporter-textfile\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:14.091936 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:14.091893 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/37abe973-b5d8-4271-9269-95a4ecbd28e2-root\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:14.092356 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:14.092325 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/37abe973-b5d8-4271-9269-95a4ecbd28e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:14.092544 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:14.092507 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37abe973-b5d8-4271-9269-95a4ecbd28e2-metrics-client-ca\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:14.094722 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:14.094699 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37abe973-b5d8-4271-9269-95a4ecbd28e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:14.101153 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:14.101133 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7r8m\" (UniqueName: \"kubernetes.io/projected/37abe973-b5d8-4271-9269-95a4ecbd28e2-kube-api-access-z7r8m\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:14.597055 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:14.597020 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/37abe973-b5d8-4271-9269-95a4ecbd28e2-node-exporter-tls\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:14.599639 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:14.599609 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/37abe973-b5d8-4271-9269-95a4ecbd28e2-node-exporter-tls\") pod \"node-exporter-sjxqx\" (UID: \"37abe973-b5d8-4271-9269-95a4ecbd28e2\") " pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:14.722940 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:14.722907 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sjxqx" Jul 06 18:56:14.735540 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:56:14.735512 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37abe973_b5d8_4271_9269_95a4ecbd28e2.slice/crio-01fe99410b4ad2618c9e40408dca59fc478ebf5aa326bf43e223bbfe90fff0ad WatchSource:0}: Error finding container 01fe99410b4ad2618c9e40408dca59fc478ebf5aa326bf43e223bbfe90fff0ad: Status 404 returned error can't find the container with id 01fe99410b4ad2618c9e40408dca59fc478ebf5aa326bf43e223bbfe90fff0ad Jul 06 18:56:15.030120 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:15.030089 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kpxk9" Jul 06 18:56:15.076205 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:15.076146 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sjxqx" event={"ID":"37abe973-b5d8-4271-9269-95a4ecbd28e2","Type":"ContainerStarted","Data":"01fe99410b4ad2618c9e40408dca59fc478ebf5aa326bf43e223bbfe90fff0ad"} Jul 06 18:56:17.087869 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:17.087827 2567 generic.go:356] "Generic (PLEG): container finished" podID="37abe973-b5d8-4271-9269-95a4ecbd28e2" containerID="379a196232c83f71be088fbfcebf07e447ce4624a089cc2345bec9e1d2bc0eb0" exitCode=0 Jul 06 18:56:17.088309 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:17.087935 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sjxqx" event={"ID":"37abe973-b5d8-4271-9269-95a4ecbd28e2","Type":"ContainerDied","Data":"379a196232c83f71be088fbfcebf07e447ce4624a089cc2345bec9e1d2bc0eb0"} Jul 06 18:56:18.094410 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:18.094368 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sjxqx" event={"ID":"37abe973-b5d8-4271-9269-95a4ecbd28e2","Type":"ContainerStarted","Data":"60882388eab3a3a1241a00ea25d629651ba9412af0f0b89b3a6f193e2ceed3b6"} Jul 06 18:56:18.094869 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:18.094541 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sjxqx" event={"ID":"37abe973-b5d8-4271-9269-95a4ecbd28e2","Type":"ContainerStarted","Data":"d066ff169ed87def61088fd4f6ead1655c4d47f0c3a11260f9be16bc752d6d1f"} Jul 06 18:56:18.114646 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:18.114594 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sjxqx" podStartSLOduration=3.619810039 podStartE2EDuration="5.11457465s" totalImagesPullingTime="1.421124083s" totalInitContainerRuntime="73.640528ms" isStatefulPod=true podCreationTimestamp="2026-07-06 18:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:56:18.112353409 +0000 UTC m=+86.038787960" watchObservedRunningTime="2026-07-06 18:56:18.11457465 +0000 UTC m=+86.041009201" Jul 06 18:56:22.006610 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:22.006574 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:56:23.517411 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.517376 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6587457c97-f8468"] Jul 06 18:56:23.530250 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.530222 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:23.533998 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.533961 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 18:56:23.533998 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.533961 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 18:56:23.534190 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.534032 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 18:56:23.534321 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.534301 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 18:56:23.534915 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.534898 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9l9vz\"" Jul 06 18:56:23.535349 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.535330 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 18:56:23.543237 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.543214 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 18:56:23.544508 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.544455 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6587457c97-f8468"] Jul 06 18:56:23.576279 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.576256 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44281231-f987-4f76-b76b-a3f1ba1bd36c-console-serving-cert\") pod \"console-6587457c97-f8468\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:23.576413 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.576288 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw5k6\" (UniqueName: \"kubernetes.io/projected/44281231-f987-4f76-b76b-a3f1ba1bd36c-kube-api-access-gw5k6\") pod \"console-6587457c97-f8468\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:23.576413 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.576324 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-console-config\") pod \"console-6587457c97-f8468\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:23.576413 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.576352 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-oauth-serving-cert\") pod \"console-6587457c97-f8468\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:23.576590 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.576417 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-trusted-ca-bundle\") pod \"console-6587457c97-f8468\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:23.576590 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.576458 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-service-ca\") pod \"console-6587457c97-f8468\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:23.576590 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.576530 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44281231-f987-4f76-b76b-a3f1ba1bd36c-console-oauth-config\") pod \"console-6587457c97-f8468\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:23.677873 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.677832 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-console-config\") pod \"console-6587457c97-f8468\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:23.678054 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.677898 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-oauth-serving-cert\") pod \"console-6587457c97-f8468\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:23.678054 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.677960 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-trusted-ca-bundle\") pod \"console-6587457c97-f8468\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:23.678054 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.677991 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-service-ca\") pod \"console-6587457c97-f8468\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:23.678219 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.678055 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44281231-f987-4f76-b76b-a3f1ba1bd36c-console-oauth-config\") pod \"console-6587457c97-f8468\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:23.678219 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.678118 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44281231-f987-4f76-b76b-a3f1ba1bd36c-console-serving-cert\") pod \"console-6587457c97-f8468\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:23.678219 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.678151 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw5k6\" (UniqueName: \"kubernetes.io/projected/44281231-f987-4f76-b76b-a3f1ba1bd36c-kube-api-access-gw5k6\") pod \"console-6587457c97-f8468\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:23.678828 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.678795 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-oauth-serving-cert\") pod \"console-6587457c97-f8468\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:23.678828 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.678795 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-service-ca\") pod \"console-6587457c97-f8468\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:23.679277 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.679250 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-console-config\") pod \"console-6587457c97-f8468\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:23.679835 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.679812 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-trusted-ca-bundle\") pod \"console-6587457c97-f8468\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:23.681233 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.681212 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44281231-f987-4f76-b76b-a3f1ba1bd36c-console-oauth-config\") pod \"console-6587457c97-f8468\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:23.681422 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.681398 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44281231-f987-4f76-b76b-a3f1ba1bd36c-console-serving-cert\") pod \"console-6587457c97-f8468\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:23.687865 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.687843 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw5k6\" (UniqueName: \"kubernetes.io/projected/44281231-f987-4f76-b76b-a3f1ba1bd36c-kube-api-access-gw5k6\") pod \"console-6587457c97-f8468\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:23.842948 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:23.842859 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:25.507924 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:25.507892 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6587457c97-f8468"] Jul 06 18:56:25.622342 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:56:25.622313 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44281231_f987_4f76_b76b_a3f1ba1bd36c.slice/crio-d2ed8c4922b0eb620732016bd8a4f5ae4ce072586f850f60bdb0deebb445165a WatchSource:0}: Error finding container d2ed8c4922b0eb620732016bd8a4f5ae4ce072586f850f60bdb0deebb445165a: Status 404 returned error can't find the container with id d2ed8c4922b0eb620732016bd8a4f5ae4ce072586f850f60bdb0deebb445165a Jul 06 18:56:26.133621 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:26.133507 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6587457c97-f8468" event={"ID":"44281231-f987-4f76-b76b-a3f1ba1bd36c","Type":"ContainerStarted","Data":"d2ed8c4922b0eb620732016bd8a4f5ae4ce072586f850f60bdb0deebb445165a"} Jul 06 18:56:26.135529 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:26.135498 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-59zcr" event={"ID":"901fa5ce-e25c-4616-926d-d7b0aa724797","Type":"ContainerStarted","Data":"42080b10f3a95dba5a792577679a6f8359d7490d40918758d2572b7b875f208c"} Jul 06 18:56:26.135761 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:26.135739 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-59zcr" Jul 06 18:56:26.138091 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:26.137553 2567 patch_prober.go:28] interesting pod/downloads-685bfb5f64-59zcr container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.20:8080/\": dial tcp 10.132.0.20:8080: connect: connection refused" start-of-body= Jul 06 18:56:26.138091 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:26.137609 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-59zcr" podUID="901fa5ce-e25c-4616-926d-d7b0aa724797" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.20:8080/\": dial tcp 10.132.0.20:8080: connect: connection refused" Jul 06 18:56:26.154698 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:26.154647 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-59zcr" podStartSLOduration=1.6696706190000001 podStartE2EDuration="21.15462751s" totalImagesPullingTime="19.484956891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:56:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:56:26.152679719 +0000 UTC m=+94.079114272" watchObservedRunningTime="2026-07-06 18:56:26.15462751 +0000 UTC m=+94.081062059" Jul 06 18:56:27.163533 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:27.163491 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-59zcr" Jul 06 18:56:29.394365 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:29.394326 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6db87cfddf-pjkbq"] Jul 06 18:56:29.989280 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:29.989252 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-d94p2" Jul 06 18:56:30.156093 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:30.156056 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6587457c97-f8468" event={"ID":"44281231-f987-4f76-b76b-a3f1ba1bd36c","Type":"ContainerStarted","Data":"2784e698b398ff6ac56802cf3acf2b2620cf9fd193cc50fccf13392dc86ae99b"} Jul 06 18:56:30.184216 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:30.184151 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6587457c97-f8468" podStartSLOduration=3.6111985669999997 podStartE2EDuration="7.184127386s" totalImagesPullingTime="3.572928819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:56:30.182820525 +0000 UTC m=+98.109255085" watchObservedRunningTime="2026-07-06 18:56:30.184127386 +0000 UTC m=+98.110561937" Jul 06 18:56:33.843241 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:33.843206 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:33.843828 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:33.843277 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:33.849041 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:33.849016 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:34.178732 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:34.178699 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6587457c97-f8468" Jul 06 18:56:54.420272 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.420215 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" podUID="2e4f8630-04c0-411a-881f-514f0cd4c6d6" containerName="registry" containerID="cri-o://6251449e766fb467ad772d86e70001823d3e185be2b27c9ccac9cd30c772d7ec" gracePeriod=30 Jul 06 18:56:54.684293 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.684236 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:56:54.850756 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.850726 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls\") pod \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " Jul 06 18:56:54.850914 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.850808 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e4f8630-04c0-411a-881f-514f0cd4c6d6-installation-pull-secrets\") pod \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " Jul 06 18:56:54.850914 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.850839 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-certificates\") pod \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " Jul 06 18:56:54.850914 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.850870 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjpv4\" (UniqueName: \"kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-kube-api-access-tjpv4\") pod \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " Jul 06 18:56:54.850914 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.850906 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e4f8630-04c0-411a-881f-514f0cd4c6d6-image-registry-private-configuration\") pod \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " Jul 06 18:56:54.851122 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.850973 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-bound-sa-token\") pod \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " Jul 06 18:56:54.851122 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.850998 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e4f8630-04c0-411a-881f-514f0cd4c6d6-ca-trust-extracted\") pod \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " Jul 06 18:56:54.851122 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.851025 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e4f8630-04c0-411a-881f-514f0cd4c6d6-trusted-ca\") pod \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\" (UID: \"2e4f8630-04c0-411a-881f-514f0cd4c6d6\") " Jul 06 18:56:54.851553 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.851352 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2e4f8630-04c0-411a-881f-514f0cd4c6d6" (UID: "2e4f8630-04c0-411a-881f-514f0cd4c6d6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:56:54.851664 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.851597 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e4f8630-04c0-411a-881f-514f0cd4c6d6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2e4f8630-04c0-411a-881f-514f0cd4c6d6" (UID: "2e4f8630-04c0-411a-881f-514f0cd4c6d6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:56:54.853504 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.853426 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e4f8630-04c0-411a-881f-514f0cd4c6d6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2e4f8630-04c0-411a-881f-514f0cd4c6d6" (UID: "2e4f8630-04c0-411a-881f-514f0cd4c6d6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:56:54.853624 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.853509 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2e4f8630-04c0-411a-881f-514f0cd4c6d6" (UID: "2e4f8630-04c0-411a-881f-514f0cd4c6d6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:56:54.853735 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.853712 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e4f8630-04c0-411a-881f-514f0cd4c6d6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2e4f8630-04c0-411a-881f-514f0cd4c6d6" (UID: "2e4f8630-04c0-411a-881f-514f0cd4c6d6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:56:54.853841 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.853796 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2e4f8630-04c0-411a-881f-514f0cd4c6d6" (UID: "2e4f8630-04c0-411a-881f-514f0cd4c6d6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:56:54.853918 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.853897 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-kube-api-access-tjpv4" (OuterVolumeSpecName: "kube-api-access-tjpv4") pod "2e4f8630-04c0-411a-881f-514f0cd4c6d6" (UID: "2e4f8630-04c0-411a-881f-514f0cd4c6d6"). InnerVolumeSpecName "kube-api-access-tjpv4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:56:54.859252 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.859228 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e4f8630-04c0-411a-881f-514f0cd4c6d6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2e4f8630-04c0-411a-881f-514f0cd4c6d6" (UID: "2e4f8630-04c0-411a-881f-514f0cd4c6d6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:56:54.951934 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.951874 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-bound-sa-token\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 18:56:54.951934 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.951894 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e4f8630-04c0-411a-881f-514f0cd4c6d6-ca-trust-extracted\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 18:56:54.951934 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.951905 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e4f8630-04c0-411a-881f-514f0cd4c6d6-trusted-ca\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 18:56:54.951934 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.951914 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-tls\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 18:56:54.951934 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.951923 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e4f8630-04c0-411a-881f-514f0cd4c6d6-installation-pull-secrets\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 18:56:54.951934 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.951931 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e4f8630-04c0-411a-881f-514f0cd4c6d6-registry-certificates\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 18:56:54.951934 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.951939 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjpv4\" (UniqueName: \"kubernetes.io/projected/2e4f8630-04c0-411a-881f-514f0cd4c6d6-kube-api-access-tjpv4\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 18:56:54.952228 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:54.951948 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e4f8630-04c0-411a-881f-514f0cd4c6d6-image-registry-private-configuration\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 18:56:55.252708 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:55.252620 2567 generic.go:356] "Generic (PLEG): container finished" podID="2e4f8630-04c0-411a-881f-514f0cd4c6d6" containerID="6251449e766fb467ad772d86e70001823d3e185be2b27c9ccac9cd30c772d7ec" exitCode=0 Jul 06 18:56:55.252708 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:55.252664 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" Jul 06 18:56:55.252873 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:55.252703 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" event={"ID":"2e4f8630-04c0-411a-881f-514f0cd4c6d6","Type":"ContainerDied","Data":"6251449e766fb467ad772d86e70001823d3e185be2b27c9ccac9cd30c772d7ec"} Jul 06 18:56:55.252873 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:55.252754 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db87cfddf-pjkbq" event={"ID":"2e4f8630-04c0-411a-881f-514f0cd4c6d6","Type":"ContainerDied","Data":"aa34dd19326ce4af3e7b22b761e2a337bf16b7aab15517d6065bf1ed0dcfa42a"} Jul 06 18:56:55.252873 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:55.252776 2567 scope.go:117] "RemoveContainer" containerID="6251449e766fb467ad772d86e70001823d3e185be2b27c9ccac9cd30c772d7ec" Jul 06 18:56:55.261318 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:55.261301 2567 scope.go:117] "RemoveContainer" containerID="6251449e766fb467ad772d86e70001823d3e185be2b27c9ccac9cd30c772d7ec" Jul 06 18:56:55.261681 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:56:55.261659 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6251449e766fb467ad772d86e70001823d3e185be2b27c9ccac9cd30c772d7ec\": container with ID starting with 6251449e766fb467ad772d86e70001823d3e185be2b27c9ccac9cd30c772d7ec not found: ID does not exist" containerID="6251449e766fb467ad772d86e70001823d3e185be2b27c9ccac9cd30c772d7ec" Jul 06 18:56:55.261747 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:55.261689 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6251449e766fb467ad772d86e70001823d3e185be2b27c9ccac9cd30c772d7ec"} err="failed to get container status \"6251449e766fb467ad772d86e70001823d3e185be2b27c9ccac9cd30c772d7ec\": rpc error: code = NotFound desc = could not find container \"6251449e766fb467ad772d86e70001823d3e185be2b27c9ccac9cd30c772d7ec\": container with ID starting with 6251449e766fb467ad772d86e70001823d3e185be2b27c9ccac9cd30c772d7ec not found: ID does not exist" Jul 06 18:56:55.274398 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:55.274372 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6db87cfddf-pjkbq"] Jul 06 18:56:55.279099 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:55.279080 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6db87cfddf-pjkbq"] Jul 06 18:56:56.574344 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:56.574313 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e4f8630-04c0-411a-881f-514f0cd4c6d6" path="/var/lib/kubelet/pods/2e4f8630-04c0-411a-881f-514f0cd4c6d6/volumes" Jul 06 18:56:58.266254 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:58.266219 2567 generic.go:356] "Generic (PLEG): container finished" podID="c2b88852-6092-4980-905d-8801e95abd38" containerID="30e0a6f665e99a26f05663077ad50adb7ea51f1f5bf207dda7552d95e5642b71" exitCode=0 Jul 06 18:56:58.266703 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:58.266292 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" event={"ID":"c2b88852-6092-4980-905d-8801e95abd38","Type":"ContainerDied","Data":"30e0a6f665e99a26f05663077ad50adb7ea51f1f5bf207dda7552d95e5642b71"} Jul 06 18:56:58.266703 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:58.266636 2567 scope.go:117] "RemoveContainer" containerID="30e0a6f665e99a26f05663077ad50adb7ea51f1f5bf207dda7552d95e5642b71" Jul 06 18:56:59.272337 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:56:59.272303 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-zcpj7" event={"ID":"c2b88852-6092-4980-905d-8801e95abd38","Type":"ContainerStarted","Data":"1b82a4d37622dc93293a150edbed4ba278a6d3adc51e1dc82a81513787d04e83"} Jul 06 18:57:03.289108 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:03.289070 2567 generic.go:356] "Generic (PLEG): container finished" podID="a645ee26-3516-4de3-99f2-603d7cb6914c" containerID="5b8fabb3ad39ff16a1b929116513148189fb55e1589f3b5db400b425549cafd7" exitCode=0 Jul 06 18:57:03.289662 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:03.289148 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jh7tn" event={"ID":"a645ee26-3516-4de3-99f2-603d7cb6914c","Type":"ContainerDied","Data":"5b8fabb3ad39ff16a1b929116513148189fb55e1589f3b5db400b425549cafd7"} Jul 06 18:57:03.289662 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:03.289604 2567 scope.go:117] "RemoveContainer" containerID="5b8fabb3ad39ff16a1b929116513148189fb55e1589f3b5db400b425549cafd7" Jul 06 18:57:04.295042 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:04.295011 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jh7tn" event={"ID":"a645ee26-3516-4de3-99f2-603d7cb6914c","Type":"ContainerStarted","Data":"c0eee625b086a929024fd6c270441dfc0162bf8f7c4606071d03eb7e1c7d79b3"} Jul 06 18:57:08.310068 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:08.310035 2567 generic.go:356] "Generic (PLEG): container finished" podID="31a1816c-63a0-47a9-93fc-b76fda98725c" containerID="7dc27a0e7b78f0b3a4a5caba01f05c741e8a380f9e18a3c12d320d0181140ad2" exitCode=0 Jul 06 18:57:08.310513 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:08.310108 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vlffp" event={"ID":"31a1816c-63a0-47a9-93fc-b76fda98725c","Type":"ContainerDied","Data":"7dc27a0e7b78f0b3a4a5caba01f05c741e8a380f9e18a3c12d320d0181140ad2"} Jul 06 18:57:08.310513 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:08.310443 2567 scope.go:117] "RemoveContainer" containerID="7dc27a0e7b78f0b3a4a5caba01f05c741e8a380f9e18a3c12d320d0181140ad2" Jul 06 18:57:09.315347 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:09.315316 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vlffp" event={"ID":"31a1816c-63a0-47a9-93fc-b76fda98725c","Type":"ContainerStarted","Data":"1597a660a12bc68fb5ff5afe4b2639aed52aa9511d1d9ec20fa427802ed09240"} Jul 06 18:57:42.576584 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.576548 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b47b9dfd9-qqc2b"] Jul 06 18:57:42.577152 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.576938 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e4f8630-04c0-411a-881f-514f0cd4c6d6" containerName="registry" Jul 06 18:57:42.577152 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.576954 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e4f8630-04c0-411a-881f-514f0cd4c6d6" containerName="registry" Jul 06 18:57:42.577152 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.577042 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e4f8630-04c0-411a-881f-514f0cd4c6d6" containerName="registry" Jul 06 18:57:42.580152 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.580124 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:42.584405 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.584383 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b47b9dfd9-qqc2b"] Jul 06 18:57:42.694298 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.694258 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-console-config\") pod \"console-b47b9dfd9-qqc2b\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:42.694298 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.694298 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzx2p\" (UniqueName: \"kubernetes.io/projected/d48960b5-a504-4054-bfaf-916098cfbb08-kube-api-access-nzx2p\") pod \"console-b47b9dfd9-qqc2b\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:42.694539 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.694368 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d48960b5-a504-4054-bfaf-916098cfbb08-console-oauth-config\") pod \"console-b47b9dfd9-qqc2b\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:42.694539 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.694410 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-service-ca\") pod \"console-b47b9dfd9-qqc2b\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:42.694539 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.694439 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d48960b5-a504-4054-bfaf-916098cfbb08-console-serving-cert\") pod \"console-b47b9dfd9-qqc2b\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:42.694539 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.694464 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-trusted-ca-bundle\") pod \"console-b47b9dfd9-qqc2b\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:42.694539 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.694534 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-oauth-serving-cert\") pod \"console-b47b9dfd9-qqc2b\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:42.795327 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.795290 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-trusted-ca-bundle\") pod \"console-b47b9dfd9-qqc2b\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:42.795530 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.795337 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-oauth-serving-cert\") pod \"console-b47b9dfd9-qqc2b\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:42.795530 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.795356 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-console-config\") pod \"console-b47b9dfd9-qqc2b\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:42.795530 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.795375 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzx2p\" (UniqueName: \"kubernetes.io/projected/d48960b5-a504-4054-bfaf-916098cfbb08-kube-api-access-nzx2p\") pod \"console-b47b9dfd9-qqc2b\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:42.795530 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.795403 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d48960b5-a504-4054-bfaf-916098cfbb08-console-oauth-config\") pod \"console-b47b9dfd9-qqc2b\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:42.795530 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.795428 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-service-ca\") pod \"console-b47b9dfd9-qqc2b\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:42.795530 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.795448 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d48960b5-a504-4054-bfaf-916098cfbb08-console-serving-cert\") pod \"console-b47b9dfd9-qqc2b\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:42.796254 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.796231 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-service-ca\") pod \"console-b47b9dfd9-qqc2b\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:42.796364 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.796269 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-trusted-ca-bundle\") pod \"console-b47b9dfd9-qqc2b\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:42.796364 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.796269 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-console-config\") pod \"console-b47b9dfd9-qqc2b\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:42.796627 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.796607 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-oauth-serving-cert\") pod \"console-b47b9dfd9-qqc2b\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:42.797876 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.797857 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d48960b5-a504-4054-bfaf-916098cfbb08-console-serving-cert\") pod \"console-b47b9dfd9-qqc2b\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:42.798019 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.797999 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d48960b5-a504-4054-bfaf-916098cfbb08-console-oauth-config\") pod \"console-b47b9dfd9-qqc2b\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:42.803420 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.803396 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzx2p\" (UniqueName: \"kubernetes.io/projected/d48960b5-a504-4054-bfaf-916098cfbb08-kube-api-access-nzx2p\") pod \"console-b47b9dfd9-qqc2b\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:42.892934 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:42.892849 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:43.028466 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:43.026084 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b47b9dfd9-qqc2b"] Jul 06 18:57:43.029068 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:57:43.029038 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd48960b5_a504_4054_bfaf_916098cfbb08.slice/crio-ba42eb74b44064c0dc0fe1560df6ec6fc78db19208ed053a8387355f199c2dd3 WatchSource:0}: Error finding container ba42eb74b44064c0dc0fe1560df6ec6fc78db19208ed053a8387355f199c2dd3: Status 404 returned error can't find the container with id ba42eb74b44064c0dc0fe1560df6ec6fc78db19208ed053a8387355f199c2dd3 Jul 06 18:57:43.458569 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:43.458536 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b47b9dfd9-qqc2b" event={"ID":"d48960b5-a504-4054-bfaf-916098cfbb08","Type":"ContainerStarted","Data":"bc36e078376421b11ca1ee52f7711b6b952f362e4571ffce4de86831961af5b1"} Jul 06 18:57:43.458745 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:43.458609 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b47b9dfd9-qqc2b" event={"ID":"d48960b5-a504-4054-bfaf-916098cfbb08","Type":"ContainerStarted","Data":"ba42eb74b44064c0dc0fe1560df6ec6fc78db19208ed053a8387355f199c2dd3"} Jul 06 18:57:43.478559 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:43.478506 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b47b9dfd9-qqc2b" podStartSLOduration=1.4784680350000001 podStartE2EDuration="1.478468035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:57:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:57:43.477390831 +0000 UTC m=+171.403825380" watchObservedRunningTime="2026-07-06 18:57:43.478468035 +0000 UTC m=+171.404902584" Jul 06 18:57:52.893225 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:52.893145 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:52.893225 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:52.893199 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:52.898018 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:52.897997 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:53.497844 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:53.497815 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:57:53.554827 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:57:53.554795 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6587457c97-f8468"] Jul 06 18:58:18.580901 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:18.580858 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6587457c97-f8468" podUID="44281231-f987-4f76-b76b-a3f1ba1bd36c" containerName="console" containerID="cri-o://2784e698b398ff6ac56802cf3acf2b2620cf9fd193cc50fccf13392dc86ae99b" gracePeriod=15 Jul 06 18:58:18.817833 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:18.817806 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6587457c97-f8468" Jul 06 18:58:18.979682 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:18.979642 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-console-config\") pod \"44281231-f987-4f76-b76b-a3f1ba1bd36c\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " Jul 06 18:58:18.979682 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:18.979688 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gw5k6\" (UniqueName: \"kubernetes.io/projected/44281231-f987-4f76-b76b-a3f1ba1bd36c-kube-api-access-gw5k6\") pod \"44281231-f987-4f76-b76b-a3f1ba1bd36c\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " Jul 06 18:58:18.979893 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:18.979727 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-service-ca\") pod \"44281231-f987-4f76-b76b-a3f1ba1bd36c\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " Jul 06 18:58:18.979893 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:18.979743 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-trusted-ca-bundle\") pod \"44281231-f987-4f76-b76b-a3f1ba1bd36c\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " Jul 06 18:58:18.979893 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:18.979761 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44281231-f987-4f76-b76b-a3f1ba1bd36c-console-serving-cert\") pod \"44281231-f987-4f76-b76b-a3f1ba1bd36c\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " Jul 06 18:58:18.979893 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:18.979777 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-oauth-serving-cert\") pod \"44281231-f987-4f76-b76b-a3f1ba1bd36c\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " Jul 06 18:58:18.979893 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:18.979850 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44281231-f987-4f76-b76b-a3f1ba1bd36c-console-oauth-config\") pod \"44281231-f987-4f76-b76b-a3f1ba1bd36c\" (UID: \"44281231-f987-4f76-b76b-a3f1ba1bd36c\") " Jul 06 18:58:18.980216 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:18.980185 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-service-ca" (OuterVolumeSpecName: "service-ca") pod "44281231-f987-4f76-b76b-a3f1ba1bd36c" (UID: "44281231-f987-4f76-b76b-a3f1ba1bd36c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:58:18.980341 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:18.980185 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-console-config" (OuterVolumeSpecName: "console-config") pod "44281231-f987-4f76-b76b-a3f1ba1bd36c" (UID: "44281231-f987-4f76-b76b-a3f1ba1bd36c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:58:18.980341 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:18.980318 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "44281231-f987-4f76-b76b-a3f1ba1bd36c" (UID: "44281231-f987-4f76-b76b-a3f1ba1bd36c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:58:18.980423 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:18.980401 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "44281231-f987-4f76-b76b-a3f1ba1bd36c" (UID: "44281231-f987-4f76-b76b-a3f1ba1bd36c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:58:18.982125 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:18.982095 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44281231-f987-4f76-b76b-a3f1ba1bd36c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "44281231-f987-4f76-b76b-a3f1ba1bd36c" (UID: "44281231-f987-4f76-b76b-a3f1ba1bd36c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:58:18.982468 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:18.982447 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44281231-f987-4f76-b76b-a3f1ba1bd36c-kube-api-access-gw5k6" (OuterVolumeSpecName: "kube-api-access-gw5k6") pod "44281231-f987-4f76-b76b-a3f1ba1bd36c" (UID: "44281231-f987-4f76-b76b-a3f1ba1bd36c"). InnerVolumeSpecName "kube-api-access-gw5k6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:58:18.982566 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:18.982451 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44281231-f987-4f76-b76b-a3f1ba1bd36c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "44281231-f987-4f76-b76b-a3f1ba1bd36c" (UID: "44281231-f987-4f76-b76b-a3f1ba1bd36c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:58:19.081017 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:19.080974 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44281231-f987-4f76-b76b-a3f1ba1bd36c-console-oauth-config\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 18:58:19.081017 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:19.081015 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-console-config\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 18:58:19.081017 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:19.081025 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw5k6\" (UniqueName: \"kubernetes.io/projected/44281231-f987-4f76-b76b-a3f1ba1bd36c-kube-api-access-gw5k6\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 18:58:19.081017 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:19.081035 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-service-ca\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 18:58:19.081255 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:19.081043 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-trusted-ca-bundle\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 18:58:19.081255 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:19.081052 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44281231-f987-4f76-b76b-a3f1ba1bd36c-console-serving-cert\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 18:58:19.081255 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:19.081062 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44281231-f987-4f76-b76b-a3f1ba1bd36c-oauth-serving-cert\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 18:58:19.593137 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:19.593105 2567 generic.go:356] "Generic (PLEG): container finished" podID="44281231-f987-4f76-b76b-a3f1ba1bd36c" containerID="2784e698b398ff6ac56802cf3acf2b2620cf9fd193cc50fccf13392dc86ae99b" exitCode=0 Jul 06 18:58:19.593627 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:19.593148 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6587457c97-f8468" Jul 06 18:58:19.593627 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:19.593162 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6587457c97-f8468" event={"ID":"44281231-f987-4f76-b76b-a3f1ba1bd36c","Type":"ContainerDied","Data":"2784e698b398ff6ac56802cf3acf2b2620cf9fd193cc50fccf13392dc86ae99b"} Jul 06 18:58:19.593627 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:19.593207 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6587457c97-f8468" event={"ID":"44281231-f987-4f76-b76b-a3f1ba1bd36c","Type":"ContainerDied","Data":"d2ed8c4922b0eb620732016bd8a4f5ae4ce072586f850f60bdb0deebb445165a"} Jul 06 18:58:19.593627 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:19.593235 2567 scope.go:117] "RemoveContainer" containerID="2784e698b398ff6ac56802cf3acf2b2620cf9fd193cc50fccf13392dc86ae99b" Jul 06 18:58:19.601952 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:19.601938 2567 scope.go:117] "RemoveContainer" containerID="2784e698b398ff6ac56802cf3acf2b2620cf9fd193cc50fccf13392dc86ae99b" Jul 06 18:58:19.602222 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:58:19.602205 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2784e698b398ff6ac56802cf3acf2b2620cf9fd193cc50fccf13392dc86ae99b\": container with ID starting with 2784e698b398ff6ac56802cf3acf2b2620cf9fd193cc50fccf13392dc86ae99b not found: ID does not exist" containerID="2784e698b398ff6ac56802cf3acf2b2620cf9fd193cc50fccf13392dc86ae99b" Jul 06 18:58:19.602269 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:19.602230 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2784e698b398ff6ac56802cf3acf2b2620cf9fd193cc50fccf13392dc86ae99b"} err="failed to get container status \"2784e698b398ff6ac56802cf3acf2b2620cf9fd193cc50fccf13392dc86ae99b\": rpc error: code = NotFound desc = could not find container \"2784e698b398ff6ac56802cf3acf2b2620cf9fd193cc50fccf13392dc86ae99b\": container with ID starting with 2784e698b398ff6ac56802cf3acf2b2620cf9fd193cc50fccf13392dc86ae99b not found: ID does not exist" Jul 06 18:58:19.615009 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:19.614990 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6587457c97-f8468"] Jul 06 18:58:19.619145 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:19.619123 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6587457c97-f8468"] Jul 06 18:58:20.574926 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:20.574891 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44281231-f987-4f76-b76b-a3f1ba1bd36c" path="/var/lib/kubelet/pods/44281231-f987-4f76-b76b-a3f1ba1bd36c/volumes" Jul 06 18:58:58.565127 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.565083 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-786bbb7986-sw96w"] Jul 06 18:58:58.565727 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.565516 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44281231-f987-4f76-b76b-a3f1ba1bd36c" containerName="console" Jul 06 18:58:58.565727 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.565534 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="44281231-f987-4f76-b76b-a3f1ba1bd36c" containerName="console" Jul 06 18:58:58.565727 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.565641 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="44281231-f987-4f76-b76b-a3f1ba1bd36c" containerName="console" Jul 06 18:58:58.568657 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.568635 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:58.589449 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.589423 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-786bbb7986-sw96w"] Jul 06 18:58:58.676954 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.676918 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sccdc\" (UniqueName: \"kubernetes.io/projected/422c8004-a1ec-4c0f-b11b-28e482aaa46e-kube-api-access-sccdc\") pod \"console-786bbb7986-sw96w\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:58.677157 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.676979 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-console-config\") pod \"console-786bbb7986-sw96w\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:58.677157 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.677003 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-service-ca\") pod \"console-786bbb7986-sw96w\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:58.677157 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.677072 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/422c8004-a1ec-4c0f-b11b-28e482aaa46e-console-serving-cert\") pod \"console-786bbb7986-sw96w\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:58.677157 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.677122 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-trusted-ca-bundle\") pod \"console-786bbb7986-sw96w\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:58.677157 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.677152 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/422c8004-a1ec-4c0f-b11b-28e482aaa46e-console-oauth-config\") pod \"console-786bbb7986-sw96w\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:58.677366 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.677177 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-oauth-serving-cert\") pod \"console-786bbb7986-sw96w\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:58.778492 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.778438 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/422c8004-a1ec-4c0f-b11b-28e482aaa46e-console-serving-cert\") pod \"console-786bbb7986-sw96w\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:58.778492 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.778494 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-trusted-ca-bundle\") pod \"console-786bbb7986-sw96w\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:58.778757 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.778513 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/422c8004-a1ec-4c0f-b11b-28e482aaa46e-console-oauth-config\") pod \"console-786bbb7986-sw96w\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:58.778757 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.778527 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-oauth-serving-cert\") pod \"console-786bbb7986-sw96w\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:58.778757 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.778587 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sccdc\" (UniqueName: \"kubernetes.io/projected/422c8004-a1ec-4c0f-b11b-28e482aaa46e-kube-api-access-sccdc\") pod \"console-786bbb7986-sw96w\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:58.778757 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.778629 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-console-config\") pod \"console-786bbb7986-sw96w\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:58.778757 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.778654 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-service-ca\") pod \"console-786bbb7986-sw96w\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:58.779232 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.779207 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-oauth-serving-cert\") pod \"console-786bbb7986-sw96w\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:58.779377 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.779354 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-console-config\") pod \"console-786bbb7986-sw96w\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:58.779440 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.779361 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-service-ca\") pod \"console-786bbb7986-sw96w\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:58.779440 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.779392 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-trusted-ca-bundle\") pod \"console-786bbb7986-sw96w\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:58.781495 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.781459 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/422c8004-a1ec-4c0f-b11b-28e482aaa46e-console-oauth-config\") pod \"console-786bbb7986-sw96w\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:58.781716 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.781694 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/422c8004-a1ec-4c0f-b11b-28e482aaa46e-console-serving-cert\") pod \"console-786bbb7986-sw96w\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:58.788568 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.788547 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sccdc\" (UniqueName: \"kubernetes.io/projected/422c8004-a1ec-4c0f-b11b-28e482aaa46e-kube-api-access-sccdc\") pod \"console-786bbb7986-sw96w\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:58.880680 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:58.880593 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:58:59.013789 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:59.013756 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-786bbb7986-sw96w"] Jul 06 18:58:59.016791 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:58:59.016764 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod422c8004_a1ec_4c0f_b11b_28e482aaa46e.slice/crio-83cb868554853a2a7dfb86eb5d0154d4017d30ae93e873b19fc06e348f77b74a WatchSource:0}: Error finding container 83cb868554853a2a7dfb86eb5d0154d4017d30ae93e873b19fc06e348f77b74a: Status 404 returned error can't find the container with id 83cb868554853a2a7dfb86eb5d0154d4017d30ae93e873b19fc06e348f77b74a Jul 06 18:58:59.739010 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:59.738976 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786bbb7986-sw96w" event={"ID":"422c8004-a1ec-4c0f-b11b-28e482aaa46e","Type":"ContainerStarted","Data":"519bf1f6c0424db629595704e0c4fb6e42f6d34769e3a087d4550c3ccc48e10c"} Jul 06 18:58:59.739409 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:59.739028 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786bbb7986-sw96w" event={"ID":"422c8004-a1ec-4c0f-b11b-28e482aaa46e","Type":"ContainerStarted","Data":"83cb868554853a2a7dfb86eb5d0154d4017d30ae93e873b19fc06e348f77b74a"} Jul 06 18:58:59.759731 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:58:59.759685 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-786bbb7986-sw96w" podStartSLOduration=1.7596706009999998 podStartE2EDuration="1.759670601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:58:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:58:59.758302656 +0000 UTC m=+247.684737207" watchObservedRunningTime="2026-07-06 18:58:59.759670601 +0000 UTC m=+247.686105150" Jul 06 18:59:08.881323 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:08.881287 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:59:08.881746 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:08.881393 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:59:08.886281 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:08.886261 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:59:09.781414 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:09.781387 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-786bbb7986-sw96w" Jul 06 18:59:09.830963 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:09.830923 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b47b9dfd9-qqc2b"] Jul 06 18:59:34.855556 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:34.855468 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-b47b9dfd9-qqc2b" podUID="d48960b5-a504-4054-bfaf-916098cfbb08" containerName="console" containerID="cri-o://bc36e078376421b11ca1ee52f7711b6b952f362e4571ffce4de86831961af5b1" gracePeriod=15 Jul 06 18:59:35.093755 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.093732 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:59:35.179232 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.179205 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-console-config\") pod \"d48960b5-a504-4054-bfaf-916098cfbb08\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " Jul 06 18:59:35.179396 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.179249 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzx2p\" (UniqueName: \"kubernetes.io/projected/d48960b5-a504-4054-bfaf-916098cfbb08-kube-api-access-nzx2p\") pod \"d48960b5-a504-4054-bfaf-916098cfbb08\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " Jul 06 18:59:35.179396 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.179288 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-trusted-ca-bundle\") pod \"d48960b5-a504-4054-bfaf-916098cfbb08\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " Jul 06 18:59:35.179396 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.179325 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d48960b5-a504-4054-bfaf-916098cfbb08-console-oauth-config\") pod \"d48960b5-a504-4054-bfaf-916098cfbb08\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " Jul 06 18:59:35.179396 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.179375 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-service-ca\") pod \"d48960b5-a504-4054-bfaf-916098cfbb08\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " Jul 06 18:59:35.179624 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.179399 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-oauth-serving-cert\") pod \"d48960b5-a504-4054-bfaf-916098cfbb08\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " Jul 06 18:59:35.179624 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.179432 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d48960b5-a504-4054-bfaf-916098cfbb08-console-serving-cert\") pod \"d48960b5-a504-4054-bfaf-916098cfbb08\" (UID: \"d48960b5-a504-4054-bfaf-916098cfbb08\") " Jul 06 18:59:35.179768 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.179670 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-console-config" (OuterVolumeSpecName: "console-config") pod "d48960b5-a504-4054-bfaf-916098cfbb08" (UID: "d48960b5-a504-4054-bfaf-916098cfbb08"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:59:35.179888 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.179812 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-service-ca" (OuterVolumeSpecName: "service-ca") pod "d48960b5-a504-4054-bfaf-916098cfbb08" (UID: "d48960b5-a504-4054-bfaf-916098cfbb08"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:59:35.179888 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.179818 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d48960b5-a504-4054-bfaf-916098cfbb08" (UID: "d48960b5-a504-4054-bfaf-916098cfbb08"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:59:35.179888 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.179826 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d48960b5-a504-4054-bfaf-916098cfbb08" (UID: "d48960b5-a504-4054-bfaf-916098cfbb08"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:59:35.181438 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.181412 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d48960b5-a504-4054-bfaf-916098cfbb08-kube-api-access-nzx2p" (OuterVolumeSpecName: "kube-api-access-nzx2p") pod "d48960b5-a504-4054-bfaf-916098cfbb08" (UID: "d48960b5-a504-4054-bfaf-916098cfbb08"). InnerVolumeSpecName "kube-api-access-nzx2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:59:35.181553 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.181533 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d48960b5-a504-4054-bfaf-916098cfbb08-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d48960b5-a504-4054-bfaf-916098cfbb08" (UID: "d48960b5-a504-4054-bfaf-916098cfbb08"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:59:35.181619 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.181599 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d48960b5-a504-4054-bfaf-916098cfbb08-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d48960b5-a504-4054-bfaf-916098cfbb08" (UID: "d48960b5-a504-4054-bfaf-916098cfbb08"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:59:35.280344 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.280297 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-service-ca\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 18:59:35.280344 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.280338 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-oauth-serving-cert\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 18:59:35.280344 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.280347 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d48960b5-a504-4054-bfaf-916098cfbb08-console-serving-cert\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 18:59:35.280344 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.280355 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-console-config\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 18:59:35.280344 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.280363 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzx2p\" (UniqueName: \"kubernetes.io/projected/d48960b5-a504-4054-bfaf-916098cfbb08-kube-api-access-nzx2p\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 18:59:35.280667 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.280372 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d48960b5-a504-4054-bfaf-916098cfbb08-trusted-ca-bundle\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 18:59:35.280667 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.280381 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d48960b5-a504-4054-bfaf-916098cfbb08-console-oauth-config\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 18:59:35.876577 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.876540 2567 generic.go:356] "Generic (PLEG): container finished" podID="d48960b5-a504-4054-bfaf-916098cfbb08" containerID="bc36e078376421b11ca1ee52f7711b6b952f362e4571ffce4de86831961af5b1" exitCode=0 Jul 06 18:59:35.876997 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.876592 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b47b9dfd9-qqc2b" Jul 06 18:59:35.876997 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.876626 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b47b9dfd9-qqc2b" event={"ID":"d48960b5-a504-4054-bfaf-916098cfbb08","Type":"ContainerDied","Data":"bc36e078376421b11ca1ee52f7711b6b952f362e4571ffce4de86831961af5b1"} Jul 06 18:59:35.876997 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.876680 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b47b9dfd9-qqc2b" event={"ID":"d48960b5-a504-4054-bfaf-916098cfbb08","Type":"ContainerDied","Data":"ba42eb74b44064c0dc0fe1560df6ec6fc78db19208ed053a8387355f199c2dd3"} Jul 06 18:59:35.876997 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.876701 2567 scope.go:117] "RemoveContainer" containerID="bc36e078376421b11ca1ee52f7711b6b952f362e4571ffce4de86831961af5b1" Jul 06 18:59:35.885607 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.885586 2567 scope.go:117] "RemoveContainer" containerID="bc36e078376421b11ca1ee52f7711b6b952f362e4571ffce4de86831961af5b1" Jul 06 18:59:35.885849 ip-10-0-139-154 kubenswrapper[2567]: E0706 18:59:35.885830 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc36e078376421b11ca1ee52f7711b6b952f362e4571ffce4de86831961af5b1\": container with ID starting with bc36e078376421b11ca1ee52f7711b6b952f362e4571ffce4de86831961af5b1 not found: ID does not exist" containerID="bc36e078376421b11ca1ee52f7711b6b952f362e4571ffce4de86831961af5b1" Jul 06 18:59:35.885894 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.885860 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc36e078376421b11ca1ee52f7711b6b952f362e4571ffce4de86831961af5b1"} err="failed to get container status \"bc36e078376421b11ca1ee52f7711b6b952f362e4571ffce4de86831961af5b1\": rpc error: code = NotFound desc = could not find container \"bc36e078376421b11ca1ee52f7711b6b952f362e4571ffce4de86831961af5b1\": container with ID starting with bc36e078376421b11ca1ee52f7711b6b952f362e4571ffce4de86831961af5b1 not found: ID does not exist" Jul 06 18:59:35.898012 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.897991 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b47b9dfd9-qqc2b"] Jul 06 18:59:35.900258 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:35.900238 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b47b9dfd9-qqc2b"] Jul 06 18:59:36.574258 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:36.574227 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d48960b5-a504-4054-bfaf-916098cfbb08" path="/var/lib/kubelet/pods/d48960b5-a504-4054-bfaf-916098cfbb08/volumes" Jul 06 18:59:52.474942 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:52.474916 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/1.log" Jul 06 18:59:52.479812 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:52.479793 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/1.log" Jul 06 18:59:52.486509 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:52.486491 2567 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 18:59:56.601267 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:56.601233 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr"] Jul 06 18:59:56.602722 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:56.601597 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d48960b5-a504-4054-bfaf-916098cfbb08" containerName="console" Jul 06 18:59:56.602722 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:56.601611 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d48960b5-a504-4054-bfaf-916098cfbb08" containerName="console" Jul 06 18:59:56.602722 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:56.601674 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d48960b5-a504-4054-bfaf-916098cfbb08" containerName="console" Jul 06 18:59:56.603687 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:56.603672 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr" Jul 06 18:59:56.606314 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:56.606285 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 18:59:56.606444 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:56.606353 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 18:59:56.607334 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:56.607319 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mqjx7\"" Jul 06 18:59:56.614165 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:56.614146 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr"] Jul 06 18:59:56.653722 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:56.653683 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/956b3c26-f6a6-424d-836a-fb2b2c325804-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr\" (UID: \"956b3c26-f6a6-424d-836a-fb2b2c325804\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr" Jul 06 18:59:56.653876 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:56.653747 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/956b3c26-f6a6-424d-836a-fb2b2c325804-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr\" (UID: \"956b3c26-f6a6-424d-836a-fb2b2c325804\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr" Jul 06 18:59:56.653876 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:56.653784 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp8zg\" (UniqueName: \"kubernetes.io/projected/956b3c26-f6a6-424d-836a-fb2b2c325804-kube-api-access-gp8zg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr\" (UID: \"956b3c26-f6a6-424d-836a-fb2b2c325804\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr" Jul 06 18:59:56.754311 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:56.754265 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/956b3c26-f6a6-424d-836a-fb2b2c325804-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr\" (UID: \"956b3c26-f6a6-424d-836a-fb2b2c325804\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr" Jul 06 18:59:56.754467 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:56.754319 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp8zg\" (UniqueName: \"kubernetes.io/projected/956b3c26-f6a6-424d-836a-fb2b2c325804-kube-api-access-gp8zg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr\" (UID: \"956b3c26-f6a6-424d-836a-fb2b2c325804\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr" Jul 06 18:59:56.754467 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:56.754375 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/956b3c26-f6a6-424d-836a-fb2b2c325804-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr\" (UID: \"956b3c26-f6a6-424d-836a-fb2b2c325804\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr" Jul 06 18:59:56.754813 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:56.754791 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/956b3c26-f6a6-424d-836a-fb2b2c325804-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr\" (UID: \"956b3c26-f6a6-424d-836a-fb2b2c325804\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr" Jul 06 18:59:56.754895 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:56.754880 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/956b3c26-f6a6-424d-836a-fb2b2c325804-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr\" (UID: \"956b3c26-f6a6-424d-836a-fb2b2c325804\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr" Jul 06 18:59:56.763274 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:56.763249 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp8zg\" (UniqueName: \"kubernetes.io/projected/956b3c26-f6a6-424d-836a-fb2b2c325804-kube-api-access-gp8zg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr\" (UID: \"956b3c26-f6a6-424d-836a-fb2b2c325804\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr" Jul 06 18:59:56.913648 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:56.913544 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr" Jul 06 18:59:57.043487 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:57.043443 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr"] Jul 06 18:59:57.045821 ip-10-0-139-154 kubenswrapper[2567]: W0706 18:59:57.045794 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod956b3c26_f6a6_424d_836a_fb2b2c325804.slice/crio-d0b2307d6e682fc1379f06425fe030be414f290a12e2a0606880cf06093c69e0 WatchSource:0}: Error finding container d0b2307d6e682fc1379f06425fe030be414f290a12e2a0606880cf06093c69e0: Status 404 returned error can't find the container with id d0b2307d6e682fc1379f06425fe030be414f290a12e2a0606880cf06093c69e0 Jul 06 18:59:57.047800 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:57.047782 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 18:59:57.960368 ip-10-0-139-154 kubenswrapper[2567]: I0706 18:59:57.960329 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr" event={"ID":"956b3c26-f6a6-424d-836a-fb2b2c325804","Type":"ContainerStarted","Data":"d0b2307d6e682fc1379f06425fe030be414f290a12e2a0606880cf06093c69e0"} Jul 06 19:00:04.991419 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:04.991378 2567 generic.go:356] "Generic (PLEG): container finished" podID="956b3c26-f6a6-424d-836a-fb2b2c325804" containerID="ced63ea0a221f4f479c3d2ca30aca3a02e7e8501fbd124d176ff5c63d9fcc68a" exitCode=0 Jul 06 19:00:04.991934 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:04.991467 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr" event={"ID":"956b3c26-f6a6-424d-836a-fb2b2c325804","Type":"ContainerDied","Data":"ced63ea0a221f4f479c3d2ca30aca3a02e7e8501fbd124d176ff5c63d9fcc68a"} Jul 06 19:00:09.025431 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:09.025390 2567 generic.go:356] "Generic (PLEG): container finished" podID="956b3c26-f6a6-424d-836a-fb2b2c325804" containerID="84b49a4ce5b84909d3723d29162165a156f5f9ce17e5428536e178288b4d369c" exitCode=0 Jul 06 19:00:09.025863 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:09.025495 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr" event={"ID":"956b3c26-f6a6-424d-836a-fb2b2c325804","Type":"ContainerDied","Data":"84b49a4ce5b84909d3723d29162165a156f5f9ce17e5428536e178288b4d369c"} Jul 06 19:00:18.064634 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:18.064543 2567 generic.go:356] "Generic (PLEG): container finished" podID="956b3c26-f6a6-424d-836a-fb2b2c325804" containerID="fe6f17992b492fc9b3fd12a2030bbd41e1a7ac599e9a7fc2c3ce2b1a4e09e216" exitCode=0 Jul 06 19:00:18.065032 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:18.064629 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr" event={"ID":"956b3c26-f6a6-424d-836a-fb2b2c325804","Type":"ContainerDied","Data":"fe6f17992b492fc9b3fd12a2030bbd41e1a7ac599e9a7fc2c3ce2b1a4e09e216"} Jul 06 19:00:19.220996 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:19.220967 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr" Jul 06 19:00:19.361716 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:19.361621 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gp8zg\" (UniqueName: \"kubernetes.io/projected/956b3c26-f6a6-424d-836a-fb2b2c325804-kube-api-access-gp8zg\") pod \"956b3c26-f6a6-424d-836a-fb2b2c325804\" (UID: \"956b3c26-f6a6-424d-836a-fb2b2c325804\") " Jul 06 19:00:19.361716 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:19.361677 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/956b3c26-f6a6-424d-836a-fb2b2c325804-bundle\") pod \"956b3c26-f6a6-424d-836a-fb2b2c325804\" (UID: \"956b3c26-f6a6-424d-836a-fb2b2c325804\") " Jul 06 19:00:19.361949 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:19.361733 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/956b3c26-f6a6-424d-836a-fb2b2c325804-util\") pod \"956b3c26-f6a6-424d-836a-fb2b2c325804\" (UID: \"956b3c26-f6a6-424d-836a-fb2b2c325804\") " Jul 06 19:00:19.362461 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:19.362436 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/956b3c26-f6a6-424d-836a-fb2b2c325804-bundle" (OuterVolumeSpecName: "bundle") pod "956b3c26-f6a6-424d-836a-fb2b2c325804" (UID: "956b3c26-f6a6-424d-836a-fb2b2c325804"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:00:19.364026 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:19.364001 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/956b3c26-f6a6-424d-836a-fb2b2c325804-kube-api-access-gp8zg" (OuterVolumeSpecName: "kube-api-access-gp8zg") pod "956b3c26-f6a6-424d-836a-fb2b2c325804" (UID: "956b3c26-f6a6-424d-836a-fb2b2c325804"). InnerVolumeSpecName "kube-api-access-gp8zg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:00:19.366811 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:19.366784 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/956b3c26-f6a6-424d-836a-fb2b2c325804-util" (OuterVolumeSpecName: "util") pod "956b3c26-f6a6-424d-836a-fb2b2c325804" (UID: "956b3c26-f6a6-424d-836a-fb2b2c325804"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:00:19.462675 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:19.462638 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/956b3c26-f6a6-424d-836a-fb2b2c325804-util\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:00:19.462675 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:19.462672 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp8zg\" (UniqueName: \"kubernetes.io/projected/956b3c26-f6a6-424d-836a-fb2b2c325804-kube-api-access-gp8zg\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:00:19.462675 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:19.462683 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/956b3c26-f6a6-424d-836a-fb2b2c325804-bundle\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:00:20.073719 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:20.073684 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr" event={"ID":"956b3c26-f6a6-424d-836a-fb2b2c325804","Type":"ContainerDied","Data":"d0b2307d6e682fc1379f06425fe030be414f290a12e2a0606880cf06093c69e0"} Jul 06 19:00:20.073889 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:20.073721 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404l9zr" Jul 06 19:00:20.073889 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:20.073731 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0b2307d6e682fc1379f06425fe030be414f290a12e2a0606880cf06093c69e0" Jul 06 19:00:24.645219 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:24.645190 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqtxk"] Jul 06 19:00:24.645626 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:24.645514 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="956b3c26-f6a6-424d-836a-fb2b2c325804" containerName="extract" Jul 06 19:00:24.645626 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:24.645526 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="956b3c26-f6a6-424d-836a-fb2b2c325804" containerName="extract" Jul 06 19:00:24.645626 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:24.645538 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="956b3c26-f6a6-424d-836a-fb2b2c325804" containerName="util" Jul 06 19:00:24.645626 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:24.645545 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="956b3c26-f6a6-424d-836a-fb2b2c325804" containerName="util" Jul 06 19:00:24.645626 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:24.645551 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="956b3c26-f6a6-424d-836a-fb2b2c325804" containerName="pull" Jul 06 19:00:24.645626 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:24.645556 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="956b3c26-f6a6-424d-836a-fb2b2c325804" containerName="pull" Jul 06 19:00:24.645626 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:24.645611 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="956b3c26-f6a6-424d-836a-fb2b2c325804" containerName="extract" Jul 06 19:00:24.647735 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:24.647718 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqtxk" Jul 06 19:00:24.650189 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:24.650165 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-q56pr\"" Jul 06 19:00:24.650573 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:24.650555 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:00:24.651318 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:24.651298 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 19:00:24.661650 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:24.661626 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqtxk"] Jul 06 19:00:24.807385 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:24.807341 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5d5be56-346f-4cb4-bf2d-86752449b28b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sqtxk\" (UID: \"d5d5be56-346f-4cb4-bf2d-86752449b28b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqtxk" Jul 06 19:00:24.807587 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:24.807402 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m52ls\" (UniqueName: \"kubernetes.io/projected/d5d5be56-346f-4cb4-bf2d-86752449b28b-kube-api-access-m52ls\") pod \"cert-manager-operator-controller-manager-55c444bf86-sqtxk\" (UID: \"d5d5be56-346f-4cb4-bf2d-86752449b28b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqtxk" Jul 06 19:00:24.908592 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:24.908500 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5d5be56-346f-4cb4-bf2d-86752449b28b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sqtxk\" (UID: \"d5d5be56-346f-4cb4-bf2d-86752449b28b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqtxk" Jul 06 19:00:24.908592 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:24.908553 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m52ls\" (UniqueName: \"kubernetes.io/projected/d5d5be56-346f-4cb4-bf2d-86752449b28b-kube-api-access-m52ls\") pod \"cert-manager-operator-controller-manager-55c444bf86-sqtxk\" (UID: \"d5d5be56-346f-4cb4-bf2d-86752449b28b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqtxk" Jul 06 19:00:24.908908 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:24.908888 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5d5be56-346f-4cb4-bf2d-86752449b28b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sqtxk\" (UID: \"d5d5be56-346f-4cb4-bf2d-86752449b28b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqtxk" Jul 06 19:00:24.918157 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:24.918131 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m52ls\" (UniqueName: \"kubernetes.io/projected/d5d5be56-346f-4cb4-bf2d-86752449b28b-kube-api-access-m52ls\") pod \"cert-manager-operator-controller-manager-55c444bf86-sqtxk\" (UID: \"d5d5be56-346f-4cb4-bf2d-86752449b28b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqtxk" Jul 06 19:00:24.956285 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:24.956259 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqtxk" Jul 06 19:00:25.092148 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:25.092126 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqtxk"] Jul 06 19:00:25.095204 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:00:25.095175 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5d5be56_346f_4cb4_bf2d_86752449b28b.slice/crio-08e8af37510ae1e2bf24518f6e93702f9a91b45bf95fa8747fc116954740f8a2 WatchSource:0}: Error finding container 08e8af37510ae1e2bf24518f6e93702f9a91b45bf95fa8747fc116954740f8a2: Status 404 returned error can't find the container with id 08e8af37510ae1e2bf24518f6e93702f9a91b45bf95fa8747fc116954740f8a2 Jul 06 19:00:26.099044 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:26.099003 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqtxk" event={"ID":"d5d5be56-346f-4cb4-bf2d-86752449b28b","Type":"ContainerStarted","Data":"08e8af37510ae1e2bf24518f6e93702f9a91b45bf95fa8747fc116954740f8a2"} Jul 06 19:00:27.104629 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:27.104596 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqtxk" event={"ID":"d5d5be56-346f-4cb4-bf2d-86752449b28b","Type":"ContainerStarted","Data":"df17b13ffcde970d0cad495b723b4693aef181f71c1a513259aba334a60a6cc3"} Jul 06 19:00:27.140078 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:27.140008 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqtxk" podStartSLOduration=1.596221968 podStartE2EDuration="3.139989318s" totalImagesPullingTime="1.54376735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:00:27.139141489 +0000 UTC m=+335.065576040" watchObservedRunningTime="2026-07-06 19:00:27.139989318 +0000 UTC m=+335.066423868" Jul 06 19:00:28.495332 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:28.495296 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7"] Jul 06 19:00:28.497890 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:28.497873 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7" Jul 06 19:00:28.501345 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:28.501293 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mqjx7\"" Jul 06 19:00:28.501682 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:28.501652 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 19:00:28.502096 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:28.502069 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 19:00:28.515556 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:28.515532 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7"] Jul 06 19:00:28.638535 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:28.638501 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9e8f528-eaf7-441f-8bd5-29d6b0ca6541-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7\" (UID: \"d9e8f528-eaf7-441f-8bd5-29d6b0ca6541\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7" Jul 06 19:00:28.638691 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:28.638559 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9e8f528-eaf7-441f-8bd5-29d6b0ca6541-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7\" (UID: \"d9e8f528-eaf7-441f-8bd5-29d6b0ca6541\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7" Jul 06 19:00:28.638691 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:28.638627 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88gbz\" (UniqueName: \"kubernetes.io/projected/d9e8f528-eaf7-441f-8bd5-29d6b0ca6541-kube-api-access-88gbz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7\" (UID: \"d9e8f528-eaf7-441f-8bd5-29d6b0ca6541\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7" Jul 06 19:00:28.739587 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:28.739554 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9e8f528-eaf7-441f-8bd5-29d6b0ca6541-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7\" (UID: \"d9e8f528-eaf7-441f-8bd5-29d6b0ca6541\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7" Jul 06 19:00:28.739752 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:28.739606 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9e8f528-eaf7-441f-8bd5-29d6b0ca6541-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7\" (UID: \"d9e8f528-eaf7-441f-8bd5-29d6b0ca6541\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7" Jul 06 19:00:28.739752 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:28.739652 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88gbz\" (UniqueName: \"kubernetes.io/projected/d9e8f528-eaf7-441f-8bd5-29d6b0ca6541-kube-api-access-88gbz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7\" (UID: \"d9e8f528-eaf7-441f-8bd5-29d6b0ca6541\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7" Jul 06 19:00:28.740067 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:28.740047 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9e8f528-eaf7-441f-8bd5-29d6b0ca6541-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7\" (UID: \"d9e8f528-eaf7-441f-8bd5-29d6b0ca6541\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7" Jul 06 19:00:28.740067 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:28.740058 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9e8f528-eaf7-441f-8bd5-29d6b0ca6541-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7\" (UID: \"d9e8f528-eaf7-441f-8bd5-29d6b0ca6541\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7" Jul 06 19:00:28.751397 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:28.751338 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88gbz\" (UniqueName: \"kubernetes.io/projected/d9e8f528-eaf7-441f-8bd5-29d6b0ca6541-kube-api-access-88gbz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7\" (UID: \"d9e8f528-eaf7-441f-8bd5-29d6b0ca6541\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7" Jul 06 19:00:28.812222 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:28.812191 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7" Jul 06 19:00:28.954706 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:28.954683 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7"] Jul 06 19:00:28.956733 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:00:28.956707 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e8f528_eaf7_441f_8bd5_29d6b0ca6541.slice/crio-162565dadb25e2664dba4f2b578987f570f8094c71ec4cb3d98efdc5155c061c WatchSource:0}: Error finding container 162565dadb25e2664dba4f2b578987f570f8094c71ec4cb3d98efdc5155c061c: Status 404 returned error can't find the container with id 162565dadb25e2664dba4f2b578987f570f8094c71ec4cb3d98efdc5155c061c Jul 06 19:00:29.114354 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:29.114316 2567 generic.go:356] "Generic (PLEG): container finished" podID="d9e8f528-eaf7-441f-8bd5-29d6b0ca6541" containerID="c7adcf2af483fc86fba0264d8050962ec79169362a6cfc03d89ecbcb7879b43c" exitCode=0 Jul 06 19:00:29.114524 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:29.114364 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7" event={"ID":"d9e8f528-eaf7-441f-8bd5-29d6b0ca6541","Type":"ContainerDied","Data":"c7adcf2af483fc86fba0264d8050962ec79169362a6cfc03d89ecbcb7879b43c"} Jul 06 19:00:29.114524 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:29.114409 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7" event={"ID":"d9e8f528-eaf7-441f-8bd5-29d6b0ca6541","Type":"ContainerStarted","Data":"162565dadb25e2664dba4f2b578987f570f8094c71ec4cb3d98efdc5155c061c"} Jul 06 19:00:32.131648 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:32.131615 2567 generic.go:356] "Generic (PLEG): container finished" podID="d9e8f528-eaf7-441f-8bd5-29d6b0ca6541" containerID="a3d1f93d6c13951d8b69c847d25ac595cd1d0e42eea1a88ef1d16efec3a892cd" exitCode=0 Jul 06 19:00:32.132038 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:32.131683 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7" event={"ID":"d9e8f528-eaf7-441f-8bd5-29d6b0ca6541","Type":"ContainerDied","Data":"a3d1f93d6c13951d8b69c847d25ac595cd1d0e42eea1a88ef1d16efec3a892cd"} Jul 06 19:00:33.137347 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:33.137296 2567 generic.go:356] "Generic (PLEG): container finished" podID="d9e8f528-eaf7-441f-8bd5-29d6b0ca6541" containerID="43d6bf988eda7123c837411b61dec77e21fbd8e7dff077f43b88c4c48e3e32be" exitCode=0 Jul 06 19:00:33.137738 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:33.137390 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7" event={"ID":"d9e8f528-eaf7-441f-8bd5-29d6b0ca6541","Type":"ContainerDied","Data":"43d6bf988eda7123c837411b61dec77e21fbd8e7dff077f43b88c4c48e3e32be"} Jul 06 19:00:34.266394 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:34.266369 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7" Jul 06 19:00:34.384504 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:34.384456 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88gbz\" (UniqueName: \"kubernetes.io/projected/d9e8f528-eaf7-441f-8bd5-29d6b0ca6541-kube-api-access-88gbz\") pod \"d9e8f528-eaf7-441f-8bd5-29d6b0ca6541\" (UID: \"d9e8f528-eaf7-441f-8bd5-29d6b0ca6541\") " Jul 06 19:00:34.384677 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:34.384542 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9e8f528-eaf7-441f-8bd5-29d6b0ca6541-util\") pod \"d9e8f528-eaf7-441f-8bd5-29d6b0ca6541\" (UID: \"d9e8f528-eaf7-441f-8bd5-29d6b0ca6541\") " Jul 06 19:00:34.384677 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:34.384573 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9e8f528-eaf7-441f-8bd5-29d6b0ca6541-bundle\") pod \"d9e8f528-eaf7-441f-8bd5-29d6b0ca6541\" (UID: \"d9e8f528-eaf7-441f-8bd5-29d6b0ca6541\") " Jul 06 19:00:34.384975 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:34.384952 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9e8f528-eaf7-441f-8bd5-29d6b0ca6541-bundle" (OuterVolumeSpecName: "bundle") pod "d9e8f528-eaf7-441f-8bd5-29d6b0ca6541" (UID: "d9e8f528-eaf7-441f-8bd5-29d6b0ca6541"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:00:34.386584 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:34.386560 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9e8f528-eaf7-441f-8bd5-29d6b0ca6541-kube-api-access-88gbz" (OuterVolumeSpecName: "kube-api-access-88gbz") pod "d9e8f528-eaf7-441f-8bd5-29d6b0ca6541" (UID: "d9e8f528-eaf7-441f-8bd5-29d6b0ca6541"). InnerVolumeSpecName "kube-api-access-88gbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:00:34.433581 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:34.433552 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9e8f528-eaf7-441f-8bd5-29d6b0ca6541-util" (OuterVolumeSpecName: "util") pod "d9e8f528-eaf7-441f-8bd5-29d6b0ca6541" (UID: "d9e8f528-eaf7-441f-8bd5-29d6b0ca6541"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:00:34.485443 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:34.485418 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88gbz\" (UniqueName: \"kubernetes.io/projected/d9e8f528-eaf7-441f-8bd5-29d6b0ca6541-kube-api-access-88gbz\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:00:34.485551 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:34.485444 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9e8f528-eaf7-441f-8bd5-29d6b0ca6541-util\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:00:34.485551 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:34.485456 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9e8f528-eaf7-441f-8bd5-29d6b0ca6541-bundle\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:00:35.148485 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:35.148456 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7" Jul 06 19:00:35.148682 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:35.148459 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsjv7" event={"ID":"d9e8f528-eaf7-441f-8bd5-29d6b0ca6541","Type":"ContainerDied","Data":"162565dadb25e2664dba4f2b578987f570f8094c71ec4cb3d98efdc5155c061c"} Jul 06 19:00:35.148682 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:35.148592 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="162565dadb25e2664dba4f2b578987f570f8094c71ec4cb3d98efdc5155c061c" Jul 06 19:00:38.745740 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:38.745706 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4tsc8"] Jul 06 19:00:38.746210 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:38.746123 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9e8f528-eaf7-441f-8bd5-29d6b0ca6541" containerName="pull" Jul 06 19:00:38.746210 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:38.746141 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9e8f528-eaf7-441f-8bd5-29d6b0ca6541" containerName="pull" Jul 06 19:00:38.746210 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:38.746157 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9e8f528-eaf7-441f-8bd5-29d6b0ca6541" containerName="util" Jul 06 19:00:38.746210 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:38.746164 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9e8f528-eaf7-441f-8bd5-29d6b0ca6541" containerName="util" Jul 06 19:00:38.746210 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:38.746181 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9e8f528-eaf7-441f-8bd5-29d6b0ca6541" containerName="extract" Jul 06 19:00:38.746210 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:38.746189 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9e8f528-eaf7-441f-8bd5-29d6b0ca6541" containerName="extract" Jul 06 19:00:38.746552 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:38.746275 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9e8f528-eaf7-441f-8bd5-29d6b0ca6541" containerName="extract" Jul 06 19:00:38.754007 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:38.753981 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4tsc8" Jul 06 19:00:38.757249 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:38.757225 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:00:38.757590 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:38.757254 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-q6jgd\"" Jul 06 19:00:38.757711 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:38.757269 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 19:00:38.758075 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:38.758054 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4tsc8"] Jul 06 19:00:38.820827 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:38.820793 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a54dadb0-b4c5-4dfa-a5ba-d9ca95793f88-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4tsc8\" (UID: \"a54dadb0-b4c5-4dfa-a5ba-d9ca95793f88\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4tsc8" Jul 06 19:00:38.820957 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:38.820868 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5hmx\" (UniqueName: \"kubernetes.io/projected/a54dadb0-b4c5-4dfa-a5ba-d9ca95793f88-kube-api-access-z5hmx\") pod \"openshift-lws-operator-fd8ccff4c-4tsc8\" (UID: \"a54dadb0-b4c5-4dfa-a5ba-d9ca95793f88\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4tsc8" Jul 06 19:00:38.921761 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:38.921731 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5hmx\" (UniqueName: \"kubernetes.io/projected/a54dadb0-b4c5-4dfa-a5ba-d9ca95793f88-kube-api-access-z5hmx\") pod \"openshift-lws-operator-fd8ccff4c-4tsc8\" (UID: \"a54dadb0-b4c5-4dfa-a5ba-d9ca95793f88\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4tsc8" Jul 06 19:00:38.921899 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:38.921782 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a54dadb0-b4c5-4dfa-a5ba-d9ca95793f88-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4tsc8\" (UID: \"a54dadb0-b4c5-4dfa-a5ba-d9ca95793f88\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4tsc8" Jul 06 19:00:38.922125 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:38.922108 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a54dadb0-b4c5-4dfa-a5ba-d9ca95793f88-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4tsc8\" (UID: \"a54dadb0-b4c5-4dfa-a5ba-d9ca95793f88\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4tsc8" Jul 06 19:00:38.931084 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:38.931060 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5hmx\" (UniqueName: \"kubernetes.io/projected/a54dadb0-b4c5-4dfa-a5ba-d9ca95793f88-kube-api-access-z5hmx\") pod \"openshift-lws-operator-fd8ccff4c-4tsc8\" (UID: \"a54dadb0-b4c5-4dfa-a5ba-d9ca95793f88\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4tsc8" Jul 06 19:00:39.076273 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:39.076193 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4tsc8" Jul 06 19:00:39.213437 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:39.213399 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4tsc8"] Jul 06 19:00:39.216677 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:00:39.216650 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda54dadb0_b4c5_4dfa_a5ba_d9ca95793f88.slice/crio-ded1cf878725b665d7d3d64da0efe2d758a87d0a0cff808df15424fac127b945 WatchSource:0}: Error finding container ded1cf878725b665d7d3d64da0efe2d758a87d0a0cff808df15424fac127b945: Status 404 returned error can't find the container with id ded1cf878725b665d7d3d64da0efe2d758a87d0a0cff808df15424fac127b945 Jul 06 19:00:40.171770 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:40.171735 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4tsc8" event={"ID":"a54dadb0-b4c5-4dfa-a5ba-d9ca95793f88","Type":"ContainerStarted","Data":"ded1cf878725b665d7d3d64da0efe2d758a87d0a0cff808df15424fac127b945"} Jul 06 19:00:40.901165 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:40.901141 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9szlv"] Jul 06 19:00:40.905415 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:40.905397 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9szlv" Jul 06 19:00:40.908398 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:40.908373 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-zs7vm\"" Jul 06 19:00:40.908767 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:40.908439 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 19:00:40.909294 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:40.909277 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 19:00:40.916787 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:40.916765 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9szlv"] Jul 06 19:00:40.939812 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:40.939785 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqtpv\" (UniqueName: \"kubernetes.io/projected/69401fe7-8732-4609-8e3f-803cb3cac03f-kube-api-access-rqtpv\") pod \"cert-manager-webhook-6486ffd997-9szlv\" (UID: \"69401fe7-8732-4609-8e3f-803cb3cac03f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9szlv" Jul 06 19:00:40.939965 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:40.939832 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69401fe7-8732-4609-8e3f-803cb3cac03f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9szlv\" (UID: \"69401fe7-8732-4609-8e3f-803cb3cac03f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9szlv" Jul 06 19:00:41.040931 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:41.040902 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69401fe7-8732-4609-8e3f-803cb3cac03f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9szlv\" (UID: \"69401fe7-8732-4609-8e3f-803cb3cac03f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9szlv" Jul 06 19:00:41.041062 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:41.040974 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqtpv\" (UniqueName: \"kubernetes.io/projected/69401fe7-8732-4609-8e3f-803cb3cac03f-kube-api-access-rqtpv\") pod \"cert-manager-webhook-6486ffd997-9szlv\" (UID: \"69401fe7-8732-4609-8e3f-803cb3cac03f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9szlv" Jul 06 19:00:41.051049 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:41.051018 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69401fe7-8732-4609-8e3f-803cb3cac03f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9szlv\" (UID: \"69401fe7-8732-4609-8e3f-803cb3cac03f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9szlv" Jul 06 19:00:41.051556 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:41.051530 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqtpv\" (UniqueName: \"kubernetes.io/projected/69401fe7-8732-4609-8e3f-803cb3cac03f-kube-api-access-rqtpv\") pod \"cert-manager-webhook-6486ffd997-9szlv\" (UID: \"69401fe7-8732-4609-8e3f-803cb3cac03f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9szlv" Jul 06 19:00:41.177512 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:41.177467 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4tsc8" event={"ID":"a54dadb0-b4c5-4dfa-a5ba-d9ca95793f88","Type":"ContainerStarted","Data":"143688832c72d14dfc31cf1cbe829841c14cad420b1fcb7506b3b3048dc14f14"} Jul 06 19:00:41.201169 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:41.201113 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4tsc8" podStartSLOduration=1.563672884 podStartE2EDuration="3.201097459s" totalImagesPullingTime="1.637424575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:00:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:00:41.201056913 +0000 UTC m=+349.127491462" watchObservedRunningTime="2026-07-06 19:00:41.201097459 +0000 UTC m=+349.127532008" Jul 06 19:00:41.216199 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:41.216168 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9szlv" Jul 06 19:00:41.355632 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:41.355603 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9szlv"] Jul 06 19:00:41.357060 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:00:41.357027 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69401fe7_8732_4609_8e3f_803cb3cac03f.slice/crio-18e5cfdfee3e16d3ae150a75f495ab2603ceebb21cf6024dcce988b922a3b7e4 WatchSource:0}: Error finding container 18e5cfdfee3e16d3ae150a75f495ab2603ceebb21cf6024dcce988b922a3b7e4: Status 404 returned error can't find the container with id 18e5cfdfee3e16d3ae150a75f495ab2603ceebb21cf6024dcce988b922a3b7e4 Jul 06 19:00:42.184317 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:42.184265 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9szlv" event={"ID":"69401fe7-8732-4609-8e3f-803cb3cac03f","Type":"ContainerStarted","Data":"18e5cfdfee3e16d3ae150a75f495ab2603ceebb21cf6024dcce988b922a3b7e4"} Jul 06 19:00:44.157826 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:44.157746 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw"] Jul 06 19:00:44.165546 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:44.165526 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw" Jul 06 19:00:44.172044 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:44.171826 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 19:00:44.172044 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:44.171978 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mqjx7\"" Jul 06 19:00:44.172688 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:44.172671 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 19:00:44.194813 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:44.194788 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw"] Jul 06 19:00:44.268508 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:44.268468 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/166dd41d-b199-4011-b60c-18941ed1b73b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw\" (UID: \"166dd41d-b199-4011-b60c-18941ed1b73b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw" Jul 06 19:00:44.268612 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:44.268537 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/166dd41d-b199-4011-b60c-18941ed1b73b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw\" (UID: \"166dd41d-b199-4011-b60c-18941ed1b73b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw" Jul 06 19:00:44.268612 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:44.268564 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhm99\" (UniqueName: \"kubernetes.io/projected/166dd41d-b199-4011-b60c-18941ed1b73b-kube-api-access-rhm99\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw\" (UID: \"166dd41d-b199-4011-b60c-18941ed1b73b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw" Jul 06 19:00:44.369103 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:44.369069 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/166dd41d-b199-4011-b60c-18941ed1b73b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw\" (UID: \"166dd41d-b199-4011-b60c-18941ed1b73b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw" Jul 06 19:00:44.369284 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:44.369121 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/166dd41d-b199-4011-b60c-18941ed1b73b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw\" (UID: \"166dd41d-b199-4011-b60c-18941ed1b73b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw" Jul 06 19:00:44.369284 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:44.369148 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhm99\" (UniqueName: \"kubernetes.io/projected/166dd41d-b199-4011-b60c-18941ed1b73b-kube-api-access-rhm99\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw\" (UID: \"166dd41d-b199-4011-b60c-18941ed1b73b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw" Jul 06 19:00:44.369447 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:44.369425 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/166dd41d-b199-4011-b60c-18941ed1b73b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw\" (UID: \"166dd41d-b199-4011-b60c-18941ed1b73b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw" Jul 06 19:00:44.369573 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:44.369552 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/166dd41d-b199-4011-b60c-18941ed1b73b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw\" (UID: \"166dd41d-b199-4011-b60c-18941ed1b73b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw" Jul 06 19:00:44.384310 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:44.384285 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhm99\" (UniqueName: \"kubernetes.io/projected/166dd41d-b199-4011-b60c-18941ed1b73b-kube-api-access-rhm99\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw\" (UID: \"166dd41d-b199-4011-b60c-18941ed1b73b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw" Jul 06 19:00:44.475019 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:44.474987 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw" Jul 06 19:00:44.654961 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:00:44.654931 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod166dd41d_b199_4011_b60c_18941ed1b73b.slice/crio-28143493718e3a99604f8d276725fd559efc671656c10773ec770421bdb8e87a WatchSource:0}: Error finding container 28143493718e3a99604f8d276725fd559efc671656c10773ec770421bdb8e87a: Status 404 returned error can't find the container with id 28143493718e3a99604f8d276725fd559efc671656c10773ec770421bdb8e87a Jul 06 19:00:44.656278 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:44.656248 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw"] Jul 06 19:00:45.200590 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:45.200557 2567 generic.go:356] "Generic (PLEG): container finished" podID="166dd41d-b199-4011-b60c-18941ed1b73b" containerID="a0994432be6ddcfa86113728936d0657cf0d9466adc9f87bd2e0f76b7ad1d3b0" exitCode=0 Jul 06 19:00:45.201047 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:45.200641 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw" event={"ID":"166dd41d-b199-4011-b60c-18941ed1b73b","Type":"ContainerDied","Data":"a0994432be6ddcfa86113728936d0657cf0d9466adc9f87bd2e0f76b7ad1d3b0"} Jul 06 19:00:45.201047 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:45.200690 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw" event={"ID":"166dd41d-b199-4011-b60c-18941ed1b73b","Type":"ContainerStarted","Data":"28143493718e3a99604f8d276725fd559efc671656c10773ec770421bdb8e87a"} Jul 06 19:00:45.202220 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:45.202201 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9szlv" event={"ID":"69401fe7-8732-4609-8e3f-803cb3cac03f","Type":"ContainerStarted","Data":"3d5377c453aa353f18daf39e9effcf7b20f717184417af8011b95d4a9436ab64"} Jul 06 19:00:45.202343 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:45.202324 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9szlv" Jul 06 19:00:46.208685 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:46.208655 2567 generic.go:356] "Generic (PLEG): container finished" podID="166dd41d-b199-4011-b60c-18941ed1b73b" containerID="8570f4094ff6468fb0aefbbf5ffd5e06b652d0f205298a5faedcf7affcbbc66f" exitCode=0 Jul 06 19:00:46.209097 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:46.208730 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw" event={"ID":"166dd41d-b199-4011-b60c-18941ed1b73b","Type":"ContainerDied","Data":"8570f4094ff6468fb0aefbbf5ffd5e06b652d0f205298a5faedcf7affcbbc66f"} Jul 06 19:00:46.230139 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:46.230099 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-9szlv" podStartSLOduration=3.3984693 podStartE2EDuration="6.230083192s" totalImagesPullingTime="2.831613892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:00:45.2411323 +0000 UTC m=+353.167566848" watchObservedRunningTime="2026-07-06 19:00:46.230083192 +0000 UTC m=+354.156517741" Jul 06 19:00:47.215643 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:47.215611 2567 generic.go:356] "Generic (PLEG): container finished" podID="166dd41d-b199-4011-b60c-18941ed1b73b" containerID="99b477f76684bd3e68b1b9796f616a5b0d072e4f32bb31ecd5437a18205f47e4" exitCode=0 Jul 06 19:00:47.216087 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:47.215678 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw" event={"ID":"166dd41d-b199-4011-b60c-18941ed1b73b","Type":"ContainerDied","Data":"99b477f76684bd3e68b1b9796f616a5b0d072e4f32bb31ecd5437a18205f47e4"} Jul 06 19:00:48.343881 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:48.343857 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw" Jul 06 19:00:48.400943 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:48.400912 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/166dd41d-b199-4011-b60c-18941ed1b73b-bundle\") pod \"166dd41d-b199-4011-b60c-18941ed1b73b\" (UID: \"166dd41d-b199-4011-b60c-18941ed1b73b\") " Jul 06 19:00:48.401080 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:48.400959 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhm99\" (UniqueName: \"kubernetes.io/projected/166dd41d-b199-4011-b60c-18941ed1b73b-kube-api-access-rhm99\") pod \"166dd41d-b199-4011-b60c-18941ed1b73b\" (UID: \"166dd41d-b199-4011-b60c-18941ed1b73b\") " Jul 06 19:00:48.401080 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:48.401000 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/166dd41d-b199-4011-b60c-18941ed1b73b-util\") pod \"166dd41d-b199-4011-b60c-18941ed1b73b\" (UID: \"166dd41d-b199-4011-b60c-18941ed1b73b\") " Jul 06 19:00:48.401845 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:48.401816 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/166dd41d-b199-4011-b60c-18941ed1b73b-bundle" (OuterVolumeSpecName: "bundle") pod "166dd41d-b199-4011-b60c-18941ed1b73b" (UID: "166dd41d-b199-4011-b60c-18941ed1b73b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:00:48.403081 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:48.403059 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/166dd41d-b199-4011-b60c-18941ed1b73b-kube-api-access-rhm99" (OuterVolumeSpecName: "kube-api-access-rhm99") pod "166dd41d-b199-4011-b60c-18941ed1b73b" (UID: "166dd41d-b199-4011-b60c-18941ed1b73b"). InnerVolumeSpecName "kube-api-access-rhm99". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:00:48.409550 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:48.409524 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/166dd41d-b199-4011-b60c-18941ed1b73b-util" (OuterVolumeSpecName: "util") pod "166dd41d-b199-4011-b60c-18941ed1b73b" (UID: "166dd41d-b199-4011-b60c-18941ed1b73b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:00:48.502024 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:48.501939 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/166dd41d-b199-4011-b60c-18941ed1b73b-bundle\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:00:48.502024 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:48.501981 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhm99\" (UniqueName: \"kubernetes.io/projected/166dd41d-b199-4011-b60c-18941ed1b73b-kube-api-access-rhm99\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:00:48.502024 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:48.501991 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/166dd41d-b199-4011-b60c-18941ed1b73b-util\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:00:49.227427 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:49.227390 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw" Jul 06 19:00:49.227427 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:49.227410 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmflw" event={"ID":"166dd41d-b199-4011-b60c-18941ed1b73b","Type":"ContainerDied","Data":"28143493718e3a99604f8d276725fd559efc671656c10773ec770421bdb8e87a"} Jul 06 19:00:49.227692 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:49.227461 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28143493718e3a99604f8d276725fd559efc671656c10773ec770421bdb8e87a" Jul 06 19:00:51.210863 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:00:51.210837 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9szlv" Jul 06 19:01:01.247870 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.247835 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj"] Jul 06 19:01:01.248235 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.248140 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="166dd41d-b199-4011-b60c-18941ed1b73b" containerName="util" Jul 06 19:01:01.248235 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.248152 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="166dd41d-b199-4011-b60c-18941ed1b73b" containerName="util" Jul 06 19:01:01.248235 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.248160 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="166dd41d-b199-4011-b60c-18941ed1b73b" containerName="pull" Jul 06 19:01:01.248235 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.248166 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="166dd41d-b199-4011-b60c-18941ed1b73b" containerName="pull" Jul 06 19:01:01.248235 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.248174 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="166dd41d-b199-4011-b60c-18941ed1b73b" containerName="extract" Jul 06 19:01:01.248235 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.248178 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="166dd41d-b199-4011-b60c-18941ed1b73b" containerName="extract" Jul 06 19:01:01.248235 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.248239 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="166dd41d-b199-4011-b60c-18941ed1b73b" containerName="extract" Jul 06 19:01:01.250865 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.250849 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" Jul 06 19:01:01.258256 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.258238 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 19:01:01.262207 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.262190 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 19:01:01.262333 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.262319 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-65wfm\"" Jul 06 19:01:01.262434 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.262421 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 19:01:01.262888 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.262870 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 19:01:01.305344 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.305312 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83bcbb72-b275-43d7-b2f0-533daa61ae3d-tmp\") pod \"opendatahub-operator-controller-manager-546c6c6d78-j4wtj\" (UID: \"83bcbb72-b275-43d7-b2f0-533daa61ae3d\") " pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" Jul 06 19:01:01.305504 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.305354 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgrcs\" (UniqueName: \"kubernetes.io/projected/83bcbb72-b275-43d7-b2f0-533daa61ae3d-kube-api-access-jgrcs\") pod \"opendatahub-operator-controller-manager-546c6c6d78-j4wtj\" (UID: \"83bcbb72-b275-43d7-b2f0-533daa61ae3d\") " pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" Jul 06 19:01:01.305504 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.305379 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83bcbb72-b275-43d7-b2f0-533daa61ae3d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546c6c6d78-j4wtj\" (UID: \"83bcbb72-b275-43d7-b2f0-533daa61ae3d\") " pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" Jul 06 19:01:01.305504 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.305456 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83bcbb72-b275-43d7-b2f0-533daa61ae3d-webhook-cert\") pod \"opendatahub-operator-controller-manager-546c6c6d78-j4wtj\" (UID: \"83bcbb72-b275-43d7-b2f0-533daa61ae3d\") " pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" Jul 06 19:01:01.305653 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.305536 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/83bcbb72-b275-43d7-b2f0-533daa61ae3d-manifests\") pod \"opendatahub-operator-controller-manager-546c6c6d78-j4wtj\" (UID: \"83bcbb72-b275-43d7-b2f0-533daa61ae3d\") " pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" Jul 06 19:01:01.365317 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.365288 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj"] Jul 06 19:01:01.406567 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.406545 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83bcbb72-b275-43d7-b2f0-533daa61ae3d-tmp\") pod \"opendatahub-operator-controller-manager-546c6c6d78-j4wtj\" (UID: \"83bcbb72-b275-43d7-b2f0-533daa61ae3d\") " pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" Jul 06 19:01:01.406682 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.406574 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgrcs\" (UniqueName: \"kubernetes.io/projected/83bcbb72-b275-43d7-b2f0-533daa61ae3d-kube-api-access-jgrcs\") pod \"opendatahub-operator-controller-manager-546c6c6d78-j4wtj\" (UID: \"83bcbb72-b275-43d7-b2f0-533daa61ae3d\") " pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" Jul 06 19:01:01.406682 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.406598 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83bcbb72-b275-43d7-b2f0-533daa61ae3d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546c6c6d78-j4wtj\" (UID: \"83bcbb72-b275-43d7-b2f0-533daa61ae3d\") " pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" Jul 06 19:01:01.406758 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.406732 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83bcbb72-b275-43d7-b2f0-533daa61ae3d-webhook-cert\") pod \"opendatahub-operator-controller-manager-546c6c6d78-j4wtj\" (UID: \"83bcbb72-b275-43d7-b2f0-533daa61ae3d\") " pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" Jul 06 19:01:01.406808 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.406790 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/83bcbb72-b275-43d7-b2f0-533daa61ae3d-manifests\") pod \"opendatahub-operator-controller-manager-546c6c6d78-j4wtj\" (UID: \"83bcbb72-b275-43d7-b2f0-533daa61ae3d\") " pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" Jul 06 19:01:01.407161 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.407131 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/83bcbb72-b275-43d7-b2f0-533daa61ae3d-manifests\") pod \"opendatahub-operator-controller-manager-546c6c6d78-j4wtj\" (UID: \"83bcbb72-b275-43d7-b2f0-533daa61ae3d\") " pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" Jul 06 19:01:01.408885 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.408867 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83bcbb72-b275-43d7-b2f0-533daa61ae3d-tmp\") pod \"opendatahub-operator-controller-manager-546c6c6d78-j4wtj\" (UID: \"83bcbb72-b275-43d7-b2f0-533daa61ae3d\") " pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" Jul 06 19:01:01.409098 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.409079 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83bcbb72-b275-43d7-b2f0-533daa61ae3d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546c6c6d78-j4wtj\" (UID: \"83bcbb72-b275-43d7-b2f0-533daa61ae3d\") " pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" Jul 06 19:01:01.409143 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.409088 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83bcbb72-b275-43d7-b2f0-533daa61ae3d-webhook-cert\") pod \"opendatahub-operator-controller-manager-546c6c6d78-j4wtj\" (UID: \"83bcbb72-b275-43d7-b2f0-533daa61ae3d\") " pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" Jul 06 19:01:01.442401 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.442372 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgrcs\" (UniqueName: \"kubernetes.io/projected/83bcbb72-b275-43d7-b2f0-533daa61ae3d-kube-api-access-jgrcs\") pod \"opendatahub-operator-controller-manager-546c6c6d78-j4wtj\" (UID: \"83bcbb72-b275-43d7-b2f0-533daa61ae3d\") " pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" Jul 06 19:01:01.560276 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.560197 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" Jul 06 19:01:01.717898 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:01.717874 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj"] Jul 06 19:01:01.719068 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:01:01.719038 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83bcbb72_b275_43d7_b2f0_533daa61ae3d.slice/crio-3e1a46272099c1b9fcae687a91b44e6b8d05206be3649e3469a2ca1e17c014e1 WatchSource:0}: Error finding container 3e1a46272099c1b9fcae687a91b44e6b8d05206be3649e3469a2ca1e17c014e1: Status 404 returned error can't find the container with id 3e1a46272099c1b9fcae687a91b44e6b8d05206be3649e3469a2ca1e17c014e1 Jul 06 19:01:02.285525 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:02.285466 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" event={"ID":"83bcbb72-b275-43d7-b2f0-533daa61ae3d","Type":"ContainerStarted","Data":"3e1a46272099c1b9fcae687a91b44e6b8d05206be3649e3469a2ca1e17c014e1"} Jul 06 19:01:05.308426 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:05.308388 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" event={"ID":"83bcbb72-b275-43d7-b2f0-533daa61ae3d","Type":"ContainerStarted","Data":"e8a5d967af9b5307d2e57aba8703ae550d9914f8ba6ede986c8ca1d087712172"} Jul 06 19:01:06.314729 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:06.314641 2567 generic.go:356] "Generic (PLEG): container finished" podID="83bcbb72-b275-43d7-b2f0-533daa61ae3d" containerID="e8a5d967af9b5307d2e57aba8703ae550d9914f8ba6ede986c8ca1d087712172" exitCode=0 Jul 06 19:01:06.314729 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:06.314678 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" event={"ID":"83bcbb72-b275-43d7-b2f0-533daa61ae3d","Type":"ContainerDied","Data":"e8a5d967af9b5307d2e57aba8703ae550d9914f8ba6ede986c8ca1d087712172"} Jul 06 19:01:07.321302 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:07.321267 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" event={"ID":"83bcbb72-b275-43d7-b2f0-533daa61ae3d","Type":"ContainerStarted","Data":"e4e7bcd48d2ff652afdc6a6e509c9eae3931838fef87ef57fe72718b273ff4e6"} Jul 06 19:01:07.321764 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:07.321405 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" Jul 06 19:01:07.346644 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:07.346582 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" podStartSLOduration=1.754044037 podStartE2EDuration="6.346561378s" totalImagesPullingTime="3.556851864s" totalInitContainerRuntime="1.035665477s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:01:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:01:07.345319268 +0000 UTC m=+375.271753818" watchObservedRunningTime="2026-07-06 19:01:07.346561378 +0000 UTC m=+375.272995930" Jul 06 19:01:18.328361 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:18.328323 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-546c6c6d78-j4wtj" Jul 06 19:01:22.716957 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:22.716923 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2hwc7"] Jul 06 19:01:22.719994 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:22.719979 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2hwc7" Jul 06 19:01:22.725318 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:22.725294 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 06 19:01:22.725444 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:22.725329 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-mnb96\"" Jul 06 19:01:22.746554 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:22.746527 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2hwc7"] Jul 06 19:01:22.896176 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:22.896144 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhcf2\" (UniqueName: \"kubernetes.io/projected/fd788a33-68ae-4f84-96c2-d087b1601a38-kube-api-access-rhcf2\") pod \"odh-model-controller-7998c67dc4-2hwc7\" (UID: \"fd788a33-68ae-4f84-96c2-d087b1601a38\") " pod="opendatahub/odh-model-controller-7998c67dc4-2hwc7" Jul 06 19:01:22.896340 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:22.896193 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd788a33-68ae-4f84-96c2-d087b1601a38-cert\") pod \"odh-model-controller-7998c67dc4-2hwc7\" (UID: \"fd788a33-68ae-4f84-96c2-d087b1601a38\") " pod="opendatahub/odh-model-controller-7998c67dc4-2hwc7" Jul 06 19:01:22.997714 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:22.997621 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhcf2\" (UniqueName: \"kubernetes.io/projected/fd788a33-68ae-4f84-96c2-d087b1601a38-kube-api-access-rhcf2\") pod \"odh-model-controller-7998c67dc4-2hwc7\" (UID: \"fd788a33-68ae-4f84-96c2-d087b1601a38\") " pod="opendatahub/odh-model-controller-7998c67dc4-2hwc7" Jul 06 19:01:22.997714 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:22.997684 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd788a33-68ae-4f84-96c2-d087b1601a38-cert\") pod \"odh-model-controller-7998c67dc4-2hwc7\" (UID: \"fd788a33-68ae-4f84-96c2-d087b1601a38\") " pod="opendatahub/odh-model-controller-7998c67dc4-2hwc7" Jul 06 19:01:22.997893 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:01:22.997780 2567 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 06 19:01:22.997893 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:01:22.997830 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd788a33-68ae-4f84-96c2-d087b1601a38-cert podName:fd788a33-68ae-4f84-96c2-d087b1601a38 nodeName:}" failed. No retries permitted until 2026-07-06 19:01:23.497816372 +0000 UTC m=+391.424250899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fd788a33-68ae-4f84-96c2-d087b1601a38-cert") pod "odh-model-controller-7998c67dc4-2hwc7" (UID: "fd788a33-68ae-4f84-96c2-d087b1601a38") : secret "odh-model-controller-webhook-cert" not found Jul 06 19:01:23.011800 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:23.011777 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhcf2\" (UniqueName: \"kubernetes.io/projected/fd788a33-68ae-4f84-96c2-d087b1601a38-kube-api-access-rhcf2\") pod \"odh-model-controller-7998c67dc4-2hwc7\" (UID: \"fd788a33-68ae-4f84-96c2-d087b1601a38\") " pod="opendatahub/odh-model-controller-7998c67dc4-2hwc7" Jul 06 19:01:23.502566 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:23.502532 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd788a33-68ae-4f84-96c2-d087b1601a38-cert\") pod \"odh-model-controller-7998c67dc4-2hwc7\" (UID: \"fd788a33-68ae-4f84-96c2-d087b1601a38\") " pod="opendatahub/odh-model-controller-7998c67dc4-2hwc7" Jul 06 19:01:23.505038 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:23.505014 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd788a33-68ae-4f84-96c2-d087b1601a38-cert\") pod \"odh-model-controller-7998c67dc4-2hwc7\" (UID: \"fd788a33-68ae-4f84-96c2-d087b1601a38\") " pod="opendatahub/odh-model-controller-7998c67dc4-2hwc7" Jul 06 19:01:23.630204 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:23.630150 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2hwc7" Jul 06 19:01:23.785449 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:23.785365 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2hwc7"] Jul 06 19:01:23.791784 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:01:23.791758 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd788a33_68ae_4f84_96c2_d087b1601a38.slice/crio-3403a86cf0f26827e66530c27510b7b1713ff8b619e40b9dbc4146263c4bbcc9 WatchSource:0}: Error finding container 3403a86cf0f26827e66530c27510b7b1713ff8b619e40b9dbc4146263c4bbcc9: Status 404 returned error can't find the container with id 3403a86cf0f26827e66530c27510b7b1713ff8b619e40b9dbc4146263c4bbcc9 Jul 06 19:01:24.398463 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:24.398425 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2hwc7" event={"ID":"fd788a33-68ae-4f84-96c2-d087b1601a38","Type":"ContainerStarted","Data":"3403a86cf0f26827e66530c27510b7b1713ff8b619e40b9dbc4146263c4bbcc9"} Jul 06 19:01:28.377210 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:28.377169 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6c488d768d-qm8dr"] Jul 06 19:01:28.379488 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:28.379461 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c488d768d-qm8dr" Jul 06 19:01:28.390237 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:28.390218 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 19:01:28.390748 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:28.390725 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 19:01:28.391021 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:28.391002 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-j5v6g\"" Jul 06 19:01:28.419366 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:28.419322 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2hwc7" event={"ID":"fd788a33-68ae-4f84-96c2-d087b1601a38","Type":"ContainerStarted","Data":"5381245a5d5d4b59e47e3e779f43f999abd77a1c5fc7116888efb98beea0b7e7"} Jul 06 19:01:28.419511 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:28.419400 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-2hwc7" Jul 06 19:01:28.420742 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:28.420722 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c488d768d-qm8dr"] Jul 06 19:01:28.542789 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:28.542757 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ea1fc37-774e-4877-86db-3c1f1be8c61f-tmp\") pod \"kube-auth-proxy-6c488d768d-qm8dr\" (UID: \"3ea1fc37-774e-4877-86db-3c1f1be8c61f\") " pod="openshift-ingress/kube-auth-proxy-6c488d768d-qm8dr" Jul 06 19:01:28.542950 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:28.542807 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97wdz\" (UniqueName: \"kubernetes.io/projected/3ea1fc37-774e-4877-86db-3c1f1be8c61f-kube-api-access-97wdz\") pod \"kube-auth-proxy-6c488d768d-qm8dr\" (UID: \"3ea1fc37-774e-4877-86db-3c1f1be8c61f\") " pod="openshift-ingress/kube-auth-proxy-6c488d768d-qm8dr" Jul 06 19:01:28.542950 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:28.542882 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ea1fc37-774e-4877-86db-3c1f1be8c61f-tls-certs\") pod \"kube-auth-proxy-6c488d768d-qm8dr\" (UID: \"3ea1fc37-774e-4877-86db-3c1f1be8c61f\") " pod="openshift-ingress/kube-auth-proxy-6c488d768d-qm8dr" Jul 06 19:01:28.643591 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:28.643505 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ea1fc37-774e-4877-86db-3c1f1be8c61f-tmp\") pod \"kube-auth-proxy-6c488d768d-qm8dr\" (UID: \"3ea1fc37-774e-4877-86db-3c1f1be8c61f\") " pod="openshift-ingress/kube-auth-proxy-6c488d768d-qm8dr" Jul 06 19:01:28.643591 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:28.643575 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97wdz\" (UniqueName: \"kubernetes.io/projected/3ea1fc37-774e-4877-86db-3c1f1be8c61f-kube-api-access-97wdz\") pod \"kube-auth-proxy-6c488d768d-qm8dr\" (UID: \"3ea1fc37-774e-4877-86db-3c1f1be8c61f\") " pod="openshift-ingress/kube-auth-proxy-6c488d768d-qm8dr" Jul 06 19:01:28.643813 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:28.643607 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ea1fc37-774e-4877-86db-3c1f1be8c61f-tls-certs\") pod \"kube-auth-proxy-6c488d768d-qm8dr\" (UID: \"3ea1fc37-774e-4877-86db-3c1f1be8c61f\") " pod="openshift-ingress/kube-auth-proxy-6c488d768d-qm8dr" Jul 06 19:01:28.645877 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:28.645847 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ea1fc37-774e-4877-86db-3c1f1be8c61f-tmp\") pod \"kube-auth-proxy-6c488d768d-qm8dr\" (UID: \"3ea1fc37-774e-4877-86db-3c1f1be8c61f\") " pod="openshift-ingress/kube-auth-proxy-6c488d768d-qm8dr" Jul 06 19:01:28.646079 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:28.646057 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ea1fc37-774e-4877-86db-3c1f1be8c61f-tls-certs\") pod \"kube-auth-proxy-6c488d768d-qm8dr\" (UID: \"3ea1fc37-774e-4877-86db-3c1f1be8c61f\") " pod="openshift-ingress/kube-auth-proxy-6c488d768d-qm8dr" Jul 06 19:01:28.654806 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:28.654779 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97wdz\" (UniqueName: \"kubernetes.io/projected/3ea1fc37-774e-4877-86db-3c1f1be8c61f-kube-api-access-97wdz\") pod \"kube-auth-proxy-6c488d768d-qm8dr\" (UID: \"3ea1fc37-774e-4877-86db-3c1f1be8c61f\") " pod="openshift-ingress/kube-auth-proxy-6c488d768d-qm8dr" Jul 06 19:01:28.690372 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:28.690344 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c488d768d-qm8dr" Jul 06 19:01:28.824639 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:28.824579 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-2hwc7" podStartSLOduration=3.208099661 podStartE2EDuration="6.824558628s" totalImagesPullingTime="3.616458967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:01:28.501858131 +0000 UTC m=+396.428292681" watchObservedRunningTime="2026-07-06 19:01:28.824558628 +0000 UTC m=+396.750993177" Jul 06 19:01:28.825513 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:28.825494 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c488d768d-qm8dr"] Jul 06 19:01:28.827074 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:01:28.827050 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea1fc37_774e_4877_86db_3c1f1be8c61f.slice/crio-2979c36f55a2f6c817add2cbe9909390121fb132ad8f717a7e42c73f56d2b786 WatchSource:0}: Error finding container 2979c36f55a2f6c817add2cbe9909390121fb132ad8f717a7e42c73f56d2b786: Status 404 returned error can't find the container with id 2979c36f55a2f6c817add2cbe9909390121fb132ad8f717a7e42c73f56d2b786 Jul 06 19:01:29.425157 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:29.425118 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c488d768d-qm8dr" event={"ID":"3ea1fc37-774e-4877-86db-3c1f1be8c61f","Type":"ContainerStarted","Data":"2979c36f55a2f6c817add2cbe9909390121fb132ad8f717a7e42c73f56d2b786"} Jul 06 19:01:30.399272 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.399236 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2"] Jul 06 19:01:30.401672 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.401655 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.407009 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.406982 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 19:01:30.407009 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.407001 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 19:01:30.411681 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.411656 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 19:01:30.411803 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.411683 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 19:01:30.415513 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.415493 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-szv48\"" Jul 06 19:01:30.436525 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.436490 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2"] Jul 06 19:01:30.456861 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.456833 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d2614794-291b-44fb-8a1f-303d48458c72-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hj6f2\" (UID: \"d2614794-291b-44fb-8a1f-303d48458c72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.456980 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.456864 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d2614794-291b-44fb-8a1f-303d48458c72-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hj6f2\" (UID: \"d2614794-291b-44fb-8a1f-303d48458c72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.456980 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.456886 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d2614794-291b-44fb-8a1f-303d48458c72-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hj6f2\" (UID: \"d2614794-291b-44fb-8a1f-303d48458c72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.456980 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.456924 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2614794-291b-44fb-8a1f-303d48458c72-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hj6f2\" (UID: \"d2614794-291b-44fb-8a1f-303d48458c72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.456980 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.456976 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2614794-291b-44fb-8a1f-303d48458c72-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hj6f2\" (UID: \"d2614794-291b-44fb-8a1f-303d48458c72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.457146 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.456995 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d2614794-291b-44fb-8a1f-303d48458c72-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hj6f2\" (UID: \"d2614794-291b-44fb-8a1f-303d48458c72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.457146 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.457021 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhfcw\" (UniqueName: \"kubernetes.io/projected/d2614794-291b-44fb-8a1f-303d48458c72-kube-api-access-dhfcw\") pod \"istiod-openshift-gateway-94bb8fbfd-hj6f2\" (UID: \"d2614794-291b-44fb-8a1f-303d48458c72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.557655 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.557627 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d2614794-291b-44fb-8a1f-303d48458c72-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hj6f2\" (UID: \"d2614794-291b-44fb-8a1f-303d48458c72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.557829 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.557663 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d2614794-291b-44fb-8a1f-303d48458c72-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hj6f2\" (UID: \"d2614794-291b-44fb-8a1f-303d48458c72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.557829 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.557690 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2614794-291b-44fb-8a1f-303d48458c72-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hj6f2\" (UID: \"d2614794-291b-44fb-8a1f-303d48458c72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.557829 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.557719 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2614794-291b-44fb-8a1f-303d48458c72-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hj6f2\" (UID: \"d2614794-291b-44fb-8a1f-303d48458c72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.557829 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.557735 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d2614794-291b-44fb-8a1f-303d48458c72-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hj6f2\" (UID: \"d2614794-291b-44fb-8a1f-303d48458c72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.557829 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.557764 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhfcw\" (UniqueName: \"kubernetes.io/projected/d2614794-291b-44fb-8a1f-303d48458c72-kube-api-access-dhfcw\") pod \"istiod-openshift-gateway-94bb8fbfd-hj6f2\" (UID: \"d2614794-291b-44fb-8a1f-303d48458c72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.558094 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.557836 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d2614794-291b-44fb-8a1f-303d48458c72-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hj6f2\" (UID: \"d2614794-291b-44fb-8a1f-303d48458c72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.558404 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.558371 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d2614794-291b-44fb-8a1f-303d48458c72-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hj6f2\" (UID: \"d2614794-291b-44fb-8a1f-303d48458c72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.560085 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.560065 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d2614794-291b-44fb-8a1f-303d48458c72-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hj6f2\" (UID: \"d2614794-291b-44fb-8a1f-303d48458c72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.560180 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.560133 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d2614794-291b-44fb-8a1f-303d48458c72-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hj6f2\" (UID: \"d2614794-291b-44fb-8a1f-303d48458c72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.560330 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.560313 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2614794-291b-44fb-8a1f-303d48458c72-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hj6f2\" (UID: \"d2614794-291b-44fb-8a1f-303d48458c72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.560389 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.560366 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d2614794-291b-44fb-8a1f-303d48458c72-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hj6f2\" (UID: \"d2614794-291b-44fb-8a1f-303d48458c72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.600931 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.600902 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhfcw\" (UniqueName: \"kubernetes.io/projected/d2614794-291b-44fb-8a1f-303d48458c72-kube-api-access-dhfcw\") pod \"istiod-openshift-gateway-94bb8fbfd-hj6f2\" (UID: \"d2614794-291b-44fb-8a1f-303d48458c72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.601085 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.600942 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2614794-291b-44fb-8a1f-303d48458c72-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hj6f2\" (UID: \"d2614794-291b-44fb-8a1f-303d48458c72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.712419 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.712391 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:30.926077 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:30.926052 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2"] Jul 06 19:01:30.928026 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:01:30.927978 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2614794_291b_44fb_8a1f_303d48458c72.slice/crio-2eb48193648e316f4535aaff7708f32e63cd02d61da13a4fc2a75443d2d01491 WatchSource:0}: Error finding container 2eb48193648e316f4535aaff7708f32e63cd02d61da13a4fc2a75443d2d01491: Status 404 returned error can't find the container with id 2eb48193648e316f4535aaff7708f32e63cd02d61da13a4fc2a75443d2d01491 Jul 06 19:01:31.442491 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:31.442419 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" event={"ID":"d2614794-291b-44fb-8a1f-303d48458c72","Type":"ContainerStarted","Data":"2eb48193648e316f4535aaff7708f32e63cd02d61da13a4fc2a75443d2d01491"} Jul 06 19:01:33.686171 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:33.686116 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:01:33.686558 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:33.686199 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:01:34.461072 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:34.461033 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" event={"ID":"d2614794-291b-44fb-8a1f-303d48458c72","Type":"ContainerStarted","Data":"dcacfed74a2e60d22f449c317e4b06db1f878b3095f60757a9b705296faa541a"} Jul 06 19:01:34.461284 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:34.461214 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:34.462701 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:34.462665 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c488d768d-qm8dr" event={"ID":"3ea1fc37-774e-4877-86db-3c1f1be8c61f","Type":"ContainerStarted","Data":"c5fd137e7a8bbd9a0dabd86f99346e5e9fe1ddbb32f7e424d235c3a3401628c7"} Jul 06 19:01:34.463174 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:34.463150 2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-hj6f2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 19:01:34.463273 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:34.463191 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" podUID="d2614794-291b-44fb-8a1f-303d48458c72" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 19:01:34.541384 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:34.541304 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" podStartSLOduration=1.7857219359999998 podStartE2EDuration="4.541291102s" totalImagesPullingTime="2.755569166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:01:34.539357035 +0000 UTC m=+402.465791586" watchObservedRunningTime="2026-07-06 19:01:34.541291102 +0000 UTC m=+402.467725650" Jul 06 19:01:34.578682 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:34.578636 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6c488d768d-qm8dr" podStartSLOduration=1.725429715 podStartE2EDuration="6.578621669s" totalImagesPullingTime="4.853191954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:01:34.576785288 +0000 UTC m=+402.503219837" watchObservedRunningTime="2026-07-06 19:01:34.578621669 +0000 UTC m=+402.505056257" Jul 06 19:01:35.467811 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:35.467781 2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-hj6f2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 19:01:35.468178 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:35.467831 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" podUID="d2614794-291b-44fb-8a1f-303d48458c72" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 19:01:35.907819 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:35.907739 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wdtbt"] Jul 06 19:01:35.910433 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:35.910414 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wdtbt" Jul 06 19:01:35.921431 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:35.921410 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 06 19:01:35.921753 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:35.921735 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qv2bb\"" Jul 06 19:01:35.968970 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:35.968941 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wdtbt"] Jul 06 19:01:36.007974 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:36.007927 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq2b4\" (UniqueName: \"kubernetes.io/projected/3eae5464-ef34-4403-8b77-c52674b74f81-kube-api-access-tq2b4\") pod \"kserve-controller-manager-d6f4b65b8-wdtbt\" (UID: \"3eae5464-ef34-4403-8b77-c52674b74f81\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wdtbt" Jul 06 19:01:36.008171 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:36.008029 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3eae5464-ef34-4403-8b77-c52674b74f81-cert\") pod \"kserve-controller-manager-d6f4b65b8-wdtbt\" (UID: \"3eae5464-ef34-4403-8b77-c52674b74f81\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wdtbt" Jul 06 19:01:36.108847 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:36.108811 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3eae5464-ef34-4403-8b77-c52674b74f81-cert\") pod \"kserve-controller-manager-d6f4b65b8-wdtbt\" (UID: \"3eae5464-ef34-4403-8b77-c52674b74f81\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wdtbt" Jul 06 19:01:36.109006 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:36.108869 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq2b4\" (UniqueName: \"kubernetes.io/projected/3eae5464-ef34-4403-8b77-c52674b74f81-kube-api-access-tq2b4\") pod \"kserve-controller-manager-d6f4b65b8-wdtbt\" (UID: \"3eae5464-ef34-4403-8b77-c52674b74f81\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wdtbt" Jul 06 19:01:36.109006 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:01:36.108959 2567 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 06 19:01:36.109081 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:01:36.109032 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3eae5464-ef34-4403-8b77-c52674b74f81-cert podName:3eae5464-ef34-4403-8b77-c52674b74f81 nodeName:}" failed. No retries permitted until 2026-07-06 19:01:36.609015055 +0000 UTC m=+404.535449582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3eae5464-ef34-4403-8b77-c52674b74f81-cert") pod "kserve-controller-manager-d6f4b65b8-wdtbt" (UID: "3eae5464-ef34-4403-8b77-c52674b74f81") : secret "kserve-webhook-server-cert" not found Jul 06 19:01:36.131150 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:36.131120 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq2b4\" (UniqueName: \"kubernetes.io/projected/3eae5464-ef34-4403-8b77-c52674b74f81-kube-api-access-tq2b4\") pod \"kserve-controller-manager-d6f4b65b8-wdtbt\" (UID: \"3eae5464-ef34-4403-8b77-c52674b74f81\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wdtbt" Jul 06 19:01:36.612743 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:36.612714 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3eae5464-ef34-4403-8b77-c52674b74f81-cert\") pod \"kserve-controller-manager-d6f4b65b8-wdtbt\" (UID: \"3eae5464-ef34-4403-8b77-c52674b74f81\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wdtbt" Jul 06 19:01:36.616501 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:36.616082 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3eae5464-ef34-4403-8b77-c52674b74f81-cert\") pod \"kserve-controller-manager-d6f4b65b8-wdtbt\" (UID: \"3eae5464-ef34-4403-8b77-c52674b74f81\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wdtbt" Jul 06 19:01:36.820658 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:36.820623 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wdtbt" Jul 06 19:01:36.979651 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:36.979529 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wdtbt"] Jul 06 19:01:36.982529 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:01:36.982499 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eae5464_ef34_4403_8b77_c52674b74f81.slice/crio-dc5ad327367ac3a4849f6b1848de6ffca849a81f4e168f555819b2c847abf086 WatchSource:0}: Error finding container dc5ad327367ac3a4849f6b1848de6ffca849a81f4e168f555819b2c847abf086: Status 404 returned error can't find the container with id dc5ad327367ac3a4849f6b1848de6ffca849a81f4e168f555819b2c847abf086 Jul 06 19:01:37.478091 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.478058 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wdtbt" event={"ID":"3eae5464-ef34-4403-8b77-c52674b74f81","Type":"ContainerStarted","Data":"dc5ad327367ac3a4849f6b1848de6ffca849a81f4e168f555819b2c847abf086"} Jul 06 19:01:37.673037 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.673000 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g"] Jul 06 19:01:37.676286 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.676262 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.679445 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.679419 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-jhjcd\"" Jul 06 19:01:37.711337 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.711310 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g"] Jul 06 19:01:37.722668 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.722643 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b78c8385-4890-4949-a303-859482f4f641-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.722761 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.722682 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b78c8385-4890-4949-a303-859482f4f641-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.722799 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.722763 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b78c8385-4890-4949-a303-859482f4f641-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.722799 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.722789 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b78c8385-4890-4949-a303-859482f4f641-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.722893 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.722817 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b78c8385-4890-4949-a303-859482f4f641-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.722893 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.722833 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkqcm\" (UniqueName: \"kubernetes.io/projected/b78c8385-4890-4949-a303-859482f4f641-kube-api-access-vkqcm\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.722979 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.722930 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b78c8385-4890-4949-a303-859482f4f641-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.723035 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.722992 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b78c8385-4890-4949-a303-859482f4f641-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.723035 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.723020 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b78c8385-4890-4949-a303-859482f4f641-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.824226 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.824144 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b78c8385-4890-4949-a303-859482f4f641-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.824226 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.824191 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b78c8385-4890-4949-a303-859482f4f641-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.824449 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.824234 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b78c8385-4890-4949-a303-859482f4f641-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.824449 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.824274 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkqcm\" (UniqueName: \"kubernetes.io/projected/b78c8385-4890-4949-a303-859482f4f641-kube-api-access-vkqcm\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.824449 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.824301 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b78c8385-4890-4949-a303-859482f4f641-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.824449 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.824333 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b78c8385-4890-4949-a303-859482f4f641-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.824449 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.824359 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b78c8385-4890-4949-a303-859482f4f641-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.824449 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.824406 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b78c8385-4890-4949-a303-859482f4f641-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.824449 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.824448 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b78c8385-4890-4949-a303-859482f4f641-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.825044 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.824597 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b78c8385-4890-4949-a303-859482f4f641-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.825044 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.824617 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b78c8385-4890-4949-a303-859482f4f641-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.825212 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.825150 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b78c8385-4890-4949-a303-859482f4f641-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.825212 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.825174 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b78c8385-4890-4949-a303-859482f4f641-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.825469 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.825419 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b78c8385-4890-4949-a303-859482f4f641-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.827743 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.827703 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b78c8385-4890-4949-a303-859482f4f641-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.828158 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.828139 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b78c8385-4890-4949-a303-859482f4f641-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.840737 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.840700 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b78c8385-4890-4949-a303-859482f4f641-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.850650 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.850631 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkqcm\" (UniqueName: \"kubernetes.io/projected/b78c8385-4890-4949-a303-859482f4f641-kube-api-access-vkqcm\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dxl6g\" (UID: \"b78c8385-4890-4949-a303-859482f4f641\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:37.988907 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:37.988870 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:38.241341 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:38.241301 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g"] Jul 06 19:01:38.259628 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:01:38.259597 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb78c8385_4890_4949_a303_859482f4f641.slice/crio-7bf0bb59d229f25d9152bf59fc6f6699f47c1ba6209640de75165e3b5a16c884 WatchSource:0}: Error finding container 7bf0bb59d229f25d9152bf59fc6f6699f47c1ba6209640de75165e3b5a16c884: Status 404 returned error can't find the container with id 7bf0bb59d229f25d9152bf59fc6f6699f47c1ba6209640de75165e3b5a16c884 Jul 06 19:01:38.468065 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:38.468040 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hj6f2" Jul 06 19:01:38.484132 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:38.484105 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" event={"ID":"b78c8385-4890-4949-a303-859482f4f641","Type":"ContainerStarted","Data":"7bf0bb59d229f25d9152bf59fc6f6699f47c1ba6209640de75165e3b5a16c884"} Jul 06 19:01:39.427441 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:39.427412 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-2hwc7" Jul 06 19:01:41.346637 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:41.346591 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:01:41.346941 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:41.346687 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:01:41.346941 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:41.346725 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:01:41.502915 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:41.502878 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" event={"ID":"b78c8385-4890-4949-a303-859482f4f641","Type":"ContainerStarted","Data":"28c1b480a46cd26fae1b8a08c5623a27bd201289f9c6899cb398bee259503037"} Jul 06 19:01:41.505242 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:41.505210 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wdtbt" event={"ID":"3eae5464-ef34-4403-8b77-c52674b74f81","Type":"ContainerStarted","Data":"71c0a3fd9c44340ecd4f83ee957c74b47f9273e1c588bb91ce21590aa198a936"} Jul 06 19:01:41.505394 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:41.505312 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wdtbt" Jul 06 19:01:41.572570 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:41.572520 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" podStartSLOduration=1.4883933599999999 podStartE2EDuration="4.572506624s" totalImagesPullingTime="3.084113264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:01:41.565184938 +0000 UTC m=+409.491619498" watchObservedRunningTime="2026-07-06 19:01:41.572506624 +0000 UTC m=+409.498941172" Jul 06 19:01:41.619589 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:41.619485 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wdtbt" podStartSLOduration=2.258996996 podStartE2EDuration="6.619453789s" totalImagesPullingTime="4.360456793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:01:41.616287887 +0000 UTC m=+409.542722437" watchObservedRunningTime="2026-07-06 19:01:41.619453789 +0000 UTC m=+409.545888338" Jul 06 19:01:41.989159 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:41.989125 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:42.994649 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:42.994619 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:43.518868 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:43.518838 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:01:43.519841 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:01:43.519820 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dxl6g" Jul 06 19:02:12.519243 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:12.519211 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wdtbt" Jul 06 19:02:39.047402 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.047370 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t"] Jul 06 19:02:39.049957 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.049937 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t" Jul 06 19:02:39.052449 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.052421 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nqzkc\"" Jul 06 19:02:39.052449 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.052421 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 19:02:39.053506 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.053450 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 19:02:39.060016 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.059998 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t"] Jul 06 19:02:39.130937 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.130891 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2f0b925-1dee-405d-87ea-4102316fe940-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t\" (UID: \"e2f0b925-1dee-405d-87ea-4102316fe940\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t" Jul 06 19:02:39.130937 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.130941 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znhpt\" (UniqueName: \"kubernetes.io/projected/e2f0b925-1dee-405d-87ea-4102316fe940-kube-api-access-znhpt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t\" (UID: \"e2f0b925-1dee-405d-87ea-4102316fe940\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t" Jul 06 19:02:39.131155 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.131034 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2f0b925-1dee-405d-87ea-4102316fe940-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t\" (UID: \"e2f0b925-1dee-405d-87ea-4102316fe940\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t" Jul 06 19:02:39.231421 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.231384 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2f0b925-1dee-405d-87ea-4102316fe940-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t\" (UID: \"e2f0b925-1dee-405d-87ea-4102316fe940\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t" Jul 06 19:02:39.231631 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.231426 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znhpt\" (UniqueName: \"kubernetes.io/projected/e2f0b925-1dee-405d-87ea-4102316fe940-kube-api-access-znhpt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t\" (UID: \"e2f0b925-1dee-405d-87ea-4102316fe940\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t" Jul 06 19:02:39.231631 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.231536 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2f0b925-1dee-405d-87ea-4102316fe940-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t\" (UID: \"e2f0b925-1dee-405d-87ea-4102316fe940\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t" Jul 06 19:02:39.231844 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.231823 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2f0b925-1dee-405d-87ea-4102316fe940-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t\" (UID: \"e2f0b925-1dee-405d-87ea-4102316fe940\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t" Jul 06 19:02:39.231879 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.231850 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2f0b925-1dee-405d-87ea-4102316fe940-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t\" (UID: \"e2f0b925-1dee-405d-87ea-4102316fe940\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t" Jul 06 19:02:39.240822 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.240799 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znhpt\" (UniqueName: \"kubernetes.io/projected/e2f0b925-1dee-405d-87ea-4102316fe940-kube-api-access-znhpt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t\" (UID: \"e2f0b925-1dee-405d-87ea-4102316fe940\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t" Jul 06 19:02:39.359943 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.359852 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t" Jul 06 19:02:39.503304 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.503276 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t"] Jul 06 19:02:39.505173 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:02:39.505144 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2f0b925_1dee_405d_87ea_4102316fe940.slice/crio-7be78901c63fd83ce8d4804c05c55787572222e70aa70c930cf97db15294a480 WatchSource:0}: Error finding container 7be78901c63fd83ce8d4804c05c55787572222e70aa70c930cf97db15294a480: Status 404 returned error can't find the container with id 7be78901c63fd83ce8d4804c05c55787572222e70aa70c930cf97db15294a480 Jul 06 19:02:39.807648 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.807613 2567 generic.go:356] "Generic (PLEG): container finished" podID="e2f0b925-1dee-405d-87ea-4102316fe940" containerID="0722ac9a377fecb3143a76085b06cb4b1cae1b412a9667ca17c5f7e5648ebdd9" exitCode=0 Jul 06 19:02:39.807807 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.807657 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t" event={"ID":"e2f0b925-1dee-405d-87ea-4102316fe940","Type":"ContainerDied","Data":"0722ac9a377fecb3143a76085b06cb4b1cae1b412a9667ca17c5f7e5648ebdd9"} Jul 06 19:02:39.807807 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.807720 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t" event={"ID":"e2f0b925-1dee-405d-87ea-4102316fe940","Type":"ContainerStarted","Data":"7be78901c63fd83ce8d4804c05c55787572222e70aa70c930cf97db15294a480"} Jul 06 19:02:39.843126 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.843094 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj"] Jul 06 19:02:39.845757 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.845734 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj" Jul 06 19:02:39.855253 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.855230 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj"] Jul 06 19:02:39.937135 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.937103 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58068485-137c-4cac-8145-905ef660eb4b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj\" (UID: \"58068485-137c-4cac-8145-905ef660eb4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj" Jul 06 19:02:39.937329 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.937148 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58068485-137c-4cac-8145-905ef660eb4b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj\" (UID: \"58068485-137c-4cac-8145-905ef660eb4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj" Jul 06 19:02:39.937329 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:39.937176 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh42j\" (UniqueName: \"kubernetes.io/projected/58068485-137c-4cac-8145-905ef660eb4b-kube-api-access-fh42j\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj\" (UID: \"58068485-137c-4cac-8145-905ef660eb4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj" Jul 06 19:02:40.038202 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.038167 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58068485-137c-4cac-8145-905ef660eb4b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj\" (UID: \"58068485-137c-4cac-8145-905ef660eb4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj" Jul 06 19:02:40.038380 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.038213 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh42j\" (UniqueName: \"kubernetes.io/projected/58068485-137c-4cac-8145-905ef660eb4b-kube-api-access-fh42j\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj\" (UID: \"58068485-137c-4cac-8145-905ef660eb4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj" Jul 06 19:02:40.038380 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.038276 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58068485-137c-4cac-8145-905ef660eb4b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj\" (UID: \"58068485-137c-4cac-8145-905ef660eb4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj" Jul 06 19:02:40.038581 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.038561 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58068485-137c-4cac-8145-905ef660eb4b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj\" (UID: \"58068485-137c-4cac-8145-905ef660eb4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj" Jul 06 19:02:40.038635 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.038582 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58068485-137c-4cac-8145-905ef660eb4b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj\" (UID: \"58068485-137c-4cac-8145-905ef660eb4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj" Jul 06 19:02:40.046778 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.046757 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh42j\" (UniqueName: \"kubernetes.io/projected/58068485-137c-4cac-8145-905ef660eb4b-kube-api-access-fh42j\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj\" (UID: \"58068485-137c-4cac-8145-905ef660eb4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj" Jul 06 19:02:40.155000 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.154924 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj" Jul 06 19:02:40.285432 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.285394 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj"] Jul 06 19:02:40.287489 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:02:40.287450 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58068485_137c_4cac_8145_905ef660eb4b.slice/crio-da5b4fb51e88e2f480104c73556345f678690b624c9bafcbff83882675605044 WatchSource:0}: Error finding container da5b4fb51e88e2f480104c73556345f678690b624c9bafcbff83882675605044: Status 404 returned error can't find the container with id da5b4fb51e88e2f480104c73556345f678690b624c9bafcbff83882675605044 Jul 06 19:02:40.446628 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.446592 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g"] Jul 06 19:02:40.449118 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.449096 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g" Jul 06 19:02:40.462170 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.462146 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g"] Jul 06 19:02:40.542272 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.542244 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b951428c-bcc4-40fc-b920-a7ea13fb99e3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g\" (UID: \"b951428c-bcc4-40fc-b920-a7ea13fb99e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g" Jul 06 19:02:40.542272 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.542276 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x222q\" (UniqueName: \"kubernetes.io/projected/b951428c-bcc4-40fc-b920-a7ea13fb99e3-kube-api-access-x222q\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g\" (UID: \"b951428c-bcc4-40fc-b920-a7ea13fb99e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g" Jul 06 19:02:40.542466 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.542296 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b951428c-bcc4-40fc-b920-a7ea13fb99e3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g\" (UID: \"b951428c-bcc4-40fc-b920-a7ea13fb99e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g" Jul 06 19:02:40.643118 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.643093 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b951428c-bcc4-40fc-b920-a7ea13fb99e3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g\" (UID: \"b951428c-bcc4-40fc-b920-a7ea13fb99e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g" Jul 06 19:02:40.643244 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.643226 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b951428c-bcc4-40fc-b920-a7ea13fb99e3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g\" (UID: \"b951428c-bcc4-40fc-b920-a7ea13fb99e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g" Jul 06 19:02:40.643285 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.643261 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x222q\" (UniqueName: \"kubernetes.io/projected/b951428c-bcc4-40fc-b920-a7ea13fb99e3-kube-api-access-x222q\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g\" (UID: \"b951428c-bcc4-40fc-b920-a7ea13fb99e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g" Jul 06 19:02:40.643496 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.643459 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b951428c-bcc4-40fc-b920-a7ea13fb99e3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g\" (UID: \"b951428c-bcc4-40fc-b920-a7ea13fb99e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g" Jul 06 19:02:40.643545 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.643506 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b951428c-bcc4-40fc-b920-a7ea13fb99e3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g\" (UID: \"b951428c-bcc4-40fc-b920-a7ea13fb99e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g" Jul 06 19:02:40.651169 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.651149 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x222q\" (UniqueName: \"kubernetes.io/projected/b951428c-bcc4-40fc-b920-a7ea13fb99e3-kube-api-access-x222q\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g\" (UID: \"b951428c-bcc4-40fc-b920-a7ea13fb99e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g" Jul 06 19:02:40.757797 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.757768 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g" Jul 06 19:02:40.815728 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.815364 2567 generic.go:356] "Generic (PLEG): container finished" podID="e2f0b925-1dee-405d-87ea-4102316fe940" containerID="e475461ce7ebe5a641138ca3cb4f18d2a8f75cbd4f387ef94d0dd717faca5f49" exitCode=0 Jul 06 19:02:40.815728 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.815454 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t" event={"ID":"e2f0b925-1dee-405d-87ea-4102316fe940","Type":"ContainerDied","Data":"e475461ce7ebe5a641138ca3cb4f18d2a8f75cbd4f387ef94d0dd717faca5f49"} Jul 06 19:02:40.817519 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.817492 2567 generic.go:356] "Generic (PLEG): container finished" podID="58068485-137c-4cac-8145-905ef660eb4b" containerID="34233b859a3206d0aad80068f7b1b075b2923e790f241bed76a0ea6d959518e0" exitCode=0 Jul 06 19:02:40.817698 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.817637 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj" event={"ID":"58068485-137c-4cac-8145-905ef660eb4b","Type":"ContainerDied","Data":"34233b859a3206d0aad80068f7b1b075b2923e790f241bed76a0ea6d959518e0"} Jul 06 19:02:40.817698 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.817682 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj" event={"ID":"58068485-137c-4cac-8145-905ef660eb4b","Type":"ContainerStarted","Data":"da5b4fb51e88e2f480104c73556345f678690b624c9bafcbff83882675605044"} Jul 06 19:02:40.847848 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.847820 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc"] Jul 06 19:02:40.852199 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.851503 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc" Jul 06 19:02:40.868534 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.868507 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc"] Jul 06 19:02:40.908245 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.908225 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g"] Jul 06 19:02:40.910824 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:02:40.910794 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb951428c_bcc4_40fc_b920_a7ea13fb99e3.slice/crio-39be640069a9b57c4e7a9e6a3bcb3e69a9614e77456733db4bf8852d6879f127 WatchSource:0}: Error finding container 39be640069a9b57c4e7a9e6a3bcb3e69a9614e77456733db4bf8852d6879f127: Status 404 returned error can't find the container with id 39be640069a9b57c4e7a9e6a3bcb3e69a9614e77456733db4bf8852d6879f127 Jul 06 19:02:40.945917 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.945891 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nzw6\" (UniqueName: \"kubernetes.io/projected/7278c014-ec7e-4fae-98a6-3e9cdfa85700-kube-api-access-9nzw6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc\" (UID: \"7278c014-ec7e-4fae-98a6-3e9cdfa85700\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc" Jul 06 19:02:40.946024 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.945955 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7278c014-ec7e-4fae-98a6-3e9cdfa85700-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc\" (UID: \"7278c014-ec7e-4fae-98a6-3e9cdfa85700\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc" Jul 06 19:02:40.946024 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:40.945989 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7278c014-ec7e-4fae-98a6-3e9cdfa85700-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc\" (UID: \"7278c014-ec7e-4fae-98a6-3e9cdfa85700\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc" Jul 06 19:02:41.047098 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:41.047062 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nzw6\" (UniqueName: \"kubernetes.io/projected/7278c014-ec7e-4fae-98a6-3e9cdfa85700-kube-api-access-9nzw6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc\" (UID: \"7278c014-ec7e-4fae-98a6-3e9cdfa85700\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc" Jul 06 19:02:41.047209 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:41.047123 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7278c014-ec7e-4fae-98a6-3e9cdfa85700-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc\" (UID: \"7278c014-ec7e-4fae-98a6-3e9cdfa85700\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc" Jul 06 19:02:41.047209 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:41.047142 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7278c014-ec7e-4fae-98a6-3e9cdfa85700-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc\" (UID: \"7278c014-ec7e-4fae-98a6-3e9cdfa85700\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc" Jul 06 19:02:41.047498 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:41.047459 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7278c014-ec7e-4fae-98a6-3e9cdfa85700-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc\" (UID: \"7278c014-ec7e-4fae-98a6-3e9cdfa85700\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc" Jul 06 19:02:41.047543 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:41.047501 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7278c014-ec7e-4fae-98a6-3e9cdfa85700-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc\" (UID: \"7278c014-ec7e-4fae-98a6-3e9cdfa85700\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc" Jul 06 19:02:41.055306 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:41.055284 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nzw6\" (UniqueName: \"kubernetes.io/projected/7278c014-ec7e-4fae-98a6-3e9cdfa85700-kube-api-access-9nzw6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc\" (UID: \"7278c014-ec7e-4fae-98a6-3e9cdfa85700\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc" Jul 06 19:02:41.182575 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:41.182549 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc" Jul 06 19:02:41.312311 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:41.312287 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc"] Jul 06 19:02:41.314216 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:02:41.314193 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7278c014_ec7e_4fae_98a6_3e9cdfa85700.slice/crio-1635b62a282e567ed1fc7049b116edd35d72358b8abcdd15b4dc6862e69cc475 WatchSource:0}: Error finding container 1635b62a282e567ed1fc7049b116edd35d72358b8abcdd15b4dc6862e69cc475: Status 404 returned error can't find the container with id 1635b62a282e567ed1fc7049b116edd35d72358b8abcdd15b4dc6862e69cc475 Jul 06 19:02:41.824580 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:41.824497 2567 generic.go:356] "Generic (PLEG): container finished" podID="e2f0b925-1dee-405d-87ea-4102316fe940" containerID="747e9aa3e563389cbc6b1b716b782520f4a8cfe41b763d3d6b407edeb70057da" exitCode=0 Jul 06 19:02:41.824733 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:41.824578 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t" event={"ID":"e2f0b925-1dee-405d-87ea-4102316fe940","Type":"ContainerDied","Data":"747e9aa3e563389cbc6b1b716b782520f4a8cfe41b763d3d6b407edeb70057da"} Jul 06 19:02:41.826357 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:41.826331 2567 generic.go:356] "Generic (PLEG): container finished" podID="58068485-137c-4cac-8145-905ef660eb4b" containerID="33fd419878d05d1d6e4b435a320b125560880a749559409d509c97137c1a2906" exitCode=0 Jul 06 19:02:41.826486 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:41.826409 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj" event={"ID":"58068485-137c-4cac-8145-905ef660eb4b","Type":"ContainerDied","Data":"33fd419878d05d1d6e4b435a320b125560880a749559409d509c97137c1a2906"} Jul 06 19:02:41.827935 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:41.827864 2567 generic.go:356] "Generic (PLEG): container finished" podID="7278c014-ec7e-4fae-98a6-3e9cdfa85700" containerID="97c24bf5b2703910920c8709e7b52936e408f120d799a9a56647ff848b000040" exitCode=0 Jul 06 19:02:41.827935 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:41.827919 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc" event={"ID":"7278c014-ec7e-4fae-98a6-3e9cdfa85700","Type":"ContainerDied","Data":"97c24bf5b2703910920c8709e7b52936e408f120d799a9a56647ff848b000040"} Jul 06 19:02:41.828025 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:41.827956 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc" event={"ID":"7278c014-ec7e-4fae-98a6-3e9cdfa85700","Type":"ContainerStarted","Data":"1635b62a282e567ed1fc7049b116edd35d72358b8abcdd15b4dc6862e69cc475"} Jul 06 19:02:41.829492 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:41.829448 2567 generic.go:356] "Generic (PLEG): container finished" podID="b951428c-bcc4-40fc-b920-a7ea13fb99e3" containerID="4ae0cf4890b5237e02f2f02421d667bac2a380a41eeffa5549ca4f756580a878" exitCode=0 Jul 06 19:02:41.829586 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:41.829564 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g" event={"ID":"b951428c-bcc4-40fc-b920-a7ea13fb99e3","Type":"ContainerDied","Data":"4ae0cf4890b5237e02f2f02421d667bac2a380a41eeffa5549ca4f756580a878"} Jul 06 19:02:41.829657 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:41.829609 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g" event={"ID":"b951428c-bcc4-40fc-b920-a7ea13fb99e3","Type":"ContainerStarted","Data":"39be640069a9b57c4e7a9e6a3bcb3e69a9614e77456733db4bf8852d6879f127"} Jul 06 19:02:42.838897 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:42.838866 2567 generic.go:356] "Generic (PLEG): container finished" podID="58068485-137c-4cac-8145-905ef660eb4b" containerID="efef1a22d850099da10d2fab2edfe1fd8bcf0ed9400fbd998edb866b869f696f" exitCode=0 Jul 06 19:02:42.839271 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:42.838960 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj" event={"ID":"58068485-137c-4cac-8145-905ef660eb4b","Type":"ContainerDied","Data":"efef1a22d850099da10d2fab2edfe1fd8bcf0ed9400fbd998edb866b869f696f"} Jul 06 19:02:42.841445 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:42.841416 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc" event={"ID":"7278c014-ec7e-4fae-98a6-3e9cdfa85700","Type":"ContainerStarted","Data":"7c933158d089c81747df79ccaae5c421652d35873cf1f21c180e72f5e0de95ae"} Jul 06 19:02:42.844184 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:42.844112 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g" event={"ID":"b951428c-bcc4-40fc-b920-a7ea13fb99e3","Type":"ContainerStarted","Data":"1b8bd0cf4f083f96a73fceeaf6911a1f4f053aa920271dce7125e7258036034f"} Jul 06 19:02:42.967736 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:42.967710 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t" Jul 06 19:02:43.061506 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:43.061410 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znhpt\" (UniqueName: \"kubernetes.io/projected/e2f0b925-1dee-405d-87ea-4102316fe940-kube-api-access-znhpt\") pod \"e2f0b925-1dee-405d-87ea-4102316fe940\" (UID: \"e2f0b925-1dee-405d-87ea-4102316fe940\") " Jul 06 19:02:43.061506 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:43.061462 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2f0b925-1dee-405d-87ea-4102316fe940-bundle\") pod \"e2f0b925-1dee-405d-87ea-4102316fe940\" (UID: \"e2f0b925-1dee-405d-87ea-4102316fe940\") " Jul 06 19:02:43.061731 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:43.061555 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2f0b925-1dee-405d-87ea-4102316fe940-util\") pod \"e2f0b925-1dee-405d-87ea-4102316fe940\" (UID: \"e2f0b925-1dee-405d-87ea-4102316fe940\") " Jul 06 19:02:43.061982 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:43.061954 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2f0b925-1dee-405d-87ea-4102316fe940-bundle" (OuterVolumeSpecName: "bundle") pod "e2f0b925-1dee-405d-87ea-4102316fe940" (UID: "e2f0b925-1dee-405d-87ea-4102316fe940"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:02:43.063665 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:43.063641 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2f0b925-1dee-405d-87ea-4102316fe940-kube-api-access-znhpt" (OuterVolumeSpecName: "kube-api-access-znhpt") pod "e2f0b925-1dee-405d-87ea-4102316fe940" (UID: "e2f0b925-1dee-405d-87ea-4102316fe940"). InnerVolumeSpecName "kube-api-access-znhpt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:02:43.068123 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:43.068099 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2f0b925-1dee-405d-87ea-4102316fe940-util" (OuterVolumeSpecName: "util") pod "e2f0b925-1dee-405d-87ea-4102316fe940" (UID: "e2f0b925-1dee-405d-87ea-4102316fe940"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:02:43.162251 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:43.162225 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znhpt\" (UniqueName: \"kubernetes.io/projected/e2f0b925-1dee-405d-87ea-4102316fe940-kube-api-access-znhpt\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:02:43.162251 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:43.162248 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2f0b925-1dee-405d-87ea-4102316fe940-bundle\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:02:43.162403 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:43.162257 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2f0b925-1dee-405d-87ea-4102316fe940-util\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:02:43.852661 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:43.852629 2567 generic.go:356] "Generic (PLEG): container finished" podID="7278c014-ec7e-4fae-98a6-3e9cdfa85700" containerID="7c933158d089c81747df79ccaae5c421652d35873cf1f21c180e72f5e0de95ae" exitCode=0 Jul 06 19:02:43.853082 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:43.852708 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc" event={"ID":"7278c014-ec7e-4fae-98a6-3e9cdfa85700","Type":"ContainerDied","Data":"7c933158d089c81747df79ccaae5c421652d35873cf1f21c180e72f5e0de95ae"} Jul 06 19:02:43.854781 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:43.854757 2567 generic.go:356] "Generic (PLEG): container finished" podID="b951428c-bcc4-40fc-b920-a7ea13fb99e3" containerID="1b8bd0cf4f083f96a73fceeaf6911a1f4f053aa920271dce7125e7258036034f" exitCode=0 Jul 06 19:02:43.854943 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:43.854794 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g" event={"ID":"b951428c-bcc4-40fc-b920-a7ea13fb99e3","Type":"ContainerDied","Data":"1b8bd0cf4f083f96a73fceeaf6911a1f4f053aa920271dce7125e7258036034f"} Jul 06 19:02:43.857100 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:43.857079 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t" Jul 06 19:02:43.857209 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:43.857100 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t" event={"ID":"e2f0b925-1dee-405d-87ea-4102316fe940","Type":"ContainerDied","Data":"7be78901c63fd83ce8d4804c05c55787572222e70aa70c930cf97db15294a480"} Jul 06 19:02:43.857209 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:43.857141 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7be78901c63fd83ce8d4804c05c55787572222e70aa70c930cf97db15294a480" Jul 06 19:02:44.108608 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:44.108545 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj" Jul 06 19:02:44.169675 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:44.169646 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fh42j\" (UniqueName: \"kubernetes.io/projected/58068485-137c-4cac-8145-905ef660eb4b-kube-api-access-fh42j\") pod \"58068485-137c-4cac-8145-905ef660eb4b\" (UID: \"58068485-137c-4cac-8145-905ef660eb4b\") " Jul 06 19:02:44.169813 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:44.169708 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58068485-137c-4cac-8145-905ef660eb4b-util\") pod \"58068485-137c-4cac-8145-905ef660eb4b\" (UID: \"58068485-137c-4cac-8145-905ef660eb4b\") " Jul 06 19:02:44.169855 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:44.169818 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58068485-137c-4cac-8145-905ef660eb4b-bundle\") pod \"58068485-137c-4cac-8145-905ef660eb4b\" (UID: \"58068485-137c-4cac-8145-905ef660eb4b\") " Jul 06 19:02:44.170359 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:44.170333 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58068485-137c-4cac-8145-905ef660eb4b-bundle" (OuterVolumeSpecName: "bundle") pod "58068485-137c-4cac-8145-905ef660eb4b" (UID: "58068485-137c-4cac-8145-905ef660eb4b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:02:44.171761 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:44.171736 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58068485-137c-4cac-8145-905ef660eb4b-kube-api-access-fh42j" (OuterVolumeSpecName: "kube-api-access-fh42j") pod "58068485-137c-4cac-8145-905ef660eb4b" (UID: "58068485-137c-4cac-8145-905ef660eb4b"). InnerVolumeSpecName "kube-api-access-fh42j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:02:44.175366 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:44.175335 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58068485-137c-4cac-8145-905ef660eb4b-util" (OuterVolumeSpecName: "util") pod "58068485-137c-4cac-8145-905ef660eb4b" (UID: "58068485-137c-4cac-8145-905ef660eb4b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:02:44.271465 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:44.271433 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58068485-137c-4cac-8145-905ef660eb4b-bundle\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:02:44.271465 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:44.271460 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fh42j\" (UniqueName: \"kubernetes.io/projected/58068485-137c-4cac-8145-905ef660eb4b-kube-api-access-fh42j\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:02:44.271663 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:44.271470 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58068485-137c-4cac-8145-905ef660eb4b-util\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:02:44.864737 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:44.864644 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj" event={"ID":"58068485-137c-4cac-8145-905ef660eb4b","Type":"ContainerDied","Data":"da5b4fb51e88e2f480104c73556345f678690b624c9bafcbff83882675605044"} Jul 06 19:02:44.864737 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:44.864684 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj" Jul 06 19:02:44.864737 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:44.864702 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da5b4fb51e88e2f480104c73556345f678690b624c9bafcbff83882675605044" Jul 06 19:02:44.866784 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:44.866718 2567 generic.go:356] "Generic (PLEG): container finished" podID="7278c014-ec7e-4fae-98a6-3e9cdfa85700" containerID="459ef94fb703348378a73fd48dfd15ff068387d940c2851baf35e610df2471f6" exitCode=0 Jul 06 19:02:44.867006 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:44.866816 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc" event={"ID":"7278c014-ec7e-4fae-98a6-3e9cdfa85700","Type":"ContainerDied","Data":"459ef94fb703348378a73fd48dfd15ff068387d940c2851baf35e610df2471f6"} Jul 06 19:02:44.868829 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:44.868807 2567 generic.go:356] "Generic (PLEG): container finished" podID="b951428c-bcc4-40fc-b920-a7ea13fb99e3" containerID="e37c7b442007220025b536736304776aba6a2e3f11083f23e30cf0a51dfe0972" exitCode=0 Jul 06 19:02:44.868926 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:44.868885 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g" event={"ID":"b951428c-bcc4-40fc-b920-a7ea13fb99e3","Type":"ContainerDied","Data":"e37c7b442007220025b536736304776aba6a2e3f11083f23e30cf0a51dfe0972"} Jul 06 19:02:46.010636 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.010609 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g" Jul 06 19:02:46.039964 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.039943 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc" Jul 06 19:02:46.086941 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.086909 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b951428c-bcc4-40fc-b920-a7ea13fb99e3-bundle\") pod \"b951428c-bcc4-40fc-b920-a7ea13fb99e3\" (UID: \"b951428c-bcc4-40fc-b920-a7ea13fb99e3\") " Jul 06 19:02:46.086941 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.086943 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x222q\" (UniqueName: \"kubernetes.io/projected/b951428c-bcc4-40fc-b920-a7ea13fb99e3-kube-api-access-x222q\") pod \"b951428c-bcc4-40fc-b920-a7ea13fb99e3\" (UID: \"b951428c-bcc4-40fc-b920-a7ea13fb99e3\") " Jul 06 19:02:46.087101 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.086969 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b951428c-bcc4-40fc-b920-a7ea13fb99e3-util\") pod \"b951428c-bcc4-40fc-b920-a7ea13fb99e3\" (UID: \"b951428c-bcc4-40fc-b920-a7ea13fb99e3\") " Jul 06 19:02:46.087101 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.086998 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nzw6\" (UniqueName: \"kubernetes.io/projected/7278c014-ec7e-4fae-98a6-3e9cdfa85700-kube-api-access-9nzw6\") pod \"7278c014-ec7e-4fae-98a6-3e9cdfa85700\" (UID: \"7278c014-ec7e-4fae-98a6-3e9cdfa85700\") " Jul 06 19:02:46.087101 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.087025 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7278c014-ec7e-4fae-98a6-3e9cdfa85700-util\") pod \"7278c014-ec7e-4fae-98a6-3e9cdfa85700\" (UID: \"7278c014-ec7e-4fae-98a6-3e9cdfa85700\") " Jul 06 19:02:46.087101 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.087038 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7278c014-ec7e-4fae-98a6-3e9cdfa85700-bundle\") pod \"7278c014-ec7e-4fae-98a6-3e9cdfa85700\" (UID: \"7278c014-ec7e-4fae-98a6-3e9cdfa85700\") " Jul 06 19:02:46.087608 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.087574 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7278c014-ec7e-4fae-98a6-3e9cdfa85700-bundle" (OuterVolumeSpecName: "bundle") pod "7278c014-ec7e-4fae-98a6-3e9cdfa85700" (UID: "7278c014-ec7e-4fae-98a6-3e9cdfa85700"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:02:46.087711 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.087608 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b951428c-bcc4-40fc-b920-a7ea13fb99e3-bundle" (OuterVolumeSpecName: "bundle") pod "b951428c-bcc4-40fc-b920-a7ea13fb99e3" (UID: "b951428c-bcc4-40fc-b920-a7ea13fb99e3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:02:46.089141 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.089110 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7278c014-ec7e-4fae-98a6-3e9cdfa85700-kube-api-access-9nzw6" (OuterVolumeSpecName: "kube-api-access-9nzw6") pod "7278c014-ec7e-4fae-98a6-3e9cdfa85700" (UID: "7278c014-ec7e-4fae-98a6-3e9cdfa85700"). InnerVolumeSpecName "kube-api-access-9nzw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:02:46.089400 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.089384 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b951428c-bcc4-40fc-b920-a7ea13fb99e3-kube-api-access-x222q" (OuterVolumeSpecName: "kube-api-access-x222q") pod "b951428c-bcc4-40fc-b920-a7ea13fb99e3" (UID: "b951428c-bcc4-40fc-b920-a7ea13fb99e3"). InnerVolumeSpecName "kube-api-access-x222q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:02:46.092770 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.092742 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b951428c-bcc4-40fc-b920-a7ea13fb99e3-util" (OuterVolumeSpecName: "util") pod "b951428c-bcc4-40fc-b920-a7ea13fb99e3" (UID: "b951428c-bcc4-40fc-b920-a7ea13fb99e3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:02:46.093555 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.093536 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7278c014-ec7e-4fae-98a6-3e9cdfa85700-util" (OuterVolumeSpecName: "util") pod "7278c014-ec7e-4fae-98a6-3e9cdfa85700" (UID: "7278c014-ec7e-4fae-98a6-3e9cdfa85700"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:02:46.187929 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.187903 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b951428c-bcc4-40fc-b920-a7ea13fb99e3-bundle\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:02:46.187929 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.187928 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x222q\" (UniqueName: \"kubernetes.io/projected/b951428c-bcc4-40fc-b920-a7ea13fb99e3-kube-api-access-x222q\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:02:46.188082 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.187940 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b951428c-bcc4-40fc-b920-a7ea13fb99e3-util\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:02:46.188082 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.187951 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nzw6\" (UniqueName: \"kubernetes.io/projected/7278c014-ec7e-4fae-98a6-3e9cdfa85700-kube-api-access-9nzw6\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:02:46.188082 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.187960 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7278c014-ec7e-4fae-98a6-3e9cdfa85700-util\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:02:46.188082 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.187967 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7278c014-ec7e-4fae-98a6-3e9cdfa85700-bundle\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:02:46.881856 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.881783 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc" Jul 06 19:02:46.881856 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.881778 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc" event={"ID":"7278c014-ec7e-4fae-98a6-3e9cdfa85700","Type":"ContainerDied","Data":"1635b62a282e567ed1fc7049b116edd35d72358b8abcdd15b4dc6862e69cc475"} Jul 06 19:02:46.882045 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.881891 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1635b62a282e567ed1fc7049b116edd35d72358b8abcdd15b4dc6862e69cc475" Jul 06 19:02:46.883784 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.883752 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g" event={"ID":"b951428c-bcc4-40fc-b920-a7ea13fb99e3","Type":"ContainerDied","Data":"39be640069a9b57c4e7a9e6a3bcb3e69a9614e77456733db4bf8852d6879f127"} Jul 06 19:02:46.883925 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.883820 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39be640069a9b57c4e7a9e6a3bcb3e69a9614e77456733db4bf8852d6879f127" Jul 06 19:02:46.883925 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:46.883822 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g" Jul 06 19:02:49.509948 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.509917 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b5c7cd587-4bsfd"] Jul 06 19:02:49.510335 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510321 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2f0b925-1dee-405d-87ea-4102316fe940" containerName="pull" Jul 06 19:02:49.510335 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510335 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2f0b925-1dee-405d-87ea-4102316fe940" containerName="pull" Jul 06 19:02:49.510434 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510347 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2f0b925-1dee-405d-87ea-4102316fe940" containerName="util" Jul 06 19:02:49.510434 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510352 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2f0b925-1dee-405d-87ea-4102316fe940" containerName="util" Jul 06 19:02:49.510434 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510361 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7278c014-ec7e-4fae-98a6-3e9cdfa85700" containerName="extract" Jul 06 19:02:49.510434 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510366 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7278c014-ec7e-4fae-98a6-3e9cdfa85700" containerName="extract" Jul 06 19:02:49.510434 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510373 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b951428c-bcc4-40fc-b920-a7ea13fb99e3" containerName="extract" Jul 06 19:02:49.510434 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510379 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b951428c-bcc4-40fc-b920-a7ea13fb99e3" containerName="extract" Jul 06 19:02:49.510434 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510385 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2f0b925-1dee-405d-87ea-4102316fe940" containerName="extract" Jul 06 19:02:49.510434 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510389 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2f0b925-1dee-405d-87ea-4102316fe940" containerName="extract" Jul 06 19:02:49.510434 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510396 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58068485-137c-4cac-8145-905ef660eb4b" containerName="util" Jul 06 19:02:49.510434 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510401 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="58068485-137c-4cac-8145-905ef660eb4b" containerName="util" Jul 06 19:02:49.510434 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510411 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b951428c-bcc4-40fc-b920-a7ea13fb99e3" containerName="pull" Jul 06 19:02:49.510434 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510416 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b951428c-bcc4-40fc-b920-a7ea13fb99e3" containerName="pull" Jul 06 19:02:49.510434 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510426 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7278c014-ec7e-4fae-98a6-3e9cdfa85700" containerName="util" Jul 06 19:02:49.510434 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510430 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7278c014-ec7e-4fae-98a6-3e9cdfa85700" containerName="util" Jul 06 19:02:49.510434 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510436 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58068485-137c-4cac-8145-905ef660eb4b" containerName="pull" Jul 06 19:02:49.510434 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510441 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="58068485-137c-4cac-8145-905ef660eb4b" containerName="pull" Jul 06 19:02:49.511152 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510448 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b951428c-bcc4-40fc-b920-a7ea13fb99e3" containerName="util" Jul 06 19:02:49.511152 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510453 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b951428c-bcc4-40fc-b920-a7ea13fb99e3" containerName="util" Jul 06 19:02:49.511152 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510458 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7278c014-ec7e-4fae-98a6-3e9cdfa85700" containerName="pull" Jul 06 19:02:49.511152 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510462 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7278c014-ec7e-4fae-98a6-3e9cdfa85700" containerName="pull" Jul 06 19:02:49.511152 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510468 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58068485-137c-4cac-8145-905ef660eb4b" containerName="extract" Jul 06 19:02:49.511152 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510490 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="58068485-137c-4cac-8145-905ef660eb4b" containerName="extract" Jul 06 19:02:49.511152 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510588 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="58068485-137c-4cac-8145-905ef660eb4b" containerName="extract" Jul 06 19:02:49.511152 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510605 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2f0b925-1dee-405d-87ea-4102316fe940" containerName="extract" Jul 06 19:02:49.511152 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510614 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7278c014-ec7e-4fae-98a6-3e9cdfa85700" containerName="extract" Jul 06 19:02:49.511152 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.510621 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b951428c-bcc4-40fc-b920-a7ea13fb99e3" containerName="extract" Jul 06 19:02:49.512935 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.512912 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.531787 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.531760 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b5c7cd587-4bsfd"] Jul 06 19:02:49.614669 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.614636 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62ec1818-6565-4762-bce1-da8c05a51cb8-console-oauth-config\") pod \"console-7b5c7cd587-4bsfd\" (UID: \"62ec1818-6565-4762-bce1-da8c05a51cb8\") " pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.614838 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.614682 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62ec1818-6565-4762-bce1-da8c05a51cb8-service-ca\") pod \"console-7b5c7cd587-4bsfd\" (UID: \"62ec1818-6565-4762-bce1-da8c05a51cb8\") " pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.614838 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.614744 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62ec1818-6565-4762-bce1-da8c05a51cb8-console-serving-cert\") pod \"console-7b5c7cd587-4bsfd\" (UID: \"62ec1818-6565-4762-bce1-da8c05a51cb8\") " pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.614838 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.614784 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62ec1818-6565-4762-bce1-da8c05a51cb8-trusted-ca-bundle\") pod \"console-7b5c7cd587-4bsfd\" (UID: \"62ec1818-6565-4762-bce1-da8c05a51cb8\") " pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.614838 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.614805 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppv5z\" (UniqueName: \"kubernetes.io/projected/62ec1818-6565-4762-bce1-da8c05a51cb8-kube-api-access-ppv5z\") pod \"console-7b5c7cd587-4bsfd\" (UID: \"62ec1818-6565-4762-bce1-da8c05a51cb8\") " pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.614838 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.614829 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62ec1818-6565-4762-bce1-da8c05a51cb8-console-config\") pod \"console-7b5c7cd587-4bsfd\" (UID: \"62ec1818-6565-4762-bce1-da8c05a51cb8\") " pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.615081 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.614953 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62ec1818-6565-4762-bce1-da8c05a51cb8-oauth-serving-cert\") pod \"console-7b5c7cd587-4bsfd\" (UID: \"62ec1818-6565-4762-bce1-da8c05a51cb8\") " pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.716160 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.716131 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62ec1818-6565-4762-bce1-da8c05a51cb8-service-ca\") pod \"console-7b5c7cd587-4bsfd\" (UID: \"62ec1818-6565-4762-bce1-da8c05a51cb8\") " pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.716336 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.716167 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62ec1818-6565-4762-bce1-da8c05a51cb8-console-serving-cert\") pod \"console-7b5c7cd587-4bsfd\" (UID: \"62ec1818-6565-4762-bce1-da8c05a51cb8\") " pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.716336 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.716190 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62ec1818-6565-4762-bce1-da8c05a51cb8-trusted-ca-bundle\") pod \"console-7b5c7cd587-4bsfd\" (UID: \"62ec1818-6565-4762-bce1-da8c05a51cb8\") " pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.716336 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.716209 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppv5z\" (UniqueName: \"kubernetes.io/projected/62ec1818-6565-4762-bce1-da8c05a51cb8-kube-api-access-ppv5z\") pod \"console-7b5c7cd587-4bsfd\" (UID: \"62ec1818-6565-4762-bce1-da8c05a51cb8\") " pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.716336 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.716229 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62ec1818-6565-4762-bce1-da8c05a51cb8-console-config\") pod \"console-7b5c7cd587-4bsfd\" (UID: \"62ec1818-6565-4762-bce1-da8c05a51cb8\") " pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.716565 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.716373 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62ec1818-6565-4762-bce1-da8c05a51cb8-oauth-serving-cert\") pod \"console-7b5c7cd587-4bsfd\" (UID: \"62ec1818-6565-4762-bce1-da8c05a51cb8\") " pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.716565 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.716509 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62ec1818-6565-4762-bce1-da8c05a51cb8-console-oauth-config\") pod \"console-7b5c7cd587-4bsfd\" (UID: \"62ec1818-6565-4762-bce1-da8c05a51cb8\") " pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.716936 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.716910 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62ec1818-6565-4762-bce1-da8c05a51cb8-service-ca\") pod \"console-7b5c7cd587-4bsfd\" (UID: \"62ec1818-6565-4762-bce1-da8c05a51cb8\") " pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.717050 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.716973 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62ec1818-6565-4762-bce1-da8c05a51cb8-console-config\") pod \"console-7b5c7cd587-4bsfd\" (UID: \"62ec1818-6565-4762-bce1-da8c05a51cb8\") " pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.717089 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.717059 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62ec1818-6565-4762-bce1-da8c05a51cb8-oauth-serving-cert\") pod \"console-7b5c7cd587-4bsfd\" (UID: \"62ec1818-6565-4762-bce1-da8c05a51cb8\") " pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.717143 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.717121 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62ec1818-6565-4762-bce1-da8c05a51cb8-trusted-ca-bundle\") pod \"console-7b5c7cd587-4bsfd\" (UID: \"62ec1818-6565-4762-bce1-da8c05a51cb8\") " pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.718744 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.718716 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62ec1818-6565-4762-bce1-da8c05a51cb8-console-serving-cert\") pod \"console-7b5c7cd587-4bsfd\" (UID: \"62ec1818-6565-4762-bce1-da8c05a51cb8\") " pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.718893 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.718876 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62ec1818-6565-4762-bce1-da8c05a51cb8-console-oauth-config\") pod \"console-7b5c7cd587-4bsfd\" (UID: \"62ec1818-6565-4762-bce1-da8c05a51cb8\") " pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.725434 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.725412 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppv5z\" (UniqueName: \"kubernetes.io/projected/62ec1818-6565-4762-bce1-da8c05a51cb8-kube-api-access-ppv5z\") pod \"console-7b5c7cd587-4bsfd\" (UID: \"62ec1818-6565-4762-bce1-da8c05a51cb8\") " pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.823102 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.823032 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:49.962573 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:49.962544 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b5c7cd587-4bsfd"] Jul 06 19:02:49.964652 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:02:49.964626 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62ec1818_6565_4762_bce1_da8c05a51cb8.slice/crio-f38bfd5be157b160457540e8660b6527a307badf9a62af967d87ff8a5086ed47 WatchSource:0}: Error finding container f38bfd5be157b160457540e8660b6527a307badf9a62af967d87ff8a5086ed47: Status 404 returned error can't find the container with id f38bfd5be157b160457540e8660b6527a307badf9a62af967d87ff8a5086ed47 Jul 06 19:02:50.904683 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:50.904648 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b5c7cd587-4bsfd" event={"ID":"62ec1818-6565-4762-bce1-da8c05a51cb8","Type":"ContainerStarted","Data":"b65cd60b8433e8d6ae6469418e7abf6b61a3a0e974e0c479edc91e218077a1a4"} Jul 06 19:02:50.905062 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:50.904697 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b5c7cd587-4bsfd" event={"ID":"62ec1818-6565-4762-bce1-da8c05a51cb8","Type":"ContainerStarted","Data":"f38bfd5be157b160457540e8660b6527a307badf9a62af967d87ff8a5086ed47"} Jul 06 19:02:50.925414 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:50.925369 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b5c7cd587-4bsfd" podStartSLOduration=1.92535372 podStartE2EDuration="1.92535372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:02:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:02:50.924767994 +0000 UTC m=+478.851202542" watchObservedRunningTime="2026-07-06 19:02:50.92535372 +0000 UTC m=+478.851788246" Jul 06 19:02:55.836854 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:55.836819 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbjp6"] Jul 06 19:02:55.839235 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:55.839220 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbjp6" Jul 06 19:02:55.843578 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:55.843560 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5jphl\"" Jul 06 19:02:55.844327 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:55.844314 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 19:02:55.857039 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:55.857016 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 19:02:55.868738 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:55.868714 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpnlb\" (UniqueName: \"kubernetes.io/projected/a3f2f559-5d8d-4192-90a8-737dc6d19f80-kube-api-access-zpnlb\") pod \"limitador-operator-controller-manager-859d7b78bd-lbjp6\" (UID: \"a3f2f559-5d8d-4192-90a8-737dc6d19f80\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbjp6" Jul 06 19:02:55.882967 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:55.882945 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbjp6"] Jul 06 19:02:55.969288 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:55.969253 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpnlb\" (UniqueName: \"kubernetes.io/projected/a3f2f559-5d8d-4192-90a8-737dc6d19f80-kube-api-access-zpnlb\") pod \"limitador-operator-controller-manager-859d7b78bd-lbjp6\" (UID: \"a3f2f559-5d8d-4192-90a8-737dc6d19f80\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbjp6" Jul 06 19:02:55.980287 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:55.980259 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpnlb\" (UniqueName: \"kubernetes.io/projected/a3f2f559-5d8d-4192-90a8-737dc6d19f80-kube-api-access-zpnlb\") pod \"limitador-operator-controller-manager-859d7b78bd-lbjp6\" (UID: \"a3f2f559-5d8d-4192-90a8-737dc6d19f80\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbjp6" Jul 06 19:02:56.149708 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:56.149625 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbjp6" Jul 06 19:02:56.313588 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:56.313561 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbjp6"] Jul 06 19:02:56.315524 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:02:56.315466 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f2f559_5d8d_4192_90a8_737dc6d19f80.slice/crio-360e8e80ac7b907cdfec6cdb4ae7bce140928828341a5f8feeed3aff2f4820dc WatchSource:0}: Error finding container 360e8e80ac7b907cdfec6cdb4ae7bce140928828341a5f8feeed3aff2f4820dc: Status 404 returned error can't find the container with id 360e8e80ac7b907cdfec6cdb4ae7bce140928828341a5f8feeed3aff2f4820dc Jul 06 19:02:56.937979 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:56.937941 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbjp6" event={"ID":"a3f2f559-5d8d-4192-90a8-737dc6d19f80","Type":"ContainerStarted","Data":"360e8e80ac7b907cdfec6cdb4ae7bce140928828341a5f8feeed3aff2f4820dc"} Jul 06 19:02:59.824080 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:59.823997 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:59.824080 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:59.824063 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:59.828512 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:59.828467 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:02:59.955517 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:59.955457 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbjp6" event={"ID":"a3f2f559-5d8d-4192-90a8-737dc6d19f80","Type":"ContainerStarted","Data":"e03f81ba9001cb7bd387f1900ba8a5e16ba51b43f1eb8035d5c436471baec531"} Jul 06 19:02:59.955803 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:59.955780 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbjp6" Jul 06 19:02:59.959309 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:02:59.959294 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b5c7cd587-4bsfd" Jul 06 19:03:00.044104 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:00.044054 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbjp6" podStartSLOduration=1.825530841 podStartE2EDuration="5.044038276s" totalImagesPullingTime="3.218507435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:03:00.005858327 +0000 UTC m=+487.932292876" watchObservedRunningTime="2026-07-06 19:03:00.044038276 +0000 UTC m=+487.970472825" Jul 06 19:03:00.095063 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:00.094965 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-786bbb7986-sw96w"] Jul 06 19:03:05.049401 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:05.049363 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jtltb"] Jul 06 19:03:05.052084 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:05.052065 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jtltb" Jul 06 19:03:05.055103 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:05.055082 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-fr96p\"" Jul 06 19:03:05.065432 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:05.065409 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jtltb"] Jul 06 19:03:05.147992 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:05.147961 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mkc4\" (UniqueName: \"kubernetes.io/projected/a771cd7b-c570-4948-92c6-b22b2f96dd04-kube-api-access-5mkc4\") pod \"authorino-operator-75cc8d5cb7-jtltb\" (UID: \"a771cd7b-c570-4948-92c6-b22b2f96dd04\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jtltb" Jul 06 19:03:05.249391 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:05.249351 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mkc4\" (UniqueName: \"kubernetes.io/projected/a771cd7b-c570-4948-92c6-b22b2f96dd04-kube-api-access-5mkc4\") pod \"authorino-operator-75cc8d5cb7-jtltb\" (UID: \"a771cd7b-c570-4948-92c6-b22b2f96dd04\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jtltb" Jul 06 19:03:05.260783 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:05.260751 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mkc4\" (UniqueName: \"kubernetes.io/projected/a771cd7b-c570-4948-92c6-b22b2f96dd04-kube-api-access-5mkc4\") pod \"authorino-operator-75cc8d5cb7-jtltb\" (UID: \"a771cd7b-c570-4948-92c6-b22b2f96dd04\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jtltb" Jul 06 19:03:05.362564 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:05.362454 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jtltb" Jul 06 19:03:05.503460 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:05.503434 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jtltb"] Jul 06 19:03:05.504872 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:03:05.504842 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda771cd7b_c570_4948_92c6_b22b2f96dd04.slice/crio-8366f9124ecc0c5e45ec4be258641b439052d17d68178c98c34cec6e9277ffeb WatchSource:0}: Error finding container 8366f9124ecc0c5e45ec4be258641b439052d17d68178c98c34cec6e9277ffeb: Status 404 returned error can't find the container with id 8366f9124ecc0c5e45ec4be258641b439052d17d68178c98c34cec6e9277ffeb Jul 06 19:03:05.986924 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:05.986891 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jtltb" event={"ID":"a771cd7b-c570-4948-92c6-b22b2f96dd04","Type":"ContainerStarted","Data":"8366f9124ecc0c5e45ec4be258641b439052d17d68178c98c34cec6e9277ffeb"} Jul 06 19:03:08.003545 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:08.003512 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jtltb" event={"ID":"a771cd7b-c570-4948-92c6-b22b2f96dd04","Type":"ContainerStarted","Data":"a52c17c685e0fbbbac1f2af87a84921ee52341fe3619bd68af20e54375cef9f0"} Jul 06 19:03:08.003930 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:08.003578 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jtltb" Jul 06 19:03:08.028887 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:08.028839 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jtltb" podStartSLOduration=0.692233343 podStartE2EDuration="3.028822338s" totalImagesPullingTime="2.336588995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:03:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:03:08.027029044 +0000 UTC m=+495.953463593" watchObservedRunningTime="2026-07-06 19:03:08.028822338 +0000 UTC m=+495.955256918" Jul 06 19:03:10.963697 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:10.963668 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbjp6" Jul 06 19:03:19.011727 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:19.011693 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jtltb" Jul 06 19:03:22.148974 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:22.148935 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbjp6"] Jul 06 19:03:22.149433 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:22.149176 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbjp6" podUID="a3f2f559-5d8d-4192-90a8-737dc6d19f80" containerName="manager" containerID="cri-o://e03f81ba9001cb7bd387f1900ba8a5e16ba51b43f1eb8035d5c436471baec531" gracePeriod=2 Jul 06 19:03:22.157923 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:03:22.152925 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lbjp6\" is forbidden: User \"system:node:ip-10-0-139-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-154.ec2.internal' and this object" podUID="a3f2f559-5d8d-4192-90a8-737dc6d19f80" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbjp6" Jul 06 19:03:22.157923 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:22.156016 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbjp6"] Jul 06 19:03:22.192487 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:22.192443 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9v49s"] Jul 06 19:03:22.192886 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:22.192869 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3f2f559-5d8d-4192-90a8-737dc6d19f80" containerName="manager" Jul 06 19:03:22.192967 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:22.192889 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3f2f559-5d8d-4192-90a8-737dc6d19f80" containerName="manager" Jul 06 19:03:22.193022 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:22.193009 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3f2f559-5d8d-4192-90a8-737dc6d19f80" containerName="manager" Jul 06 19:03:22.195949 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:22.195924 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9v49s" Jul 06 19:03:22.198717 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:03:22.198680 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lbjp6\" is forbidden: User \"system:node:ip-10-0-139-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-154.ec2.internal' and this object" podUID="a3f2f559-5d8d-4192-90a8-737dc6d19f80" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbjp6" Jul 06 19:03:22.230527 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:22.230498 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9v49s"] Jul 06 19:03:22.301304 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:22.301266 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h8ln\" (UniqueName: \"kubernetes.io/projected/1bc828b2-b2ba-4d5c-a9c9-5b31c6edbed4-kube-api-access-4h8ln\") pod \"limitador-operator-controller-manager-859d7b78bd-9v49s\" (UID: \"1bc828b2-b2ba-4d5c-a9c9-5b31c6edbed4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9v49s" Jul 06 19:03:22.389626 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:22.389601 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbjp6" Jul 06 19:03:22.392105 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:03:22.392077 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lbjp6\" is forbidden: User \"system:node:ip-10-0-139-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-154.ec2.internal' and this object" podUID="a3f2f559-5d8d-4192-90a8-737dc6d19f80" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbjp6" Jul 06 19:03:22.402532 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:22.402459 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h8ln\" (UniqueName: \"kubernetes.io/projected/1bc828b2-b2ba-4d5c-a9c9-5b31c6edbed4-kube-api-access-4h8ln\") pod \"limitador-operator-controller-manager-859d7b78bd-9v49s\" (UID: \"1bc828b2-b2ba-4d5c-a9c9-5b31c6edbed4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9v49s" Jul 06 19:03:22.428169 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:22.428144 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h8ln\" (UniqueName: \"kubernetes.io/projected/1bc828b2-b2ba-4d5c-a9c9-5b31c6edbed4-kube-api-access-4h8ln\") pod \"limitador-operator-controller-manager-859d7b78bd-9v49s\" (UID: \"1bc828b2-b2ba-4d5c-a9c9-5b31c6edbed4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9v49s" Jul 06 19:03:22.503129 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:22.503084 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpnlb\" (UniqueName: \"kubernetes.io/projected/a3f2f559-5d8d-4192-90a8-737dc6d19f80-kube-api-access-zpnlb\") pod \"a3f2f559-5d8d-4192-90a8-737dc6d19f80\" (UID: \"a3f2f559-5d8d-4192-90a8-737dc6d19f80\") " Jul 06 19:03:22.505141 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:22.505114 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3f2f559-5d8d-4192-90a8-737dc6d19f80-kube-api-access-zpnlb" (OuterVolumeSpecName: "kube-api-access-zpnlb") pod "a3f2f559-5d8d-4192-90a8-737dc6d19f80" (UID: "a3f2f559-5d8d-4192-90a8-737dc6d19f80"). InnerVolumeSpecName "kube-api-access-zpnlb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:03:22.523932 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:22.523908 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9v49s" Jul 06 19:03:22.576284 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:03:22.576230 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lbjp6\" is forbidden: User \"system:node:ip-10-0-139-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-154.ec2.internal' and this object" podUID="a3f2f559-5d8d-4192-90a8-737dc6d19f80" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbjp6" Jul 06 19:03:22.578444 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:22.578410 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3f2f559-5d8d-4192-90a8-737dc6d19f80" path="/var/lib/kubelet/pods/a3f2f559-5d8d-4192-90a8-737dc6d19f80/volumes" Jul 06 19:03:22.604735 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:22.604700 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpnlb\" (UniqueName: \"kubernetes.io/projected/a3f2f559-5d8d-4192-90a8-737dc6d19f80-kube-api-access-zpnlb\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:03:22.666652 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:22.666629 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9v49s"] Jul 06 19:03:22.667969 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:03:22.667942 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bc828b2_b2ba_4d5c_a9c9_5b31c6edbed4.slice/crio-74d6eab9f43d66726eb55670edb93b45627ff39225292b0c70c19e0a2db65088 WatchSource:0}: Error finding container 74d6eab9f43d66726eb55670edb93b45627ff39225292b0c70c19e0a2db65088: Status 404 returned error can't find the container with id 74d6eab9f43d66726eb55670edb93b45627ff39225292b0c70c19e0a2db65088 Jul 06 19:03:23.080015 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:23.079981 2567 generic.go:356] "Generic (PLEG): container finished" podID="a3f2f559-5d8d-4192-90a8-737dc6d19f80" containerID="e03f81ba9001cb7bd387f1900ba8a5e16ba51b43f1eb8035d5c436471baec531" exitCode=0 Jul 06 19:03:23.080197 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:23.080032 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbjp6" Jul 06 19:03:23.080197 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:23.080082 2567 scope.go:117] "RemoveContainer" containerID="e03f81ba9001cb7bd387f1900ba8a5e16ba51b43f1eb8035d5c436471baec531" Jul 06 19:03:23.081994 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:23.081948 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9v49s" event={"ID":"1bc828b2-b2ba-4d5c-a9c9-5b31c6edbed4","Type":"ContainerStarted","Data":"2cf88ead867cb438d08784e57cb24e64eaaf4d54cd8dc1106d9b00cb48ad5ce6"} Jul 06 19:03:23.082171 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:23.082005 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9v49s" event={"ID":"1bc828b2-b2ba-4d5c-a9c9-5b31c6edbed4","Type":"ContainerStarted","Data":"74d6eab9f43d66726eb55670edb93b45627ff39225292b0c70c19e0a2db65088"} Jul 06 19:03:23.082171 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:23.082135 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9v49s" Jul 06 19:03:23.089040 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:23.089023 2567 scope.go:117] "RemoveContainer" containerID="e03f81ba9001cb7bd387f1900ba8a5e16ba51b43f1eb8035d5c436471baec531" Jul 06 19:03:23.089277 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:03:23.089261 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e03f81ba9001cb7bd387f1900ba8a5e16ba51b43f1eb8035d5c436471baec531\": container with ID starting with e03f81ba9001cb7bd387f1900ba8a5e16ba51b43f1eb8035d5c436471baec531 not found: ID does not exist" containerID="e03f81ba9001cb7bd387f1900ba8a5e16ba51b43f1eb8035d5c436471baec531" Jul 06 19:03:23.089350 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:23.089284 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e03f81ba9001cb7bd387f1900ba8a5e16ba51b43f1eb8035d5c436471baec531"} err="failed to get container status \"e03f81ba9001cb7bd387f1900ba8a5e16ba51b43f1eb8035d5c436471baec531\": rpc error: code = NotFound desc = could not find container \"e03f81ba9001cb7bd387f1900ba8a5e16ba51b43f1eb8035d5c436471baec531\": container with ID starting with e03f81ba9001cb7bd387f1900ba8a5e16ba51b43f1eb8035d5c436471baec531 not found: ID does not exist" Jul 06 19:03:23.115699 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:23.115655 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9v49s" podStartSLOduration=1.115642798 podStartE2EDuration="1.115642798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:03:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:03:23.113370122 +0000 UTC m=+511.039804668" watchObservedRunningTime="2026-07-06 19:03:23.115642798 +0000 UTC m=+511.042077348" Jul 06 19:03:25.118062 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.118020 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-786bbb7986-sw96w" podUID="422c8004-a1ec-4c0f-b11b-28e482aaa46e" containerName="console" containerID="cri-o://519bf1f6c0424db629595704e0c4fb6e42f6d34769e3a087d4550c3ccc48e10c" gracePeriod=15 Jul 06 19:03:25.372791 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.372739 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786bbb7986-sw96w" Jul 06 19:03:25.530288 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.530259 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-trusted-ca-bundle\") pod \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " Jul 06 19:03:25.530462 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.530308 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-console-config\") pod \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " Jul 06 19:03:25.530462 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.530330 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/422c8004-a1ec-4c0f-b11b-28e482aaa46e-console-oauth-config\") pod \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " Jul 06 19:03:25.530462 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.530361 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sccdc\" (UniqueName: \"kubernetes.io/projected/422c8004-a1ec-4c0f-b11b-28e482aaa46e-kube-api-access-sccdc\") pod \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " Jul 06 19:03:25.530462 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.530395 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-oauth-serving-cert\") pod \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " Jul 06 19:03:25.530703 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.530469 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/422c8004-a1ec-4c0f-b11b-28e482aaa46e-console-serving-cert\") pod \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " Jul 06 19:03:25.530703 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.530532 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-service-ca\") pod \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\" (UID: \"422c8004-a1ec-4c0f-b11b-28e482aaa46e\") " Jul 06 19:03:25.530824 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.530689 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "422c8004-a1ec-4c0f-b11b-28e482aaa46e" (UID: "422c8004-a1ec-4c0f-b11b-28e482aaa46e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:03:25.530879 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.530814 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-console-config" (OuterVolumeSpecName: "console-config") pod "422c8004-a1ec-4c0f-b11b-28e482aaa46e" (UID: "422c8004-a1ec-4c0f-b11b-28e482aaa46e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:03:25.530929 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.530875 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "422c8004-a1ec-4c0f-b11b-28e482aaa46e" (UID: "422c8004-a1ec-4c0f-b11b-28e482aaa46e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:03:25.531071 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.531048 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-service-ca" (OuterVolumeSpecName: "service-ca") pod "422c8004-a1ec-4c0f-b11b-28e482aaa46e" (UID: "422c8004-a1ec-4c0f-b11b-28e482aaa46e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:03:25.532437 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.532415 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/422c8004-a1ec-4c0f-b11b-28e482aaa46e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "422c8004-a1ec-4c0f-b11b-28e482aaa46e" (UID: "422c8004-a1ec-4c0f-b11b-28e482aaa46e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:03:25.532944 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.532924 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/422c8004-a1ec-4c0f-b11b-28e482aaa46e-kube-api-access-sccdc" (OuterVolumeSpecName: "kube-api-access-sccdc") pod "422c8004-a1ec-4c0f-b11b-28e482aaa46e" (UID: "422c8004-a1ec-4c0f-b11b-28e482aaa46e"). InnerVolumeSpecName "kube-api-access-sccdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:03:25.532944 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.532925 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/422c8004-a1ec-4c0f-b11b-28e482aaa46e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "422c8004-a1ec-4c0f-b11b-28e482aaa46e" (UID: "422c8004-a1ec-4c0f-b11b-28e482aaa46e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:03:25.631751 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.631670 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-console-config\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:03:25.631751 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.631706 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/422c8004-a1ec-4c0f-b11b-28e482aaa46e-console-oauth-config\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:03:25.631751 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.631738 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sccdc\" (UniqueName: \"kubernetes.io/projected/422c8004-a1ec-4c0f-b11b-28e482aaa46e-kube-api-access-sccdc\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:03:25.631751 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.631747 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-oauth-serving-cert\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:03:25.631751 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.631756 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/422c8004-a1ec-4c0f-b11b-28e482aaa46e-console-serving-cert\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:03:25.631751 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.631764 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-service-ca\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:03:25.632035 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:25.631773 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/422c8004-a1ec-4c0f-b11b-28e482aaa46e-trusted-ca-bundle\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:03:26.099174 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:26.099137 2567 generic.go:356] "Generic (PLEG): container finished" podID="422c8004-a1ec-4c0f-b11b-28e482aaa46e" containerID="519bf1f6c0424db629595704e0c4fb6e42f6d34769e3a087d4550c3ccc48e10c" exitCode=0 Jul 06 19:03:26.099364 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:26.099208 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786bbb7986-sw96w" Jul 06 19:03:26.099364 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:26.099218 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786bbb7986-sw96w" event={"ID":"422c8004-a1ec-4c0f-b11b-28e482aaa46e","Type":"ContainerDied","Data":"519bf1f6c0424db629595704e0c4fb6e42f6d34769e3a087d4550c3ccc48e10c"} Jul 06 19:03:26.099364 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:26.099284 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786bbb7986-sw96w" event={"ID":"422c8004-a1ec-4c0f-b11b-28e482aaa46e","Type":"ContainerDied","Data":"83cb868554853a2a7dfb86eb5d0154d4017d30ae93e873b19fc06e348f77b74a"} Jul 06 19:03:26.099364 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:26.099313 2567 scope.go:117] "RemoveContainer" containerID="519bf1f6c0424db629595704e0c4fb6e42f6d34769e3a087d4550c3ccc48e10c" Jul 06 19:03:26.109098 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:26.109083 2567 scope.go:117] "RemoveContainer" containerID="519bf1f6c0424db629595704e0c4fb6e42f6d34769e3a087d4550c3ccc48e10c" Jul 06 19:03:26.109349 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:03:26.109322 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"519bf1f6c0424db629595704e0c4fb6e42f6d34769e3a087d4550c3ccc48e10c\": container with ID starting with 519bf1f6c0424db629595704e0c4fb6e42f6d34769e3a087d4550c3ccc48e10c not found: ID does not exist" containerID="519bf1f6c0424db629595704e0c4fb6e42f6d34769e3a087d4550c3ccc48e10c" Jul 06 19:03:26.109349 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:26.109353 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"519bf1f6c0424db629595704e0c4fb6e42f6d34769e3a087d4550c3ccc48e10c"} err="failed to get container status \"519bf1f6c0424db629595704e0c4fb6e42f6d34769e3a087d4550c3ccc48e10c\": rpc error: code = NotFound desc = could not find container \"519bf1f6c0424db629595704e0c4fb6e42f6d34769e3a087d4550c3ccc48e10c\": container with ID starting with 519bf1f6c0424db629595704e0c4fb6e42f6d34769e3a087d4550c3ccc48e10c not found: ID does not exist" Jul 06 19:03:26.134345 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:26.134318 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-786bbb7986-sw96w"] Jul 06 19:03:26.150903 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:26.150882 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-786bbb7986-sw96w"] Jul 06 19:03:26.575282 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:26.575251 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="422c8004-a1ec-4c0f-b11b-28e482aaa46e" path="/var/lib/kubelet/pods/422c8004-a1ec-4c0f-b11b-28e482aaa46e/volumes" Jul 06 19:03:34.089930 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:03:34.089903 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9v49s" Jul 06 19:04:02.777978 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.777941 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh"] Jul 06 19:04:02.778428 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.778304 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="422c8004-a1ec-4c0f-b11b-28e482aaa46e" containerName="console" Jul 06 19:04:02.778428 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.778315 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="422c8004-a1ec-4c0f-b11b-28e482aaa46e" containerName="console" Jul 06 19:04:02.778428 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.778381 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="422c8004-a1ec-4c0f-b11b-28e482aaa46e" containerName="console" Jul 06 19:04:02.782807 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.782789 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.787845 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.787826 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-jgn69\"" Jul 06 19:04:02.800461 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.800433 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.800461 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.800463 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.800636 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.800508 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czgxz\" (UniqueName: \"kubernetes.io/projected/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-kube-api-access-czgxz\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.800636 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.800537 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.800636 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.800556 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.800767 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.800634 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.800767 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.800665 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.800870 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.800782 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.800870 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.800833 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.808399 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.808375 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh"] Jul 06 19:04:02.902095 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.902054 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.902095 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.902099 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.902344 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.902161 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.902344 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.902186 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.902344 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.902208 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.902344 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.902236 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.902344 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.902254 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czgxz\" (UniqueName: \"kubernetes.io/projected/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-kube-api-access-czgxz\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.902344 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.902289 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.902344 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.902319 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.902689 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.902554 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.902814 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.902793 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.902880 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.902862 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.902919 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.902902 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.902955 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.902941 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.904714 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.904694 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.904831 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.904814 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.911889 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.911865 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:02.912130 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:02.912104 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czgxz\" (UniqueName: \"kubernetes.io/projected/3df391cf-3927-4c0b-aa2b-dbf5d896d20b-kube-api-access-czgxz\") pod \"maas-default-gateway-openshift-default-56654dcf7-5nwsh\" (UID: \"3df391cf-3927-4c0b-aa2b-dbf5d896d20b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:03.092333 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:03.092259 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:03.230664 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:03.230631 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh"] Jul 06 19:04:03.231337 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:04:03.231306 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3df391cf_3927_4c0b_aa2b_dbf5d896d20b.slice/crio-0d8614a1db2e48bc0ce3054daeff27c037e290bbdc061b3b6b66580a4402ba60 WatchSource:0}: Error finding container 0d8614a1db2e48bc0ce3054daeff27c037e290bbdc061b3b6b66580a4402ba60: Status 404 returned error can't find the container with id 0d8614a1db2e48bc0ce3054daeff27c037e290bbdc061b3b6b66580a4402ba60 Jul 06 19:04:03.233554 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:03.233517 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:04:03.233631 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:03.233598 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:04:03.233678 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:03.233645 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:04:03.300704 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:03.300674 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" event={"ID":"3df391cf-3927-4c0b-aa2b-dbf5d896d20b","Type":"ContainerStarted","Data":"18cd1d1e6fe3efb63cfa7f4838c49a2bc1da3d35a8d01eac201a1550eb3f2eed"} Jul 06 19:04:03.300809 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:03.300747 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" event={"ID":"3df391cf-3927-4c0b-aa2b-dbf5d896d20b","Type":"ContainerStarted","Data":"0d8614a1db2e48bc0ce3054daeff27c037e290bbdc061b3b6b66580a4402ba60"} Jul 06 19:04:03.332544 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:03.332465 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" podStartSLOduration=1.332449893 podStartE2EDuration="1.332449893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:04:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:04:03.32970878 +0000 UTC m=+551.256143329" watchObservedRunningTime="2026-07-06 19:04:03.332449893 +0000 UTC m=+551.258884441" Jul 06 19:04:04.092417 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:04.092381 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:04.097761 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:04.097735 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:04.306144 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:04.306114 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:04.307051 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:04.307034 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:04:52.516699 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:52.516673 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/1.log" Jul 06 19:04:52.517243 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:04:52.516734 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/1.log" Jul 06 19:05:17.133018 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:17.132915 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-wrvd5"] Jul 06 19:05:17.136290 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:17.136274 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-wrvd5" Jul 06 19:05:17.140674 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:05:17.140651 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"payload-processing-dockercfg-szxrl\" is forbidden: User \"system:node:ip-10-0-139-154.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-154.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-szxrl\"" type="*v1.Secret" Jul 06 19:05:17.140811 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:05:17.140670 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"payload-processing-58f86c7798-wrvd5\" is forbidden: User \"system:node:ip-10-0-139-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-154.ec2.internal' and this object" podUID="1fa5d2e7-3246-426d-82e1-9288cc2e3e31" pod="openshift-ingress/payload-processing-58f86c7798-wrvd5" Jul 06 19:05:17.141203 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:05:17.141183 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"payload-processing-plugins\" is forbidden: User \"system:node:ip-10-0-139-154.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-154.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" type="*v1.ConfigMap" Jul 06 19:05:17.188745 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:17.188715 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-wrvd5"] Jul 06 19:05:17.259668 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:17.259631 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcrnf\" (UniqueName: \"kubernetes.io/projected/1fa5d2e7-3246-426d-82e1-9288cc2e3e31-kube-api-access-zcrnf\") pod \"payload-processing-58f86c7798-wrvd5\" (UID: \"1fa5d2e7-3246-426d-82e1-9288cc2e3e31\") " pod="openshift-ingress/payload-processing-58f86c7798-wrvd5" Jul 06 19:05:17.259856 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:17.259741 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa5d2e7-3246-426d-82e1-9288cc2e3e31-plugins-config-volume\") pod \"payload-processing-58f86c7798-wrvd5\" (UID: \"1fa5d2e7-3246-426d-82e1-9288cc2e3e31\") " pod="openshift-ingress/payload-processing-58f86c7798-wrvd5" Jul 06 19:05:17.360839 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:17.360801 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa5d2e7-3246-426d-82e1-9288cc2e3e31-plugins-config-volume\") pod \"payload-processing-58f86c7798-wrvd5\" (UID: \"1fa5d2e7-3246-426d-82e1-9288cc2e3e31\") " pod="openshift-ingress/payload-processing-58f86c7798-wrvd5" Jul 06 19:05:17.361006 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:17.360864 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcrnf\" (UniqueName: \"kubernetes.io/projected/1fa5d2e7-3246-426d-82e1-9288cc2e3e31-kube-api-access-zcrnf\") pod \"payload-processing-58f86c7798-wrvd5\" (UID: \"1fa5d2e7-3246-426d-82e1-9288cc2e3e31\") " pod="openshift-ingress/payload-processing-58f86c7798-wrvd5" Jul 06 19:05:17.371415 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:17.371385 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcrnf\" (UniqueName: \"kubernetes.io/projected/1fa5d2e7-3246-426d-82e1-9288cc2e3e31-kube-api-access-zcrnf\") pod \"payload-processing-58f86c7798-wrvd5\" (UID: \"1fa5d2e7-3246-426d-82e1-9288cc2e3e31\") " pod="openshift-ingress/payload-processing-58f86c7798-wrvd5" Jul 06 19:05:18.361090 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:05:18.361059 2567 configmap.go:193] Couldn't get configMap openshift-ingress/payload-processing-plugins: failed to sync configmap cache: timed out waiting for the condition Jul 06 19:05:18.361502 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:05:18.361134 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1fa5d2e7-3246-426d-82e1-9288cc2e3e31-plugins-config-volume podName:1fa5d2e7-3246-426d-82e1-9288cc2e3e31 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:18.861118999 +0000 UTC m=+626.787553529 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugins-config-volume" (UniqueName: "kubernetes.io/configmap/1fa5d2e7-3246-426d-82e1-9288cc2e3e31-plugins-config-volume") pod "payload-processing-58f86c7798-wrvd5" (UID: "1fa5d2e7-3246-426d-82e1-9288cc2e3e31") : failed to sync configmap cache: timed out waiting for the condition Jul 06 19:05:18.433070 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:18.433029 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-szxrl\"" Jul 06 19:05:18.684604 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:18.684577 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 06 19:05:18.874102 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:18.874069 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa5d2e7-3246-426d-82e1-9288cc2e3e31-plugins-config-volume\") pod \"payload-processing-58f86c7798-wrvd5\" (UID: \"1fa5d2e7-3246-426d-82e1-9288cc2e3e31\") " pod="openshift-ingress/payload-processing-58f86c7798-wrvd5" Jul 06 19:05:18.874732 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:18.874714 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa5d2e7-3246-426d-82e1-9288cc2e3e31-plugins-config-volume\") pod \"payload-processing-58f86c7798-wrvd5\" (UID: \"1fa5d2e7-3246-426d-82e1-9288cc2e3e31\") " pod="openshift-ingress/payload-processing-58f86c7798-wrvd5" Jul 06 19:05:18.946135 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:18.946049 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-wrvd5" Jul 06 19:05:19.110533 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:19.110503 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-wrvd5"] Jul 06 19:05:19.112179 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:05:19.112150 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fa5d2e7_3246_426d_82e1_9288cc2e3e31.slice/crio-342966a46f22982e700641224610993333169a150595cf1113c59893d106bb50 WatchSource:0}: Error finding container 342966a46f22982e700641224610993333169a150595cf1113c59893d106bb50: Status 404 returned error can't find the container with id 342966a46f22982e700641224610993333169a150595cf1113c59893d106bb50 Jul 06 19:05:19.114174 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:19.114158 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:05:19.700622 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:19.700591 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-wrvd5" event={"ID":"1fa5d2e7-3246-426d-82e1-9288cc2e3e31","Type":"ContainerStarted","Data":"342966a46f22982e700641224610993333169a150595cf1113c59893d106bb50"} Jul 06 19:05:20.707850 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:20.707807 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-wrvd5" event={"ID":"1fa5d2e7-3246-426d-82e1-9288cc2e3e31","Type":"ContainerStarted","Data":"86b533b89511f6f8fcbfbe6c6da5d99b80917c99b3454bf4ac4e4f993e4ac44f"} Jul 06 19:05:20.708456 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:20.707876 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-wrvd5" Jul 06 19:05:20.727204 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:20.727154 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-wrvd5" podStartSLOduration=2.445886468 podStartE2EDuration="3.727139457s" totalImagesPullingTime="1.281252989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:20.72478951 +0000 UTC m=+628.651224059" watchObservedRunningTime="2026-07-06 19:05:20.727139457 +0000 UTC m=+628.653574006" Jul 06 19:05:24.738882 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:24.738796 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" event={"ID":"3df391cf-3927-4c0b-aa2b-dbf5d896d20b","Type":"ContainerDied","Data":"18cd1d1e6fe3efb63cfa7f4838c49a2bc1da3d35a8d01eac201a1550eb3f2eed"} Jul 06 19:05:24.738882 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:24.738804 2567 generic.go:356] "Generic (PLEG): container finished" podID="3df391cf-3927-4c0b-aa2b-dbf5d896d20b" containerID="18cd1d1e6fe3efb63cfa7f4838c49a2bc1da3d35a8d01eac201a1550eb3f2eed" exitCode=0 Jul 06 19:05:24.739390 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:24.739171 2567 scope.go:117] "RemoveContainer" containerID="18cd1d1e6fe3efb63cfa7f4838c49a2bc1da3d35a8d01eac201a1550eb3f2eed" Jul 06 19:05:24.740271 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:24.740238 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:05:24.740375 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:24.740320 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:05:24.740375 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:24.740360 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:05:25.746368 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:25.746339 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" event={"ID":"3df391cf-3927-4c0b-aa2b-dbf5d896d20b","Type":"ContainerStarted","Data":"7c319f35edbc2cce5c9a2722a42a31962aaf93ca43fba1bea2620a777d609b08"} Jul 06 19:05:26.093358 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:26.093258 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:05:26.093581 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:26.093553 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-5nwsh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 06 19:05:26.093673 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:26.093612 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" podUID="3df391cf-3927-4c0b-aa2b-dbf5d896d20b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 06 19:05:27.092625 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:27.092591 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-5nwsh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 06 19:05:27.093024 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:27.092645 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" podUID="3df391cf-3927-4c0b-aa2b-dbf5d896d20b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 06 19:05:28.093111 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:28.093071 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-5nwsh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 06 19:05:28.093527 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:28.093130 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" podUID="3df391cf-3927-4c0b-aa2b-dbf5d896d20b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 06 19:05:29.093626 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:29.093590 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-5nwsh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 06 19:05:29.094028 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:29.093652 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" podUID="3df391cf-3927-4c0b-aa2b-dbf5d896d20b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 06 19:05:30.097236 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:30.097206 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:05:30.097668 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:30.097494 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:05:30.098127 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:30.098107 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5nwsh" Jul 06 19:05:31.716467 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:05:31.716391 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-wrvd5" Jul 06 19:09:52.551382 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:09:52.551350 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/1.log" Jul 06 19:09:52.553153 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:09:52.553128 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/1.log" Jul 06 19:14:52.594815 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:14:52.594787 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/1.log" Jul 06 19:14:52.596848 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:14:52.596824 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/1.log" Jul 06 19:15:00.517955 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:15:00.517916 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722755-t48md"] Jul 06 19:15:00.521138 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:15:00.521120 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722755-t48md" Jul 06 19:15:00.524201 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:15:00.524171 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-key-cleanup-29722755-t48md\" is forbidden: User \"system:node:ip-10-0-139-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-154.ec2.internal' and this object" podUID="5fef3d8f-6b56-43ef-bfa3-68b1bde18aca" pod="opendatahub/maas-api-key-cleanup-29722755-t48md" Jul 06 19:15:00.524740 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:15:00.524716 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-api-dockercfg-6wq86\" is forbidden: User \"system:node:ip-10-0-139-154.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-154.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-6wq86\"" type="*v1.Secret" Jul 06 19:15:00.582625 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:15:00.582598 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j5rs\" (UniqueName: \"kubernetes.io/projected/5fef3d8f-6b56-43ef-bfa3-68b1bde18aca-kube-api-access-9j5rs\") pod \"maas-api-key-cleanup-29722755-t48md\" (UID: \"5fef3d8f-6b56-43ef-bfa3-68b1bde18aca\") " pod="opendatahub/maas-api-key-cleanup-29722755-t48md" Jul 06 19:15:00.598725 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:15:00.598698 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722755-t48md"] Jul 06 19:15:00.684030 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:15:00.683995 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j5rs\" (UniqueName: \"kubernetes.io/projected/5fef3d8f-6b56-43ef-bfa3-68b1bde18aca-kube-api-access-9j5rs\") pod \"maas-api-key-cleanup-29722755-t48md\" (UID: \"5fef3d8f-6b56-43ef-bfa3-68b1bde18aca\") " pod="opendatahub/maas-api-key-cleanup-29722755-t48md" Jul 06 19:15:00.739855 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:15:00.739829 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j5rs\" (UniqueName: \"kubernetes.io/projected/5fef3d8f-6b56-43ef-bfa3-68b1bde18aca-kube-api-access-9j5rs\") pod \"maas-api-key-cleanup-29722755-t48md\" (UID: \"5fef3d8f-6b56-43ef-bfa3-68b1bde18aca\") " pod="opendatahub/maas-api-key-cleanup-29722755-t48md" Jul 06 19:15:01.831279 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:15:01.831246 2567 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="opendatahub/maas-api-key-cleanup-29722755-t48md" secret="" err="failed to sync secret cache: timed out waiting for the condition" Jul 06 19:15:01.831743 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:15:01.831302 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722755-t48md" Jul 06 19:15:01.957091 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:15:01.957063 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-6wq86\"" Jul 06 19:15:01.983768 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:15:01.983748 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722755-t48md"] Jul 06 19:15:01.986442 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:15:01.986415 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fef3d8f_6b56_43ef_bfa3_68b1bde18aca.slice/crio-e87efcbaf4dc2c7afefca0cef83babcd839f77bdeaade500e85e7e8c815d783b WatchSource:0}: Error finding container e87efcbaf4dc2c7afefca0cef83babcd839f77bdeaade500e85e7e8c815d783b: Status 404 returned error can't find the container with id e87efcbaf4dc2c7afefca0cef83babcd839f77bdeaade500e85e7e8c815d783b Jul 06 19:15:01.988162 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:15:01.988143 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:15:02.837563 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:15:02.837529 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722755-t48md" event={"ID":"5fef3d8f-6b56-43ef-bfa3-68b1bde18aca","Type":"ContainerStarted","Data":"e87efcbaf4dc2c7afefca0cef83babcd839f77bdeaade500e85e7e8c815d783b"} Jul 06 19:15:05.857063 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:15:05.857035 2567 generic.go:356] "Generic (PLEG): container finished" podID="5fef3d8f-6b56-43ef-bfa3-68b1bde18aca" containerID="8b793b9e0e82b1410bb371b37ca3767efe4f84dd559da3a34ebe0d090c854d25" exitCode=0 Jul 06 19:15:05.857415 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:15:05.857114 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722755-t48md" event={"ID":"5fef3d8f-6b56-43ef-bfa3-68b1bde18aca","Type":"ContainerDied","Data":"8b793b9e0e82b1410bb371b37ca3767efe4f84dd559da3a34ebe0d090c854d25"} Jul 06 19:15:06.999008 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:15:06.998981 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722755-t48md" Jul 06 19:15:07.138757 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:15:07.138673 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9j5rs\" (UniqueName: \"kubernetes.io/projected/5fef3d8f-6b56-43ef-bfa3-68b1bde18aca-kube-api-access-9j5rs\") pod \"5fef3d8f-6b56-43ef-bfa3-68b1bde18aca\" (UID: \"5fef3d8f-6b56-43ef-bfa3-68b1bde18aca\") " Jul 06 19:15:07.140870 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:15:07.140842 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fef3d8f-6b56-43ef-bfa3-68b1bde18aca-kube-api-access-9j5rs" (OuterVolumeSpecName: "kube-api-access-9j5rs") pod "5fef3d8f-6b56-43ef-bfa3-68b1bde18aca" (UID: "5fef3d8f-6b56-43ef-bfa3-68b1bde18aca"). InnerVolumeSpecName "kube-api-access-9j5rs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:15:07.239650 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:15:07.239619 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9j5rs\" (UniqueName: \"kubernetes.io/projected/5fef3d8f-6b56-43ef-bfa3-68b1bde18aca-kube-api-access-9j5rs\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:15:07.869243 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:15:07.869208 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722755-t48md" Jul 06 19:15:07.869243 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:15:07.869234 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722755-t48md" event={"ID":"5fef3d8f-6b56-43ef-bfa3-68b1bde18aca","Type":"ContainerDied","Data":"e87efcbaf4dc2c7afefca0cef83babcd839f77bdeaade500e85e7e8c815d783b"} Jul 06 19:15:07.869468 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:15:07.869285 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e87efcbaf4dc2c7afefca0cef83babcd839f77bdeaade500e85e7e8c815d783b" Jul 06 19:19:52.628668 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:19:52.628635 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/1.log" Jul 06 19:19:52.632434 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:19:52.632411 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/1.log" Jul 06 19:21:24.868014 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:24.867975 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8"] Jul 06 19:21:24.868544 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:24.868322 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fef3d8f-6b56-43ef-bfa3-68b1bde18aca" containerName="cleanup" Jul 06 19:21:24.868544 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:24.868333 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fef3d8f-6b56-43ef-bfa3-68b1bde18aca" containerName="cleanup" Jul 06 19:21:24.868544 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:24.868408 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fef3d8f-6b56-43ef-bfa3-68b1bde18aca" containerName="cleanup" Jul 06 19:21:24.871374 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:24.871352 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:24.873671 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:24.873653 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1bd5e6c9-openshift-default-dockercfg-5p9qm\"" Jul 06 19:21:24.919937 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:24.919904 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-workload-certs\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:24.920086 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:24.919953 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-data\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:24.920086 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:24.920048 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-credential-socket\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:24.920211 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:24.920082 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-podinfo\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:24.920211 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:24.920109 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istiod-ca-cert\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:24.920211 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:24.920140 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-workload-socket\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:24.920211 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:24.920164 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-envoy\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:24.920394 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:24.920211 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-token\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:24.920394 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:24.920278 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csl5j\" (UniqueName: \"kubernetes.io/projected/6010f747-84aa-4ed0-970c-d2eb7775dfd5-kube-api-access-csl5j\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:24.968060 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:24.968028 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8"] Jul 06 19:21:25.020968 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.020941 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-workload-certs\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:25.021143 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.020990 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-data\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:25.021143 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.021030 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-credential-socket\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:25.021143 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.021048 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-podinfo\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:25.021143 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.021065 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istiod-ca-cert\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:25.021143 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.021084 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-workload-socket\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:25.021143 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.021098 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-envoy\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:25.021500 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.021429 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-workload-certs\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:25.021571 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.021496 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-credential-socket\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:25.021571 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.021518 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-token\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:25.021571 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.021536 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-workload-socket\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:25.021744 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.021582 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csl5j\" (UniqueName: \"kubernetes.io/projected/6010f747-84aa-4ed0-970c-d2eb7775dfd5-kube-api-access-csl5j\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:25.021744 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.021631 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-data\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:25.021940 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.021918 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istiod-ca-cert\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:25.023450 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.023425 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-envoy\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:25.023638 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.023621 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-podinfo\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:25.048871 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.048851 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-token\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:25.050696 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.050678 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csl5j\" (UniqueName: \"kubernetes.io/projected/6010f747-84aa-4ed0-970c-d2eb7775dfd5-kube-api-access-csl5j\") pod \"e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:25.187873 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.187844 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:25.336618 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:21:25.336590 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6010f747_84aa_4ed0_970c_d2eb7775dfd5.slice/crio-4a5b7e6d74c0d30e6e1f9475bd021482f9608b1515eca8b4d4839c8cb58573b6 WatchSource:0}: Error finding container 4a5b7e6d74c0d30e6e1f9475bd021482f9608b1515eca8b4d4839c8cb58573b6: Status 404 returned error can't find the container with id 4a5b7e6d74c0d30e6e1f9475bd021482f9608b1515eca8b4d4839c8cb58573b6 Jul 06 19:21:25.337092 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.337023 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8"] Jul 06 19:21:25.338709 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.338675 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:21:25.338779 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.338744 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:21:25.338779 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.338772 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:21:25.857144 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.857109 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" event={"ID":"6010f747-84aa-4ed0-970c-d2eb7775dfd5","Type":"ContainerStarted","Data":"cc63a39191ad4bbc0fab7343b6c40fa6976f3926dea8c651c82341964dbd0902"} Jul 06 19:21:25.857340 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.857164 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" event={"ID":"6010f747-84aa-4ed0-970c-d2eb7775dfd5","Type":"ContainerStarted","Data":"4a5b7e6d74c0d30e6e1f9475bd021482f9608b1515eca8b4d4839c8cb58573b6"} Jul 06 19:21:25.888374 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:25.888330 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" podStartSLOduration=1.888310758 podStartE2EDuration="1.888310758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:21:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:21:25.887276995 +0000 UTC m=+1593.813711563" watchObservedRunningTime="2026-07-06 19:21:25.888310758 +0000 UTC m=+1593.814745307" Jul 06 19:21:26.188716 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:26.188679 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:26.193872 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:26.193847 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:26.863145 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:26.863118 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:26.863991 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:26.863972 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:31.374500 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:31.374439 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8"] Jul 06 19:21:31.374983 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:31.374702 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" podUID="6010f747-84aa-4ed0-970c-d2eb7775dfd5" containerName="istio-proxy" containerID="cri-o://cc63a39191ad4bbc0fab7343b6c40fa6976f3926dea8c651c82341964dbd0902" gracePeriod=30 Jul 06 19:21:36.633998 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.633944 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:36.732501 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.732445 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-podinfo\") pod \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " Jul 06 19:21:36.732689 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.732522 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-token\") pod \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " Jul 06 19:21:36.732689 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.732593 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csl5j\" (UniqueName: \"kubernetes.io/projected/6010f747-84aa-4ed0-970c-d2eb7775dfd5-kube-api-access-csl5j\") pod \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " Jul 06 19:21:36.732689 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.732631 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-credential-socket\") pod \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " Jul 06 19:21:36.732689 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.732647 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-envoy\") pod \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " Jul 06 19:21:36.732689 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.732667 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-data\") pod \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " Jul 06 19:21:36.732689 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.732691 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istiod-ca-cert\") pod \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " Jul 06 19:21:36.733029 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.732758 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-workload-certs\") pod \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " Jul 06 19:21:36.733029 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.732813 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-workload-socket\") pod \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\" (UID: \"6010f747-84aa-4ed0-970c-d2eb7775dfd5\") " Jul 06 19:21:36.733029 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.732951 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-data" (OuterVolumeSpecName: "istio-data") pod "6010f747-84aa-4ed0-970c-d2eb7775dfd5" (UID: "6010f747-84aa-4ed0-970c-d2eb7775dfd5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:21:36.733029 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.732967 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6010f747-84aa-4ed0-970c-d2eb7775dfd5" (UID: "6010f747-84aa-4ed0-970c-d2eb7775dfd5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:21:36.733236 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.733167 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6010f747-84aa-4ed0-970c-d2eb7775dfd5" (UID: "6010f747-84aa-4ed0-970c-d2eb7775dfd5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:21:36.733236 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.733188 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-credential-socket\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:21:36.733236 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.733211 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-data\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:21:36.733405 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.733290 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6010f747-84aa-4ed0-970c-d2eb7775dfd5" (UID: "6010f747-84aa-4ed0-970c-d2eb7775dfd5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:21:36.733405 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.733391 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6010f747-84aa-4ed0-970c-d2eb7775dfd5" (UID: "6010f747-84aa-4ed0-970c-d2eb7775dfd5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:21:36.734927 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.734900 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-token" (OuterVolumeSpecName: "istio-token") pod "6010f747-84aa-4ed0-970c-d2eb7775dfd5" (UID: "6010f747-84aa-4ed0-970c-d2eb7775dfd5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:21:36.735054 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.734939 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6010f747-84aa-4ed0-970c-d2eb7775dfd5" (UID: "6010f747-84aa-4ed0-970c-d2eb7775dfd5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:21:36.735131 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.735110 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6010f747-84aa-4ed0-970c-d2eb7775dfd5" (UID: "6010f747-84aa-4ed0-970c-d2eb7775dfd5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:21:36.735171 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.735119 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6010f747-84aa-4ed0-970c-d2eb7775dfd5-kube-api-access-csl5j" (OuterVolumeSpecName: "kube-api-access-csl5j") pod "6010f747-84aa-4ed0-970c-d2eb7775dfd5" (UID: "6010f747-84aa-4ed0-970c-d2eb7775dfd5"). InnerVolumeSpecName "kube-api-access-csl5j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:21:36.834360 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.834330 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-workload-socket\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:21:36.834360 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.834357 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-podinfo\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:21:36.834360 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.834366 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-token\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:21:36.834621 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.834375 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csl5j\" (UniqueName: \"kubernetes.io/projected/6010f747-84aa-4ed0-970c-d2eb7775dfd5-kube-api-access-csl5j\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:21:36.834621 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.834384 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istio-envoy\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:21:36.834621 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.834392 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6010f747-84aa-4ed0-970c-d2eb7775dfd5-istiod-ca-cert\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:21:36.834621 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.834400 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6010f747-84aa-4ed0-970c-d2eb7775dfd5-workload-certs\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:21:36.918990 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.918965 2567 generic.go:356] "Generic (PLEG): container finished" podID="6010f747-84aa-4ed0-970c-d2eb7775dfd5" containerID="cc63a39191ad4bbc0fab7343b6c40fa6976f3926dea8c651c82341964dbd0902" exitCode=0 Jul 06 19:21:36.919133 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.919014 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" Jul 06 19:21:36.919133 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.919047 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" event={"ID":"6010f747-84aa-4ed0-970c-d2eb7775dfd5","Type":"ContainerDied","Data":"cc63a39191ad4bbc0fab7343b6c40fa6976f3926dea8c651c82341964dbd0902"} Jul 06 19:21:36.919133 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.919099 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8" event={"ID":"6010f747-84aa-4ed0-970c-d2eb7775dfd5","Type":"ContainerDied","Data":"4a5b7e6d74c0d30e6e1f9475bd021482f9608b1515eca8b4d4839c8cb58573b6"} Jul 06 19:21:36.919133 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.919126 2567 scope.go:117] "RemoveContainer" containerID="cc63a39191ad4bbc0fab7343b6c40fa6976f3926dea8c651c82341964dbd0902" Jul 06 19:21:36.928699 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.928680 2567 scope.go:117] "RemoveContainer" containerID="cc63a39191ad4bbc0fab7343b6c40fa6976f3926dea8c651c82341964dbd0902" Jul 06 19:21:36.928958 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:21:36.928940 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc63a39191ad4bbc0fab7343b6c40fa6976f3926dea8c651c82341964dbd0902\": container with ID starting with cc63a39191ad4bbc0fab7343b6c40fa6976f3926dea8c651c82341964dbd0902 not found: ID does not exist" containerID="cc63a39191ad4bbc0fab7343b6c40fa6976f3926dea8c651c82341964dbd0902" Jul 06 19:21:36.929007 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.928966 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc63a39191ad4bbc0fab7343b6c40fa6976f3926dea8c651c82341964dbd0902"} err="failed to get container status \"cc63a39191ad4bbc0fab7343b6c40fa6976f3926dea8c651c82341964dbd0902\": rpc error: code = NotFound desc = could not find container \"cc63a39191ad4bbc0fab7343b6c40fa6976f3926dea8c651c82341964dbd0902\": container with ID starting with cc63a39191ad4bbc0fab7343b6c40fa6976f3926dea8c651c82341964dbd0902 not found: ID does not exist" Jul 06 19:21:36.943488 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.943453 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8"] Jul 06 19:21:36.949776 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:36.949753 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1bd5e6c9-openshift-default-8697dbc65c-pdcj8"] Jul 06 19:21:38.405451 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.405412 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht"] Jul 06 19:21:38.405951 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.405782 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6010f747-84aa-4ed0-970c-d2eb7775dfd5" containerName="istio-proxy" Jul 06 19:21:38.405951 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.405794 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6010f747-84aa-4ed0-970c-d2eb7775dfd5" containerName="istio-proxy" Jul 06 19:21:38.405951 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.405858 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6010f747-84aa-4ed0-970c-d2eb7775dfd5" containerName="istio-proxy" Jul 06 19:21:38.410056 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.410031 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.423617 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.423596 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8e717861-openshift-default-dockercfg-bqdb5\"" Jul 06 19:21:38.485184 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.485146 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht"] Jul 06 19:21:38.547711 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.547678 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-token\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.547891 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.547720 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-workload-socket\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.547891 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.547753 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-data\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.547891 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.547778 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smt25\" (UniqueName: \"kubernetes.io/projected/9031369a-bdbc-4a60-8df4-5a644fe17814-kube-api-access-smt25\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.547891 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.547819 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-envoy\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.547891 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.547837 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-workload-certs\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.547891 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.547858 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9031369a-bdbc-4a60-8df4-5a644fe17814-istiod-ca-cert\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.548112 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.547896 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-podinfo\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.548112 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.547957 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-credential-socket\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.575639 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.575609 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6010f747-84aa-4ed0-970c-d2eb7775dfd5" path="/var/lib/kubelet/pods/6010f747-84aa-4ed0-970c-d2eb7775dfd5/volumes" Jul 06 19:21:38.648708 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.648677 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-token\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.648876 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.648717 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-workload-socket\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.648876 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.648740 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-data\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.648876 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.648766 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smt25\" (UniqueName: \"kubernetes.io/projected/9031369a-bdbc-4a60-8df4-5a644fe17814-kube-api-access-smt25\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.648876 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.648847 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-envoy\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.648876 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.648872 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-workload-certs\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.649159 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.649042 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9031369a-bdbc-4a60-8df4-5a644fe17814-istiod-ca-cert\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.649159 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.649128 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-podinfo\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.649258 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.649128 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-workload-socket\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.649258 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.649181 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-credential-socket\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.649258 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.649190 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-data\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.649377 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.649276 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-workload-certs\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.649543 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.649523 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-credential-socket\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.649719 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.649696 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9031369a-bdbc-4a60-8df4-5a644fe17814-istiod-ca-cert\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.651414 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.651391 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-envoy\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.651524 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.651496 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-podinfo\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.684742 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.684715 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-token\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.716255 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.716229 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smt25\" (UniqueName: \"kubernetes.io/projected/9031369a-bdbc-4a60-8df4-5a644fe17814-kube-api-access-smt25\") pod \"e2e-ait-8e717861-openshift-default-8658789fc7-2rpht\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.723061 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.723041 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:38.930722 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.930648 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht"] Jul 06 19:21:38.934086 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:21:38.934058 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9031369a_bdbc_4a60_8df4_5a644fe17814.slice/crio-9dba99bec01c2757561ae5526072587d1599b9a7744c336ad6bf53069f388da2 WatchSource:0}: Error finding container 9dba99bec01c2757561ae5526072587d1599b9a7744c336ad6bf53069f388da2: Status 404 returned error can't find the container with id 9dba99bec01c2757561ae5526072587d1599b9a7744c336ad6bf53069f388da2 Jul 06 19:21:38.936187 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.936157 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:21:38.936260 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.936222 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:21:38.936260 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:38.936251 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:21:39.942161 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:39.942126 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" event={"ID":"9031369a-bdbc-4a60-8df4-5a644fe17814","Type":"ContainerStarted","Data":"a4852ef46dcf53c1bc12015aa3867c0f3deaa6ca35b80c87b35ac44e8794ede2"} Jul 06 19:21:39.942599 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:39.942211 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" event={"ID":"9031369a-bdbc-4a60-8df4-5a644fe17814","Type":"ContainerStarted","Data":"9dba99bec01c2757561ae5526072587d1599b9a7744c336ad6bf53069f388da2"} Jul 06 19:21:39.988536 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:39.988460 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" podStartSLOduration=1.988442474 podStartE2EDuration="1.988442474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:21:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:21:39.984299783 +0000 UTC m=+1607.910734334" watchObservedRunningTime="2026-07-06 19:21:39.988442474 +0000 UTC m=+1607.914877030" Jul 06 19:21:40.723226 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:40.723189 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:40.728199 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:40.728175 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:40.948319 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:40.948289 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:40.949262 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:40.949246 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:50.885743 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:50.885630 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht"] Jul 06 19:21:50.886259 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:50.885944 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" podUID="9031369a-bdbc-4a60-8df4-5a644fe17814" containerName="istio-proxy" containerID="cri-o://a4852ef46dcf53c1bc12015aa3867c0f3deaa6ca35b80c87b35ac44e8794ede2" gracePeriod=30 Jul 06 19:21:51.007857 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.007827 2567 generic.go:356] "Generic (PLEG): container finished" podID="9031369a-bdbc-4a60-8df4-5a644fe17814" containerID="a4852ef46dcf53c1bc12015aa3867c0f3deaa6ca35b80c87b35ac44e8794ede2" exitCode=0 Jul 06 19:21:51.008027 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.007904 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" event={"ID":"9031369a-bdbc-4a60-8df4-5a644fe17814","Type":"ContainerDied","Data":"a4852ef46dcf53c1bc12015aa3867c0f3deaa6ca35b80c87b35ac44e8794ede2"} Jul 06 19:21:51.034841 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.034820 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:51.169662 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.169639 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-token\") pod \"9031369a-bdbc-4a60-8df4-5a644fe17814\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " Jul 06 19:21:51.169827 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.169676 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9031369a-bdbc-4a60-8df4-5a644fe17814-istiod-ca-cert\") pod \"9031369a-bdbc-4a60-8df4-5a644fe17814\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " Jul 06 19:21:51.169827 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.169711 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-envoy\") pod \"9031369a-bdbc-4a60-8df4-5a644fe17814\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " Jul 06 19:21:51.169827 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.169731 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-credential-socket\") pod \"9031369a-bdbc-4a60-8df4-5a644fe17814\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " Jul 06 19:21:51.169827 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.169776 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-podinfo\") pod \"9031369a-bdbc-4a60-8df4-5a644fe17814\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " Jul 06 19:21:51.169827 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.169826 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-data\") pod \"9031369a-bdbc-4a60-8df4-5a644fe17814\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " Jul 06 19:21:51.170106 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.169863 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-workload-socket\") pod \"9031369a-bdbc-4a60-8df4-5a644fe17814\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " Jul 06 19:21:51.170106 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.169900 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smt25\" (UniqueName: \"kubernetes.io/projected/9031369a-bdbc-4a60-8df4-5a644fe17814-kube-api-access-smt25\") pod \"9031369a-bdbc-4a60-8df4-5a644fe17814\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " Jul 06 19:21:51.170106 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.169924 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-workload-certs\") pod \"9031369a-bdbc-4a60-8df4-5a644fe17814\" (UID: \"9031369a-bdbc-4a60-8df4-5a644fe17814\") " Jul 06 19:21:51.170106 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.170068 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9031369a-bdbc-4a60-8df4-5a644fe17814" (UID: "9031369a-bdbc-4a60-8df4-5a644fe17814"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:21:51.170295 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.170217 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-credential-socket\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:21:51.170295 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.170253 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9031369a-bdbc-4a60-8df4-5a644fe17814" (UID: "9031369a-bdbc-4a60-8df4-5a644fe17814"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:21:51.170295 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.170287 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9031369a-bdbc-4a60-8df4-5a644fe17814-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9031369a-bdbc-4a60-8df4-5a644fe17814" (UID: "9031369a-bdbc-4a60-8df4-5a644fe17814"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:21:51.171829 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.171775 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9031369a-bdbc-4a60-8df4-5a644fe17814" (UID: "9031369a-bdbc-4a60-8df4-5a644fe17814"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:21:51.172259 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.172219 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-data" (OuterVolumeSpecName: "istio-data") pod "9031369a-bdbc-4a60-8df4-5a644fe17814" (UID: "9031369a-bdbc-4a60-8df4-5a644fe17814"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:21:51.172437 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.172415 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-token" (OuterVolumeSpecName: "istio-token") pod "9031369a-bdbc-4a60-8df4-5a644fe17814" (UID: "9031369a-bdbc-4a60-8df4-5a644fe17814"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:21:51.172561 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.172521 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9031369a-bdbc-4a60-8df4-5a644fe17814" (UID: "9031369a-bdbc-4a60-8df4-5a644fe17814"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:21:51.172936 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.172915 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9031369a-bdbc-4a60-8df4-5a644fe17814" (UID: "9031369a-bdbc-4a60-8df4-5a644fe17814"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:21:51.173751 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.173728 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9031369a-bdbc-4a60-8df4-5a644fe17814-kube-api-access-smt25" (OuterVolumeSpecName: "kube-api-access-smt25") pod "9031369a-bdbc-4a60-8df4-5a644fe17814" (UID: "9031369a-bdbc-4a60-8df4-5a644fe17814"). InnerVolumeSpecName "kube-api-access-smt25". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:21:51.270668 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.270642 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-data\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:21:51.270668 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.270664 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-workload-socket\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:21:51.270886 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.270675 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smt25\" (UniqueName: \"kubernetes.io/projected/9031369a-bdbc-4a60-8df4-5a644fe17814-kube-api-access-smt25\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:21:51.270886 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.270686 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-workload-certs\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:21:51.270886 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.270694 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-token\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:21:51.270886 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.270701 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9031369a-bdbc-4a60-8df4-5a644fe17814-istiod-ca-cert\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:21:51.270886 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.270708 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-envoy\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:21:51.270886 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:51.270715 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9031369a-bdbc-4a60-8df4-5a644fe17814-istio-podinfo\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:21:52.014539 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:52.014508 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" Jul 06 19:21:52.014983 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:52.014513 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht" event={"ID":"9031369a-bdbc-4a60-8df4-5a644fe17814","Type":"ContainerDied","Data":"9dba99bec01c2757561ae5526072587d1599b9a7744c336ad6bf53069f388da2"} Jul 06 19:21:52.014983 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:52.014638 2567 scope.go:117] "RemoveContainer" containerID="a4852ef46dcf53c1bc12015aa3867c0f3deaa6ca35b80c87b35ac44e8794ede2" Jul 06 19:21:52.039740 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:52.039715 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht"] Jul 06 19:21:52.041971 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:52.041949 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8e717861-openshift-default-8658789fc7-2rpht"] Jul 06 19:21:52.575516 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:52.575466 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9031369a-bdbc-4a60-8df4-5a644fe17814" path="/var/lib/kubelet/pods/9031369a-bdbc-4a60-8df4-5a644fe17814/volumes" Jul 06 19:21:57.559536 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.559502 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz"] Jul 06 19:21:57.559986 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.559867 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9031369a-bdbc-4a60-8df4-5a644fe17814" containerName="istio-proxy" Jul 06 19:21:57.559986 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.559877 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9031369a-bdbc-4a60-8df4-5a644fe17814" containerName="istio-proxy" Jul 06 19:21:57.559986 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.559954 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9031369a-bdbc-4a60-8df4-5a644fe17814" containerName="istio-proxy" Jul 06 19:21:57.563398 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.563377 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.572700 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.572675 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-1faecda1-openshift-default-dockercfg-ps2kl\"" Jul 06 19:21:57.590919 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.590896 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz"] Jul 06 19:21:57.730346 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.730315 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ad49c6f-8922-4f70-a554-c4485857af33-istio-podinfo\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.730542 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.730380 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrfw9\" (UniqueName: \"kubernetes.io/projected/7ad49c6f-8922-4f70-a554-c4485857af33-kube-api-access-wrfw9\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.730542 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.730414 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-istio-envoy\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.730542 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.730459 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-credential-socket\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.730542 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.730522 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ad49c6f-8922-4f70-a554-c4485857af33-istio-token\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.730712 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.730548 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-workload-certs\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.730712 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.730575 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-workload-socket\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.730712 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.730612 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-istio-data\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.730712 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.730629 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ad49c6f-8922-4f70-a554-c4485857af33-istiod-ca-cert\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.832065 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.831992 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrfw9\" (UniqueName: \"kubernetes.io/projected/7ad49c6f-8922-4f70-a554-c4485857af33-kube-api-access-wrfw9\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.832065 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.832026 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-istio-envoy\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.832254 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.832094 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-credential-socket\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.832254 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.832114 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ad49c6f-8922-4f70-a554-c4485857af33-istio-token\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.832254 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.832138 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-workload-certs\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.832254 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.832163 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-workload-socket\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.832463 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.832268 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-istio-data\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.832463 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.832297 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ad49c6f-8922-4f70-a554-c4485857af33-istiod-ca-cert\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.832463 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.832337 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ad49c6f-8922-4f70-a554-c4485857af33-istio-podinfo\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.832654 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.832532 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-credential-socket\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.832654 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.832591 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-workload-certs\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.832654 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.832642 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-workload-socket\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.832754 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.832693 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-istio-data\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.833054 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.833032 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ad49c6f-8922-4f70-a554-c4485857af33-istiod-ca-cert\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.834645 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.834618 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-istio-envoy\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.834776 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.834758 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ad49c6f-8922-4f70-a554-c4485857af33-istio-podinfo\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.840956 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.840932 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrfw9\" (UniqueName: \"kubernetes.io/projected/7ad49c6f-8922-4f70-a554-c4485857af33-kube-api-access-wrfw9\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.841060 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.840972 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ad49c6f-8922-4f70-a554-c4485857af33-istio-token\") pod \"e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:57.874608 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:57.874588 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:58.012556 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:58.012391 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz"] Jul 06 19:21:58.015181 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:21:58.015156 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ad49c6f_8922_4f70_a554_c4485857af33.slice/crio-1b3f03904b3297b6f42b5b264e5d932b6bd1476ad457e570170381618cc4aaa1 WatchSource:0}: Error finding container 1b3f03904b3297b6f42b5b264e5d932b6bd1476ad457e570170381618cc4aaa1: Status 404 returned error can't find the container with id 1b3f03904b3297b6f42b5b264e5d932b6bd1476ad457e570170381618cc4aaa1 Jul 06 19:21:58.017338 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:58.017304 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:21:58.017439 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:58.017366 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:21:58.017439 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:58.017399 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:21:58.048735 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:58.048710 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" event={"ID":"7ad49c6f-8922-4f70-a554-c4485857af33","Type":"ContainerStarted","Data":"1b3f03904b3297b6f42b5b264e5d932b6bd1476ad457e570170381618cc4aaa1"} Jul 06 19:21:59.055924 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:59.055879 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" event={"ID":"7ad49c6f-8922-4f70-a554-c4485857af33","Type":"ContainerStarted","Data":"df206ab7e9aa513d110f3e36c082ab0a29b53c05b3f782fcfe9a43aee0816b68"} Jul 06 19:21:59.121372 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:59.121322 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" podStartSLOduration=2.121308499 podStartE2EDuration="2.121308499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:21:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:21:59.12046548 +0000 UTC m=+1627.046900051" watchObservedRunningTime="2026-07-06 19:21:59.121308499 +0000 UTC m=+1627.047743047" Jul 06 19:21:59.875415 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:59.875380 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:21:59.880604 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:21:59.880579 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:22:00.064718 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:00.064683 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:22:00.065768 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:00.065747 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:22:03.574543 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:03.574509 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz"] Jul 06 19:22:03.574990 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:03.574701 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" podUID="7ad49c6f-8922-4f70-a554-c4485857af33" containerName="istio-proxy" containerID="cri-o://df206ab7e9aa513d110f3e36c082ab0a29b53c05b3f782fcfe9a43aee0816b68" gracePeriod=30 Jul 06 19:22:10.435568 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.435537 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:22:10.447495 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.447461 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-workload-socket\") pod \"7ad49c6f-8922-4f70-a554-c4485857af33\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " Jul 06 19:22:10.447584 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.447528 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ad49c6f-8922-4f70-a554-c4485857af33-istio-podinfo\") pod \"7ad49c6f-8922-4f70-a554-c4485857af33\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " Jul 06 19:22:10.447584 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.447557 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrfw9\" (UniqueName: \"kubernetes.io/projected/7ad49c6f-8922-4f70-a554-c4485857af33-kube-api-access-wrfw9\") pod \"7ad49c6f-8922-4f70-a554-c4485857af33\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " Jul 06 19:22:10.447678 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.447588 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-istio-data\") pod \"7ad49c6f-8922-4f70-a554-c4485857af33\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " Jul 06 19:22:10.447678 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.447624 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-istio-envoy\") pod \"7ad49c6f-8922-4f70-a554-c4485857af33\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " Jul 06 19:22:10.447678 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.447654 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ad49c6f-8922-4f70-a554-c4485857af33-istiod-ca-cert\") pod \"7ad49c6f-8922-4f70-a554-c4485857af33\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " Jul 06 19:22:10.447834 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.447678 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7ad49c6f-8922-4f70-a554-c4485857af33" (UID: "7ad49c6f-8922-4f70-a554-c4485857af33"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:22:10.447834 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.447710 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-credential-socket\") pod \"7ad49c6f-8922-4f70-a554-c4485857af33\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " Jul 06 19:22:10.447834 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.447749 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ad49c6f-8922-4f70-a554-c4485857af33-istio-token\") pod \"7ad49c6f-8922-4f70-a554-c4485857af33\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " Jul 06 19:22:10.447834 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.447809 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-workload-certs\") pod \"7ad49c6f-8922-4f70-a554-c4485857af33\" (UID: \"7ad49c6f-8922-4f70-a554-c4485857af33\") " Jul 06 19:22:10.448044 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.447976 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7ad49c6f-8922-4f70-a554-c4485857af33" (UID: "7ad49c6f-8922-4f70-a554-c4485857af33"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:22:10.448104 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.448046 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ad49c6f-8922-4f70-a554-c4485857af33-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7ad49c6f-8922-4f70-a554-c4485857af33" (UID: "7ad49c6f-8922-4f70-a554-c4485857af33"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:22:10.448197 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.448173 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7ad49c6f-8922-4f70-a554-c4485857af33" (UID: "7ad49c6f-8922-4f70-a554-c4485857af33"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:22:10.448255 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.448235 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ad49c6f-8922-4f70-a554-c4485857af33-istiod-ca-cert\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:22:10.448311 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.448255 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-credential-socket\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:22:10.448311 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.448269 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-workload-socket\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:22:10.448502 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.448456 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-istio-data" (OuterVolumeSpecName: "istio-data") pod "7ad49c6f-8922-4f70-a554-c4485857af33" (UID: "7ad49c6f-8922-4f70-a554-c4485857af33"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:22:10.449926 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.449898 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7ad49c6f-8922-4f70-a554-c4485857af33-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7ad49c6f-8922-4f70-a554-c4485857af33" (UID: "7ad49c6f-8922-4f70-a554-c4485857af33"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:22:10.450028 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.449925 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ad49c6f-8922-4f70-a554-c4485857af33-istio-token" (OuterVolumeSpecName: "istio-token") pod "7ad49c6f-8922-4f70-a554-c4485857af33" (UID: "7ad49c6f-8922-4f70-a554-c4485857af33"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:22:10.450136 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.450115 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7ad49c6f-8922-4f70-a554-c4485857af33" (UID: "7ad49c6f-8922-4f70-a554-c4485857af33"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:22:10.450187 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.450141 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ad49c6f-8922-4f70-a554-c4485857af33-kube-api-access-wrfw9" (OuterVolumeSpecName: "kube-api-access-wrfw9") pod "7ad49c6f-8922-4f70-a554-c4485857af33" (UID: "7ad49c6f-8922-4f70-a554-c4485857af33"). InnerVolumeSpecName "kube-api-access-wrfw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:22:10.555701 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.549974 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ad49c6f-8922-4f70-a554-c4485857af33-istio-token\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:22:10.555701 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.550023 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-workload-certs\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:22:10.555701 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.550036 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ad49c6f-8922-4f70-a554-c4485857af33-istio-podinfo\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:22:10.555701 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.550049 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrfw9\" (UniqueName: \"kubernetes.io/projected/7ad49c6f-8922-4f70-a554-c4485857af33-kube-api-access-wrfw9\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:22:10.555701 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.550120 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-istio-data\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:22:10.555701 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:10.550140 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ad49c6f-8922-4f70-a554-c4485857af33-istio-envoy\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:22:11.129778 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:11.129746 2567 generic.go:356] "Generic (PLEG): container finished" podID="7ad49c6f-8922-4f70-a554-c4485857af33" containerID="df206ab7e9aa513d110f3e36c082ab0a29b53c05b3f782fcfe9a43aee0816b68" exitCode=0 Jul 06 19:22:11.129962 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:11.129822 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" Jul 06 19:22:11.129962 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:11.129832 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" event={"ID":"7ad49c6f-8922-4f70-a554-c4485857af33","Type":"ContainerDied","Data":"df206ab7e9aa513d110f3e36c082ab0a29b53c05b3f782fcfe9a43aee0816b68"} Jul 06 19:22:11.129962 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:11.129889 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz" event={"ID":"7ad49c6f-8922-4f70-a554-c4485857af33","Type":"ContainerDied","Data":"1b3f03904b3297b6f42b5b264e5d932b6bd1476ad457e570170381618cc4aaa1"} Jul 06 19:22:11.130968 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:11.129914 2567 scope.go:117] "RemoveContainer" containerID="df206ab7e9aa513d110f3e36c082ab0a29b53c05b3f782fcfe9a43aee0816b68" Jul 06 19:22:11.139709 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:11.139691 2567 scope.go:117] "RemoveContainer" containerID="df206ab7e9aa513d110f3e36c082ab0a29b53c05b3f782fcfe9a43aee0816b68" Jul 06 19:22:11.139939 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:22:11.139921 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df206ab7e9aa513d110f3e36c082ab0a29b53c05b3f782fcfe9a43aee0816b68\": container with ID starting with df206ab7e9aa513d110f3e36c082ab0a29b53c05b3f782fcfe9a43aee0816b68 not found: ID does not exist" containerID="df206ab7e9aa513d110f3e36c082ab0a29b53c05b3f782fcfe9a43aee0816b68" Jul 06 19:22:11.139984 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:11.139947 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df206ab7e9aa513d110f3e36c082ab0a29b53c05b3f782fcfe9a43aee0816b68"} err="failed to get container status \"df206ab7e9aa513d110f3e36c082ab0a29b53c05b3f782fcfe9a43aee0816b68\": rpc error: code = NotFound desc = could not find container \"df206ab7e9aa513d110f3e36c082ab0a29b53c05b3f782fcfe9a43aee0816b68\": container with ID starting with df206ab7e9aa513d110f3e36c082ab0a29b53c05b3f782fcfe9a43aee0816b68 not found: ID does not exist" Jul 06 19:22:11.157970 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:11.157940 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz"] Jul 06 19:22:11.167939 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:11.167914 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-1faecda1-openshift-default-ddff8ff5f-k9gxz"] Jul 06 19:22:12.575454 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:22:12.575425 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ad49c6f-8922-4f70-a554-c4485857af33" path="/var/lib/kubelet/pods/7ad49c6f-8922-4f70-a554-c4485857af33/volumes" Jul 06 19:23:54.901933 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:54.901893 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg"] Jul 06 19:23:54.902359 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:54.902258 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ad49c6f-8922-4f70-a554-c4485857af33" containerName="istio-proxy" Jul 06 19:23:54.902359 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:54.902269 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ad49c6f-8922-4f70-a554-c4485857af33" containerName="istio-proxy" Jul 06 19:23:54.902359 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:54.902334 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ad49c6f-8922-4f70-a554-c4485857af33" containerName="istio-proxy" Jul 06 19:23:54.904349 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:54.904334 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:54.907587 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:54.907569 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a5970fbd-openshift-default-dockercfg-wvv2t\"" Jul 06 19:23:54.944440 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:54.944416 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg"] Jul 06 19:23:54.951332 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:54.951304 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-istio-data\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:54.951459 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:54.951340 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkrsl\" (UniqueName: \"kubernetes.io/projected/814bada1-526d-4287-bd2d-b6065f7bd297-kube-api-access-lkrsl\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:54.951459 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:54.951393 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-workload-certs\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:54.951459 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:54.951412 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/814bada1-526d-4287-bd2d-b6065f7bd297-istiod-ca-cert\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:54.951670 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:54.951495 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-credential-socket\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:54.951670 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:54.951529 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-workload-socket\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:54.951670 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:54.951550 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/814bada1-526d-4287-bd2d-b6065f7bd297-istio-podinfo\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:54.951670 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:54.951570 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-istio-envoy\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:54.951670 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:54.951585 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/814bada1-526d-4287-bd2d-b6065f7bd297-istio-token\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:55.052152 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.052124 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-credential-socket\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:55.052315 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.052159 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-workload-socket\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:55.052315 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.052179 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/814bada1-526d-4287-bd2d-b6065f7bd297-istio-podinfo\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:55.052315 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.052199 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-istio-envoy\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:55.052315 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.052214 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/814bada1-526d-4287-bd2d-b6065f7bd297-istio-token\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:55.052315 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.052259 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-istio-data\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:55.052315 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.052277 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkrsl\" (UniqueName: \"kubernetes.io/projected/814bada1-526d-4287-bd2d-b6065f7bd297-kube-api-access-lkrsl\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:55.052685 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.052324 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-workload-certs\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:55.052685 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.052351 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/814bada1-526d-4287-bd2d-b6065f7bd297-istiod-ca-cert\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:55.052685 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.052582 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-credential-socket\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:55.052870 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.052691 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-workload-socket\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:55.052870 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.052775 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-istio-data\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:55.052966 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.052866 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-workload-certs\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:55.053068 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.053051 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/814bada1-526d-4287-bd2d-b6065f7bd297-istiod-ca-cert\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:55.054513 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.054463 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-istio-envoy\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:55.054817 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.054799 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/814bada1-526d-4287-bd2d-b6065f7bd297-istio-podinfo\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:55.071893 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.071870 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/814bada1-526d-4287-bd2d-b6065f7bd297-istio-token\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:55.072327 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.072304 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkrsl\" (UniqueName: \"kubernetes.io/projected/814bada1-526d-4287-bd2d-b6065f7bd297-kube-api-access-lkrsl\") pod \"e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:55.215406 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.215376 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:55.361313 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.361286 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg"] Jul 06 19:23:55.363550 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:23:55.363523 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod814bada1_526d_4287_bd2d_b6065f7bd297.slice/crio-b8aa9c5d627033e455faa50bfdb533d534c15a34088a984c94e539e63591d8f0 WatchSource:0}: Error finding container b8aa9c5d627033e455faa50bfdb533d534c15a34088a984c94e539e63591d8f0: Status 404 returned error can't find the container with id b8aa9c5d627033e455faa50bfdb533d534c15a34088a984c94e539e63591d8f0 Jul 06 19:23:55.365685 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.365636 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:23:55.365800 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.365720 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:23:55.365800 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.365767 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:23:55.684015 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.683985 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" event={"ID":"814bada1-526d-4287-bd2d-b6065f7bd297","Type":"ContainerStarted","Data":"ab49a8abd1eddb2009c86ead51ea092653d0f23cdb1b8db34726f7b545e84723"} Jul 06 19:23:55.684220 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.684041 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" event={"ID":"814bada1-526d-4287-bd2d-b6065f7bd297","Type":"ContainerStarted","Data":"b8aa9c5d627033e455faa50bfdb533d534c15a34088a984c94e539e63591d8f0"} Jul 06 19:23:55.716423 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:55.716368 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" podStartSLOduration=1.716349144 podStartE2EDuration="1.716349144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:23:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:55.715705506 +0000 UTC m=+1743.642140054" watchObservedRunningTime="2026-07-06 19:23:55.716349144 +0000 UTC m=+1743.642783693" Jul 06 19:23:56.216051 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:56.216021 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:56.220566 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:56.220543 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:56.688966 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:56.688928 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:23:56.689772 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:23:56.689753 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:24:09.761489 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:09.761448 2567 generic.go:356] "Generic (PLEG): container finished" podID="814bada1-526d-4287-bd2d-b6065f7bd297" containerID="ab49a8abd1eddb2009c86ead51ea092653d0f23cdb1b8db34726f7b545e84723" exitCode=0 Jul 06 19:24:09.761906 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:09.761521 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" event={"ID":"814bada1-526d-4287-bd2d-b6065f7bd297","Type":"ContainerDied","Data":"ab49a8abd1eddb2009c86ead51ea092653d0f23cdb1b8db34726f7b545e84723"} Jul 06 19:24:09.761956 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:09.761910 2567 scope.go:117] "RemoveContainer" containerID="ab49a8abd1eddb2009c86ead51ea092653d0f23cdb1b8db34726f7b545e84723" Jul 06 19:24:09.762959 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:09.762919 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:24:09.763075 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:09.763010 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:24:09.763140 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:09.763082 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:24:10.771365 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:10.771326 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" event={"ID":"814bada1-526d-4287-bd2d-b6065f7bd297","Type":"ContainerStarted","Data":"149eb7e4ac37422888370a42615bc77aa6d870616027e94c7e7ad54c94f3119c"} Jul 06 19:24:11.215893 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:11.215857 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:24:11.217044 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:11.217014 2567 patch_prober.go:28] interesting pod/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 06 19:24:11.217186 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:11.217071 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" podUID="814bada1-526d-4287-bd2d-b6065f7bd297" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 06 19:24:11.689380 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:11.689349 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:24:12.216042 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:12.216011 2567 patch_prober.go:28] interesting pod/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 06 19:24:12.216420 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:12.216065 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" podUID="814bada1-526d-4287-bd2d-b6065f7bd297" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 06 19:24:13.215735 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:13.215701 2567 patch_prober.go:28] interesting pod/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 06 19:24:13.215914 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:13.215756 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" podUID="814bada1-526d-4287-bd2d-b6065f7bd297" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 06 19:24:14.215787 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:14.215732 2567 patch_prober.go:28] interesting pod/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 06 19:24:14.216263 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:14.215812 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" podUID="814bada1-526d-4287-bd2d-b6065f7bd297" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 06 19:24:15.219745 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:15.219712 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:24:15.220902 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:15.220880 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:24:17.773305 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:17.773269 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg"] Jul 06 19:24:17.773797 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:17.773453 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" podUID="814bada1-526d-4287-bd2d-b6065f7bd297" containerName="istio-proxy" containerID="cri-o://149eb7e4ac37422888370a42615bc77aa6d870616027e94c7e7ad54c94f3119c" gracePeriod=30 Jul 06 19:24:23.036750 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.036690 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:24:23.108393 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.108364 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-istio-envoy\") pod \"814bada1-526d-4287-bd2d-b6065f7bd297\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " Jul 06 19:24:23.108584 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.108416 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-workload-certs\") pod \"814bada1-526d-4287-bd2d-b6065f7bd297\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " Jul 06 19:24:23.108584 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.108448 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/814bada1-526d-4287-bd2d-b6065f7bd297-istio-podinfo\") pod \"814bada1-526d-4287-bd2d-b6065f7bd297\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " Jul 06 19:24:23.108584 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.108523 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-istio-data\") pod \"814bada1-526d-4287-bd2d-b6065f7bd297\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " Jul 06 19:24:23.108584 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.108545 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/814bada1-526d-4287-bd2d-b6065f7bd297-istio-token\") pod \"814bada1-526d-4287-bd2d-b6065f7bd297\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " Jul 06 19:24:23.108584 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.108570 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkrsl\" (UniqueName: \"kubernetes.io/projected/814bada1-526d-4287-bd2d-b6065f7bd297-kube-api-access-lkrsl\") pod \"814bada1-526d-4287-bd2d-b6065f7bd297\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " Jul 06 19:24:23.108867 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.108592 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-credential-socket\") pod \"814bada1-526d-4287-bd2d-b6065f7bd297\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " Jul 06 19:24:23.108867 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.108632 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/814bada1-526d-4287-bd2d-b6065f7bd297-istiod-ca-cert\") pod \"814bada1-526d-4287-bd2d-b6065f7bd297\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " Jul 06 19:24:23.108867 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.108658 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-workload-socket\") pod \"814bada1-526d-4287-bd2d-b6065f7bd297\" (UID: \"814bada1-526d-4287-bd2d-b6065f7bd297\") " Jul 06 19:24:23.108867 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.108719 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "814bada1-526d-4287-bd2d-b6065f7bd297" (UID: "814bada1-526d-4287-bd2d-b6065f7bd297"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:24:23.109066 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.108989 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "814bada1-526d-4287-bd2d-b6065f7bd297" (UID: "814bada1-526d-4287-bd2d-b6065f7bd297"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:24:23.109066 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.109012 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-workload-certs\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:24:23.109066 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.109003 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "814bada1-526d-4287-bd2d-b6065f7bd297" (UID: "814bada1-526d-4287-bd2d-b6065f7bd297"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:24:23.109274 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.109247 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/814bada1-526d-4287-bd2d-b6065f7bd297-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "814bada1-526d-4287-bd2d-b6065f7bd297" (UID: "814bada1-526d-4287-bd2d-b6065f7bd297"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:24:23.109517 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.109497 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-istio-data" (OuterVolumeSpecName: "istio-data") pod "814bada1-526d-4287-bd2d-b6065f7bd297" (UID: "814bada1-526d-4287-bd2d-b6065f7bd297"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:24:23.111077 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.111056 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "814bada1-526d-4287-bd2d-b6065f7bd297" (UID: "814bada1-526d-4287-bd2d-b6065f7bd297"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:24:23.111159 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.111130 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/814bada1-526d-4287-bd2d-b6065f7bd297-istio-token" (OuterVolumeSpecName: "istio-token") pod "814bada1-526d-4287-bd2d-b6065f7bd297" (UID: "814bada1-526d-4287-bd2d-b6065f7bd297"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:24:23.111159 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.111142 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/814bada1-526d-4287-bd2d-b6065f7bd297-kube-api-access-lkrsl" (OuterVolumeSpecName: "kube-api-access-lkrsl") pod "814bada1-526d-4287-bd2d-b6065f7bd297" (UID: "814bada1-526d-4287-bd2d-b6065f7bd297"). InnerVolumeSpecName "kube-api-access-lkrsl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:24:23.111262 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.111219 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/814bada1-526d-4287-bd2d-b6065f7bd297-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "814bada1-526d-4287-bd2d-b6065f7bd297" (UID: "814bada1-526d-4287-bd2d-b6065f7bd297"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:24:23.210192 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.210165 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-istio-envoy\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:24:23.210192 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.210189 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/814bada1-526d-4287-bd2d-b6065f7bd297-istio-podinfo\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:24:23.210366 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.210198 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-istio-data\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:24:23.210366 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.210207 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/814bada1-526d-4287-bd2d-b6065f7bd297-istio-token\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:24:23.210366 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.210215 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkrsl\" (UniqueName: \"kubernetes.io/projected/814bada1-526d-4287-bd2d-b6065f7bd297-kube-api-access-lkrsl\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:24:23.210366 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.210223 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-credential-socket\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:24:23.210366 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.210232 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/814bada1-526d-4287-bd2d-b6065f7bd297-istiod-ca-cert\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:24:23.210366 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.210240 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/814bada1-526d-4287-bd2d-b6065f7bd297-workload-socket\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:24:23.845005 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.844966 2567 generic.go:356] "Generic (PLEG): container finished" podID="814bada1-526d-4287-bd2d-b6065f7bd297" containerID="149eb7e4ac37422888370a42615bc77aa6d870616027e94c7e7ad54c94f3119c" exitCode=0 Jul 06 19:24:23.845184 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.845008 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" event={"ID":"814bada1-526d-4287-bd2d-b6065f7bd297","Type":"ContainerDied","Data":"149eb7e4ac37422888370a42615bc77aa6d870616027e94c7e7ad54c94f3119c"} Jul 06 19:24:23.845184 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.845052 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" event={"ID":"814bada1-526d-4287-bd2d-b6065f7bd297","Type":"ContainerDied","Data":"b8aa9c5d627033e455faa50bfdb533d534c15a34088a984c94e539e63591d8f0"} Jul 06 19:24:23.845184 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.845074 2567 scope.go:117] "RemoveContainer" containerID="149eb7e4ac37422888370a42615bc77aa6d870616027e94c7e7ad54c94f3119c" Jul 06 19:24:23.845184 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.845014 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg" Jul 06 19:24:23.854938 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.854918 2567 scope.go:117] "RemoveContainer" containerID="ab49a8abd1eddb2009c86ead51ea092653d0f23cdb1b8db34726f7b545e84723" Jul 06 19:24:23.862953 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.862936 2567 scope.go:117] "RemoveContainer" containerID="149eb7e4ac37422888370a42615bc77aa6d870616027e94c7e7ad54c94f3119c" Jul 06 19:24:23.863170 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:24:23.863152 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"149eb7e4ac37422888370a42615bc77aa6d870616027e94c7e7ad54c94f3119c\": container with ID starting with 149eb7e4ac37422888370a42615bc77aa6d870616027e94c7e7ad54c94f3119c not found: ID does not exist" containerID="149eb7e4ac37422888370a42615bc77aa6d870616027e94c7e7ad54c94f3119c" Jul 06 19:24:23.863208 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.863181 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"149eb7e4ac37422888370a42615bc77aa6d870616027e94c7e7ad54c94f3119c"} err="failed to get container status \"149eb7e4ac37422888370a42615bc77aa6d870616027e94c7e7ad54c94f3119c\": rpc error: code = NotFound desc = could not find container \"149eb7e4ac37422888370a42615bc77aa6d870616027e94c7e7ad54c94f3119c\": container with ID starting with 149eb7e4ac37422888370a42615bc77aa6d870616027e94c7e7ad54c94f3119c not found: ID does not exist" Jul 06 19:24:23.863208 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.863202 2567 scope.go:117] "RemoveContainer" containerID="ab49a8abd1eddb2009c86ead51ea092653d0f23cdb1b8db34726f7b545e84723" Jul 06 19:24:23.863391 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:24:23.863376 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab49a8abd1eddb2009c86ead51ea092653d0f23cdb1b8db34726f7b545e84723\": container with ID starting with ab49a8abd1eddb2009c86ead51ea092653d0f23cdb1b8db34726f7b545e84723 not found: ID does not exist" containerID="ab49a8abd1eddb2009c86ead51ea092653d0f23cdb1b8db34726f7b545e84723" Jul 06 19:24:23.863434 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.863395 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab49a8abd1eddb2009c86ead51ea092653d0f23cdb1b8db34726f7b545e84723"} err="failed to get container status \"ab49a8abd1eddb2009c86ead51ea092653d0f23cdb1b8db34726f7b545e84723\": rpc error: code = NotFound desc = could not find container \"ab49a8abd1eddb2009c86ead51ea092653d0f23cdb1b8db34726f7b545e84723\": container with ID starting with ab49a8abd1eddb2009c86ead51ea092653d0f23cdb1b8db34726f7b545e84723 not found: ID does not exist" Jul 06 19:24:23.872495 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.872456 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg"] Jul 06 19:24:23.879739 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:23.879715 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a5970fbd-openshift-default-64ffcdcd79-zwffg"] Jul 06 19:24:24.576159 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:24.576123 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="814bada1-526d-4287-bd2d-b6065f7bd297" path="/var/lib/kubelet/pods/814bada1-526d-4287-bd2d-b6065f7bd297/volumes" Jul 06 19:24:38.830155 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:38.830109 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2"] Jul 06 19:24:38.830971 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:38.830943 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="814bada1-526d-4287-bd2d-b6065f7bd297" containerName="istio-proxy" Jul 06 19:24:38.831084 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:38.830974 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="814bada1-526d-4287-bd2d-b6065f7bd297" containerName="istio-proxy" Jul 06 19:24:38.831200 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:38.831185 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="814bada1-526d-4287-bd2d-b6065f7bd297" containerName="istio-proxy" Jul 06 19:24:38.831263 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:38.831208 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="814bada1-526d-4287-bd2d-b6065f7bd297" containerName="istio-proxy" Jul 06 19:24:38.834052 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:38.834029 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:38.837351 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:38.837330 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-4f73e900-openshift-default-dockercfg-k9cgz\"" Jul 06 19:24:38.864231 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:38.864208 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2"] Jul 06 19:24:38.947836 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:38.947798 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-podinfo\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:38.948002 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:38.947923 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-credential-socket\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:38.948002 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:38.947963 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-workload-socket\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:38.948002 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:38.947991 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-envoy\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:38.948116 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:38.948072 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-token\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:38.948151 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:38.948121 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-workload-certs\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:38.948151 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:38.948140 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-data\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:38.948218 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:38.948159 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d82aa85-61cd-4630-bc43-ce605e1488d0-istiod-ca-cert\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:38.948218 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:38.948175 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj46q\" (UniqueName: \"kubernetes.io/projected/7d82aa85-61cd-4630-bc43-ce605e1488d0-kube-api-access-gj46q\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:39.049189 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.049153 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-credential-socket\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:39.049376 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.049202 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-workload-socket\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:39.049376 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.049232 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-envoy\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:39.049376 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.049272 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-token\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:39.049376 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.049299 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-workload-certs\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:39.049376 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.049318 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-data\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:39.049376 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.049342 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d82aa85-61cd-4630-bc43-ce605e1488d0-istiod-ca-cert\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:39.049376 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.049367 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj46q\" (UniqueName: \"kubernetes.io/projected/7d82aa85-61cd-4630-bc43-ce605e1488d0-kube-api-access-gj46q\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:39.049787 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.049407 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-podinfo\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:39.049787 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.049659 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-credential-socket\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:39.049787 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.049767 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-workload-certs\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:39.049941 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.049922 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-data\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:39.049995 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.049936 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-workload-socket\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:39.050131 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.050113 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d82aa85-61cd-4630-bc43-ce605e1488d0-istiod-ca-cert\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:39.051818 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.051790 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-envoy\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:39.051967 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.051953 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-podinfo\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:39.060983 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.060956 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-token\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:39.067513 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.067469 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj46q\" (UniqueName: \"kubernetes.io/projected/7d82aa85-61cd-4630-bc43-ce605e1488d0-kube-api-access-gj46q\") pod \"e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:39.144382 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.144307 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:39.296080 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.296054 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2"] Jul 06 19:24:39.296676 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:24:39.296652 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d82aa85_61cd_4630_bc43_ce605e1488d0.slice/crio-50d3f9e1483e6fc013d2e80421bdaa66d59f1818005f63603e9d354855f46720 WatchSource:0}: Error finding container 50d3f9e1483e6fc013d2e80421bdaa66d59f1818005f63603e9d354855f46720: Status 404 returned error can't find the container with id 50d3f9e1483e6fc013d2e80421bdaa66d59f1818005f63603e9d354855f46720 Jul 06 19:24:39.298702 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.298668 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:24:39.298781 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.298735 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:24:39.298781 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.298778 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:24:39.933562 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.933517 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" event={"ID":"7d82aa85-61cd-4630-bc43-ce605e1488d0","Type":"ContainerStarted","Data":"01270dc83350190c6aa8cc87563cf14ccdd001b0e9f23e71dc58bba9d169114e"} Jul 06 19:24:39.933943 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:39.933577 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" event={"ID":"7d82aa85-61cd-4630-bc43-ce605e1488d0","Type":"ContainerStarted","Data":"50d3f9e1483e6fc013d2e80421bdaa66d59f1818005f63603e9d354855f46720"} Jul 06 19:24:40.145440 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:40.145401 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:40.150307 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:40.150282 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:40.174959 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:40.174912 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" podStartSLOduration=2.17489469 podStartE2EDuration="2.17489469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:24:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:24:39.965882709 +0000 UTC m=+1787.892317257" watchObservedRunningTime="2026-07-06 19:24:40.17489469 +0000 UTC m=+1788.101329239" Jul 06 19:24:40.939615 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:40.939587 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:40.940625 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:40.940601 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:52.676661 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:52.676625 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/1.log" Jul 06 19:24:52.678160 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:52.678136 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/1.log" Jul 06 19:24:55.940915 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:55.940881 2567 patch_prober.go:28] interesting pod/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 06 19:24:55.941393 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:55.940949 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" podUID="7d82aa85-61cd-4630-bc43-ce605e1488d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 06 19:24:56.027667 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:56.027585 2567 generic.go:356] "Generic (PLEG): container finished" podID="7d82aa85-61cd-4630-bc43-ce605e1488d0" containerID="01270dc83350190c6aa8cc87563cf14ccdd001b0e9f23e71dc58bba9d169114e" exitCode=0 Jul 06 19:24:56.027810 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:56.027660 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" event={"ID":"7d82aa85-61cd-4630-bc43-ce605e1488d0","Type":"ContainerDied","Data":"01270dc83350190c6aa8cc87563cf14ccdd001b0e9f23e71dc58bba9d169114e"} Jul 06 19:24:56.028109 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:56.028092 2567 scope.go:117] "RemoveContainer" containerID="01270dc83350190c6aa8cc87563cf14ccdd001b0e9f23e71dc58bba9d169114e" Jul 06 19:24:56.029123 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:56.029094 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:24:56.029188 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:56.029164 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:24:56.029230 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:56.029198 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:24:57.039158 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:57.039119 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" event={"ID":"7d82aa85-61cd-4630-bc43-ce605e1488d0","Type":"ContainerStarted","Data":"ec34b4d4211002eb2e53fc4d9c1f583f829f0b45d138e63ccaba50e620d722c4"} Jul 06 19:24:57.144754 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:57.144712 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:24:57.144958 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:57.144840 2567 patch_prober.go:28] interesting pod/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 06 19:24:57.144958 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:57.144894 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" podUID="7d82aa85-61cd-4630-bc43-ce605e1488d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 06 19:24:58.145213 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:58.145174 2567 patch_prober.go:28] interesting pod/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 06 19:24:58.145828 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:58.145792 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" podUID="7d82aa85-61cd-4630-bc43-ce605e1488d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 06 19:24:59.145359 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:59.145314 2567 patch_prober.go:28] interesting pod/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 06 19:24:59.145977 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:24:59.145382 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" podUID="7d82aa85-61cd-4630-bc43-ce605e1488d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 06 19:25:00.145080 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:25:00.145037 2567 patch_prober.go:28] interesting pod/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 06 19:25:00.145292 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:25:00.145104 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" podUID="7d82aa85-61cd-4630-bc43-ce605e1488d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 06 19:25:01.144953 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:25:01.144917 2567 patch_prober.go:28] interesting pod/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 06 19:25:01.145467 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:25:01.144976 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" podUID="7d82aa85-61cd-4630-bc43-ce605e1488d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 06 19:25:02.148520 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:25:02.148491 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:25:02.148911 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:25:02.148756 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:25:02.149389 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:25:02.149369 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:26:31.196523 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:31.196418 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2"] Jul 06 19:26:31.197091 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:31.196686 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" podUID="7d82aa85-61cd-4630-bc43-ce605e1488d0" containerName="istio-proxy" containerID="cri-o://ec34b4d4211002eb2e53fc4d9c1f583f829f0b45d138e63ccaba50e620d722c4" gracePeriod=30 Jul 06 19:26:32.151001 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:32.150962 2567 patch_prober.go:28] interesting pod/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 19:26:32.151169 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:32.151065 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" podUID="7d82aa85-61cd-4630-bc43-ce605e1488d0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 19:26:36.443751 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.443725 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:26:36.491425 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.491362 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-data\") pod \"7d82aa85-61cd-4630-bc43-ce605e1488d0\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " Jul 06 19:26:36.491425 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.491405 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj46q\" (UniqueName: \"kubernetes.io/projected/7d82aa85-61cd-4630-bc43-ce605e1488d0-kube-api-access-gj46q\") pod \"7d82aa85-61cd-4630-bc43-ce605e1488d0\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " Jul 06 19:26:36.491713 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.491432 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-workload-certs\") pod \"7d82aa85-61cd-4630-bc43-ce605e1488d0\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " Jul 06 19:26:36.491713 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.491459 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-envoy\") pod \"7d82aa85-61cd-4630-bc43-ce605e1488d0\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " Jul 06 19:26:36.491713 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.491530 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-credential-socket\") pod \"7d82aa85-61cd-4630-bc43-ce605e1488d0\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " Jul 06 19:26:36.491713 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.491558 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-podinfo\") pod \"7d82aa85-61cd-4630-bc43-ce605e1488d0\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " Jul 06 19:26:36.491713 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.491590 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-token\") pod \"7d82aa85-61cd-4630-bc43-ce605e1488d0\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " Jul 06 19:26:36.491713 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.491647 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-workload-socket\") pod \"7d82aa85-61cd-4630-bc43-ce605e1488d0\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " Jul 06 19:26:36.492066 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.491707 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7d82aa85-61cd-4630-bc43-ce605e1488d0" (UID: "7d82aa85-61cd-4630-bc43-ce605e1488d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:26:36.492066 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.491757 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d82aa85-61cd-4630-bc43-ce605e1488d0-istiod-ca-cert\") pod \"7d82aa85-61cd-4630-bc43-ce605e1488d0\" (UID: \"7d82aa85-61cd-4630-bc43-ce605e1488d0\") " Jul 06 19:26:36.492066 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.491905 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7d82aa85-61cd-4630-bc43-ce605e1488d0" (UID: "7d82aa85-61cd-4630-bc43-ce605e1488d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:26:36.492212 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.492106 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7d82aa85-61cd-4630-bc43-ce605e1488d0" (UID: "7d82aa85-61cd-4630-bc43-ce605e1488d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:26:36.492212 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.492131 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-workload-certs\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:26:36.492212 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.492143 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d82aa85-61cd-4630-bc43-ce605e1488d0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7d82aa85-61cd-4630-bc43-ce605e1488d0" (UID: "7d82aa85-61cd-4630-bc43-ce605e1488d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:26:36.492212 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.492150 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-workload-socket\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:26:36.492371 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.492249 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-data" (OuterVolumeSpecName: "istio-data") pod "7d82aa85-61cd-4630-bc43-ce605e1488d0" (UID: "7d82aa85-61cd-4630-bc43-ce605e1488d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:26:36.494104 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.494078 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d82aa85-61cd-4630-bc43-ce605e1488d0-kube-api-access-gj46q" (OuterVolumeSpecName: "kube-api-access-gj46q") pod "7d82aa85-61cd-4630-bc43-ce605e1488d0" (UID: "7d82aa85-61cd-4630-bc43-ce605e1488d0"). InnerVolumeSpecName "kube-api-access-gj46q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:26:36.494207 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.494105 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7d82aa85-61cd-4630-bc43-ce605e1488d0" (UID: "7d82aa85-61cd-4630-bc43-ce605e1488d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:26:36.494207 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.494111 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-token" (OuterVolumeSpecName: "istio-token") pod "7d82aa85-61cd-4630-bc43-ce605e1488d0" (UID: "7d82aa85-61cd-4630-bc43-ce605e1488d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:26:36.494207 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.494147 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7d82aa85-61cd-4630-bc43-ce605e1488d0" (UID: "7d82aa85-61cd-4630-bc43-ce605e1488d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:26:36.592614 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.592565 2567 generic.go:356] "Generic (PLEG): container finished" podID="7d82aa85-61cd-4630-bc43-ce605e1488d0" containerID="ec34b4d4211002eb2e53fc4d9c1f583f829f0b45d138e63ccaba50e620d722c4" exitCode=0 Jul 06 19:26:36.592614 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.592603 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" Jul 06 19:26:36.592840 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.592703 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-data\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:26:36.592840 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.592720 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj46q\" (UniqueName: \"kubernetes.io/projected/7d82aa85-61cd-4630-bc43-ce605e1488d0-kube-api-access-gj46q\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:26:36.592840 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.592732 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-envoy\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:26:36.592840 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.592755 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" event={"ID":"7d82aa85-61cd-4630-bc43-ce605e1488d0","Type":"ContainerDied","Data":"ec34b4d4211002eb2e53fc4d9c1f583f829f0b45d138e63ccaba50e620d722c4"} Jul 06 19:26:36.592840 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.592794 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d82aa85-61cd-4630-bc43-ce605e1488d0-credential-socket\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:26:36.592840 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.592815 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2" event={"ID":"7d82aa85-61cd-4630-bc43-ce605e1488d0","Type":"ContainerDied","Data":"50d3f9e1483e6fc013d2e80421bdaa66d59f1818005f63603e9d354855f46720"} Jul 06 19:26:36.593158 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.592848 2567 scope.go:117] "RemoveContainer" containerID="ec34b4d4211002eb2e53fc4d9c1f583f829f0b45d138e63ccaba50e620d722c4" Jul 06 19:26:36.593158 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.592877 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-podinfo\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:26:36.593158 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.592897 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d82aa85-61cd-4630-bc43-ce605e1488d0-istio-token\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:26:36.593158 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.592912 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d82aa85-61cd-4630-bc43-ce605e1488d0-istiod-ca-cert\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:26:36.601804 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.601790 2567 scope.go:117] "RemoveContainer" containerID="01270dc83350190c6aa8cc87563cf14ccdd001b0e9f23e71dc58bba9d169114e" Jul 06 19:26:36.609827 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.609807 2567 scope.go:117] "RemoveContainer" containerID="ec34b4d4211002eb2e53fc4d9c1f583f829f0b45d138e63ccaba50e620d722c4" Jul 06 19:26:36.610066 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:26:36.610044 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec34b4d4211002eb2e53fc4d9c1f583f829f0b45d138e63ccaba50e620d722c4\": container with ID starting with ec34b4d4211002eb2e53fc4d9c1f583f829f0b45d138e63ccaba50e620d722c4 not found: ID does not exist" containerID="ec34b4d4211002eb2e53fc4d9c1f583f829f0b45d138e63ccaba50e620d722c4" Jul 06 19:26:36.610121 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.610072 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec34b4d4211002eb2e53fc4d9c1f583f829f0b45d138e63ccaba50e620d722c4"} err="failed to get container status \"ec34b4d4211002eb2e53fc4d9c1f583f829f0b45d138e63ccaba50e620d722c4\": rpc error: code = NotFound desc = could not find container \"ec34b4d4211002eb2e53fc4d9c1f583f829f0b45d138e63ccaba50e620d722c4\": container with ID starting with ec34b4d4211002eb2e53fc4d9c1f583f829f0b45d138e63ccaba50e620d722c4 not found: ID does not exist" Jul 06 19:26:36.610121 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.610090 2567 scope.go:117] "RemoveContainer" containerID="01270dc83350190c6aa8cc87563cf14ccdd001b0e9f23e71dc58bba9d169114e" Jul 06 19:26:36.610332 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:26:36.610315 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01270dc83350190c6aa8cc87563cf14ccdd001b0e9f23e71dc58bba9d169114e\": container with ID starting with 01270dc83350190c6aa8cc87563cf14ccdd001b0e9f23e71dc58bba9d169114e not found: ID does not exist" containerID="01270dc83350190c6aa8cc87563cf14ccdd001b0e9f23e71dc58bba9d169114e" Jul 06 19:26:36.610375 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:36.610337 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01270dc83350190c6aa8cc87563cf14ccdd001b0e9f23e71dc58bba9d169114e"} err="failed to get container status \"01270dc83350190c6aa8cc87563cf14ccdd001b0e9f23e71dc58bba9d169114e\": rpc error: code = NotFound desc = could not find container \"01270dc83350190c6aa8cc87563cf14ccdd001b0e9f23e71dc58bba9d169114e\": container with ID starting with 01270dc83350190c6aa8cc87563cf14ccdd001b0e9f23e71dc58bba9d169114e not found: ID does not exist" Jul 06 19:26:47.282468 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:47.282434 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2"] Jul 06 19:26:47.293468 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:47.293441 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-4f73e900-openshift-default-546dff4695-bmdm2"] Jul 06 19:26:48.576298 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:26:48.576255 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d82aa85-61cd-4630-bc43-ce605e1488d0" path="/var/lib/kubelet/pods/7d82aa85-61cd-4630-bc43-ce605e1488d0/volumes" Jul 06 19:27:40.796956 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.796924 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq"] Jul 06 19:27:40.797541 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.797335 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d82aa85-61cd-4630-bc43-ce605e1488d0" containerName="istio-proxy" Jul 06 19:27:40.797541 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.797351 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d82aa85-61cd-4630-bc43-ce605e1488d0" containerName="istio-proxy" Jul 06 19:27:40.797541 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.797383 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d82aa85-61cd-4630-bc43-ce605e1488d0" containerName="istio-proxy" Jul 06 19:27:40.797541 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.797392 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d82aa85-61cd-4630-bc43-ce605e1488d0" containerName="istio-proxy" Jul 06 19:27:40.797541 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.797405 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="814bada1-526d-4287-bd2d-b6065f7bd297" containerName="istio-proxy" Jul 06 19:27:40.797541 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.797413 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="814bada1-526d-4287-bd2d-b6065f7bd297" containerName="istio-proxy" Jul 06 19:27:40.797541 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.797514 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d82aa85-61cd-4630-bc43-ce605e1488d0" containerName="istio-proxy" Jul 06 19:27:40.800837 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.800800 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.816781 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.816760 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-88c5f6-openshift-default-dockercfg-xq5ds\"" Jul 06 19:27:40.848238 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.848217 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-token\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.848353 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.848245 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-envoy\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.848353 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.848278 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-credential-socket\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.848353 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.848327 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-podinfo\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.848502 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.848396 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-workload-certs\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.848502 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.848438 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-data\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.848502 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.848466 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-workload-socket\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.848621 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.848513 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istiod-ca-cert\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.848621 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.848548 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxpfm\" (UniqueName: \"kubernetes.io/projected/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-kube-api-access-vxpfm\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.876309 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.876273 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq"] Jul 06 19:27:40.949129 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.949099 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-credential-socket\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.949331 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.949163 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-podinfo\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.949331 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.949199 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-workload-certs\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.949331 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.949299 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-data\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.949552 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.949353 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-workload-socket\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.949552 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.949380 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istiod-ca-cert\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.949552 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.949426 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxpfm\" (UniqueName: \"kubernetes.io/projected/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-kube-api-access-vxpfm\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.949552 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.949459 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-token\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.949552 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.949501 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-envoy\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.949819 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.949756 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-credential-socket\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.950266 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.950212 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-data\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.950390 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.950375 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-workload-certs\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.950659 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.950564 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-workload-socket\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.950982 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.950939 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istiod-ca-cert\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.952536 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.952509 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-podinfo\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:40.952900 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:40.952871 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-envoy\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:41.009606 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:41.009582 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-token\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:41.009738 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:41.009648 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxpfm\" (UniqueName: \"kubernetes.io/projected/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-kube-api-access-vxpfm\") pod \"e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:41.111819 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:41.111729 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:41.288983 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:41.288949 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq"] Jul 06 19:27:41.300852 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:27:41.300821 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11daf41e_00d0_4f44_b7b0_db3bc49d2da6.slice/crio-01235cc6132bf12b41b407f946d3c5661a8a60808514724032b1f0f700e46278 WatchSource:0}: Error finding container 01235cc6132bf12b41b407f946d3c5661a8a60808514724032b1f0f700e46278: Status 404 returned error can't find the container with id 01235cc6132bf12b41b407f946d3c5661a8a60808514724032b1f0f700e46278 Jul 06 19:27:41.302971 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:41.302940 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:27:41.303049 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:41.303002 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:27:41.303049 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:41.303031 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:27:41.945010 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:41.944972 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" event={"ID":"11daf41e-00d0-4f44-b7b0-db3bc49d2da6","Type":"ContainerStarted","Data":"3f9f129efe8be207b81a149fbf8e50dc0956e6b46bba7037bd26a984c95e3df3"} Jul 06 19:27:41.945420 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:41.945029 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" event={"ID":"11daf41e-00d0-4f44-b7b0-db3bc49d2da6","Type":"ContainerStarted","Data":"01235cc6132bf12b41b407f946d3c5661a8a60808514724032b1f0f700e46278"} Jul 06 19:27:41.981213 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:41.981162 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" podStartSLOduration=1.981141069 podStartE2EDuration="1.981141069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:41.980727979 +0000 UTC m=+1969.907162528" watchObservedRunningTime="2026-07-06 19:27:41.981141069 +0000 UTC m=+1969.907575621" Jul 06 19:27:42.112738 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:42.112703 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:42.117308 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:42.117286 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:42.950507 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:42.950461 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:42.951430 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:42.951412 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:27:49.357779 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.357740 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49"] Jul 06 19:27:49.358217 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.358202 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d82aa85-61cd-4630-bc43-ce605e1488d0" containerName="istio-proxy" Jul 06 19:27:49.361652 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.361633 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.364870 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.364851 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-cc274f-openshift-default-dockercfg-2w8kc\"" Jul 06 19:27:49.388291 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.388266 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49"] Jul 06 19:27:49.426221 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.426183 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-workload-certs\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.426392 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.426229 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-workload-socket\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.426392 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.426272 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0293831c-42e4-477e-9ab7-3c4ebebbda67-istiod-ca-cert\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.426392 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.426308 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-credential-socket\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.426392 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.426330 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-token\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.426392 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.426348 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-data\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.426392 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.426364 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-envoy\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.426769 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.426401 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-podinfo\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.426769 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.426421 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cxh2\" (UniqueName: \"kubernetes.io/projected/0293831c-42e4-477e-9ab7-3c4ebebbda67-kube-api-access-2cxh2\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.527597 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.527561 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-data\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.527597 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.527598 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-envoy\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.527818 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.527622 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-podinfo\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.527920 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.527897 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cxh2\" (UniqueName: \"kubernetes.io/projected/0293831c-42e4-477e-9ab7-3c4ebebbda67-kube-api-access-2cxh2\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.528043 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.528029 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-workload-certs\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.528098 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.528042 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-data\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.528098 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.528072 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-workload-socket\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.528205 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.528136 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0293831c-42e4-477e-9ab7-3c4ebebbda67-istiod-ca-cert\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.528205 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.528174 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-credential-socket\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.528205 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.528199 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-token\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.528353 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.528337 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-workload-certs\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.528408 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.528366 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-workload-socket\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.528686 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.528662 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-credential-socket\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.529063 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.529039 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0293831c-42e4-477e-9ab7-3c4ebebbda67-istiod-ca-cert\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.530101 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.530073 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-envoy\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.530305 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.530289 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-podinfo\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.540167 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.540142 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-token\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.540761 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.540744 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cxh2\" (UniqueName: \"kubernetes.io/projected/0293831c-42e4-477e-9ab7-3c4ebebbda67-kube-api-access-2cxh2\") pod \"e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.671892 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.671862 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:49.822390 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.822360 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49"] Jul 06 19:27:49.823521 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:27:49.823465 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0293831c_42e4_477e_9ab7_3c4ebebbda67.slice/crio-fbc18eb4a6bd1219f14eff6a32b95bd96bd6115e543e3700515f0506477e8815 WatchSource:0}: Error finding container fbc18eb4a6bd1219f14eff6a32b95bd96bd6115e543e3700515f0506477e8815: Status 404 returned error can't find the container with id fbc18eb4a6bd1219f14eff6a32b95bd96bd6115e543e3700515f0506477e8815 Jul 06 19:27:49.825833 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.825797 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:27:49.825911 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.825872 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:27:49.825962 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.825911 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:27:49.991234 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.991154 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" event={"ID":"0293831c-42e4-477e-9ab7-3c4ebebbda67","Type":"ContainerStarted","Data":"a2a7cc9ebb1587f97b1d04bca7b506c19f97695f109880f9a139c208614117ff"} Jul 06 19:27:49.991234 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:49.991220 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" event={"ID":"0293831c-42e4-477e-9ab7-3c4ebebbda67","Type":"ContainerStarted","Data":"fbc18eb4a6bd1219f14eff6a32b95bd96bd6115e543e3700515f0506477e8815"} Jul 06 19:27:50.019519 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:50.019451 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" podStartSLOduration=1.019436639 podStartE2EDuration="1.019436639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:50.016320452 +0000 UTC m=+1977.942755002" watchObservedRunningTime="2026-07-06 19:27:50.019436639 +0000 UTC m=+1977.945871188" Jul 06 19:27:50.672915 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:50.672884 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:50.677701 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:50.677681 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:50.997241 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:50.997166 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:50.998158 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:50.998120 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:27:58.992625 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:58.992588 2567 patch_prober.go:28] interesting pod/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 06 19:27:58.993117 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:27:58.992663 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" podUID="11daf41e-00d0-4f44-b7b0-db3bc49d2da6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 06 19:28:00.048342 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:00.048308 2567 generic.go:356] "Generic (PLEG): container finished" podID="11daf41e-00d0-4f44-b7b0-db3bc49d2da6" containerID="3f9f129efe8be207b81a149fbf8e50dc0956e6b46bba7037bd26a984c95e3df3" exitCode=0 Jul 06 19:28:00.048901 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:00.048387 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" event={"ID":"11daf41e-00d0-4f44-b7b0-db3bc49d2da6","Type":"ContainerDied","Data":"3f9f129efe8be207b81a149fbf8e50dc0956e6b46bba7037bd26a984c95e3df3"} Jul 06 19:28:00.048972 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:00.048958 2567 scope.go:117] "RemoveContainer" containerID="3f9f129efe8be207b81a149fbf8e50dc0956e6b46bba7037bd26a984c95e3df3" Jul 06 19:28:00.050007 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:00.049979 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:28:00.050069 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:00.050046 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:28:00.050115 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:00.050075 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:28:01.058446 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:01.058408 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" event={"ID":"11daf41e-00d0-4f44-b7b0-db3bc49d2da6","Type":"ContainerStarted","Data":"c2b63073a0e0f5800c87d73c037efbd62eec04bdae7c848334f9addc0f3c7fcd"} Jul 06 19:28:01.112194 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:01.112167 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:28:01.112464 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:01.112445 2567 patch_prober.go:28] interesting pod/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 06 19:28:01.112546 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:01.112521 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" podUID="11daf41e-00d0-4f44-b7b0-db3bc49d2da6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 06 19:28:02.112080 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:02.112048 2567 patch_prober.go:28] interesting pod/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 06 19:28:02.112458 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:02.112102 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" podUID="11daf41e-00d0-4f44-b7b0-db3bc49d2da6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 06 19:28:03.112136 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:03.112107 2567 patch_prober.go:28] interesting pod/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 06 19:28:03.112543 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:03.112159 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" podUID="11daf41e-00d0-4f44-b7b0-db3bc49d2da6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 06 19:28:04.112864 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:04.112830 2567 patch_prober.go:28] interesting pod/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 06 19:28:04.113257 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:04.112890 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" podUID="11daf41e-00d0-4f44-b7b0-db3bc49d2da6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 06 19:28:05.116131 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:05.116102 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:28:05.116562 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:05.116363 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:28:05.117071 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:05.117052 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:28:35.242372 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:35.242336 2567 generic.go:356] "Generic (PLEG): container finished" podID="0293831c-42e4-477e-9ab7-3c4ebebbda67" containerID="a2a7cc9ebb1587f97b1d04bca7b506c19f97695f109880f9a139c208614117ff" exitCode=0 Jul 06 19:28:35.242871 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:35.242413 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" event={"ID":"0293831c-42e4-477e-9ab7-3c4ebebbda67","Type":"ContainerDied","Data":"a2a7cc9ebb1587f97b1d04bca7b506c19f97695f109880f9a139c208614117ff"} Jul 06 19:28:35.243000 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:35.242983 2567 scope.go:117] "RemoveContainer" containerID="a2a7cc9ebb1587f97b1d04bca7b506c19f97695f109880f9a139c208614117ff" Jul 06 19:28:35.244026 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:35.243998 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:28:35.244093 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:35.244067 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:28:35.244137 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:35.244120 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:28:35.997493 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:35.997445 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:28:36.256496 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:36.256364 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" event={"ID":"0293831c-42e4-477e-9ab7-3c4ebebbda67","Type":"ContainerStarted","Data":"13ccbe0a98cf26d84db6492b415449c5a137edb626057a493e614a297db9ae4a"} Jul 06 19:28:36.672821 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:36.672785 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:28:36.674098 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:36.674071 2567 patch_prober.go:28] interesting pod/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 06 19:28:36.674235 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:36.674130 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" podUID="0293831c-42e4-477e-9ab7-3c4ebebbda67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 06 19:28:37.673090 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:37.673055 2567 patch_prober.go:28] interesting pod/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 06 19:28:37.673527 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:37.673121 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" podUID="0293831c-42e4-477e-9ab7-3c4ebebbda67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 06 19:28:38.673094 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:38.673058 2567 patch_prober.go:28] interesting pod/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 06 19:28:38.673520 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:38.673112 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" podUID="0293831c-42e4-477e-9ab7-3c4ebebbda67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 06 19:28:39.672543 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:39.672504 2567 patch_prober.go:28] interesting pod/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 06 19:28:39.672731 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:39.672565 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" podUID="0293831c-42e4-477e-9ab7-3c4ebebbda67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 06 19:28:40.676056 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:40.676027 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:28:40.676575 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:40.676410 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:28:40.677130 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:28:40.677105 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:29:44.685022 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:44.684980 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq"] Jul 06 19:29:44.685570 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:44.685187 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" podUID="11daf41e-00d0-4f44-b7b0-db3bc49d2da6" containerName="istio-proxy" containerID="cri-o://c2b63073a0e0f5800c87d73c037efbd62eec04bdae7c848334f9addc0f3c7fcd" gracePeriod=30 Jul 06 19:29:49.956667 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:49.956599 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:29:50.032143 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.032111 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-credential-socket\") pod \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " Jul 06 19:29:50.032336 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.032158 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-envoy\") pod \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " Jul 06 19:29:50.032336 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.032207 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxpfm\" (UniqueName: \"kubernetes.io/projected/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-kube-api-access-vxpfm\") pod \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " Jul 06 19:29:50.032336 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.032236 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-workload-socket\") pod \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " Jul 06 19:29:50.032336 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.032273 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-workload-certs\") pod \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " Jul 06 19:29:50.032576 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.032338 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-podinfo\") pod \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " Jul 06 19:29:50.032576 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.032365 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-token\") pod \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " Jul 06 19:29:50.032576 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.032407 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-data\") pod \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " Jul 06 19:29:50.032576 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.032438 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istiod-ca-cert\") pod \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\" (UID: \"11daf41e-00d0-4f44-b7b0-db3bc49d2da6\") " Jul 06 19:29:50.032576 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.032452 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "11daf41e-00d0-4f44-b7b0-db3bc49d2da6" (UID: "11daf41e-00d0-4f44-b7b0-db3bc49d2da6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:29:50.032830 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.032658 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "11daf41e-00d0-4f44-b7b0-db3bc49d2da6" (UID: "11daf41e-00d0-4f44-b7b0-db3bc49d2da6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:29:50.032830 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.032754 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-credential-socket\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:29:50.032830 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.032771 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-workload-certs\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:29:50.032989 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.032915 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "11daf41e-00d0-4f44-b7b0-db3bc49d2da6" (UID: "11daf41e-00d0-4f44-b7b0-db3bc49d2da6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:29:50.032989 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.032938 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "11daf41e-00d0-4f44-b7b0-db3bc49d2da6" (UID: "11daf41e-00d0-4f44-b7b0-db3bc49d2da6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:29:50.033212 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.033187 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-data" (OuterVolumeSpecName: "istio-data") pod "11daf41e-00d0-4f44-b7b0-db3bc49d2da6" (UID: "11daf41e-00d0-4f44-b7b0-db3bc49d2da6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:29:50.034661 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.034640 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "11daf41e-00d0-4f44-b7b0-db3bc49d2da6" (UID: "11daf41e-00d0-4f44-b7b0-db3bc49d2da6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:29:50.034774 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.034674 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-kube-api-access-vxpfm" (OuterVolumeSpecName: "kube-api-access-vxpfm") pod "11daf41e-00d0-4f44-b7b0-db3bc49d2da6" (UID: "11daf41e-00d0-4f44-b7b0-db3bc49d2da6"). InnerVolumeSpecName "kube-api-access-vxpfm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:29:50.034909 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.034887 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-token" (OuterVolumeSpecName: "istio-token") pod "11daf41e-00d0-4f44-b7b0-db3bc49d2da6" (UID: "11daf41e-00d0-4f44-b7b0-db3bc49d2da6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:29:50.034969 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.034924 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "11daf41e-00d0-4f44-b7b0-db3bc49d2da6" (UID: "11daf41e-00d0-4f44-b7b0-db3bc49d2da6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:29:50.133418 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.133391 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-podinfo\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:29:50.133418 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.133415 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-token\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:29:50.133642 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.133435 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-data\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:29:50.133642 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.133444 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istiod-ca-cert\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:29:50.133642 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.133451 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-istio-envoy\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:29:50.133642 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.133459 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxpfm\" (UniqueName: \"kubernetes.io/projected/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-kube-api-access-vxpfm\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:29:50.133642 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.133467 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11daf41e-00d0-4f44-b7b0-db3bc49d2da6-workload-socket\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:29:50.664576 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.664545 2567 generic.go:356] "Generic (PLEG): container finished" podID="11daf41e-00d0-4f44-b7b0-db3bc49d2da6" containerID="c2b63073a0e0f5800c87d73c037efbd62eec04bdae7c848334f9addc0f3c7fcd" exitCode=0 Jul 06 19:29:50.664754 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.664596 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" Jul 06 19:29:50.664754 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.664639 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" event={"ID":"11daf41e-00d0-4f44-b7b0-db3bc49d2da6","Type":"ContainerDied","Data":"c2b63073a0e0f5800c87d73c037efbd62eec04bdae7c848334f9addc0f3c7fcd"} Jul 06 19:29:50.664754 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.664697 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq" event={"ID":"11daf41e-00d0-4f44-b7b0-db3bc49d2da6","Type":"ContainerDied","Data":"01235cc6132bf12b41b407f946d3c5661a8a60808514724032b1f0f700e46278"} Jul 06 19:29:50.664754 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.664726 2567 scope.go:117] "RemoveContainer" containerID="c2b63073a0e0f5800c87d73c037efbd62eec04bdae7c848334f9addc0f3c7fcd" Jul 06 19:29:50.666364 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.666341 2567 generic.go:356] "Generic (PLEG): container finished" podID="3eae5464-ef34-4403-8b77-c52674b74f81" containerID="71c0a3fd9c44340ecd4f83ee957c74b47f9273e1c588bb91ce21590aa198a936" exitCode=1 Jul 06 19:29:50.666497 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.666430 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wdtbt" event={"ID":"3eae5464-ef34-4403-8b77-c52674b74f81","Type":"ContainerDied","Data":"71c0a3fd9c44340ecd4f83ee957c74b47f9273e1c588bb91ce21590aa198a936"} Jul 06 19:29:50.666852 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.666830 2567 scope.go:117] "RemoveContainer" containerID="71c0a3fd9c44340ecd4f83ee957c74b47f9273e1c588bb91ce21590aa198a936" Jul 06 19:29:50.667236 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.667213 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:29:50.674718 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.674701 2567 scope.go:117] "RemoveContainer" containerID="3f9f129efe8be207b81a149fbf8e50dc0956e6b46bba7037bd26a984c95e3df3" Jul 06 19:29:50.682827 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.682809 2567 scope.go:117] "RemoveContainer" containerID="c2b63073a0e0f5800c87d73c037efbd62eec04bdae7c848334f9addc0f3c7fcd" Jul 06 19:29:50.683071 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:29:50.683049 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2b63073a0e0f5800c87d73c037efbd62eec04bdae7c848334f9addc0f3c7fcd\": container with ID starting with c2b63073a0e0f5800c87d73c037efbd62eec04bdae7c848334f9addc0f3c7fcd not found: ID does not exist" containerID="c2b63073a0e0f5800c87d73c037efbd62eec04bdae7c848334f9addc0f3c7fcd" Jul 06 19:29:50.683121 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.683083 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2b63073a0e0f5800c87d73c037efbd62eec04bdae7c848334f9addc0f3c7fcd"} err="failed to get container status \"c2b63073a0e0f5800c87d73c037efbd62eec04bdae7c848334f9addc0f3c7fcd\": rpc error: code = NotFound desc = could not find container \"c2b63073a0e0f5800c87d73c037efbd62eec04bdae7c848334f9addc0f3c7fcd\": container with ID starting with c2b63073a0e0f5800c87d73c037efbd62eec04bdae7c848334f9addc0f3c7fcd not found: ID does not exist" Jul 06 19:29:50.683121 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.683102 2567 scope.go:117] "RemoveContainer" containerID="3f9f129efe8be207b81a149fbf8e50dc0956e6b46bba7037bd26a984c95e3df3" Jul 06 19:29:50.683324 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:29:50.683308 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f9f129efe8be207b81a149fbf8e50dc0956e6b46bba7037bd26a984c95e3df3\": container with ID starting with 3f9f129efe8be207b81a149fbf8e50dc0956e6b46bba7037bd26a984c95e3df3 not found: ID does not exist" containerID="3f9f129efe8be207b81a149fbf8e50dc0956e6b46bba7037bd26a984c95e3df3" Jul 06 19:29:50.683368 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.683328 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f9f129efe8be207b81a149fbf8e50dc0956e6b46bba7037bd26a984c95e3df3"} err="failed to get container status \"3f9f129efe8be207b81a149fbf8e50dc0956e6b46bba7037bd26a984c95e3df3\": rpc error: code = NotFound desc = could not find container \"3f9f129efe8be207b81a149fbf8e50dc0956e6b46bba7037bd26a984c95e3df3\": container with ID starting with 3f9f129efe8be207b81a149fbf8e50dc0956e6b46bba7037bd26a984c95e3df3 not found: ID does not exist" Jul 06 19:29:50.738971 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.738894 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq"] Jul 06 19:29:50.747960 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:50.747932 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-88c5f6-openshift-default-c65499cdf-625mq"] Jul 06 19:29:51.675041 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:51.675009 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wdtbt" event={"ID":"3eae5464-ef34-4403-8b77-c52674b74f81","Type":"ContainerStarted","Data":"bec41e815200274bc77856d66d911bffb61323ac2e11254729384d99ac3c84be"} Jul 06 19:29:51.675492 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:51.675238 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wdtbt" Jul 06 19:29:52.575963 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:52.575931 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11daf41e-00d0-4f44-b7b0-db3bc49d2da6" path="/var/lib/kubelet/pods/11daf41e-00d0-4f44-b7b0-db3bc49d2da6/volumes" Jul 06 19:29:52.714610 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:52.714579 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/1.log" Jul 06 19:29:52.718406 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:52.718382 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/1.log" Jul 06 19:29:54.438336 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:54.438299 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49"] Jul 06 19:29:54.438829 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:54.438567 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" podUID="0293831c-42e4-477e-9ab7-3c4ebebbda67" containerName="istio-proxy" containerID="cri-o://13ccbe0a98cf26d84db6492b415449c5a137edb626057a493e614a297db9ae4a" gracePeriod=30 Jul 06 19:29:55.678802 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:55.678764 2567 patch_prober.go:28] interesting pod/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 19:29:55.679149 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:55.678824 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" podUID="0293831c-42e4-477e-9ab7-3c4ebebbda67" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 19:29:59.707304 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.707244 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:29:59.719457 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.719430 2567 generic.go:356] "Generic (PLEG): container finished" podID="0293831c-42e4-477e-9ab7-3c4ebebbda67" containerID="13ccbe0a98cf26d84db6492b415449c5a137edb626057a493e614a297db9ae4a" exitCode=0 Jul 06 19:29:59.719607 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.719489 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" Jul 06 19:29:59.719607 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.719524 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" event={"ID":"0293831c-42e4-477e-9ab7-3c4ebebbda67","Type":"ContainerDied","Data":"13ccbe0a98cf26d84db6492b415449c5a137edb626057a493e614a297db9ae4a"} Jul 06 19:29:59.719607 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.719587 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49" event={"ID":"0293831c-42e4-477e-9ab7-3c4ebebbda67","Type":"ContainerDied","Data":"fbc18eb4a6bd1219f14eff6a32b95bd96bd6115e543e3700515f0506477e8815"} Jul 06 19:29:59.719777 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.719617 2567 scope.go:117] "RemoveContainer" containerID="13ccbe0a98cf26d84db6492b415449c5a137edb626057a493e614a297db9ae4a" Jul 06 19:29:59.731226 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.731202 2567 scope.go:117] "RemoveContainer" containerID="a2a7cc9ebb1587f97b1d04bca7b506c19f97695f109880f9a139c208614117ff" Jul 06 19:29:59.739246 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.739232 2567 scope.go:117] "RemoveContainer" containerID="13ccbe0a98cf26d84db6492b415449c5a137edb626057a493e614a297db9ae4a" Jul 06 19:29:59.739500 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:29:59.739464 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13ccbe0a98cf26d84db6492b415449c5a137edb626057a493e614a297db9ae4a\": container with ID starting with 13ccbe0a98cf26d84db6492b415449c5a137edb626057a493e614a297db9ae4a not found: ID does not exist" containerID="13ccbe0a98cf26d84db6492b415449c5a137edb626057a493e614a297db9ae4a" Jul 06 19:29:59.739564 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.739510 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13ccbe0a98cf26d84db6492b415449c5a137edb626057a493e614a297db9ae4a"} err="failed to get container status \"13ccbe0a98cf26d84db6492b415449c5a137edb626057a493e614a297db9ae4a\": rpc error: code = NotFound desc = could not find container \"13ccbe0a98cf26d84db6492b415449c5a137edb626057a493e614a297db9ae4a\": container with ID starting with 13ccbe0a98cf26d84db6492b415449c5a137edb626057a493e614a297db9ae4a not found: ID does not exist" Jul 06 19:29:59.739564 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.739527 2567 scope.go:117] "RemoveContainer" containerID="a2a7cc9ebb1587f97b1d04bca7b506c19f97695f109880f9a139c208614117ff" Jul 06 19:29:59.739757 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:29:59.739740 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2a7cc9ebb1587f97b1d04bca7b506c19f97695f109880f9a139c208614117ff\": container with ID starting with a2a7cc9ebb1587f97b1d04bca7b506c19f97695f109880f9a139c208614117ff not found: ID does not exist" containerID="a2a7cc9ebb1587f97b1d04bca7b506c19f97695f109880f9a139c208614117ff" Jul 06 19:29:59.739810 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.739767 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2a7cc9ebb1587f97b1d04bca7b506c19f97695f109880f9a139c208614117ff"} err="failed to get container status \"a2a7cc9ebb1587f97b1d04bca7b506c19f97695f109880f9a139c208614117ff\": rpc error: code = NotFound desc = could not find container \"a2a7cc9ebb1587f97b1d04bca7b506c19f97695f109880f9a139c208614117ff\": container with ID starting with a2a7cc9ebb1587f97b1d04bca7b506c19f97695f109880f9a139c208614117ff not found: ID does not exist" Jul 06 19:29:59.813945 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.813916 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-workload-socket\") pod \"0293831c-42e4-477e-9ab7-3c4ebebbda67\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " Jul 06 19:29:59.813945 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.813948 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-data\") pod \"0293831c-42e4-477e-9ab7-3c4ebebbda67\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " Jul 06 19:29:59.814179 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.813966 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cxh2\" (UniqueName: \"kubernetes.io/projected/0293831c-42e4-477e-9ab7-3c4ebebbda67-kube-api-access-2cxh2\") pod \"0293831c-42e4-477e-9ab7-3c4ebebbda67\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " Jul 06 19:29:59.814179 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.813995 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-podinfo\") pod \"0293831c-42e4-477e-9ab7-3c4ebebbda67\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " Jul 06 19:29:59.814179 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.814069 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-credential-socket\") pod \"0293831c-42e4-477e-9ab7-3c4ebebbda67\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " Jul 06 19:29:59.814179 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.814097 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-workload-certs\") pod \"0293831c-42e4-477e-9ab7-3c4ebebbda67\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " Jul 06 19:29:59.814179 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.814120 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0293831c-42e4-477e-9ab7-3c4ebebbda67-istiod-ca-cert\") pod \"0293831c-42e4-477e-9ab7-3c4ebebbda67\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " Jul 06 19:29:59.814179 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.814135 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-token\") pod \"0293831c-42e4-477e-9ab7-3c4ebebbda67\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " Jul 06 19:29:59.814179 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.814157 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-envoy\") pod \"0293831c-42e4-477e-9ab7-3c4ebebbda67\" (UID: \"0293831c-42e4-477e-9ab7-3c4ebebbda67\") " Jul 06 19:29:59.814564 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.814254 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0293831c-42e4-477e-9ab7-3c4ebebbda67" (UID: "0293831c-42e4-477e-9ab7-3c4ebebbda67"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:29:59.814564 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.814399 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0293831c-42e4-477e-9ab7-3c4ebebbda67" (UID: "0293831c-42e4-477e-9ab7-3c4ebebbda67"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:29:59.814564 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.814418 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0293831c-42e4-477e-9ab7-3c4ebebbda67" (UID: "0293831c-42e4-477e-9ab7-3c4ebebbda67"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:29:59.814564 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.814455 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-workload-socket\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:29:59.814564 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.814557 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0293831c-42e4-477e-9ab7-3c4ebebbda67-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0293831c-42e4-477e-9ab7-3c4ebebbda67" (UID: "0293831c-42e4-477e-9ab7-3c4ebebbda67"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:29:59.815133 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.815111 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-data" (OuterVolumeSpecName: "istio-data") pod "0293831c-42e4-477e-9ab7-3c4ebebbda67" (UID: "0293831c-42e4-477e-9ab7-3c4ebebbda67"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:29:59.816237 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.816213 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0293831c-42e4-477e-9ab7-3c4ebebbda67" (UID: "0293831c-42e4-477e-9ab7-3c4ebebbda67"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:29:59.816408 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.816391 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-token" (OuterVolumeSpecName: "istio-token") pod "0293831c-42e4-477e-9ab7-3c4ebebbda67" (UID: "0293831c-42e4-477e-9ab7-3c4ebebbda67"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:29:59.816645 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.816620 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0293831c-42e4-477e-9ab7-3c4ebebbda67" (UID: "0293831c-42e4-477e-9ab7-3c4ebebbda67"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:29:59.816645 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.816638 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0293831c-42e4-477e-9ab7-3c4ebebbda67-kube-api-access-2cxh2" (OuterVolumeSpecName: "kube-api-access-2cxh2") pod "0293831c-42e4-477e-9ab7-3c4ebebbda67" (UID: "0293831c-42e4-477e-9ab7-3c4ebebbda67"). InnerVolumeSpecName "kube-api-access-2cxh2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:29:59.915024 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.914991 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-credential-socket\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:29:59.915024 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.915019 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-workload-certs\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:29:59.915024 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.915029 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0293831c-42e4-477e-9ab7-3c4ebebbda67-istiod-ca-cert\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:29:59.915024 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.915036 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-token\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:29:59.915286 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.915045 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-envoy\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:29:59.915286 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.915052 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-data\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:29:59.915286 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.915059 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cxh2\" (UniqueName: \"kubernetes.io/projected/0293831c-42e4-477e-9ab7-3c4ebebbda67-kube-api-access-2cxh2\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:29:59.915286 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:29:59.915067 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0293831c-42e4-477e-9ab7-3c4ebebbda67-istio-podinfo\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:30:00.068027 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:00.067986 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49"] Jul 06 19:30:00.074585 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:00.074545 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-cc274f-openshift-default-6b865ccc89-vtm49"] Jul 06 19:30:00.248642 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:00.248609 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722770-46bwx"] Jul 06 19:30:00.248980 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:00.248968 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0293831c-42e4-477e-9ab7-3c4ebebbda67" containerName="istio-proxy" Jul 06 19:30:00.249026 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:00.248981 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0293831c-42e4-477e-9ab7-3c4ebebbda67" containerName="istio-proxy" Jul 06 19:30:00.249026 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:00.248995 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11daf41e-00d0-4f44-b7b0-db3bc49d2da6" containerName="istio-proxy" Jul 06 19:30:00.249026 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:00.249002 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="11daf41e-00d0-4f44-b7b0-db3bc49d2da6" containerName="istio-proxy" Jul 06 19:30:00.249026 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:00.249011 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11daf41e-00d0-4f44-b7b0-db3bc49d2da6" containerName="istio-proxy" Jul 06 19:30:00.249026 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:00.249018 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="11daf41e-00d0-4f44-b7b0-db3bc49d2da6" containerName="istio-proxy" Jul 06 19:30:00.249178 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:00.249085 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="11daf41e-00d0-4f44-b7b0-db3bc49d2da6" containerName="istio-proxy" Jul 06 19:30:00.249178 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:00.249093 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0293831c-42e4-477e-9ab7-3c4ebebbda67" containerName="istio-proxy" Jul 06 19:30:00.249178 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:00.249100 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0293831c-42e4-477e-9ab7-3c4ebebbda67" containerName="istio-proxy" Jul 06 19:30:00.253855 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:00.253838 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722770-46bwx" Jul 06 19:30:00.258304 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:00.258282 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-6wq86\"" Jul 06 19:30:00.318208 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:00.318123 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h6ts\" (UniqueName: \"kubernetes.io/projected/7c354de6-be12-427b-b68f-047c77e339fb-kube-api-access-7h6ts\") pod \"maas-api-key-cleanup-29722770-46bwx\" (UID: \"7c354de6-be12-427b-b68f-047c77e339fb\") " pod="opendatahub/maas-api-key-cleanup-29722770-46bwx" Jul 06 19:30:00.401633 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:00.401600 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722770-46bwx"] Jul 06 19:30:00.419189 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:00.419141 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h6ts\" (UniqueName: \"kubernetes.io/projected/7c354de6-be12-427b-b68f-047c77e339fb-kube-api-access-7h6ts\") pod \"maas-api-key-cleanup-29722770-46bwx\" (UID: \"7c354de6-be12-427b-b68f-047c77e339fb\") " pod="opendatahub/maas-api-key-cleanup-29722770-46bwx" Jul 06 19:30:00.432164 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:00.432132 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h6ts\" (UniqueName: \"kubernetes.io/projected/7c354de6-be12-427b-b68f-047c77e339fb-kube-api-access-7h6ts\") pod \"maas-api-key-cleanup-29722770-46bwx\" (UID: \"7c354de6-be12-427b-b68f-047c77e339fb\") " pod="opendatahub/maas-api-key-cleanup-29722770-46bwx" Jul 06 19:30:00.564105 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:00.564067 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722770-46bwx" Jul 06 19:30:00.577136 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:00.577102 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0293831c-42e4-477e-9ab7-3c4ebebbda67" path="/var/lib/kubelet/pods/0293831c-42e4-477e-9ab7-3c4ebebbda67/volumes" Jul 06 19:30:00.718868 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:00.718836 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722770-46bwx"] Jul 06 19:30:00.720426 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:30:00.720401 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c354de6_be12_427b_b68f_047c77e339fb.slice/crio-bb7c0c05f0205e531cedef5eeecbf1ad71c67ef19f866cbb9eb27012ba32e5bc WatchSource:0}: Error finding container bb7c0c05f0205e531cedef5eeecbf1ad71c67ef19f866cbb9eb27012ba32e5bc: Status 404 returned error can't find the container with id bb7c0c05f0205e531cedef5eeecbf1ad71c67ef19f866cbb9eb27012ba32e5bc Jul 06 19:30:01.734866 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:01.734829 2567 generic.go:356] "Generic (PLEG): container finished" podID="7c354de6-be12-427b-b68f-047c77e339fb" containerID="e38bef419558b3c5ca4562769cffc30c1966a0465ca98caf3df7d9c6b423c4df" exitCode=0 Jul 06 19:30:01.735234 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:01.734913 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722770-46bwx" event={"ID":"7c354de6-be12-427b-b68f-047c77e339fb","Type":"ContainerDied","Data":"e38bef419558b3c5ca4562769cffc30c1966a0465ca98caf3df7d9c6b423c4df"} Jul 06 19:30:01.735234 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:01.734965 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722770-46bwx" event={"ID":"7c354de6-be12-427b-b68f-047c77e339fb","Type":"ContainerStarted","Data":"bb7c0c05f0205e531cedef5eeecbf1ad71c67ef19f866cbb9eb27012ba32e5bc"} Jul 06 19:30:02.871107 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:02.871084 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722770-46bwx" Jul 06 19:30:02.941129 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:02.941100 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7h6ts\" (UniqueName: \"kubernetes.io/projected/7c354de6-be12-427b-b68f-047c77e339fb-kube-api-access-7h6ts\") pod \"7c354de6-be12-427b-b68f-047c77e339fb\" (UID: \"7c354de6-be12-427b-b68f-047c77e339fb\") " Jul 06 19:30:02.943123 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:02.943096 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c354de6-be12-427b-b68f-047c77e339fb-kube-api-access-7h6ts" (OuterVolumeSpecName: "kube-api-access-7h6ts") pod "7c354de6-be12-427b-b68f-047c77e339fb" (UID: "7c354de6-be12-427b-b68f-047c77e339fb"). InnerVolumeSpecName "kube-api-access-7h6ts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:30:03.042603 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:03.042533 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7h6ts\" (UniqueName: \"kubernetes.io/projected/7c354de6-be12-427b-b68f-047c77e339fb-kube-api-access-7h6ts\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:30:03.746746 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:03.746715 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722770-46bwx" Jul 06 19:30:03.746746 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:03.746722 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722770-46bwx" event={"ID":"7c354de6-be12-427b-b68f-047c77e339fb","Type":"ContainerDied","Data":"bb7c0c05f0205e531cedef5eeecbf1ad71c67ef19f866cbb9eb27012ba32e5bc"} Jul 06 19:30:03.746998 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:03.746763 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb7c0c05f0205e531cedef5eeecbf1ad71c67ef19f866cbb9eb27012ba32e5bc" Jul 06 19:30:07.727354 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.727324 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6"] Jul 06 19:30:07.727831 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.727688 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c354de6-be12-427b-b68f-047c77e339fb" containerName="cleanup" Jul 06 19:30:07.727831 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.727699 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c354de6-be12-427b-b68f-047c77e339fb" containerName="cleanup" Jul 06 19:30:07.727831 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.727725 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0293831c-42e4-477e-9ab7-3c4ebebbda67" containerName="istio-proxy" Jul 06 19:30:07.727831 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.727730 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0293831c-42e4-477e-9ab7-3c4ebebbda67" containerName="istio-proxy" Jul 06 19:30:07.727831 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.727787 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="11daf41e-00d0-4f44-b7b0-db3bc49d2da6" containerName="istio-proxy" Jul 06 19:30:07.727831 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.727794 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c354de6-be12-427b-b68f-047c77e339fb" containerName="cleanup" Jul 06 19:30:07.731012 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.730994 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.786236 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.786205 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-workload-certs\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.786391 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.786247 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-workload-socket\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.786391 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.786333 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-istio-data\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.786391 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.786376 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c25d25-515b-4b48-9183-d6dd360558a5-istio-token\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.786557 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.786402 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-credential-socket\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.786557 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.786430 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc824\" (UniqueName: \"kubernetes.io/projected/50c25d25-515b-4b48-9183-d6dd360558a5-kube-api-access-dc824\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.786557 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.786524 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c25d25-515b-4b48-9183-d6dd360558a5-istio-podinfo\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.786670 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.786564 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c25d25-515b-4b48-9183-d6dd360558a5-istiod-ca-cert\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.786670 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.786584 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-istio-envoy\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.886985 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.886954 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c25d25-515b-4b48-9183-d6dd360558a5-istio-token\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.886985 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.886985 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-credential-socket\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.887216 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.887003 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc824\" (UniqueName: \"kubernetes.io/projected/50c25d25-515b-4b48-9183-d6dd360558a5-kube-api-access-dc824\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.887216 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.887051 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c25d25-515b-4b48-9183-d6dd360558a5-istio-podinfo\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.887216 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.887100 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c25d25-515b-4b48-9183-d6dd360558a5-istiod-ca-cert\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.887216 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.887128 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-istio-envoy\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.887415 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.887242 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-workload-certs\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.887415 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.887284 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-workload-socket\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.887415 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.887318 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-istio-data\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.887612 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.887423 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-credential-socket\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.887723 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.887702 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-workload-certs\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.887782 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.887736 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-workload-socket\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.887782 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.887776 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-istio-data\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.887861 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.887844 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c25d25-515b-4b48-9183-d6dd360558a5-istiod-ca-cert\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.889881 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.889863 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-istio-envoy\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.890134 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.890113 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c25d25-515b-4b48-9183-d6dd360558a5-istio-podinfo\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.905012 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.904981 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c25d25-515b-4b48-9183-d6dd360558a5-istio-token\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:07.906408 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:07.906381 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc824\" (UniqueName: \"kubernetes.io/projected/50c25d25-515b-4b48-9183-d6dd360558a5-kube-api-access-dc824\") pod \"e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:08.029025 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:08.028954 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6"] Jul 06 19:30:08.041484 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:08.041443 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:08.211277 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:08.211249 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6"] Jul 06 19:30:08.212708 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:30:08.212684 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50c25d25_515b_4b48_9183_d6dd360558a5.slice/crio-c4836644b6635bee4cf24f0f779d3680193d38ffecb1bc92ba07826790f117e1 WatchSource:0}: Error finding container c4836644b6635bee4cf24f0f779d3680193d38ffecb1bc92ba07826790f117e1: Status 404 returned error can't find the container with id c4836644b6635bee4cf24f0f779d3680193d38ffecb1bc92ba07826790f117e1 Jul 06 19:30:08.214754 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:08.214718 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:30:08.214861 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:08.214797 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:30:08.214861 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:08.214842 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:30:08.773964 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:08.773926 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" event={"ID":"50c25d25-515b-4b48-9183-d6dd360558a5","Type":"ContainerStarted","Data":"e6e54c0cef5579eaeb6d503842e15f3aecf342244d3d63aa077932913290e5ad"} Jul 06 19:30:08.774354 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:08.773986 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" event={"ID":"50c25d25-515b-4b48-9183-d6dd360558a5","Type":"ContainerStarted","Data":"c4836644b6635bee4cf24f0f779d3680193d38ffecb1bc92ba07826790f117e1"} Jul 06 19:30:08.806797 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:08.806747 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" podStartSLOduration=1.806733639 podStartE2EDuration="1.806733639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:08.806600584 +0000 UTC m=+2116.733035132" watchObservedRunningTime="2026-07-06 19:30:08.806733639 +0000 UTC m=+2116.733168188" Jul 06 19:30:09.042522 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:09.042409 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:09.047328 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:09.047306 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:09.779772 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:09.779737 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:09.780742 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:09.780724 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:16.821741 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:16.821702 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx"] Jul 06 19:30:16.825750 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:16.825728 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:16.838953 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:16.838933 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-a30d6b-openshift-default-dockercfg-hlv7h\"" Jul 06 19:30:16.853897 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:16.853875 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx"] Jul 06 19:30:16.964936 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:16.964907 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-workload-certs\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:16.965116 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:16.964944 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-podinfo\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:16.965116 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:16.964967 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2mn4\" (UniqueName: \"kubernetes.io/projected/b4fb669a-a9da-4664-a17c-449b4f1065a3-kube-api-access-m2mn4\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:16.965116 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:16.965061 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4fb669a-a9da-4664-a17c-449b4f1065a3-istiod-ca-cert\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:16.965269 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:16.965100 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-data\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:16.965269 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:16.965151 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-credential-socket\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:16.965269 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:16.965178 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-token\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:16.965269 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:16.965220 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-workload-socket\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:16.965403 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:16.965276 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-envoy\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:17.066527 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.066456 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-envoy\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:17.066690 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.066598 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-workload-certs\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:17.066690 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.066634 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-podinfo\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:17.066690 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.066663 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2mn4\" (UniqueName: \"kubernetes.io/projected/b4fb669a-a9da-4664-a17c-449b4f1065a3-kube-api-access-m2mn4\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:17.066845 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.066696 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4fb669a-a9da-4664-a17c-449b4f1065a3-istiod-ca-cert\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:17.066845 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.066729 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-data\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:17.066845 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.066759 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-credential-socket\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:17.066845 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.066785 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-token\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:17.066845 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.066812 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-workload-socket\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:17.067190 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.067142 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-credential-socket\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:17.067265 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.067202 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-data\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:17.067382 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.067362 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-workload-socket\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:17.067449 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.067433 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-workload-certs\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:17.067641 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.067622 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4fb669a-a9da-4664-a17c-449b4f1065a3-istiod-ca-cert\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:17.068879 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.068850 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-envoy\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:17.069193 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.069172 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-podinfo\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:17.091615 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.091560 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-token\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:17.093785 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.093757 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2mn4\" (UniqueName: \"kubernetes.io/projected/b4fb669a-a9da-4664-a17c-449b4f1065a3-kube-api-access-m2mn4\") pod \"e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:17.136233 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.136211 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:17.304714 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.304686 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx"] Jul 06 19:30:17.306376 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:30:17.306351 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4fb669a_a9da_4664_a17c_449b4f1065a3.slice/crio-bc0162c1cae014686c5142dc7de0261dbfdcd145fcfbc2fd9feb88d767a7751f WatchSource:0}: Error finding container bc0162c1cae014686c5142dc7de0261dbfdcd145fcfbc2fd9feb88d767a7751f: Status 404 returned error can't find the container with id bc0162c1cae014686c5142dc7de0261dbfdcd145fcfbc2fd9feb88d767a7751f Jul 06 19:30:17.308717 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.308681 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:30:17.308833 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.308763 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:30:17.308833 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.308808 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:30:17.824958 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.824920 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" event={"ID":"b4fb669a-a9da-4664-a17c-449b4f1065a3","Type":"ContainerStarted","Data":"e1f204f77b40f5786a555262510dbf29c1219599742f3d504a04465dd3eac732"} Jul 06 19:30:17.825343 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.824976 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" event={"ID":"b4fb669a-a9da-4664-a17c-449b4f1065a3","Type":"ContainerStarted","Data":"bc0162c1cae014686c5142dc7de0261dbfdcd145fcfbc2fd9feb88d767a7751f"} Jul 06 19:30:17.890697 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:17.890637 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" podStartSLOduration=1.890616454 podStartE2EDuration="1.890616454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:17.887429121 +0000 UTC m=+2125.813863671" watchObservedRunningTime="2026-07-06 19:30:17.890616454 +0000 UTC m=+2125.817051004" Jul 06 19:30:18.138358 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:18.138261 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:18.152617 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:18.152581 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:18.832337 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:18.832303 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:18.833363 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:18.833340 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:22.686880 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:22.686849 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wdtbt" Jul 06 19:30:24.897931 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:24.896415 2567 patch_prober.go:28] interesting pod/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": read tcp 10.132.0.2:46070->10.132.0.56:15021: read: connection reset by peer" start-of-body= Jul 06 19:30:24.897931 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:24.896521 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" podUID="50c25d25-515b-4b48-9183-d6dd360558a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": read tcp 10.132.0.2:46070->10.132.0.56:15021: read: connection reset by peer" Jul 06 19:30:25.881774 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:25.881737 2567 generic.go:356] "Generic (PLEG): container finished" podID="50c25d25-515b-4b48-9183-d6dd360558a5" containerID="e6e54c0cef5579eaeb6d503842e15f3aecf342244d3d63aa077932913290e5ad" exitCode=0 Jul 06 19:30:25.881962 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:25.881812 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" event={"ID":"50c25d25-515b-4b48-9183-d6dd360558a5","Type":"ContainerDied","Data":"e6e54c0cef5579eaeb6d503842e15f3aecf342244d3d63aa077932913290e5ad"} Jul 06 19:30:25.882217 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:25.882201 2567 scope.go:117] "RemoveContainer" containerID="e6e54c0cef5579eaeb6d503842e15f3aecf342244d3d63aa077932913290e5ad" Jul 06 19:30:25.883261 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:25.883232 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:30:25.883352 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:25.883301 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:30:25.883352 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:25.883338 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:30:26.889086 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:26.889055 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" event={"ID":"50c25d25-515b-4b48-9183-d6dd360558a5","Type":"ContainerStarted","Data":"4281feab509dc65adc8167ae4962a2276e2fa5bfca4af45bf8afc088458041ad"} Jul 06 19:30:27.041859 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:27.041824 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:27.042152 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:27.042118 2567 patch_prober.go:28] interesting pod/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 06 19:30:27.042269 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:27.042180 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" podUID="50c25d25-515b-4b48-9183-d6dd360558a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 06 19:30:28.042669 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:28.042632 2567 patch_prober.go:28] interesting pod/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 06 19:30:28.043220 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:28.043191 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" podUID="50c25d25-515b-4b48-9183-d6dd360558a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 06 19:30:29.042664 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:29.042620 2567 patch_prober.go:28] interesting pod/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 06 19:30:29.043172 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:29.042688 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" podUID="50c25d25-515b-4b48-9183-d6dd360558a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 06 19:30:30.042655 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:30.042152 2567 patch_prober.go:28] interesting pod/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 06 19:30:30.042655 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:30.042252 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" podUID="50c25d25-515b-4b48-9183-d6dd360558a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 06 19:30:31.045928 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:31.045896 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:31.046328 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:31.046305 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:31.047055 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:31.047036 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:32.926155 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:32.926124 2567 generic.go:356] "Generic (PLEG): container finished" podID="b4fb669a-a9da-4664-a17c-449b4f1065a3" containerID="e1f204f77b40f5786a555262510dbf29c1219599742f3d504a04465dd3eac732" exitCode=0 Jul 06 19:30:32.926625 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:32.926207 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" event={"ID":"b4fb669a-a9da-4664-a17c-449b4f1065a3","Type":"ContainerDied","Data":"e1f204f77b40f5786a555262510dbf29c1219599742f3d504a04465dd3eac732"} Jul 06 19:30:32.926777 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:32.926754 2567 scope.go:117] "RemoveContainer" containerID="e1f204f77b40f5786a555262510dbf29c1219599742f3d504a04465dd3eac732" Jul 06 19:30:32.927809 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:32.927776 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:30:32.927919 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:32.927851 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:30:32.927919 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:32.927884 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:30:33.832597 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:33.832561 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:33.939962 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:33.939920 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" event={"ID":"b4fb669a-a9da-4664-a17c-449b4f1065a3","Type":"ContainerStarted","Data":"163e9dbd7947012734710472eee1a61c9d0ac34e0c16fcf59dbd4c2b1715aa82"} Jul 06 19:30:34.136944 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:34.136844 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:34.138026 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:34.137992 2567 patch_prober.go:28] interesting pod/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 06 19:30:34.138162 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:34.138056 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" podUID="b4fb669a-a9da-4664-a17c-449b4f1065a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 06 19:30:35.137668 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:35.137565 2567 patch_prober.go:28] interesting pod/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 06 19:30:35.137668 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:35.137639 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" podUID="b4fb669a-a9da-4664-a17c-449b4f1065a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 06 19:30:36.137345 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:36.137299 2567 patch_prober.go:28] interesting pod/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 06 19:30:36.137565 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:36.137382 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" podUID="b4fb669a-a9da-4664-a17c-449b4f1065a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 06 19:30:37.136998 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:37.136961 2567 patch_prober.go:28] interesting pod/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 06 19:30:37.137631 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:37.137598 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" podUID="b4fb669a-a9da-4664-a17c-449b4f1065a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 06 19:30:38.141308 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:38.141272 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:38.141730 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:38.141539 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:38.142286 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:38.142265 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:39.998737 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:39.998706 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6"] Jul 06 19:30:39.999233 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:39.998933 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" podUID="50c25d25-515b-4b48-9183-d6dd360558a5" containerName="istio-proxy" containerID="cri-o://4281feab509dc65adc8167ae4962a2276e2fa5bfca4af45bf8afc088458041ad" gracePeriod=30 Jul 06 19:30:45.258315 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.258253 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:45.344709 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.344678 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c25d25-515b-4b48-9183-d6dd360558a5-istio-podinfo\") pod \"50c25d25-515b-4b48-9183-d6dd360558a5\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " Jul 06 19:30:45.344877 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.344732 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dc824\" (UniqueName: \"kubernetes.io/projected/50c25d25-515b-4b48-9183-d6dd360558a5-kube-api-access-dc824\") pod \"50c25d25-515b-4b48-9183-d6dd360558a5\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " Jul 06 19:30:45.344877 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.344766 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-istio-envoy\") pod \"50c25d25-515b-4b48-9183-d6dd360558a5\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " Jul 06 19:30:45.344877 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.344795 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-workload-certs\") pod \"50c25d25-515b-4b48-9183-d6dd360558a5\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " Jul 06 19:30:45.344877 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.344809 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c25d25-515b-4b48-9183-d6dd360558a5-istio-token\") pod \"50c25d25-515b-4b48-9183-d6dd360558a5\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " Jul 06 19:30:45.344877 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.344852 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c25d25-515b-4b48-9183-d6dd360558a5-istiod-ca-cert\") pod \"50c25d25-515b-4b48-9183-d6dd360558a5\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " Jul 06 19:30:45.345142 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.344901 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-credential-socket\") pod \"50c25d25-515b-4b48-9183-d6dd360558a5\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " Jul 06 19:30:45.345142 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.344931 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-workload-socket\") pod \"50c25d25-515b-4b48-9183-d6dd360558a5\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " Jul 06 19:30:45.345142 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.344956 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-istio-data\") pod \"50c25d25-515b-4b48-9183-d6dd360558a5\" (UID: \"50c25d25-515b-4b48-9183-d6dd360558a5\") " Jul 06 19:30:45.345314 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.345171 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "50c25d25-515b-4b48-9183-d6dd360558a5" (UID: "50c25d25-515b-4b48-9183-d6dd360558a5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:30:45.345314 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.345236 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-workload-certs\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:30:45.345437 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.345342 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "50c25d25-515b-4b48-9183-d6dd360558a5" (UID: "50c25d25-515b-4b48-9183-d6dd360558a5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:30:45.345619 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.345594 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50c25d25-515b-4b48-9183-d6dd360558a5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "50c25d25-515b-4b48-9183-d6dd360558a5" (UID: "50c25d25-515b-4b48-9183-d6dd360558a5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:30:45.345838 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.345819 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "50c25d25-515b-4b48-9183-d6dd360558a5" (UID: "50c25d25-515b-4b48-9183-d6dd360558a5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:30:45.345927 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.345892 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-istio-data" (OuterVolumeSpecName: "istio-data") pod "50c25d25-515b-4b48-9183-d6dd360558a5" (UID: "50c25d25-515b-4b48-9183-d6dd360558a5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:30:45.346900 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.346874 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/50c25d25-515b-4b48-9183-d6dd360558a5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "50c25d25-515b-4b48-9183-d6dd360558a5" (UID: "50c25d25-515b-4b48-9183-d6dd360558a5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:30:45.347070 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.347045 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50c25d25-515b-4b48-9183-d6dd360558a5-istio-token" (OuterVolumeSpecName: "istio-token") pod "50c25d25-515b-4b48-9183-d6dd360558a5" (UID: "50c25d25-515b-4b48-9183-d6dd360558a5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:30:45.347342 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.347324 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "50c25d25-515b-4b48-9183-d6dd360558a5" (UID: "50c25d25-515b-4b48-9183-d6dd360558a5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:30:45.347402 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.347356 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50c25d25-515b-4b48-9183-d6dd360558a5-kube-api-access-dc824" (OuterVolumeSpecName: "kube-api-access-dc824") pod "50c25d25-515b-4b48-9183-d6dd360558a5" (UID: "50c25d25-515b-4b48-9183-d6dd360558a5"). InnerVolumeSpecName "kube-api-access-dc824". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:30:45.445857 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.445829 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dc824\" (UniqueName: \"kubernetes.io/projected/50c25d25-515b-4b48-9183-d6dd360558a5-kube-api-access-dc824\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:30:45.445857 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.445855 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-istio-envoy\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:30:45.445857 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.445865 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c25d25-515b-4b48-9183-d6dd360558a5-istio-token\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:30:45.446111 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.445873 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c25d25-515b-4b48-9183-d6dd360558a5-istiod-ca-cert\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:30:45.446111 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.445880 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-credential-socket\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:30:45.446111 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.445888 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-workload-socket\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:30:45.446111 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.445896 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c25d25-515b-4b48-9183-d6dd360558a5-istio-data\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:30:45.446111 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:45.445904 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c25d25-515b-4b48-9183-d6dd360558a5-istio-podinfo\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:30:46.019895 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:46.019856 2567 generic.go:356] "Generic (PLEG): container finished" podID="50c25d25-515b-4b48-9183-d6dd360558a5" containerID="4281feab509dc65adc8167ae4962a2276e2fa5bfca4af45bf8afc088458041ad" exitCode=0 Jul 06 19:30:46.020067 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:46.019923 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" Jul 06 19:30:46.020067 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:46.019943 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" event={"ID":"50c25d25-515b-4b48-9183-d6dd360558a5","Type":"ContainerDied","Data":"4281feab509dc65adc8167ae4962a2276e2fa5bfca4af45bf8afc088458041ad"} Jul 06 19:30:46.020067 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:46.020022 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6" event={"ID":"50c25d25-515b-4b48-9183-d6dd360558a5","Type":"ContainerDied","Data":"c4836644b6635bee4cf24f0f779d3680193d38ffecb1bc92ba07826790f117e1"} Jul 06 19:30:46.020067 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:46.020049 2567 scope.go:117] "RemoveContainer" containerID="4281feab509dc65adc8167ae4962a2276e2fa5bfca4af45bf8afc088458041ad" Jul 06 19:30:46.029772 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:46.029755 2567 scope.go:117] "RemoveContainer" containerID="e6e54c0cef5579eaeb6d503842e15f3aecf342244d3d63aa077932913290e5ad" Jul 06 19:30:46.038245 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:46.038223 2567 scope.go:117] "RemoveContainer" containerID="4281feab509dc65adc8167ae4962a2276e2fa5bfca4af45bf8afc088458041ad" Jul 06 19:30:46.038591 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:30:46.038563 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4281feab509dc65adc8167ae4962a2276e2fa5bfca4af45bf8afc088458041ad\": container with ID starting with 4281feab509dc65adc8167ae4962a2276e2fa5bfca4af45bf8afc088458041ad not found: ID does not exist" containerID="4281feab509dc65adc8167ae4962a2276e2fa5bfca4af45bf8afc088458041ad" Jul 06 19:30:46.038671 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:46.038605 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4281feab509dc65adc8167ae4962a2276e2fa5bfca4af45bf8afc088458041ad"} err="failed to get container status \"4281feab509dc65adc8167ae4962a2276e2fa5bfca4af45bf8afc088458041ad\": rpc error: code = NotFound desc = could not find container \"4281feab509dc65adc8167ae4962a2276e2fa5bfca4af45bf8afc088458041ad\": container with ID starting with 4281feab509dc65adc8167ae4962a2276e2fa5bfca4af45bf8afc088458041ad not found: ID does not exist" Jul 06 19:30:46.038671 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:46.038625 2567 scope.go:117] "RemoveContainer" containerID="e6e54c0cef5579eaeb6d503842e15f3aecf342244d3d63aa077932913290e5ad" Jul 06 19:30:46.038903 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:30:46.038884 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6e54c0cef5579eaeb6d503842e15f3aecf342244d3d63aa077932913290e5ad\": container with ID starting with e6e54c0cef5579eaeb6d503842e15f3aecf342244d3d63aa077932913290e5ad not found: ID does not exist" containerID="e6e54c0cef5579eaeb6d503842e15f3aecf342244d3d63aa077932913290e5ad" Jul 06 19:30:46.038989 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:46.038906 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6e54c0cef5579eaeb6d503842e15f3aecf342244d3d63aa077932913290e5ad"} err="failed to get container status \"e6e54c0cef5579eaeb6d503842e15f3aecf342244d3d63aa077932913290e5ad\": rpc error: code = NotFound desc = could not find container \"e6e54c0cef5579eaeb6d503842e15f3aecf342244d3d63aa077932913290e5ad\": container with ID starting with e6e54c0cef5579eaeb6d503842e15f3aecf342244d3d63aa077932913290e5ad not found: ID does not exist" Jul 06 19:30:46.046966 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:46.046945 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6"] Jul 06 19:30:46.051853 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:46.051821 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-ebed37-openshift-default-5cb487995f-wsbs6"] Jul 06 19:30:46.575464 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:46.575429 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50c25d25-515b-4b48-9183-d6dd360558a5" path="/var/lib/kubelet/pods/50c25d25-515b-4b48-9183-d6dd360558a5/volumes" Jul 06 19:30:46.968226 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:46.968195 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx"] Jul 06 19:30:46.968445 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:46.968422 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" podUID="b4fb669a-a9da-4664-a17c-449b4f1065a3" containerName="istio-proxy" containerID="cri-o://163e9dbd7947012734710472eee1a61c9d0ac34e0c16fcf59dbd4c2b1715aa82" gracePeriod=30 Jul 06 19:30:47.920941 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:47.920906 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh"] Jul 06 19:30:47.921313 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:47.921271 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50c25d25-515b-4b48-9183-d6dd360558a5" containerName="istio-proxy" Jul 06 19:30:47.921313 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:47.921284 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="50c25d25-515b-4b48-9183-d6dd360558a5" containerName="istio-proxy" Jul 06 19:30:47.921313 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:47.921293 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50c25d25-515b-4b48-9183-d6dd360558a5" containerName="istio-proxy" Jul 06 19:30:47.921313 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:47.921299 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="50c25d25-515b-4b48-9183-d6dd360558a5" containerName="istio-proxy" Jul 06 19:30:47.921459 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:47.921366 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="50c25d25-515b-4b48-9183-d6dd360558a5" containerName="istio-proxy" Jul 06 19:30:47.921459 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:47.921375 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="50c25d25-515b-4b48-9183-d6dd360558a5" containerName="istio-proxy" Jul 06 19:30:47.925946 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:47.925924 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:47.933791 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:30:47.933759 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" is forbidden: User \"system:node:ip-10-0-139-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-154.ec2.internal' and this object" podUID="a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:47.934098 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:30:47.934076 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"e2e-shared-a-3550d9-openshift-default-dockercfg-vwdc2\" is forbidden: User \"system:node:ip-10-0-139-154.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-154.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-3550d9-openshift-default-dockercfg-vwdc2\"" type="*v1.Secret" Jul 06 19:30:47.969205 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:47.969177 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-credential-socket\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:47.969368 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:47.969209 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-data\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:47.969368 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:47.969234 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z264z\" (UniqueName: \"kubernetes.io/projected/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-kube-api-access-z264z\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:47.969368 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:47.969270 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-token\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:47.969368 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:47.969299 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-podinfo\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:47.969627 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:47.969367 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-envoy\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:47.969627 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:47.969403 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-workload-socket\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:47.969627 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:47.969458 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-workload-certs\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:47.969627 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:47.969525 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istiod-ca-cert\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:47.994312 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:47.994280 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh"] Jul 06 19:30:48.070034 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:48.069996 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-envoy\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:48.070034 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:48.070033 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-workload-socket\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:48.070285 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:48.070053 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-workload-certs\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:48.070285 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:48.070182 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istiod-ca-cert\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:48.070403 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:48.070306 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-credential-socket\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:48.070403 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:48.070343 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-data\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:48.070403 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:48.070370 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z264z\" (UniqueName: \"kubernetes.io/projected/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-kube-api-access-z264z\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:48.070813 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:48.070791 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-token\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:48.070872 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:48.070839 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-podinfo\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:48.070872 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:48.070468 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-workload-certs\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:48.070961 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:48.070447 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-workload-socket\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:48.070961 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:48.070707 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-credential-socket\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:48.070961 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:48.070694 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-data\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:48.071075 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:48.070999 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istiod-ca-cert\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:48.072453 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:48.072432 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-envoy\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:48.073181 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:48.073155 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-podinfo\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:48.079723 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:48.079698 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z264z\" (UniqueName: \"kubernetes.io/projected/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-kube-api-access-z264z\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:48.079890 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:48.079869 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-token\") pod \"e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:49.145043 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:49.145013 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-3550d9-openshift-default-dockercfg-vwdc2\"" Jul 06 19:30:49.147119 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:49.147092 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:49.305896 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:49.305872 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh"] Jul 06 19:30:49.307702 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:30:49.307672 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e4a090_13a4_40cc_ae07_3aaaa4ce7b63.slice/crio-6f91ec887bde042aee87165b157fb46a65c2fd487991d1131725e0c7f064f944 WatchSource:0}: Error finding container 6f91ec887bde042aee87165b157fb46a65c2fd487991d1131725e0c7f064f944: Status 404 returned error can't find the container with id 6f91ec887bde042aee87165b157fb46a65c2fd487991d1131725e0c7f064f944 Jul 06 19:30:49.309859 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:49.309827 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:30:49.309950 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:49.309893 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:30:49.309950 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:49.309922 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:30:50.044204 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:50.044162 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" event={"ID":"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63","Type":"ContainerStarted","Data":"46f088fcd760c427442ecf554edf86f4f4fabd7fbabe5304e096fa6a59985c58"} Jul 06 19:30:50.044390 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:50.044262 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" event={"ID":"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63","Type":"ContainerStarted","Data":"6f91ec887bde042aee87165b157fb46a65c2fd487991d1131725e0c7f064f944"} Jul 06 19:30:50.080768 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:50.080716 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" podStartSLOduration=3.080701162 podStartE2EDuration="3.080701162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:50.080344101 +0000 UTC m=+2158.006778651" watchObservedRunningTime="2026-07-06 19:30:50.080701162 +0000 UTC m=+2158.007135710" Jul 06 19:30:50.147772 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:50.147734 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:50.152879 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:50.152854 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:51.050219 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:51.050191 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:51.051114 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:51.051092 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:30:52.221798 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.221776 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:52.309819 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.309743 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-token\") pod \"b4fb669a-a9da-4664-a17c-449b4f1065a3\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " Jul 06 19:30:52.309969 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.309820 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2mn4\" (UniqueName: \"kubernetes.io/projected/b4fb669a-a9da-4664-a17c-449b4f1065a3-kube-api-access-m2mn4\") pod \"b4fb669a-a9da-4664-a17c-449b4f1065a3\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " Jul 06 19:30:52.309969 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.309913 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-credential-socket\") pod \"b4fb669a-a9da-4664-a17c-449b4f1065a3\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " Jul 06 19:30:52.309969 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.309947 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-data\") pod \"b4fb669a-a9da-4664-a17c-449b4f1065a3\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " Jul 06 19:30:52.310143 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.309982 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-workload-socket\") pod \"b4fb669a-a9da-4664-a17c-449b4f1065a3\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " Jul 06 19:30:52.310143 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.310015 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-workload-certs\") pod \"b4fb669a-a9da-4664-a17c-449b4f1065a3\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " Jul 06 19:30:52.310143 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.310047 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-podinfo\") pod \"b4fb669a-a9da-4664-a17c-449b4f1065a3\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " Jul 06 19:30:52.310143 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.310070 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-envoy\") pod \"b4fb669a-a9da-4664-a17c-449b4f1065a3\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " Jul 06 19:30:52.310143 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.310132 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4fb669a-a9da-4664-a17c-449b4f1065a3-istiod-ca-cert\") pod \"b4fb669a-a9da-4664-a17c-449b4f1065a3\" (UID: \"b4fb669a-a9da-4664-a17c-449b4f1065a3\") " Jul 06 19:30:52.310404 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.310247 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b4fb669a-a9da-4664-a17c-449b4f1065a3" (UID: "b4fb669a-a9da-4664-a17c-449b4f1065a3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:30:52.310404 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.310285 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b4fb669a-a9da-4664-a17c-449b4f1065a3" (UID: "b4fb669a-a9da-4664-a17c-449b4f1065a3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:30:52.310560 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.310517 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b4fb669a-a9da-4664-a17c-449b4f1065a3" (UID: "b4fb669a-a9da-4664-a17c-449b4f1065a3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:30:52.310560 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.310531 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-workload-socket\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:30:52.310560 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.310554 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-workload-certs\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:30:52.310731 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.310612 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4fb669a-a9da-4664-a17c-449b4f1065a3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b4fb669a-a9da-4664-a17c-449b4f1065a3" (UID: "b4fb669a-a9da-4664-a17c-449b4f1065a3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:30:52.310981 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.310945 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-data" (OuterVolumeSpecName: "istio-data") pod "b4fb669a-a9da-4664-a17c-449b4f1065a3" (UID: "b4fb669a-a9da-4664-a17c-449b4f1065a3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:30:52.312191 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.312166 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-token" (OuterVolumeSpecName: "istio-token") pod "b4fb669a-a9da-4664-a17c-449b4f1065a3" (UID: "b4fb669a-a9da-4664-a17c-449b4f1065a3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:30:52.312317 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.312298 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b4fb669a-a9da-4664-a17c-449b4f1065a3" (UID: "b4fb669a-a9da-4664-a17c-449b4f1065a3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:30:52.312373 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.312320 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4fb669a-a9da-4664-a17c-449b4f1065a3-kube-api-access-m2mn4" (OuterVolumeSpecName: "kube-api-access-m2mn4") pod "b4fb669a-a9da-4664-a17c-449b4f1065a3" (UID: "b4fb669a-a9da-4664-a17c-449b4f1065a3"). InnerVolumeSpecName "kube-api-access-m2mn4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:30:52.312454 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.312440 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b4fb669a-a9da-4664-a17c-449b4f1065a3" (UID: "b4fb669a-a9da-4664-a17c-449b4f1065a3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:30:52.411239 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.411208 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-token\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:30:52.411239 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.411236 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2mn4\" (UniqueName: \"kubernetes.io/projected/b4fb669a-a9da-4664-a17c-449b4f1065a3-kube-api-access-m2mn4\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:30:52.411239 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.411246 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-credential-socket\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:30:52.411489 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.411254 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-data\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:30:52.411489 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.411263 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-podinfo\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:30:52.411489 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.411271 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4fb669a-a9da-4664-a17c-449b4f1065a3-istio-envoy\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:30:52.411489 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:52.411279 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4fb669a-a9da-4664-a17c-449b4f1065a3-istiod-ca-cert\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:30:53.062293 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:53.062262 2567 generic.go:356] "Generic (PLEG): container finished" podID="b4fb669a-a9da-4664-a17c-449b4f1065a3" containerID="163e9dbd7947012734710472eee1a61c9d0ac34e0c16fcf59dbd4c2b1715aa82" exitCode=0 Jul 06 19:30:53.062466 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:53.062309 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" Jul 06 19:30:53.062466 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:53.062345 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" event={"ID":"b4fb669a-a9da-4664-a17c-449b4f1065a3","Type":"ContainerDied","Data":"163e9dbd7947012734710472eee1a61c9d0ac34e0c16fcf59dbd4c2b1715aa82"} Jul 06 19:30:53.062466 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:53.062398 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx" event={"ID":"b4fb669a-a9da-4664-a17c-449b4f1065a3","Type":"ContainerDied","Data":"bc0162c1cae014686c5142dc7de0261dbfdcd145fcfbc2fd9feb88d767a7751f"} Jul 06 19:30:53.062466 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:53.062427 2567 scope.go:117] "RemoveContainer" containerID="163e9dbd7947012734710472eee1a61c9d0ac34e0c16fcf59dbd4c2b1715aa82" Jul 06 19:30:53.071407 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:53.071391 2567 scope.go:117] "RemoveContainer" containerID="e1f204f77b40f5786a555262510dbf29c1219599742f3d504a04465dd3eac732" Jul 06 19:30:53.079605 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:53.079582 2567 scope.go:117] "RemoveContainer" containerID="163e9dbd7947012734710472eee1a61c9d0ac34e0c16fcf59dbd4c2b1715aa82" Jul 06 19:30:53.079865 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:30:53.079838 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"163e9dbd7947012734710472eee1a61c9d0ac34e0c16fcf59dbd4c2b1715aa82\": container with ID starting with 163e9dbd7947012734710472eee1a61c9d0ac34e0c16fcf59dbd4c2b1715aa82 not found: ID does not exist" containerID="163e9dbd7947012734710472eee1a61c9d0ac34e0c16fcf59dbd4c2b1715aa82" Jul 06 19:30:53.079966 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:53.079866 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"163e9dbd7947012734710472eee1a61c9d0ac34e0c16fcf59dbd4c2b1715aa82"} err="failed to get container status \"163e9dbd7947012734710472eee1a61c9d0ac34e0c16fcf59dbd4c2b1715aa82\": rpc error: code = NotFound desc = could not find container \"163e9dbd7947012734710472eee1a61c9d0ac34e0c16fcf59dbd4c2b1715aa82\": container with ID starting with 163e9dbd7947012734710472eee1a61c9d0ac34e0c16fcf59dbd4c2b1715aa82 not found: ID does not exist" Jul 06 19:30:53.079966 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:53.079891 2567 scope.go:117] "RemoveContainer" containerID="e1f204f77b40f5786a555262510dbf29c1219599742f3d504a04465dd3eac732" Jul 06 19:30:53.080205 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:30:53.080181 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1f204f77b40f5786a555262510dbf29c1219599742f3d504a04465dd3eac732\": container with ID starting with e1f204f77b40f5786a555262510dbf29c1219599742f3d504a04465dd3eac732 not found: ID does not exist" containerID="e1f204f77b40f5786a555262510dbf29c1219599742f3d504a04465dd3eac732" Jul 06 19:30:53.080263 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:53.080217 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1f204f77b40f5786a555262510dbf29c1219599742f3d504a04465dd3eac732"} err="failed to get container status \"e1f204f77b40f5786a555262510dbf29c1219599742f3d504a04465dd3eac732\": rpc error: code = NotFound desc = could not find container \"e1f204f77b40f5786a555262510dbf29c1219599742f3d504a04465dd3eac732\": container with ID starting with e1f204f77b40f5786a555262510dbf29c1219599742f3d504a04465dd3eac732 not found: ID does not exist" Jul 06 19:30:53.111024 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:53.110995 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx"] Jul 06 19:30:53.120527 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:53.120498 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-a30d6b-openshift-default-7468d574c7-bwwdx"] Jul 06 19:30:54.576208 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:54.576173 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4fb669a-a9da-4664-a17c-449b4f1065a3" path="/var/lib/kubelet/pods/b4fb669a-a9da-4664-a17c-449b4f1065a3/volumes" Jul 06 19:30:57.461730 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.461691 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk"] Jul 06 19:30:57.462126 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.462064 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4fb669a-a9da-4664-a17c-449b4f1065a3" containerName="istio-proxy" Jul 06 19:30:57.462126 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.462076 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4fb669a-a9da-4664-a17c-449b4f1065a3" containerName="istio-proxy" Jul 06 19:30:57.462126 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.462084 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4fb669a-a9da-4664-a17c-449b4f1065a3" containerName="istio-proxy" Jul 06 19:30:57.462126 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.462090 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4fb669a-a9da-4664-a17c-449b4f1065a3" containerName="istio-proxy" Jul 06 19:30:57.462256 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.462152 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4fb669a-a9da-4664-a17c-449b4f1065a3" containerName="istio-proxy" Jul 06 19:30:57.465267 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.465244 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.470651 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.470625 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-06f95c-openshift-default-dockercfg-8qdkp\"" Jul 06 19:30:57.502735 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.502702 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk"] Jul 06 19:30:57.559734 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.559688 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-workload-certs\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.559991 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.559971 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-token\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.560114 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.560099 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpp94\" (UniqueName: \"kubernetes.io/projected/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-kube-api-access-rpp94\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.560237 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.560222 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istiod-ca-cert\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.560375 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.560358 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-envoy\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.560531 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.560511 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-workload-socket\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.560743 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.560726 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-data\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.560875 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.560858 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-credential-socket\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.560985 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.560971 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-podinfo\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.662323 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.662291 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-data\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.662537 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.662333 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-credential-socket\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.662537 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.662356 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-podinfo\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.662537 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.662408 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-workload-certs\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.662537 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.662438 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-token\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.662537 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.662493 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpp94\" (UniqueName: \"kubernetes.io/projected/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-kube-api-access-rpp94\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.662537 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.662527 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istiod-ca-cert\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.662887 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.662583 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-envoy\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.662887 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.662610 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-workload-socket\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.662887 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.662771 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-data\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.662887 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.662803 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-workload-certs\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.663042 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.662998 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-workload-socket\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.663169 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.663151 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-credential-socket\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.663342 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.663316 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istiod-ca-cert\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.664777 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.664757 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-envoy\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.665009 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.664988 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-podinfo\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.677724 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.677698 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpp94\" (UniqueName: \"kubernetes.io/projected/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-kube-api-access-rpp94\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.679335 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.679312 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-token\") pod \"e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.775559 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.775456 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:57.958725 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.958697 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk"] Jul 06 19:30:57.961868 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:30:57.961840 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeccb86ad_dcf6_4f66_9356_3e01b9f7ba5c.slice/crio-8e6b90643d2fb07e9fa24b346f41c0f3d03b246bf6bd21b0c1a31753dc31a8a5 WatchSource:0}: Error finding container 8e6b90643d2fb07e9fa24b346f41c0f3d03b246bf6bd21b0c1a31753dc31a8a5: Status 404 returned error can't find the container with id 8e6b90643d2fb07e9fa24b346f41c0f3d03b246bf6bd21b0c1a31753dc31a8a5 Jul 06 19:30:57.963921 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.963887 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:30:57.964008 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.963953 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:30:57.964008 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:57.963985 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:30:58.093618 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:58.093506 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" event={"ID":"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c","Type":"ContainerStarted","Data":"113ec05d83cdf535ba68e5336254d8e9cf3d0852a769840e13b86ed5a3843b5a"} Jul 06 19:30:58.093618 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:58.093575 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" event={"ID":"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c","Type":"ContainerStarted","Data":"8e6b90643d2fb07e9fa24b346f41c0f3d03b246bf6bd21b0c1a31753dc31a8a5"} Jul 06 19:30:58.125302 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:58.125239 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" podStartSLOduration=1.125222889 podStartE2EDuration="1.125222889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:58.124003372 +0000 UTC m=+2166.050437922" watchObservedRunningTime="2026-07-06 19:30:58.125222889 +0000 UTC m=+2166.051657437" Jul 06 19:30:58.775945 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:58.775911 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:30:59.780643 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:30:59.780609 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:31:00.104798 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:00.104708 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:31:00.105529 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:00.105511 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:31:04.131734 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:04.131650 2567 generic.go:356] "Generic (PLEG): container finished" podID="a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" containerID="46f088fcd760c427442ecf554edf86f4f4fabd7fbabe5304e096fa6a59985c58" exitCode=0 Jul 06 19:31:04.132228 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:04.131725 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" event={"ID":"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63","Type":"ContainerDied","Data":"46f088fcd760c427442ecf554edf86f4f4fabd7fbabe5304e096fa6a59985c58"} Jul 06 19:31:04.132228 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:04.132201 2567 scope.go:117] "RemoveContainer" containerID="46f088fcd760c427442ecf554edf86f4f4fabd7fbabe5304e096fa6a59985c58" Jul 06 19:31:04.133234 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:04.133207 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:31:04.133303 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:04.133287 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:31:04.133342 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:04.133319 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:31:05.144977 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:05.144944 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" event={"ID":"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63","Type":"ContainerStarted","Data":"81a66733e7db889c211acffebbd785c30a78dce6542f4797a0b5492e4444c266"} Jul 06 19:31:05.149358 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:05.149329 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:31:05.149676 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:05.149650 2567 patch_prober.go:28] interesting pod/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 06 19:31:05.149837 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:05.149812 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" podUID="a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 06 19:31:06.050664 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:06.050628 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:31:06.149985 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:06.149942 2567 patch_prober.go:28] interesting pod/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 06 19:31:06.150464 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:06.150018 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" podUID="a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 06 19:31:07.147627 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:07.147589 2567 patch_prober.go:28] interesting pod/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 06 19:31:07.147891 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:07.147863 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" podUID="a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 06 19:31:08.148292 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:08.148251 2567 patch_prober.go:28] interesting pod/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 06 19:31:08.148974 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:08.148938 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" podUID="a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 06 19:31:09.148347 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:09.148309 2567 patch_prober.go:28] interesting pod/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 06 19:31:09.149000 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:09.148967 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" podUID="a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 06 19:31:10.156651 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:10.156618 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:31:10.157813 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:10.157790 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:31:14.213062 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:14.213024 2567 generic.go:356] "Generic (PLEG): container finished" podID="eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" containerID="113ec05d83cdf535ba68e5336254d8e9cf3d0852a769840e13b86ed5a3843b5a" exitCode=0 Jul 06 19:31:14.213657 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:14.213106 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" event={"ID":"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c","Type":"ContainerDied","Data":"113ec05d83cdf535ba68e5336254d8e9cf3d0852a769840e13b86ed5a3843b5a"} Jul 06 19:31:14.213741 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:14.213658 2567 scope.go:117] "RemoveContainer" containerID="113ec05d83cdf535ba68e5336254d8e9cf3d0852a769840e13b86ed5a3843b5a" Jul 06 19:31:14.214716 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:14.214688 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:31:14.214780 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:14.214762 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:31:14.214818 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:14.214803 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:31:15.105700 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:15.105671 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:31:15.221278 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:15.221231 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" event={"ID":"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c","Type":"ContainerStarted","Data":"9d688346b712b5abbd66ac9e45d109c31b3957fba895064a7b7616921d73a93f"} Jul 06 19:31:15.775743 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:15.775706 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:31:15.776949 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:15.776920 2567 patch_prober.go:28] interesting pod/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 06 19:31:15.777096 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:15.776970 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" podUID="eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 06 19:31:16.776833 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:16.776799 2567 patch_prober.go:28] interesting pod/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 06 19:31:16.777222 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:16.776855 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" podUID="eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 06 19:31:17.776369 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:17.776338 2567 patch_prober.go:28] interesting pod/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 06 19:31:17.776615 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:17.776402 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" podUID="eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 06 19:31:18.775817 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:18.775779 2567 patch_prober.go:28] interesting pod/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 06 19:31:18.776197 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:18.775857 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" podUID="eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 06 19:31:19.780360 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:19.780330 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:31:19.780811 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:19.780718 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:31:19.781335 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:31:19.781313 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:34:52.757413 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:34:52.757383 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/1.log" Jul 06 19:34:52.763820 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:34:52.763797 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/1.log" Jul 06 19:37:55.189373 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:37:55.189335 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh"] Jul 06 19:37:55.189979 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:37:55.189627 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" podUID="a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" containerName="istio-proxy" containerID="cri-o://81a66733e7db889c211acffebbd785c30a78dce6542f4797a0b5492e4444c266" gracePeriod=30 Jul 06 19:38:00.447684 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.447661 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:38:00.493054 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.492978 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istiod-ca-cert\") pod \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " Jul 06 19:38:00.493054 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.493052 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-data\") pod \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " Jul 06 19:38:00.493250 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.493082 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-podinfo\") pod \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " Jul 06 19:38:00.493250 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.493102 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-credential-socket\") pod \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " Jul 06 19:38:00.493250 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.493123 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-token\") pod \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " Jul 06 19:38:00.493250 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.493153 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z264z\" (UniqueName: \"kubernetes.io/projected/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-kube-api-access-z264z\") pod \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " Jul 06 19:38:00.493250 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.493188 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-workload-socket\") pod \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " Jul 06 19:38:00.493250 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.493216 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-envoy\") pod \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " Jul 06 19:38:00.493250 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.493241 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-workload-certs\") pod \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\" (UID: \"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63\") " Jul 06 19:38:00.493630 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.493246 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" (UID: "a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:38:00.493630 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.493427 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" (UID: "a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:38:00.493630 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.493609 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-credential-socket\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:38:00.493630 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.493627 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istiod-ca-cert\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:38:00.493825 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.493653 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" (UID: "a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:38:00.493825 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.493779 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" (UID: "a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:38:00.494013 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.493986 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-data" (OuterVolumeSpecName: "istio-data") pod "a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" (UID: "a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:38:00.495863 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.495833 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-token" (OuterVolumeSpecName: "istio-token") pod "a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" (UID: "a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:38:00.495985 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.495883 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" (UID: "a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:38:00.495985 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.495964 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-kube-api-access-z264z" (OuterVolumeSpecName: "kube-api-access-z264z") pod "a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" (UID: "a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63"). InnerVolumeSpecName "kube-api-access-z264z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:38:00.496107 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.495999 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" (UID: "a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:38:00.502308 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.502284 2567 generic.go:356] "Generic (PLEG): container finished" podID="a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" containerID="81a66733e7db889c211acffebbd785c30a78dce6542f4797a0b5492e4444c266" exitCode=0 Jul 06 19:38:00.502426 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.502334 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" event={"ID":"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63","Type":"ContainerDied","Data":"81a66733e7db889c211acffebbd785c30a78dce6542f4797a0b5492e4444c266"} Jul 06 19:38:00.502426 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.502347 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" Jul 06 19:38:00.502426 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.502375 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh" event={"ID":"a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63","Type":"ContainerDied","Data":"6f91ec887bde042aee87165b157fb46a65c2fd487991d1131725e0c7f064f944"} Jul 06 19:38:00.502426 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.502396 2567 scope.go:117] "RemoveContainer" containerID="81a66733e7db889c211acffebbd785c30a78dce6542f4797a0b5492e4444c266" Jul 06 19:38:00.515517 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.515496 2567 scope.go:117] "RemoveContainer" containerID="46f088fcd760c427442ecf554edf86f4f4fabd7fbabe5304e096fa6a59985c58" Jul 06 19:38:00.524166 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.524148 2567 scope.go:117] "RemoveContainer" containerID="81a66733e7db889c211acffebbd785c30a78dce6542f4797a0b5492e4444c266" Jul 06 19:38:00.524415 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:38:00.524393 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81a66733e7db889c211acffebbd785c30a78dce6542f4797a0b5492e4444c266\": container with ID starting with 81a66733e7db889c211acffebbd785c30a78dce6542f4797a0b5492e4444c266 not found: ID does not exist" containerID="81a66733e7db889c211acffebbd785c30a78dce6542f4797a0b5492e4444c266" Jul 06 19:38:00.524511 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.524423 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81a66733e7db889c211acffebbd785c30a78dce6542f4797a0b5492e4444c266"} err="failed to get container status \"81a66733e7db889c211acffebbd785c30a78dce6542f4797a0b5492e4444c266\": rpc error: code = NotFound desc = could not find container \"81a66733e7db889c211acffebbd785c30a78dce6542f4797a0b5492e4444c266\": container with ID starting with 81a66733e7db889c211acffebbd785c30a78dce6542f4797a0b5492e4444c266 not found: ID does not exist" Jul 06 19:38:00.524511 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.524441 2567 scope.go:117] "RemoveContainer" containerID="46f088fcd760c427442ecf554edf86f4f4fabd7fbabe5304e096fa6a59985c58" Jul 06 19:38:00.524713 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:38:00.524698 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46f088fcd760c427442ecf554edf86f4f4fabd7fbabe5304e096fa6a59985c58\": container with ID starting with 46f088fcd760c427442ecf554edf86f4f4fabd7fbabe5304e096fa6a59985c58 not found: ID does not exist" containerID="46f088fcd760c427442ecf554edf86f4f4fabd7fbabe5304e096fa6a59985c58" Jul 06 19:38:00.524761 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.524718 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46f088fcd760c427442ecf554edf86f4f4fabd7fbabe5304e096fa6a59985c58"} err="failed to get container status \"46f088fcd760c427442ecf554edf86f4f4fabd7fbabe5304e096fa6a59985c58\": rpc error: code = NotFound desc = could not find container \"46f088fcd760c427442ecf554edf86f4f4fabd7fbabe5304e096fa6a59985c58\": container with ID starting with 46f088fcd760c427442ecf554edf86f4f4fabd7fbabe5304e096fa6a59985c58 not found: ID does not exist" Jul 06 19:38:00.601190 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.595397 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-podinfo\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:38:00.601190 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.595436 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-token\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:38:00.601190 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.595451 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z264z\" (UniqueName: \"kubernetes.io/projected/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-kube-api-access-z264z\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:38:00.601190 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.595467 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-workload-socket\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:38:00.601190 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.595512 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-envoy\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:38:00.601190 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.595532 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-workload-certs\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:38:00.601190 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:00.595544 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63-istio-data\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:38:02.739851 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:02.739818 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh"] Jul 06 19:38:02.754334 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:02.754302 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-3550d9-openshift-default-6497b6d6b7-7xjmh"] Jul 06 19:38:04.576717 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:04.576687 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" path="/var/lib/kubelet/pods/a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63/volumes" Jul 06 19:38:05.716235 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:05.716201 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk"] Jul 06 19:38:05.716658 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:05.716452 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" podUID="eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" containerName="istio-proxy" containerID="cri-o://9d688346b712b5abbd66ac9e45d109c31b3957fba895064a7b7616921d73a93f" gracePeriod=30 Jul 06 19:38:10.976556 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:10.976497 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:38:11.088299 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.088268 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-workload-socket\") pod \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " Jul 06 19:38:11.088454 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.088305 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-credential-socket\") pod \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " Jul 06 19:38:11.088454 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.088328 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpp94\" (UniqueName: \"kubernetes.io/projected/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-kube-api-access-rpp94\") pod \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " Jul 06 19:38:11.088454 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.088344 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-envoy\") pod \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " Jul 06 19:38:11.088454 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.088378 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-podinfo\") pod \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " Jul 06 19:38:11.088454 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.088402 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-data\") pod \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " Jul 06 19:38:11.088454 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.088434 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-token\") pod \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " Jul 06 19:38:11.088825 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.088517 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-workload-certs\") pod \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " Jul 06 19:38:11.088825 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.088575 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istiod-ca-cert\") pod \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\" (UID: \"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c\") " Jul 06 19:38:11.088825 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.088613 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" (UID: "eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:38:11.088825 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.088627 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" (UID: "eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:38:11.088825 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.088775 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" (UID: "eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:38:11.089087 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.088873 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-workload-socket\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:38:11.089087 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.088891 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-credential-socket\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:38:11.089087 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.088900 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-workload-certs\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:38:11.089289 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.089257 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" (UID: "eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:38:11.090118 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.090094 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-data" (OuterVolumeSpecName: "istio-data") pod "eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" (UID: "eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:38:11.090891 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.090866 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" (UID: "eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:38:11.090990 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.090909 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-kube-api-access-rpp94" (OuterVolumeSpecName: "kube-api-access-rpp94") pod "eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" (UID: "eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c"). InnerVolumeSpecName "kube-api-access-rpp94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:38:11.091047 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.091027 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-token" (OuterVolumeSpecName: "istio-token") pod "eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" (UID: "eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:38:11.091128 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.091107 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" (UID: "eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:38:11.190000 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.189962 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-podinfo\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:38:11.190000 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.189996 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-data\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:38:11.190000 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.190005 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-token\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:38:11.190000 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.190013 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istiod-ca-cert\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:38:11.190238 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.190020 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpp94\" (UniqueName: \"kubernetes.io/projected/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-kube-api-access-rpp94\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:38:11.190238 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.190029 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c-istio-envoy\") on node \"ip-10-0-139-154.ec2.internal\" DevicePath \"\"" Jul 06 19:38:11.216914 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.216890 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-wdtbt_3eae5464-ef34-4403-8b77-c52674b74f81/manager/1.log" Jul 06 19:38:11.564671 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.564632 2567 generic.go:356] "Generic (PLEG): container finished" podID="eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" containerID="9d688346b712b5abbd66ac9e45d109c31b3957fba895064a7b7616921d73a93f" exitCode=0 Jul 06 19:38:11.564816 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.564687 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" Jul 06 19:38:11.564816 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.564717 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" event={"ID":"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c","Type":"ContainerDied","Data":"9d688346b712b5abbd66ac9e45d109c31b3957fba895064a7b7616921d73a93f"} Jul 06 19:38:11.564816 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.564773 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk" event={"ID":"eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c","Type":"ContainerDied","Data":"8e6b90643d2fb07e9fa24b346f41c0f3d03b246bf6bd21b0c1a31753dc31a8a5"} Jul 06 19:38:11.564816 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.564799 2567 scope.go:117] "RemoveContainer" containerID="9d688346b712b5abbd66ac9e45d109c31b3957fba895064a7b7616921d73a93f" Jul 06 19:38:11.581407 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.581388 2567 scope.go:117] "RemoveContainer" containerID="113ec05d83cdf535ba68e5336254d8e9cf3d0852a769840e13b86ed5a3843b5a" Jul 06 19:38:11.589934 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.589916 2567 scope.go:117] "RemoveContainer" containerID="9d688346b712b5abbd66ac9e45d109c31b3957fba895064a7b7616921d73a93f" Jul 06 19:38:11.590185 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:38:11.590164 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d688346b712b5abbd66ac9e45d109c31b3957fba895064a7b7616921d73a93f\": container with ID starting with 9d688346b712b5abbd66ac9e45d109c31b3957fba895064a7b7616921d73a93f not found: ID does not exist" containerID="9d688346b712b5abbd66ac9e45d109c31b3957fba895064a7b7616921d73a93f" Jul 06 19:38:11.590231 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.590194 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d688346b712b5abbd66ac9e45d109c31b3957fba895064a7b7616921d73a93f"} err="failed to get container status \"9d688346b712b5abbd66ac9e45d109c31b3957fba895064a7b7616921d73a93f\": rpc error: code = NotFound desc = could not find container \"9d688346b712b5abbd66ac9e45d109c31b3957fba895064a7b7616921d73a93f\": container with ID starting with 9d688346b712b5abbd66ac9e45d109c31b3957fba895064a7b7616921d73a93f not found: ID does not exist" Jul 06 19:38:11.590231 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.590210 2567 scope.go:117] "RemoveContainer" containerID="113ec05d83cdf535ba68e5336254d8e9cf3d0852a769840e13b86ed5a3843b5a" Jul 06 19:38:11.590441 ip-10-0-139-154 kubenswrapper[2567]: E0706 19:38:11.590425 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"113ec05d83cdf535ba68e5336254d8e9cf3d0852a769840e13b86ed5a3843b5a\": container with ID starting with 113ec05d83cdf535ba68e5336254d8e9cf3d0852a769840e13b86ed5a3843b5a not found: ID does not exist" containerID="113ec05d83cdf535ba68e5336254d8e9cf3d0852a769840e13b86ed5a3843b5a" Jul 06 19:38:11.590516 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.590447 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"113ec05d83cdf535ba68e5336254d8e9cf3d0852a769840e13b86ed5a3843b5a"} err="failed to get container status \"113ec05d83cdf535ba68e5336254d8e9cf3d0852a769840e13b86ed5a3843b5a\": rpc error: code = NotFound desc = could not find container \"113ec05d83cdf535ba68e5336254d8e9cf3d0852a769840e13b86ed5a3843b5a\": container with ID starting with 113ec05d83cdf535ba68e5336254d8e9cf3d0852a769840e13b86ed5a3843b5a not found: ID does not exist" Jul 06 19:38:11.595704 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.595685 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk"] Jul 06 19:38:11.600796 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.600773 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-06f95c-openshift-default-7d745bcf6c-8jtsk"] Jul 06 19:38:11.616356 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.616340 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722755-t48md_5fef3d8f-6b56-43ef-bfa3-68b1bde18aca/cleanup/0.log" Jul 06 19:38:11.735527 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:11.735509 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722770-46bwx_7c354de6-be12-427b-b68f-047c77e339fb/cleanup/0.log" Jul 06 19:38:12.129762 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:12.129731 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2hwc7_fd788a33-68ae-4f84-96c2-d087b1601a38/manager/0.log" Jul 06 19:38:12.385368 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:12.385269 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546c6c6d78-j4wtj_83bcbb72-b275-43d7-b2f0-533daa61ae3d/manager/0.log" Jul 06 19:38:12.395331 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:12.395306 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546c6c6d78-j4wtj_83bcbb72-b275-43d7-b2f0-533daa61ae3d/copy-manifests/0.log" Jul 06 19:38:12.576412 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:12.576378 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" path="/var/lib/kubelet/pods/eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c/volumes" Jul 06 19:38:13.438923 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:13.438893 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc_7278c014-ec7e-4fae-98a6-3e9cdfa85700/util/0.log" Jul 06 19:38:13.446499 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:13.446444 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc_7278c014-ec7e-4fae-98a6-3e9cdfa85700/pull/0.log" Jul 06 19:38:13.453779 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:13.453752 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc_7278c014-ec7e-4fae-98a6-3e9cdfa85700/extract/0.log" Jul 06 19:38:13.575088 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:13.575062 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t_e2f0b925-1dee-405d-87ea-4102316fe940/util/0.log" Jul 06 19:38:13.587524 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:13.587495 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t_e2f0b925-1dee-405d-87ea-4102316fe940/pull/0.log" Jul 06 19:38:13.598915 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:13.598893 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t_e2f0b925-1dee-405d-87ea-4102316fe940/extract/0.log" Jul 06 19:38:13.736352 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:13.736275 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj_58068485-137c-4cac-8145-905ef660eb4b/util/0.log" Jul 06 19:38:13.747813 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:13.747787 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj_58068485-137c-4cac-8145-905ef660eb4b/pull/0.log" Jul 06 19:38:13.755774 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:13.755746 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj_58068485-137c-4cac-8145-905ef660eb4b/extract/0.log" Jul 06 19:38:13.873489 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:13.873396 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g_b951428c-bcc4-40fc-b920-a7ea13fb99e3/util/0.log" Jul 06 19:38:13.882356 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:13.882321 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g_b951428c-bcc4-40fc-b920-a7ea13fb99e3/pull/0.log" Jul 06 19:38:13.889210 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:13.889189 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g_b951428c-bcc4-40fc-b920-a7ea13fb99e3/extract/0.log" Jul 06 19:38:14.150722 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:14.150645 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jtltb_a771cd7b-c570-4948-92c6-b22b2f96dd04/manager/0.log" Jul 06 19:38:14.881939 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:14.881912 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9v49s_1bc828b2-b2ba-4d5c-a9c9-5b31c6edbed4/manager/0.log" Jul 06 19:38:15.252961 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:15.252930 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dxl6g_b78c8385-4890-4949-a303-859482f4f641/istio-proxy/0.log" Jul 06 19:38:15.381056 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:15.381029 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hj6f2_d2614794-291b-44fb-8a1f-303d48458c72/discovery/0.log" Jul 06 19:38:15.493878 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:15.493848 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c488d768d-qm8dr_3ea1fc37-774e-4877-86db-3c1f1be8c61f/kube-auth-proxy/0.log" Jul 06 19:38:15.745487 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:15.745442 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5nwsh_3df391cf-3927-4c0b-aa2b-dbf5d896d20b/istio-proxy/1.log" Jul 06 19:38:15.992530 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:15.992502 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-wrvd5_1fa5d2e7-3246-426d-82e1-9288cc2e3e31/payload-processing/0.log" Jul 06 19:38:16.113929 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:16.113834 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dc846bc67-j8qgm_16edd98b-f15f-4300-b2b1-4da848b6d588/router/0.log" Jul 06 19:38:21.107410 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.107377 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-446hm/must-gather-5nfp8"] Jul 06 19:38:21.107810 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.107777 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" containerName="istio-proxy" Jul 06 19:38:21.107810 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.107789 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" containerName="istio-proxy" Jul 06 19:38:21.107810 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.107797 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" containerName="istio-proxy" Jul 06 19:38:21.107810 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.107803 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" containerName="istio-proxy" Jul 06 19:38:21.107936 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.107826 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" containerName="istio-proxy" Jul 06 19:38:21.107936 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.107835 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" containerName="istio-proxy" Jul 06 19:38:21.107936 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.107896 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" containerName="istio-proxy" Jul 06 19:38:21.107936 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.107906 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" containerName="istio-proxy" Jul 06 19:38:21.107936 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.107914 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4fb669a-a9da-4664-a17c-449b4f1065a3" containerName="istio-proxy" Jul 06 19:38:21.107936 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.107920 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" containerName="istio-proxy" Jul 06 19:38:21.107936 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.107926 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8e4a090-13a4-40cc-ae07-3aaaa4ce7b63" containerName="istio-proxy" Jul 06 19:38:21.108146 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.108008 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" containerName="istio-proxy" Jul 06 19:38:21.108146 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.108018 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="eccb86ad-dcf6-4f66-9356-3e01b9f7ba5c" containerName="istio-proxy" Jul 06 19:38:21.112535 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.112514 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-446hm/must-gather-5nfp8" Jul 06 19:38:21.117351 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.117328 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-446hm\"/\"kube-root-ca.crt\"" Jul 06 19:38:21.117783 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.117764 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-446hm\"/\"openshift-service-ca.crt\"" Jul 06 19:38:21.118329 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.118311 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-446hm\"/\"default-dockercfg-vqxjx\"" Jul 06 19:38:21.123806 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.123783 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-446hm/must-gather-5nfp8"] Jul 06 19:38:21.179961 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.179939 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gthd\" (UniqueName: \"kubernetes.io/projected/5cdd9171-2d85-4b0a-9ba1-52857b450542-kube-api-access-2gthd\") pod \"must-gather-5nfp8\" (UID: \"5cdd9171-2d85-4b0a-9ba1-52857b450542\") " pod="openshift-must-gather-446hm/must-gather-5nfp8" Jul 06 19:38:21.180080 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.179973 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5cdd9171-2d85-4b0a-9ba1-52857b450542-must-gather-output\") pod \"must-gather-5nfp8\" (UID: \"5cdd9171-2d85-4b0a-9ba1-52857b450542\") " pod="openshift-must-gather-446hm/must-gather-5nfp8" Jul 06 19:38:21.280555 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.280527 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gthd\" (UniqueName: \"kubernetes.io/projected/5cdd9171-2d85-4b0a-9ba1-52857b450542-kube-api-access-2gthd\") pod \"must-gather-5nfp8\" (UID: \"5cdd9171-2d85-4b0a-9ba1-52857b450542\") " pod="openshift-must-gather-446hm/must-gather-5nfp8" Jul 06 19:38:21.280690 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.280562 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5cdd9171-2d85-4b0a-9ba1-52857b450542-must-gather-output\") pod \"must-gather-5nfp8\" (UID: \"5cdd9171-2d85-4b0a-9ba1-52857b450542\") " pod="openshift-must-gather-446hm/must-gather-5nfp8" Jul 06 19:38:21.280840 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.280824 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5cdd9171-2d85-4b0a-9ba1-52857b450542-must-gather-output\") pod \"must-gather-5nfp8\" (UID: \"5cdd9171-2d85-4b0a-9ba1-52857b450542\") " pod="openshift-must-gather-446hm/must-gather-5nfp8" Jul 06 19:38:21.291272 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.291252 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gthd\" (UniqueName: \"kubernetes.io/projected/5cdd9171-2d85-4b0a-9ba1-52857b450542-kube-api-access-2gthd\") pod \"must-gather-5nfp8\" (UID: \"5cdd9171-2d85-4b0a-9ba1-52857b450542\") " pod="openshift-must-gather-446hm/must-gather-5nfp8" Jul 06 19:38:21.422725 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.422695 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-446hm/must-gather-5nfp8" Jul 06 19:38:21.562510 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.562466 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-446hm/must-gather-5nfp8"] Jul 06 19:38:21.563722 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:38:21.563695 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cdd9171_2d85_4b0a_9ba1_52857b450542.slice/crio-b23d5e02867a7cb4cdff02abe3e39517d0a88c5543be7e5c771e085bfbc8d730 WatchSource:0}: Error finding container b23d5e02867a7cb4cdff02abe3e39517d0a88c5543be7e5c771e085bfbc8d730: Status 404 returned error can't find the container with id b23d5e02867a7cb4cdff02abe3e39517d0a88c5543be7e5c771e085bfbc8d730 Jul 06 19:38:21.565600 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.565584 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:38:21.620385 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:21.620349 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-446hm/must-gather-5nfp8" event={"ID":"5cdd9171-2d85-4b0a-9ba1-52857b450542","Type":"ContainerStarted","Data":"b23d5e02867a7cb4cdff02abe3e39517d0a88c5543be7e5c771e085bfbc8d730"} Jul 06 19:38:23.635415 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:23.635380 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-446hm/must-gather-5nfp8" event={"ID":"5cdd9171-2d85-4b0a-9ba1-52857b450542","Type":"ContainerStarted","Data":"bae93f0e2625e9cec25547ebc3e402c02b628ec3ea510c96d8c79fb967ddcf84"} Jul 06 19:38:23.635850 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:23.635425 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-446hm/must-gather-5nfp8" event={"ID":"5cdd9171-2d85-4b0a-9ba1-52857b450542","Type":"ContainerStarted","Data":"6b80c944be1b0a5eee3589f97094ef1049736039f21cd131b9c33b866c2b9ffa"} Jul 06 19:38:24.245168 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:24.245132 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s8pd7_e1283903-625e-49c4-a176-83b147859bd7/global-pull-secret-syncer/0.log" Jul 06 19:38:24.348449 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:24.348411 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mwp57_fc86ae6c-8718-437d-915d-6940c8be493f/konnectivity-agent/0.log" Jul 06 19:38:24.458584 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:24.458544 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-154.ec2.internal_eebd8c9c2aac021424bbe7455e90313b/haproxy/0.log" Jul 06 19:38:28.884391 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:28.884355 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc_7278c014-ec7e-4fae-98a6-3e9cdfa85700/extract/0.log" Jul 06 19:38:28.926632 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:28.926602 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc_7278c014-ec7e-4fae-98a6-3e9cdfa85700/util/0.log" Jul 06 19:38:28.963400 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:28.963365 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hnc_7278c014-ec7e-4fae-98a6-3e9cdfa85700/pull/0.log" Jul 06 19:38:29.031440 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:29.031415 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t_e2f0b925-1dee-405d-87ea-4102316fe940/extract/0.log" Jul 06 19:38:29.068167 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:29.068142 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t_e2f0b925-1dee-405d-87ea-4102316fe940/util/0.log" Jul 06 19:38:29.093912 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:29.093885 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4x5t_e2f0b925-1dee-405d-87ea-4102316fe940/pull/0.log" Jul 06 19:38:29.128229 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:29.128183 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj_58068485-137c-4cac-8145-905ef660eb4b/extract/0.log" Jul 06 19:38:29.171623 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:29.171594 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj_58068485-137c-4cac-8145-905ef660eb4b/util/0.log" Jul 06 19:38:29.226161 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:29.226128 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kpbgj_58068485-137c-4cac-8145-905ef660eb4b/pull/0.log" Jul 06 19:38:29.278067 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:29.278024 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g_b951428c-bcc4-40fc-b920-a7ea13fb99e3/extract/0.log" Jul 06 19:38:29.342748 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:29.342719 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g_b951428c-bcc4-40fc-b920-a7ea13fb99e3/util/0.log" Jul 06 19:38:29.395303 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:29.395265 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zm67g_b951428c-bcc4-40fc-b920-a7ea13fb99e3/pull/0.log" Jul 06 19:38:29.996658 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:29.996625 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jtltb_a771cd7b-c570-4948-92c6-b22b2f96dd04/manager/0.log" Jul 06 19:38:30.330923 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:30.330835 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9v49s_1bc828b2-b2ba-4d5c-a9c9-5b31c6edbed4/manager/0.log" Jul 06 19:38:32.120126 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:32.120091 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-2nscc_55ac808a-57f8-4960-aa3f-a86dd1e8b034/cluster-monitoring-operator/0.log" Jul 06 19:38:32.481231 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:32.481196 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sjxqx_37abe973-b5d8-4271-9269-95a4ecbd28e2/node-exporter/0.log" Jul 06 19:38:32.509140 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:32.509109 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sjxqx_37abe973-b5d8-4271-9269-95a4ecbd28e2/kube-rbac-proxy/0.log" Jul 06 19:38:32.534620 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:32.534591 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sjxqx_37abe973-b5d8-4271-9269-95a4ecbd28e2/init-textfile/0.log" Jul 06 19:38:32.839525 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:32.839419 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-jm55c_f7cc9be6-b284-4148-8573-0523a52a026b/prometheus-operator/0.log" Jul 06 19:38:32.861669 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:32.861635 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-jm55c_f7cc9be6-b284-4148-8573-0523a52a026b/kube-rbac-proxy/0.log" Jul 06 19:38:32.889555 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:32.889512 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-kss42_c0eb13d0-1064-4703-a575-71649e01a93e/prometheus-operator-admission-webhook/0.log" Jul 06 19:38:34.192617 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.192546 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-446hm/must-gather-5nfp8" podStartSLOduration=12.216101731 podStartE2EDuration="13.192522788s" totalImagesPullingTime="976.421057ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:38:23.654788272 +0000 UTC m=+2611.581222821" watchObservedRunningTime="2026-07-06 19:38:34.192522788 +0000 UTC m=+2622.118957338" Jul 06 19:38:34.194487 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.194443 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq"] Jul 06 19:38:34.200157 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.200129 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq" Jul 06 19:38:34.206267 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.206241 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq"] Jul 06 19:38:34.228376 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.228335 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3511b464-1683-480b-a6a7-23ab08c9b185-proc\") pod \"perf-node-gather-daemonset-rtsvq\" (UID: \"3511b464-1683-480b-a6a7-23ab08c9b185\") " pod="openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq" Jul 06 19:38:34.228651 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.228630 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3511b464-1683-480b-a6a7-23ab08c9b185-lib-modules\") pod \"perf-node-gather-daemonset-rtsvq\" (UID: \"3511b464-1683-480b-a6a7-23ab08c9b185\") " pod="openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq" Jul 06 19:38:34.228838 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.228823 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvk44\" (UniqueName: \"kubernetes.io/projected/3511b464-1683-480b-a6a7-23ab08c9b185-kube-api-access-cvk44\") pod \"perf-node-gather-daemonset-rtsvq\" (UID: \"3511b464-1683-480b-a6a7-23ab08c9b185\") " pod="openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq" Jul 06 19:38:34.229046 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.229032 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3511b464-1683-480b-a6a7-23ab08c9b185-podres\") pod \"perf-node-gather-daemonset-rtsvq\" (UID: \"3511b464-1683-480b-a6a7-23ab08c9b185\") " pod="openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq" Jul 06 19:38:34.229226 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.229212 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3511b464-1683-480b-a6a7-23ab08c9b185-sys\") pod \"perf-node-gather-daemonset-rtsvq\" (UID: \"3511b464-1683-480b-a6a7-23ab08c9b185\") " pod="openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq" Jul 06 19:38:34.330093 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.330053 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3511b464-1683-480b-a6a7-23ab08c9b185-podres\") pod \"perf-node-gather-daemonset-rtsvq\" (UID: \"3511b464-1683-480b-a6a7-23ab08c9b185\") " pod="openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq" Jul 06 19:38:34.330291 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.330134 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3511b464-1683-480b-a6a7-23ab08c9b185-sys\") pod \"perf-node-gather-daemonset-rtsvq\" (UID: \"3511b464-1683-480b-a6a7-23ab08c9b185\") " pod="openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq" Jul 06 19:38:34.330291 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.330194 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3511b464-1683-480b-a6a7-23ab08c9b185-proc\") pod \"perf-node-gather-daemonset-rtsvq\" (UID: \"3511b464-1683-480b-a6a7-23ab08c9b185\") " pod="openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq" Jul 06 19:38:34.330291 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.330224 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3511b464-1683-480b-a6a7-23ab08c9b185-lib-modules\") pod \"perf-node-gather-daemonset-rtsvq\" (UID: \"3511b464-1683-480b-a6a7-23ab08c9b185\") " pod="openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq" Jul 06 19:38:34.330291 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.330263 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvk44\" (UniqueName: \"kubernetes.io/projected/3511b464-1683-480b-a6a7-23ab08c9b185-kube-api-access-cvk44\") pod \"perf-node-gather-daemonset-rtsvq\" (UID: \"3511b464-1683-480b-a6a7-23ab08c9b185\") " pod="openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq" Jul 06 19:38:34.330666 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.330642 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3511b464-1683-480b-a6a7-23ab08c9b185-sys\") pod \"perf-node-gather-daemonset-rtsvq\" (UID: \"3511b464-1683-480b-a6a7-23ab08c9b185\") " pod="openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq" Jul 06 19:38:34.330802 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.330716 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3511b464-1683-480b-a6a7-23ab08c9b185-proc\") pod \"perf-node-gather-daemonset-rtsvq\" (UID: \"3511b464-1683-480b-a6a7-23ab08c9b185\") " pod="openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq" Jul 06 19:38:34.330895 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.330831 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3511b464-1683-480b-a6a7-23ab08c9b185-lib-modules\") pod \"perf-node-gather-daemonset-rtsvq\" (UID: \"3511b464-1683-480b-a6a7-23ab08c9b185\") " pod="openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq" Jul 06 19:38:34.330985 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.330901 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3511b464-1683-480b-a6a7-23ab08c9b185-podres\") pod \"perf-node-gather-daemonset-rtsvq\" (UID: \"3511b464-1683-480b-a6a7-23ab08c9b185\") " pod="openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq" Jul 06 19:38:34.340697 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.340667 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvk44\" (UniqueName: \"kubernetes.io/projected/3511b464-1683-480b-a6a7-23ab08c9b185-kube-api-access-cvk44\") pod \"perf-node-gather-daemonset-rtsvq\" (UID: \"3511b464-1683-480b-a6a7-23ab08c9b185\") " pod="openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq" Jul 06 19:38:34.515073 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.514983 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq" Jul 06 19:38:34.685421 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.685368 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq"] Jul 06 19:38:34.689432 ip-10-0-139-154 kubenswrapper[2567]: W0706 19:38:34.689402 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3511b464_1683_480b_a6a7_23ab08c9b185.slice/crio-5c27502d37e39970a217fee62c6919dd07136380b39261e44be2771acfeadd00 WatchSource:0}: Error finding container 5c27502d37e39970a217fee62c6919dd07136380b39261e44be2771acfeadd00: Status 404 returned error can't find the container with id 5c27502d37e39970a217fee62c6919dd07136380b39261e44be2771acfeadd00 Jul 06 19:38:34.730963 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.730927 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq" event={"ID":"3511b464-1683-480b-a6a7-23ab08c9b185","Type":"ContainerStarted","Data":"5c27502d37e39970a217fee62c6919dd07136380b39261e44be2771acfeadd00"} Jul 06 19:38:34.973747 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.973712 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/1.log" Jul 06 19:38:34.982644 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:34.982611 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qsln6_3e2b0f1e-6d00-4ad8-a194-a4604a728b56/console-operator/2.log" Jul 06 19:38:35.459895 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:35.459864 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b5c7cd587-4bsfd_62ec1818-6565-4762-bce1-da8c05a51cb8/console/0.log" Jul 06 19:38:35.508048 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:35.508013 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-59zcr_901fa5ce-e25c-4616-926d-d7b0aa724797/download-server/0.log" Jul 06 19:38:35.742468 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:35.742377 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq" event={"ID":"3511b464-1683-480b-a6a7-23ab08c9b185","Type":"ContainerStarted","Data":"888280da4618408cfd9ff485b89c181624eb9879e337d44e691c8e867c1b006b"} Jul 06 19:38:35.742658 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:35.742579 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq" Jul 06 19:38:35.759535 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:35.759454 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq" podStartSLOduration=1.75943753 podStartE2EDuration="1.75943753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:38:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:38:35.758189776 +0000 UTC m=+2623.684624327" watchObservedRunningTime="2026-07-06 19:38:35.75943753 +0000 UTC m=+2623.685872078" Jul 06 19:38:36.090043 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:36.089970 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-888gm_74de0b59-0831-45cb-91be-776aaabedf5d/volume-data-source-validator/0.log" Jul 06 19:38:37.300301 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:37.300273 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kpxk9_68ba2b4e-a36a-4b28-9485-bf70a371f48a/dns/0.log" Jul 06 19:38:37.334685 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:37.334655 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kpxk9_68ba2b4e-a36a-4b28-9485-bf70a371f48a/kube-rbac-proxy/0.log" Jul 06 19:38:37.398240 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:37.398203 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c58dn_91acad80-e6c9-4bf5-816c-a6b89d0b611e/dns-node-resolver/0.log" Jul 06 19:38:38.137568 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:38.137536 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zg5fq_7f7face8-df08-4e4c-afa4-e028aa2a95fe/node-ca/0.log" Jul 06 19:38:39.150152 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:39.150118 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dxl6g_b78c8385-4890-4949-a303-859482f4f641/istio-proxy/0.log" Jul 06 19:38:39.360532 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:39.360501 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hj6f2_d2614794-291b-44fb-8a1f-303d48458c72/discovery/0.log" Jul 06 19:38:39.385507 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:39.385459 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c488d768d-qm8dr_3ea1fc37-774e-4877-86db-3c1f1be8c61f/kube-auth-proxy/0.log" Jul 06 19:38:39.452960 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:39.452899 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5nwsh_3df391cf-3927-4c0b-aa2b-dbf5d896d20b/istio-proxy/0.log" Jul 06 19:38:39.514368 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:39.514325 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5nwsh_3df391cf-3927-4c0b-aa2b-dbf5d896d20b/istio-proxy/1.log" Jul 06 19:38:39.633553 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:39.633489 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-wrvd5_1fa5d2e7-3246-426d-82e1-9288cc2e3e31/payload-processing/0.log" Jul 06 19:38:39.662143 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:39.662115 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dc846bc67-j8qgm_16edd98b-f15f-4300-b2b1-4da848b6d588/router/0.log" Jul 06 19:38:40.425824 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:40.425786 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rhd87_fe134beb-34fb-4394-9365-d9ade5e9dd2a/serve-healthcheck-canary/0.log" Jul 06 19:38:40.901283 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:40.901198 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-zcpj7_c2b88852-6092-4980-905d-8801e95abd38/insights-operator/0.log" Jul 06 19:38:40.902241 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:40.902213 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-zcpj7_c2b88852-6092-4980-905d-8801e95abd38/insights-operator/1.log" Jul 06 19:38:40.925159 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:40.925134 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2sx62_3662c723-7767-47c2-8aeb-d928b031d441/kube-rbac-proxy/0.log" Jul 06 19:38:40.950921 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:40.950896 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2sx62_3662c723-7767-47c2-8aeb-d928b031d441/exporter/0.log" Jul 06 19:38:40.975579 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:40.975547 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2sx62_3662c723-7767-47c2-8aeb-d928b031d441/extractor/0.log" Jul 06 19:38:41.761164 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:41.761137 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-446hm/perf-node-gather-daemonset-rtsvq" Jul 06 19:38:43.478426 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:43.478337 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-wdtbt_3eae5464-ef34-4403-8b77-c52674b74f81/manager/0.log" Jul 06 19:38:43.478916 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:43.478439 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-wdtbt_3eae5464-ef34-4403-8b77-c52674b74f81/manager/1.log" Jul 06 19:38:43.682580 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:43.682554 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722755-t48md_5fef3d8f-6b56-43ef-bfa3-68b1bde18aca/cleanup/0.log" Jul 06 19:38:43.710908 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:43.710874 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722770-46bwx_7c354de6-be12-427b-b68f-047c77e339fb/cleanup/0.log" Jul 06 19:38:43.952182 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:43.950879 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2hwc7_fd788a33-68ae-4f84-96c2-d087b1601a38/manager/0.log" Jul 06 19:38:44.139451 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:44.139252 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546c6c6d78-j4wtj_83bcbb72-b275-43d7-b2f0-533daa61ae3d/manager/0.log" Jul 06 19:38:44.173255 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:44.173225 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546c6c6d78-j4wtj_83bcbb72-b275-43d7-b2f0-533daa61ae3d/copy-manifests/0.log" Jul 06 19:38:44.723358 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:44.723325 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dxl6g_b78c8385-4890-4949-a303-859482f4f641/istio-proxy/0.log" Jul 06 19:38:44.925193 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:44.925153 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hj6f2_d2614794-291b-44fb-8a1f-303d48458c72/discovery/0.log" Jul 06 19:38:44.937501 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:44.937459 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c488d768d-qm8dr_3ea1fc37-774e-4877-86db-3c1f1be8c61f/kube-auth-proxy/0.log" Jul 06 19:38:44.979114 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:44.979033 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5nwsh_3df391cf-3927-4c0b-aa2b-dbf5d896d20b/istio-proxy/0.log" Jul 06 19:38:45.040202 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:45.040166 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5nwsh_3df391cf-3927-4c0b-aa2b-dbf5d896d20b/istio-proxy/1.log" Jul 06 19:38:45.130673 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:45.130641 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-wrvd5_1fa5d2e7-3246-426d-82e1-9288cc2e3e31/payload-processing/0.log" Jul 06 19:38:45.147966 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:45.147940 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dc846bc67-j8qgm_16edd98b-f15f-4300-b2b1-4da848b6d588/router/0.log" Jul 06 19:38:45.760932 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:45.760901 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-4tsc8_a54dadb0-b4c5-4dfa-a5ba-d9ca95793f88/openshift-lws-operator/0.log" Jul 06 19:38:46.316704 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:46.316623 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dxl6g_b78c8385-4890-4949-a303-859482f4f641/istio-proxy/0.log" Jul 06 19:38:46.524008 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:46.523971 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hj6f2_d2614794-291b-44fb-8a1f-303d48458c72/discovery/0.log" Jul 06 19:38:46.538053 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:46.538023 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c488d768d-qm8dr_3ea1fc37-774e-4877-86db-3c1f1be8c61f/kube-auth-proxy/0.log" Jul 06 19:38:46.585089 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:46.585006 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5nwsh_3df391cf-3927-4c0b-aa2b-dbf5d896d20b/istio-proxy/0.log" Jul 06 19:38:46.643630 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:46.643594 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5nwsh_3df391cf-3927-4c0b-aa2b-dbf5d896d20b/istio-proxy/1.log" Jul 06 19:38:46.753765 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:46.753715 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-wrvd5_1fa5d2e7-3246-426d-82e1-9288cc2e3e31/payload-processing/0.log" Jul 06 19:38:46.771460 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:46.771428 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dc846bc67-j8qgm_16edd98b-f15f-4300-b2b1-4da848b6d588/router/0.log" Jul 06 19:38:51.012416 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:51.012375 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-jh7tn_a645ee26-3516-4de3-99f2-603d7cb6914c/kube-storage-version-migrator-operator/1.log" Jul 06 19:38:51.013590 ip-10-0-139-154 kubenswrapper[2567]: I0706 19:38:51.013558 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-jh7tn_a645ee26-3516-4de3-99f2-603d7cb6914c/kube-storage-version-migrator-operator/0.log"