Jul 10 17:57:46.843647 ip-10-0-138-201 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 10 17:57:46.843664 ip-10-0-138-201 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 10 17:57:46.843675 ip-10-0-138-201 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 10 17:57:46.844017 ip-10-0-138-201 systemd[1]: Failed to start Kubernetes Kubelet. Jul 10 17:57:56.724942 ip-10-0-138-201 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 10 17:57:56.724956 ip-10-0-138-201 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot cd94f6f8191642cd9f755826cb2024be -- Jul 10 17:59:26.640989 ip-10-0-138-201 systemd[1]: Starting Kubernetes Kubelet... Jul 10 17:59:27.087316 ip-10-0-138-201 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 17:59:27.087316 ip-10-0-138-201 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 17:59:27.087316 ip-10-0-138-201 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 17:59:27.087316 ip-10-0-138-201 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 17:59:27.087316 ip-10-0-138-201 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 17:59:27.087998 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.087397 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 17:59:27.094724 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094695 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 17:59:27.094724 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094725 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 17:59:27.094796 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094732 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 17:59:27.094796 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094736 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 17:59:27.094796 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094740 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 17:59:27.094796 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094743 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 17:59:27.094796 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094746 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 17:59:27.094796 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094749 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 17:59:27.094796 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094752 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 17:59:27.094796 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094754 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 17:59:27.094796 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094757 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 17:59:27.094796 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094760 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 17:59:27.094796 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094762 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 17:59:27.094796 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094765 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 17:59:27.094796 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094767 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 17:59:27.094796 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094770 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 17:59:27.094796 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094773 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 17:59:27.094796 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094775 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 17:59:27.094796 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094778 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 17:59:27.094796 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094791 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 17:59:27.094796 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094794 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 17:59:27.095248 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094797 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 17:59:27.095248 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094799 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 17:59:27.095248 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094802 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 17:59:27.095248 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094805 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 17:59:27.095248 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094808 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 17:59:27.095248 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094811 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 17:59:27.095248 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094813 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 17:59:27.095248 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094816 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 17:59:27.095248 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094818 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 17:59:27.095248 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094821 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 17:59:27.095248 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094824 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 17:59:27.095248 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094827 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 17:59:27.095248 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094829 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 17:59:27.095248 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094832 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 17:59:27.095248 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094834 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 17:59:27.095248 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094837 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 17:59:27.095248 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094839 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 17:59:27.095248 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094843 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 17:59:27.095248 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094845 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 17:59:27.095248 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094848 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 17:59:27.095728 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094850 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 17:59:27.095728 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094853 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 17:59:27.095728 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094855 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 17:59:27.095728 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094858 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 17:59:27.095728 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094860 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 17:59:27.095728 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094863 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 17:59:27.095728 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094866 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 17:59:27.095728 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094868 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 17:59:27.095728 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094871 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 17:59:27.095728 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094873 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 17:59:27.095728 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094875 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 17:59:27.095728 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094879 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 17:59:27.095728 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094881 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 17:59:27.095728 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094884 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 17:59:27.095728 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094887 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 17:59:27.095728 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094890 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 17:59:27.095728 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094893 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 17:59:27.095728 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094895 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 10 17:59:27.095728 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094898 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 17:59:27.095728 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094900 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 17:59:27.096215 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094903 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 17:59:27.096215 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094906 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 17:59:27.096215 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094909 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 17:59:27.096215 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094911 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 17:59:27.096215 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094913 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 17:59:27.096215 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094916 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 17:59:27.096215 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094918 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 17:59:27.096215 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094921 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 17:59:27.096215 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094923 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 17:59:27.096215 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094926 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 17:59:27.096215 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094929 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 17:59:27.096215 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094931 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 17:59:27.096215 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094934 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 17:59:27.096215 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094936 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 17:59:27.096215 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094938 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 17:59:27.096215 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094942 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 17:59:27.096215 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094944 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 17:59:27.096215 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094947 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 17:59:27.096215 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094949 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 17:59:27.096215 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094952 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 17:59:27.096693 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094954 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 17:59:27.096693 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094957 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 17:59:27.096693 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094959 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 17:59:27.096693 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094963 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 17:59:27.096693 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094967 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 17:59:27.096693 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094971 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 17:59:27.096693 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094975 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 17:59:27.096693 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094979 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 17:59:27.096693 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094982 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 17:59:27.096693 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094985 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 17:59:27.096693 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094988 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 17:59:27.096693 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094990 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 17:59:27.096693 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094993 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 17:59:27.096693 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094995 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 17:59:27.096693 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.094998 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 17:59:27.096693 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095000 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 17:59:27.096693 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095003 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 17:59:27.096693 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095005 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 17:59:27.096693 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095689 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 17:59:27.097169 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095694 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 17:59:27.097169 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095697 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 17:59:27.097169 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095700 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 17:59:27.097169 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095702 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 17:59:27.097169 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095727 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 17:59:27.097169 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095731 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 17:59:27.097169 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095734 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 17:59:27.097169 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095736 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 17:59:27.097169 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095739 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 17:59:27.097169 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095742 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 17:59:27.097169 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095747 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 17:59:27.097169 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095751 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 17:59:27.097169 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095754 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 17:59:27.097169 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095757 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 17:59:27.097169 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095760 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 17:59:27.097169 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095763 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 17:59:27.097169 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095766 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 17:59:27.097169 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095769 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 17:59:27.097169 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095772 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 17:59:27.097623 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095775 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 17:59:27.097623 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095777 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 17:59:27.097623 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095780 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 17:59:27.097623 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095783 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 17:59:27.097623 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095787 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 17:59:27.097623 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095790 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 17:59:27.097623 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095793 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 17:59:27.097623 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095795 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 17:59:27.097623 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095798 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 17:59:27.097623 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095800 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 17:59:27.097623 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095803 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 17:59:27.097623 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095806 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 17:59:27.097623 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095808 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 17:59:27.097623 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095811 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 17:59:27.097623 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095813 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 17:59:27.097623 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095816 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 17:59:27.097623 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095818 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 17:59:27.097623 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095825 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 17:59:27.097623 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095828 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 17:59:27.097623 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095830 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 17:59:27.098105 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095833 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 17:59:27.098105 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095836 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 17:59:27.098105 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095838 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 17:59:27.098105 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095841 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 17:59:27.098105 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095843 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 17:59:27.098105 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095846 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 17:59:27.098105 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095848 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 17:59:27.098105 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095851 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 17:59:27.098105 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095853 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 17:59:27.098105 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095857 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 17:59:27.098105 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095860 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 17:59:27.098105 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095863 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 17:59:27.098105 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095866 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 17:59:27.098105 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095868 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 17:59:27.098105 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095871 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 17:59:27.098105 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095874 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 17:59:27.098105 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095876 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 17:59:27.098105 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095879 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 17:59:27.098105 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095881 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 17:59:27.098105 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095884 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 17:59:27.098591 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095886 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 17:59:27.098591 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095889 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 17:59:27.098591 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095892 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 17:59:27.098591 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095894 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 17:59:27.098591 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095897 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 17:59:27.098591 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095899 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 17:59:27.098591 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095901 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 17:59:27.098591 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095904 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 17:59:27.098591 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095906 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 17:59:27.098591 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095909 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 17:59:27.098591 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095911 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 17:59:27.098591 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095914 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 17:59:27.098591 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095917 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 17:59:27.098591 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095920 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 17:59:27.098591 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095922 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 17:59:27.098591 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095924 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 17:59:27.098591 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095927 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 17:59:27.098591 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095929 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 17:59:27.098591 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095932 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 17:59:27.099071 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095934 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 17:59:27.099071 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095936 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 17:59:27.099071 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095940 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 17:59:27.099071 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095942 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 17:59:27.099071 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095946 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 17:59:27.099071 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095949 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 17:59:27.099071 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095953 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 17:59:27.099071 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095955 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 10 17:59:27.099071 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095958 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 17:59:27.099071 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095960 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 17:59:27.099071 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095963 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 17:59:27.099071 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095965 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 17:59:27.099071 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095968 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 17:59:27.099071 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095972 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 17:59:27.099071 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095975 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 17:59:27.099071 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095978 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 17:59:27.099071 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095981 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 17:59:27.099071 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095984 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 17:59:27.099071 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095986 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 17:59:27.099525 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.095989 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 17:59:27.099525 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096355 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 17:59:27.099525 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096360 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 17:59:27.099525 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096363 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 17:59:27.099525 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096366 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 17:59:27.099525 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096370 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 17:59:27.099525 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096373 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 17:59:27.099525 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096376 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 17:59:27.099525 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096378 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 17:59:27.099525 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096381 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 17:59:27.099525 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096384 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 17:59:27.099525 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096386 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 17:59:27.099525 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096389 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 17:59:27.099525 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096391 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 17:59:27.099525 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096394 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 17:59:27.099525 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096397 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 17:59:27.099525 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096402 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 17:59:27.099525 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096405 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 17:59:27.099525 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096407 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 17:59:27.099525 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096410 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 17:59:27.100014 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096412 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 10 17:59:27.100014 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096415 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 17:59:27.100014 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096417 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 17:59:27.100014 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096420 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 17:59:27.100014 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096422 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 17:59:27.100014 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096425 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 17:59:27.100014 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096427 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 17:59:27.100014 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096430 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 17:59:27.100014 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096432 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 17:59:27.100014 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096434 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 17:59:27.100014 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096437 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 17:59:27.100014 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096439 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 17:59:27.100014 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096442 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 17:59:27.100014 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096444 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 17:59:27.100014 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096447 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 17:59:27.100014 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096449 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 17:59:27.100014 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096452 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 17:59:27.100014 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096454 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 17:59:27.100014 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096457 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 17:59:27.100014 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096460 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 17:59:27.100521 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096462 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 17:59:27.100521 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096464 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 17:59:27.100521 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096467 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 17:59:27.100521 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096469 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 17:59:27.100521 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096472 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 17:59:27.100521 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096475 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 17:59:27.100521 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096478 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 17:59:27.100521 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096480 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 17:59:27.100521 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096484 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 17:59:27.100521 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096487 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 17:59:27.100521 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096490 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 17:59:27.100521 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096492 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 17:59:27.100521 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096495 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 17:59:27.100521 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096497 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 17:59:27.100521 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096500 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 17:59:27.100521 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096503 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 17:59:27.100521 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096505 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 17:59:27.100521 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096509 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 17:59:27.100521 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096513 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 17:59:27.100984 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096516 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 17:59:27.100984 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096519 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 17:59:27.100984 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096521 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 17:59:27.100984 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096524 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 17:59:27.100984 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096527 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 17:59:27.100984 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096529 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 17:59:27.100984 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096532 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 17:59:27.100984 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096534 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 17:59:27.100984 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096537 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 17:59:27.100984 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096541 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 17:59:27.100984 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096546 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 17:59:27.100984 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096550 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 17:59:27.100984 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096554 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 17:59:27.100984 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096557 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 17:59:27.100984 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096560 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 17:59:27.100984 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096563 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 17:59:27.100984 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096565 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 17:59:27.100984 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096568 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 17:59:27.100984 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096571 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 17:59:27.101535 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096573 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 17:59:27.101535 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096576 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 17:59:27.101535 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096580 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 17:59:27.101535 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096583 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 17:59:27.101535 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096585 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 17:59:27.101535 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096588 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 17:59:27.101535 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096591 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 17:59:27.101535 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096593 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 17:59:27.101535 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096595 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 17:59:27.101535 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096598 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 17:59:27.101535 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096600 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 17:59:27.101535 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096603 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 17:59:27.101535 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096605 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 17:59:27.101535 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096608 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 17:59:27.101535 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096610 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 17:59:27.101535 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096613 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 17:59:27.101535 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096615 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 17:59:27.101535 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096617 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 17:59:27.101535 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096620 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096622 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096625 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.096627 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096691 2579 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096702 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096729 2579 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096733 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096738 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096741 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096745 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096749 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096752 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096757 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096761 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096764 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096769 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096772 2579 flags.go:64] FLAG: --cgroup-root="" Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096775 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096778 2579 flags.go:64] FLAG: --client-ca-file="" Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096781 2579 flags.go:64] FLAG: --cloud-provider="external" Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096783 2579 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096788 2579 flags.go:64] FLAG: --cluster-domain="" Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096791 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 17:59:27.102061 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096794 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096797 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096800 2579 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096804 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096807 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096811 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096814 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096817 2579 flags.go:64] FLAG: --contention-profiling="false" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096820 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096823 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096826 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096829 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096833 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096836 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096839 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096842 2579 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096845 2579 flags.go:64] FLAG: --enable-server="true" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096848 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096852 2579 flags.go:64] FLAG: --event-burst="100" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096856 2579 flags.go:64] FLAG: --event-qps="50" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096858 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096863 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096866 2579 flags.go:64] FLAG: --eviction-hard="" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096872 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 17:59:27.102654 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096876 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096879 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096882 2579 flags.go:64] FLAG: --eviction-soft="" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096885 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096888 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096890 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096893 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096896 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096899 2579 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096902 2579 flags.go:64] FLAG: --feature-gates="" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096906 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096909 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096911 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096915 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096917 2579 flags.go:64] FLAG: --healthz-port="10248" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096920 2579 flags.go:64] FLAG: --help="false" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096923 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-138-201.ec2.internal" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096926 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096929 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096931 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096935 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096938 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096941 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 17:59:27.103271 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096943 2579 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096946 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096949 2579 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096952 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096955 2579 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096958 2579 flags.go:64] FLAG: --kube-reserved="" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096963 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096966 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096969 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096973 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096976 2579 flags.go:64] FLAG: --lock-file="" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096978 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096981 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096984 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096989 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096992 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096995 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.096997 2579 flags.go:64] FLAG: --logging-format="text" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097000 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097003 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097006 2579 flags.go:64] FLAG: --manifest-url="" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097009 2579 flags.go:64] FLAG: --manifest-url-header="" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097014 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097017 2579 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097021 2579 flags.go:64] FLAG: --max-pods="110" Jul 10 17:59:27.103859 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097024 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097027 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097030 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097032 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097035 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097038 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097041 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097048 2579 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097051 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097053 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097056 2579 flags.go:64] FLAG: --pod-cidr="" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097059 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097065 2579 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097067 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097072 2579 flags.go:64] FLAG: --pods-per-core="0" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097074 2579 flags.go:64] FLAG: --port="10250" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097079 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097082 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06091882e5d293cb7" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097085 2579 flags.go:64] FLAG: --qos-reserved="" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097088 2579 flags.go:64] FLAG: --read-only-port="10255" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097091 2579 flags.go:64] FLAG: --register-node="true" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097094 2579 flags.go:64] FLAG: --register-with-taints="" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097097 2579 flags.go:64] FLAG: --registry-burst="10" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097100 2579 flags.go:64] FLAG: --registry-qps="5" Jul 10 17:59:27.104537 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097103 2579 flags.go:64] FLAG: --reserved-cpus="" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097106 2579 flags.go:64] FLAG: --reserved-memory="" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097109 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097112 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097115 2579 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097118 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097120 2579 flags.go:64] FLAG: --runonce="false" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097123 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097126 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097129 2579 flags.go:64] FLAG: --seccomp-default="false" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097132 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097135 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097138 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097141 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097144 2579 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097147 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097149 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097152 2579 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097155 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097158 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097164 2579 flags.go:64] FLAG: --system-cgroups="" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097166 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097173 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097176 2579 flags.go:64] FLAG: --tls-cert-file="" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097181 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 17:59:27.105140 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097185 2579 flags.go:64] FLAG: --tls-min-version="" Jul 10 17:59:27.105778 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097188 2579 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 17:59:27.105778 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097191 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 17:59:27.105778 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097193 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 17:59:27.105778 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097196 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 17:59:27.105778 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097199 2579 flags.go:64] FLAG: --v="2" Jul 10 17:59:27.105778 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097203 2579 flags.go:64] FLAG: --version="false" Jul 10 17:59:27.105778 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097207 2579 flags.go:64] FLAG: --vmodule="" Jul 10 17:59:27.105778 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097210 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 17:59:27.105778 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.097213 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 17:59:27.105778 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097324 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 17:59:27.105778 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097327 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 17:59:27.105778 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097330 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 17:59:27.105778 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097333 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 17:59:27.105778 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097336 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 17:59:27.105778 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097339 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 17:59:27.105778 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097341 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 17:59:27.105778 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097344 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 17:59:27.105778 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097346 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 17:59:27.105778 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097349 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 17:59:27.105778 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097351 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 17:59:27.105778 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097354 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 17:59:27.106284 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097357 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 17:59:27.106284 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097359 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 17:59:27.106284 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097362 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 17:59:27.106284 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097365 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 17:59:27.106284 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097367 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 17:59:27.106284 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097370 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 17:59:27.106284 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097373 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 17:59:27.106284 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097376 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 17:59:27.106284 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097379 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 17:59:27.106284 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097382 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 17:59:27.106284 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097385 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 17:59:27.106284 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097387 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 17:59:27.106284 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097390 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 17:59:27.106284 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097393 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 17:59:27.106284 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097397 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 17:59:27.106284 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097400 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 17:59:27.106284 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097403 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 17:59:27.106284 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097406 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 17:59:27.106284 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097408 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 17:59:27.106972 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097411 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 17:59:27.106972 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097414 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 17:59:27.106972 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097417 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 17:59:27.106972 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097419 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 17:59:27.106972 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097421 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 17:59:27.106972 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097424 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 17:59:27.106972 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097426 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 17:59:27.106972 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097429 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 17:59:27.106972 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097431 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 17:59:27.106972 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097434 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 17:59:27.106972 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097436 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 17:59:27.106972 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097439 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 17:59:27.106972 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097442 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 17:59:27.106972 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097444 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 10 17:59:27.106972 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097447 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 17:59:27.106972 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097449 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 17:59:27.106972 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097453 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 17:59:27.106972 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097457 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 17:59:27.106972 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097459 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 17:59:27.107687 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097462 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 17:59:27.107687 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097465 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 17:59:27.107687 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097468 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 17:59:27.107687 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097471 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 17:59:27.107687 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097473 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 17:59:27.107687 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097476 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 17:59:27.107687 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097479 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 17:59:27.107687 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097482 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 17:59:27.107687 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097484 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 17:59:27.107687 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097486 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 17:59:27.107687 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097489 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 17:59:27.107687 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097491 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 17:59:27.107687 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097494 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 17:59:27.107687 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097496 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 17:59:27.107687 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097499 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 17:59:27.107687 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097502 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 17:59:27.107687 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097505 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 17:59:27.107687 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097509 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 17:59:27.107687 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097512 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 17:59:27.107687 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097514 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 17:59:27.108222 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097517 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 17:59:27.108222 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097520 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 17:59:27.108222 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097523 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 17:59:27.108222 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097525 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 17:59:27.108222 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097528 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 17:59:27.108222 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097531 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 17:59:27.108222 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097533 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 17:59:27.108222 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097536 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 17:59:27.108222 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097538 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 17:59:27.108222 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097541 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 17:59:27.108222 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097543 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 17:59:27.108222 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097546 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 17:59:27.108222 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097548 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 17:59:27.108222 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097551 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 17:59:27.108222 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097554 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 17:59:27.108222 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097557 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 17:59:27.108222 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097559 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 17:59:27.108222 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097562 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 17:59:27.108222 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097564 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 17:59:27.108222 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097566 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 17:59:27.108699 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097569 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 17:59:27.108699 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097571 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 17:59:27.108699 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097574 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 17:59:27.108699 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097576 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 17:59:27.108699 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097579 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 17:59:27.108699 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097581 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 17:59:27.108699 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097584 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 17:59:27.108699 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097586 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 17:59:27.108699 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.097589 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 17:59:27.108699 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.098531 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 17:59:27.108699 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.105496 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 17:59:27.108699 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.105512 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 17:59:27.108699 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.105525 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 17:59:27.108699 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.105531 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 17:59:27.108699 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105585 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 17:59:27.109102 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105590 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 17:59:27.109102 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105593 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 17:59:27.109102 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105597 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 17:59:27.109102 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105600 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 17:59:27.109102 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105603 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 17:59:27.109102 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105606 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 17:59:27.109102 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105609 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 17:59:27.109102 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105611 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 10 17:59:27.109102 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105614 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 17:59:27.109102 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105616 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 17:59:27.109102 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105619 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 17:59:27.109102 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105622 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 17:59:27.109102 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105624 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 17:59:27.109102 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105627 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 17:59:27.109102 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105630 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 17:59:27.109102 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105632 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 17:59:27.109102 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105635 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 17:59:27.109102 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105638 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 17:59:27.109102 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105640 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 17:59:27.109556 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105643 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 17:59:27.109556 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105645 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 17:59:27.109556 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105648 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 17:59:27.109556 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105650 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 17:59:27.109556 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105653 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 17:59:27.109556 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105655 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 17:59:27.109556 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105658 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 17:59:27.109556 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105661 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 17:59:27.109556 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105664 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 17:59:27.109556 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105668 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 17:59:27.109556 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105671 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 17:59:27.109556 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105673 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 17:59:27.109556 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105676 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 17:59:27.109556 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105679 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 17:59:27.109556 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105681 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 17:59:27.109556 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105684 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 17:59:27.109556 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105687 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 17:59:27.109556 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105691 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 17:59:27.109556 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105694 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 17:59:27.110039 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105697 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 17:59:27.110039 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105700 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 17:59:27.110039 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105702 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 17:59:27.110039 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105721 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 17:59:27.110039 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105725 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 17:59:27.110039 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105728 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 17:59:27.110039 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105731 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 17:59:27.110039 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105734 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 17:59:27.110039 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105736 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 17:59:27.110039 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105740 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 17:59:27.110039 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105745 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 17:59:27.110039 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105748 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 17:59:27.110039 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105751 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 17:59:27.110039 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105762 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 17:59:27.110039 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105765 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 17:59:27.110039 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105767 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 17:59:27.110039 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105770 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 17:59:27.110039 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105773 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 17:59:27.110039 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105776 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 17:59:27.110039 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105779 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 17:59:27.110542 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105782 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 17:59:27.110542 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105785 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 17:59:27.110542 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105788 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 17:59:27.110542 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105792 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 17:59:27.110542 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105795 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 17:59:27.110542 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105798 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 17:59:27.110542 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105800 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 17:59:27.110542 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105803 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 17:59:27.110542 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105806 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 17:59:27.110542 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105809 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 17:59:27.110542 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105811 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 17:59:27.110542 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105814 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 17:59:27.110542 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105816 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 17:59:27.110542 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105819 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 17:59:27.110542 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105821 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 17:59:27.110542 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105824 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 17:59:27.110542 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105826 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 17:59:27.110542 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105829 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 17:59:27.110542 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105831 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 17:59:27.111021 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105835 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 17:59:27.111021 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105838 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 17:59:27.111021 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105841 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 17:59:27.111021 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105844 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 17:59:27.111021 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105847 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 17:59:27.111021 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105850 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 17:59:27.111021 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105852 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 17:59:27.111021 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105855 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 17:59:27.111021 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105857 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 17:59:27.111021 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105860 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 17:59:27.111021 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105862 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 17:59:27.111021 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105865 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 17:59:27.111021 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105868 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 17:59:27.111021 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105871 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 17:59:27.111021 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105874 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 17:59:27.111021 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105877 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 17:59:27.111021 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105879 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 17:59:27.111021 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105882 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 17:59:27.111021 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105885 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 17:59:27.111021 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105887 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 17:59:27.111490 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.105890 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 17:59:27.111490 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.105895 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 17:59:27.111490 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106023 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 17:59:27.111490 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106027 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 17:59:27.111490 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106032 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 17:59:27.111490 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106036 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 17:59:27.111490 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106039 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 17:59:27.111490 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106041 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 17:59:27.111490 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106044 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 17:59:27.111490 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106047 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 17:59:27.111490 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106050 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 17:59:27.111490 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106054 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 17:59:27.111490 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106057 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 17:59:27.111490 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106060 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 17:59:27.111851 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106063 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 17:59:27.111851 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106066 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 17:59:27.111851 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106068 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 17:59:27.111851 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106071 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 17:59:27.111851 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106073 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 17:59:27.111851 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106076 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 17:59:27.111851 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106079 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 17:59:27.111851 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106081 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 17:59:27.111851 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106084 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 17:59:27.111851 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106086 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 17:59:27.111851 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106089 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 17:59:27.111851 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106092 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 17:59:27.111851 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106094 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 17:59:27.111851 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106097 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 17:59:27.111851 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106099 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 17:59:27.111851 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106102 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 17:59:27.111851 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106105 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 17:59:27.111851 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106108 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 17:59:27.111851 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106110 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 17:59:27.111851 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106113 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 17:59:27.112324 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106115 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 17:59:27.112324 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106118 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 17:59:27.112324 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106120 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 17:59:27.112324 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106123 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 10 17:59:27.112324 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106126 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 17:59:27.112324 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106128 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 17:59:27.112324 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106130 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 17:59:27.112324 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106133 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 17:59:27.112324 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106135 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 17:59:27.112324 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106138 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 17:59:27.112324 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106140 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 17:59:27.112324 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106142 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 17:59:27.112324 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106145 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 17:59:27.112324 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106147 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 17:59:27.112324 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106150 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 17:59:27.112324 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106152 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 17:59:27.112324 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106155 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 17:59:27.112324 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106157 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 17:59:27.112324 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106160 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 17:59:27.112324 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106162 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 17:59:27.112820 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106164 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 17:59:27.112820 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106167 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 17:59:27.112820 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106169 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 17:59:27.112820 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106172 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 17:59:27.112820 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106175 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 17:59:27.112820 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106178 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 17:59:27.112820 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106180 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 17:59:27.112820 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106183 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 17:59:27.112820 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106186 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 17:59:27.112820 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106189 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 17:59:27.112820 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106191 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 17:59:27.112820 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106194 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 17:59:27.112820 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106196 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 17:59:27.112820 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106199 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 17:59:27.112820 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106201 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 17:59:27.112820 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106204 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 17:59:27.112820 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106206 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 17:59:27.112820 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106209 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 17:59:27.112820 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106211 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 17:59:27.112820 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106214 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 17:59:27.113294 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106216 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 17:59:27.113294 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106218 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 17:59:27.113294 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106221 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 17:59:27.113294 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106224 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 17:59:27.113294 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106226 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 17:59:27.113294 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106229 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 17:59:27.113294 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106231 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 17:59:27.113294 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106233 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 17:59:27.113294 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106236 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 17:59:27.113294 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106238 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 17:59:27.113294 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106241 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 17:59:27.113294 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106243 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 17:59:27.113294 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106246 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 17:59:27.113294 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106249 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 17:59:27.113294 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106251 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 17:59:27.113294 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106253 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 17:59:27.113294 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106260 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 17:59:27.113294 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106263 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 17:59:27.113294 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106266 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 17:59:27.113294 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106268 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 17:59:27.113789 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106271 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 17:59:27.113789 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106273 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 17:59:27.113789 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106276 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 17:59:27.113789 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106279 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 17:59:27.113789 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106281 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 17:59:27.113789 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106284 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 17:59:27.113789 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:27.106286 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 17:59:27.113789 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.106291 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 17:59:27.113789 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.108010 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 17:59:27.113789 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.110468 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 17:59:27.113789 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.112094 2579 server.go:1019] "Starting client certificate rotation" Jul 10 17:59:27.113789 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.112197 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 17:59:27.113789 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.113023 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 17:59:27.115636 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.115622 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 17:59:27.120006 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.119990 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 17:59:27.132828 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.132809 2579 log.go:25] "Validated CRI v1 runtime API" Jul 10 17:59:27.134995 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.134980 2579 log.go:25] "Validated CRI v1 image API" Jul 10 17:59:27.135857 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.135842 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 17:59:27.140070 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.140048 2579 fs.go:135] Filesystem UUIDs: map[33db2321-9b72-4f5e-8d38-a2ccdcb3040a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d68239af-d76a-4a6d-b7cc-6dcee455b41d:/dev/nvme0n1p3] Jul 10 17:59:27.140133 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.140067 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 17:59:27.143998 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.143974 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 17:59:27.146195 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.146084 2579 manager.go:216] Machine: {Timestamp:2026-07-10 17:59:27.14469127 +0000 UTC m=+0.371662336 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3091773 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2aa5b5f407ee72dc31ea34580b754a SystemUUID:ec2aa5b5-f407-ee72-dc31-ea34580b754a BootID:cd94f6f8-1916-42cd-9f75-5826cb2024be Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:65:27:d7:c4:47 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:65:27:d7:c4:47 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:18:fe:62:7a:20 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 17:59:27.146195 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.146189 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 17:59:27.146321 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.146261 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 17:59:27.149693 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.149666 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 17:59:27.149853 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.149696 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-201.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 17:59:27.150489 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.150479 2579 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 17:59:27.150523 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.150493 2579 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 17:59:27.150523 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.150500 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 17:59:27.150523 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.150514 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 17:59:27.152240 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.152230 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 17:59:27.155637 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.155625 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 10 17:59:27.155793 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.155783 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 17:59:27.155826 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.155814 2579 kubelet.go:486] "Attempting to sync node with API server" Jul 10 17:59:27.155826 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.155823 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 17:59:27.155882 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.155838 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 17:59:27.155882 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.155847 2579 kubelet.go:398] "Adding apiserver pod source" Jul 10 17:59:27.155882 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.155856 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 17:59:27.156225 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.156210 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 17:59:27.156294 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.156229 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 17:59:27.159091 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.159066 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 17:59:27.161610 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.161596 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 17:59:27.161671 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.161628 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 17:59:27.161833 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.161822 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 17:59:27.161867 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.161839 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 17:59:27.161867 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.161845 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 17:59:27.161867 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.161850 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 17:59:27.161867 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.161859 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 17:59:27.161867 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.161864 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 17:59:27.162539 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.162530 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 17:59:27.162539 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.162539 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 17:59:27.162614 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.162546 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 17:59:27.162614 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.162552 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 17:59:27.162614 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.162560 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 17:59:27.162614 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.162568 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 17:59:27.163418 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.163408 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 17:59:27.163451 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.163419 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 17:59:27.165184 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.165165 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-201.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 17:59:27.165229 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:27.165163 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-201.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 17:59:27.165229 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:27.165199 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 17:59:27.166673 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.166660 2579 server.go:1268] "Started kubelet" Jul 10 17:59:27.166773 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.166745 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 17:59:27.166829 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.166793 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 17:59:27.166927 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.166879 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 17:59:27.167492 ip-10-0-138-201 systemd[1]: Started Kubernetes Kubelet. Jul 10 17:59:27.168592 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.168577 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 17:59:27.168957 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.168945 2579 server.go:310] "Adding debug handlers to kubelet server" Jul 10 17:59:27.174530 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:27.174511 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 17:59:27.176364 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.176344 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 17:59:27.176471 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.176360 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 17:59:27.176527 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:27.176482 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-201.ec2.internal\" not found" Jul 10 17:59:27.177179 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.177161 2579 factory.go:55] Registering systemd factory Jul 10 17:59:27.177256 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.177206 2579 factory.go:223] Registration of the systemd container factory successfully Jul 10 17:59:27.177256 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.177236 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 17:59:27.177256 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.177236 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 17:59:27.177402 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.177276 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 17:59:27.177402 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.177374 2579 reconstruct.go:97] "Volume reconstruction finished" Jul 10 17:59:27.177402 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.177383 2579 reconciler.go:29] "Reconciler: start to sync state" Jul 10 17:59:27.177548 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.177535 2579 factory.go:153] Registering CRI-O factory Jul 10 17:59:27.177548 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.177549 2579 factory.go:223] Registration of the crio container factory successfully Jul 10 17:59:27.177641 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.177607 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 17:59:27.177641 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.177631 2579 factory.go:103] Registering Raw factory Jul 10 17:59:27.177745 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.177646 2579 manager.go:1196] Started watching for new ooms in manager Jul 10 17:59:27.178349 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.178333 2579 manager.go:349] Starting recovery of all containers Jul 10 17:59:27.179922 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:27.179898 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 10 17:59:27.180136 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:27.180113 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-201.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 10 17:59:27.181034 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:27.179851 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-201.ec2.internal.18c0ff7d8e91d725 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-201.ec2.internal,UID:ip-10-0-138-201.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-201.ec2.internal,},FirstTimestamp:2026-07-10 17:59:27.166633765 +0000 UTC m=+0.393604812,LastTimestamp:2026-07-10 17:59:27.166633765 +0000 UTC m=+0.393604812,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-201.ec2.internal,}" Jul 10 17:59:27.189490 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.189467 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g8667" Jul 10 17:59:27.190695 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.190674 2579 manager.go:354] Recovery completed Jul 10 17:59:27.196243 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.196129 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 17:59:27.196459 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.196441 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g8667" Jul 10 17:59:27.197921 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.197904 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-201.ec2.internal" event="NodeHasSufficientMemory" Jul 10 17:59:27.197998 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.197936 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-201.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 17:59:27.197998 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.197947 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-201.ec2.internal" event="NodeHasSufficientPID" Jul 10 17:59:27.198485 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.198464 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 17:59:27.198485 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.198483 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 17:59:27.198565 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.198483 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 17:59:27.198565 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.198552 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 10 17:59:27.199168 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.199155 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-201.ec2.internal" event="NodeHasSufficientMemory" Jul 10 17:59:27.199237 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.199181 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-201.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 17:59:27.199237 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.199196 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-201.ec2.internal" event="NodeHasSufficientPID" Jul 10 17:59:27.199851 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.199839 2579 policy_none.go:49] "None policy: Start" Jul 10 17:59:27.199890 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.199856 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 17:59:27.199890 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.199866 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 17:59:27.200155 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:27.200083 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-201.ec2.internal.18c0ff7d906f3dca default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-201.ec2.internal,UID:ip-10-0-138-201.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-201.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-201.ec2.internal,},FirstTimestamp:2026-07-10 17:59:27.197920714 +0000 UTC m=+0.424891765,LastTimestamp:2026-07-10 17:59:27.197920714 +0000 UTC m=+0.424891765,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-201.ec2.internal,}" Jul 10 17:59:27.201249 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.201238 2579 policy_none.go:47] "Start" Jul 10 17:59:27.239336 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.239320 2579 manager.go:337] "Starting Device Plugin manager" Jul 10 17:59:27.247019 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:27.239386 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 17:59:27.247019 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.239402 2579 server.go:87] "Starting device plugin registration server" Jul 10 17:59:27.247019 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.239680 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 17:59:27.247019 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.239697 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 17:59:27.247019 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.239814 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 17:59:27.247019 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.239900 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 17:59:27.247019 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.239908 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 17:59:27.247019 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:27.240403 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 17:59:27.247019 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:27.240447 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-201.ec2.internal\" not found" Jul 10 17:59:27.280791 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.280749 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 17:59:27.281993 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.281974 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 17:59:27.282069 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.282007 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 17:59:27.282069 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.282038 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 17:59:27.282171 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:27.282069 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 17:59:27.284019 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.283995 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 17:59:27.340805 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.340724 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 17:59:27.341641 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.341625 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-201.ec2.internal" event="NodeHasSufficientMemory" Jul 10 17:59:27.341751 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.341659 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-201.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 17:59:27.341751 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.341672 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-201.ec2.internal" event="NodeHasSufficientPID" Jul 10 17:59:27.341751 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.341719 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-201.ec2.internal" Jul 10 17:59:27.352450 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.352431 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-201.ec2.internal" Jul 10 17:59:27.352509 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:27.352453 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-201.ec2.internal\": node \"ip-10-0-138-201.ec2.internal\" not found" Jul 10 17:59:27.371835 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:27.371811 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-201.ec2.internal\" not found" Jul 10 17:59:27.382241 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.382214 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-201.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-201.ec2.internal"] Jul 10 17:59:27.382314 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.382281 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 17:59:27.383628 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.383613 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-201.ec2.internal" event="NodeHasSufficientMemory" Jul 10 17:59:27.383694 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.383641 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-201.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 17:59:27.383694 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.383653 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-201.ec2.internal" event="NodeHasSufficientPID" Jul 10 17:59:27.384838 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.384827 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 17:59:27.384966 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.384951 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-201.ec2.internal" Jul 10 17:59:27.385053 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.384987 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 17:59:27.385495 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.385477 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-201.ec2.internal" event="NodeHasSufficientMemory" Jul 10 17:59:27.385575 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.385503 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-201.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 17:59:27.385575 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.385477 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-201.ec2.internal" event="NodeHasSufficientMemory" Jul 10 17:59:27.385575 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.385517 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-201.ec2.internal" event="NodeHasSufficientPID" Jul 10 17:59:27.385575 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.385530 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-201.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 17:59:27.385575 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.385541 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-201.ec2.internal" event="NodeHasSufficientPID" Jul 10 17:59:27.386631 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.386619 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-201.ec2.internal" Jul 10 17:59:27.386675 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.386642 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 17:59:27.387325 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.387301 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-201.ec2.internal" event="NodeHasSufficientMemory" Jul 10 17:59:27.387391 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.387335 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-201.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 17:59:27.387391 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.387351 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-201.ec2.internal" event="NodeHasSufficientPID" Jul 10 17:59:27.419359 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:27.419338 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-201.ec2.internal\" not found" node="ip-10-0-138-201.ec2.internal" Jul 10 17:59:27.423545 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:27.423530 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-201.ec2.internal\" not found" node="ip-10-0-138-201.ec2.internal" Jul 10 17:59:27.472814 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:27.472787 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-201.ec2.internal\" not found" Jul 10 17:59:27.479866 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.479848 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a3907f44b0fbb7897398c7f3ac845f75-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-201.ec2.internal\" (UID: \"a3907f44b0fbb7897398c7f3ac845f75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-201.ec2.internal" Jul 10 17:59:27.479948 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.479874 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3907f44b0fbb7897398c7f3ac845f75-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-201.ec2.internal\" (UID: \"a3907f44b0fbb7897398c7f3ac845f75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-201.ec2.internal" Jul 10 17:59:27.479948 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:27.479899 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a72846258c46978b3a5ef8b6cbff19db-config\") pod \"kube-apiserver-proxy-ip-10-0-138-201.ec2.internal\" (UID: \"a72846258c46978b3a5ef8b6cbff19db\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-201.ec2.internal" Jul 10 17:59:28.959096 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:28.959070 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-201.ec2.internal\" not found" Jul 10 17:59:28.966478 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:28.966448 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a3907f44b0fbb7897398c7f3ac845f75-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-201.ec2.internal\" (UID: \"a3907f44b0fbb7897398c7f3ac845f75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-201.ec2.internal" Jul 10 17:59:28.966478 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:28.966482 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3907f44b0fbb7897398c7f3ac845f75-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-201.ec2.internal\" (UID: \"a3907f44b0fbb7897398c7f3ac845f75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-201.ec2.internal" Jul 10 17:59:28.966583 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:28.966505 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a72846258c46978b3a5ef8b6cbff19db-config\") pod \"kube-apiserver-proxy-ip-10-0-138-201.ec2.internal\" (UID: \"a72846258c46978b3a5ef8b6cbff19db\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-201.ec2.internal" Jul 10 17:59:28.966583 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:28.966549 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a72846258c46978b3a5ef8b6cbff19db-config\") pod \"kube-apiserver-proxy-ip-10-0-138-201.ec2.internal\" (UID: \"a72846258c46978b3a5ef8b6cbff19db\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-201.ec2.internal" Jul 10 17:59:28.966583 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:28.966550 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a3907f44b0fbb7897398c7f3ac845f75-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-201.ec2.internal\" (UID: \"a3907f44b0fbb7897398c7f3ac845f75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-201.ec2.internal" Jul 10 17:59:28.966583 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:28.966561 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3907f44b0fbb7897398c7f3ac845f75-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-201.ec2.internal\" (UID: \"a3907f44b0fbb7897398c7f3ac845f75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-201.ec2.internal" Jul 10 17:59:29.059806 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:29.059783 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-201.ec2.internal\" not found" Jul 10 17:59:29.107306 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:29.107283 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-201.ec2.internal" Jul 10 17:59:29.112957 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:29.112941 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-201.ec2.internal" Jul 10 17:59:29.160577 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:29.160551 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-201.ec2.internal\" not found" Jul 10 17:59:29.261061 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:29.261037 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-201.ec2.internal\" not found" Jul 10 17:59:29.361616 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:29.361556 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-201.ec2.internal\" not found" Jul 10 17:59:29.462121 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:29.462095 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-201.ec2.internal\" not found" Jul 10 17:59:29.497553 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:29.497528 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 17:59:29.498032 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:29.497663 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 17:59:29.563460 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:29.563429 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-201.ec2.internal\" not found" Jul 10 17:59:29.579301 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:29.579276 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 17:59:29.587128 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:29.587102 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 17:54:28 +0000 UTC" deadline="2028-01-10 18:44:30.051411216 +0000 UTC" Jul 10 17:59:29.587182 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:29.587129 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13176h45m0.464285474s" Jul 10 17:59:29.595161 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:29.595132 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3907f44b0fbb7897398c7f3ac845f75.slice/crio-88a43525fd9e42c63460f6fe27e6132e284919e6dd000c04c658b11818ba3f0c WatchSource:0}: Error finding container 88a43525fd9e42c63460f6fe27e6132e284919e6dd000c04c658b11818ba3f0c: Status 404 returned error can't find the container with id 88a43525fd9e42c63460f6fe27e6132e284919e6dd000c04c658b11818ba3f0c Jul 10 17:59:29.595510 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:29.595493 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda72846258c46978b3a5ef8b6cbff19db.slice/crio-4e066de980f2db1f779a3e09c3eebeebd664bc3ca22d44dcf550ec03193ec799 WatchSource:0}: Error finding container 4e066de980f2db1f779a3e09c3eebeebd664bc3ca22d44dcf550ec03193ec799: Status 404 returned error can't find the container with id 4e066de980f2db1f779a3e09c3eebeebd664bc3ca22d44dcf550ec03193ec799 Jul 10 17:59:29.599828 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:29.599814 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 17:59:29.664153 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:29.664104 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-201.ec2.internal\" not found" Jul 10 17:59:29.671085 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:29.671047 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-201.ec2.internal" event={"ID":"a3907f44b0fbb7897398c7f3ac845f75","Type":"ContainerStarted","Data":"88a43525fd9e42c63460f6fe27e6132e284919e6dd000c04c658b11818ba3f0c"} Jul 10 17:59:29.672003 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:29.671978 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-201.ec2.internal" event={"ID":"a72846258c46978b3a5ef8b6cbff19db","Type":"ContainerStarted","Data":"4e066de980f2db1f779a3e09c3eebeebd664bc3ca22d44dcf550ec03193ec799"} Jul 10 17:59:29.752647 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:29.752623 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 17:59:29.763327 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:29.763310 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-201.ec2.internal" Jul 10 17:59:29.775638 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:29.775623 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 17:59:29.776764 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:29.776752 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-201.ec2.internal" Jul 10 17:59:29.784986 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:29.784973 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 17:59:30.064871 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.064838 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 17:59:30.320285 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.320213 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 17:59:30.543424 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.543396 2579 apiserver.go:52] "Watching apiserver" Jul 10 17:59:30.553053 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.553025 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 17:59:30.554347 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.554311 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-8crj6","openshift-multus/multus-4gr4p","openshift-multus/network-metrics-daemon-tcbv4","openshift-network-diagnostics/network-check-target-lcvdz","openshift-network-operator/iptables-alerter-v8zrl","kube-system/global-pull-secret-syncer-lkzjv","kube-system/kube-apiserver-proxy-ip-10-0-138-201.ec2.internal","openshift-dns/node-resolver-2jckr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-201.ec2.internal","openshift-multus/multus-additional-cni-plugins-w9m88","openshift-ovn-kubernetes/ovnkube-node-g7lqp","kube-system/konnectivity-agent-sz5jj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m","openshift-cluster-node-tuning-operator/tuned-s6jdr"] Jul 10 17:59:30.556008 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.555985 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.557136 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.557115 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.558476 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.558451 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:30.558601 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:30.558526 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcbv4" podUID="ed23dc61-5837-41ea-95e3-dda5b5a90212" Jul 10 17:59:30.558661 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.558624 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 17:59:30.558908 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.558889 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dkx8d\"" Jul 10 17:59:30.558908 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.558903 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 17:59:30.559084 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.558930 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 17:59:30.559189 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.559176 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 17:59:30.559278 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.559261 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n6xqx\"" Jul 10 17:59:30.559366 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.559348 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 17:59:30.559413 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.559367 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 17:59:30.559944 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.559923 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8crj6" Jul 10 17:59:30.561300 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.561275 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v8zrl" Jul 10 17:59:30.562120 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.562094 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 17:59:30.562120 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.562111 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 17:59:30.562272 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.562180 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bmrl7\"" Jul 10 17:59:30.562391 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.562376 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 17:59:30.562794 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.562774 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.563363 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.563243 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 17:59:30.563363 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.563270 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 17:59:30.563532 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.563459 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-52qbr\"" Jul 10 17:59:30.563532 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.563463 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 17:59:30.563532 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.563475 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 17:59:30.564404 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.564388 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.564937 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.564913 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 17:59:30.565429 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.565175 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 17:59:30.565429 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.565262 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 17:59:30.565556 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.565492 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sm85d\"" Jul 10 17:59:30.566139 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.566122 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2jckr" Jul 10 17:59:30.567747 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.567726 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 17:59:30.567832 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:30.567800 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcvdz" podUID="cf0aba2c-014d-4034-9d96-29ff4c768bb7" Jul 10 17:59:30.568464 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.568446 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 17:59:30.568568 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.568496 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 17:59:30.568568 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.568509 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 17:59:30.569031 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.568908 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 17:59:30.569031 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.568918 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jxlnc\"" Jul 10 17:59:30.569179 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.569043 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 17:59:30.569179 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.569049 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 17:59:30.569421 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.569404 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sz5jj" Jul 10 17:59:30.569821 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.569803 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 17:59:30.569821 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.569812 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 17:59:30.569998 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.569873 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6jspl\"" Jul 10 17:59:30.571025 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.570786 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:30.571025 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:30.570909 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkzjv" podUID="2418c763-f86f-480e-bd1e-1766be24925f" Jul 10 17:59:30.571988 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.571756 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-d4c4v\"" Jul 10 17:59:30.571988 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.571776 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 17:59:30.571988 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.571789 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 17:59:30.572272 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.572249 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.573608 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.573577 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-host-kubelet\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.573712 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.573617 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e71f5f58-2ce4-4387-b198-55f3ebc9ff22-serviceca\") pod \"node-ca-8crj6\" (UID: \"e71f5f58-2ce4-4387-b198-55f3ebc9ff22\") " pod="openshift-image-registry/node-ca-8crj6" Jul 10 17:59:30.573712 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.573686 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-var-lib-openvswitch\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.573814 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.573717 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-run-openvswitch\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.573814 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.573760 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/52aab70c-440a-4538-ae58-11b63fafef6a-cni-binary-copy\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.574025 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.574000 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-host-var-lib-cni-multus\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.574083 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.574035 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-multus-socket-dir-parent\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.574083 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.574057 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x7zd\" (UniqueName: \"kubernetes.io/projected/ed23dc61-5837-41ea-95e3-dda5b5a90212-kube-api-access-9x7zd\") pod \"network-metrics-daemon-tcbv4\" (UID: \"ed23dc61-5837-41ea-95e3-dda5b5a90212\") " pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:30.574083 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.574076 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tclw\" (UniqueName: \"kubernetes.io/projected/1c3e4f0a-8381-4159-9db4-4217f1e7358d-kube-api-access-6tclw\") pod \"aws-ebs-csi-driver-node-m2q9m\" (UID: \"1c3e4f0a-8381-4159-9db4-4217f1e7358d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.574217 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.574096 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-os-release\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.574217 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.574114 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-hostroot\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.574217 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.574182 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e71f5f58-2ce4-4387-b198-55f3ebc9ff22-host\") pod \"node-ca-8crj6\" (UID: \"e71f5f58-2ce4-4387-b198-55f3ebc9ff22\") " pod="openshift-image-registry/node-ca-8crj6" Jul 10 17:59:30.574217 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.574210 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1c3e4f0a-8381-4159-9db4-4217f1e7358d-registration-dir\") pod \"aws-ebs-csi-driver-node-m2q9m\" (UID: \"1c3e4f0a-8381-4159-9db4-4217f1e7358d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.574510 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.574242 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-log-socket\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.574510 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.574270 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f19c24a-b23a-435f-af34-60945898354c-env-overrides\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.574510 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.574408 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs\") pod \"network-metrics-daemon-tcbv4\" (UID: \"ed23dc61-5837-41ea-95e3-dda5b5a90212\") " pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:30.574660 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.574563 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjmw6\" (UniqueName: \"kubernetes.io/projected/e71f5f58-2ce4-4387-b198-55f3ebc9ff22-kube-api-access-sjmw6\") pod \"node-ca-8crj6\" (UID: \"e71f5f58-2ce4-4387-b198-55f3ebc9ff22\") " pod="openshift-image-registry/node-ca-8crj6" Jul 10 17:59:30.574660 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.574617 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/52aab70c-440a-4538-ae58-11b63fafef6a-multus-daemon-config\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.574751 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.574656 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-etc-kubernetes\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.574813 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.574793 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7f87z\"" Jul 10 17:59:30.574896 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.574875 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dmf8\" (UniqueName: \"kubernetes.io/projected/63886a28-9e42-48ce-8bf2-6f0984121b46-kube-api-access-7dmf8\") pod \"iptables-alerter-v8zrl\" (UID: \"63886a28-9e42-48ce-8bf2-6f0984121b46\") " pod="openshift-network-operator/iptables-alerter-v8zrl" Jul 10 17:59:30.574953 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.574917 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-etc-openvswitch\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.574998 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.574793 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 17:59:30.575042 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.574995 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 17:59:30.575116 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575094 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f19c24a-b23a-435f-af34-60945898354c-ovnkube-config\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.575164 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575144 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0831409-aa8d-446b-9d46-cb7d1c739cbb-system-cni-dir\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.575212 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575198 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0831409-aa8d-446b-9d46-cb7d1c739cbb-cni-binary-copy\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.575262 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575232 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1c3e4f0a-8381-4159-9db4-4217f1e7358d-device-dir\") pod \"aws-ebs-csi-driver-node-m2q9m\" (UID: \"1c3e4f0a-8381-4159-9db4-4217f1e7358d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.575310 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575283 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1c3e4f0a-8381-4159-9db4-4217f1e7358d-sys-fs\") pod \"aws-ebs-csi-driver-node-m2q9m\" (UID: \"1c3e4f0a-8381-4159-9db4-4217f1e7358d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.575357 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575314 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1c3e4f0a-8381-4159-9db4-4217f1e7358d-etc-selinux\") pod \"aws-ebs-csi-driver-node-m2q9m\" (UID: \"1c3e4f0a-8381-4159-9db4-4217f1e7358d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.575404 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575367 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-multus-cni-dir\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.575456 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575400 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-host-var-lib-cni-bin\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.575456 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575430 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63886a28-9e42-48ce-8bf2-6f0984121b46-host-slash\") pod \"iptables-alerter-v8zrl\" (UID: \"63886a28-9e42-48ce-8bf2-6f0984121b46\") " pod="openshift-network-operator/iptables-alerter-v8zrl" Jul 10 17:59:30.575627 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575457 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-systemd-units\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.575627 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575520 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-host-slash\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.575627 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575554 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-host-run-netns\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.575627 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575585 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-node-log\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.575627 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575618 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0831409-aa8d-446b-9d46-cb7d1c739cbb-cnibin\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.575840 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575648 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-system-cni-dir\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.575840 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575680 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7nfq\" (UniqueName: \"kubernetes.io/projected/9f19c24a-b23a-435f-af34-60945898354c-kube-api-access-n7nfq\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.575840 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575710 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-multus-conf-dir\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.575840 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575740 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-host-cni-bin\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.575840 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575814 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.576123 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575869 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-cnibin\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.576123 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575916 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-host-var-lib-kubelet\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.576123 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575945 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-run-systemd\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.576123 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.575983 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0831409-aa8d-446b-9d46-cb7d1c739cbb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.576123 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.576027 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0831409-aa8d-446b-9d46-cb7d1c739cbb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.576123 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.576081 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f19c24a-b23a-435f-af34-60945898354c-ovnkube-script-lib\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.576123 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.576111 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0831409-aa8d-446b-9d46-cb7d1c739cbb-os-release\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.576532 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.576156 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1c3e4f0a-8381-4159-9db4-4217f1e7358d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m2q9m\" (UID: \"1c3e4f0a-8381-4159-9db4-4217f1e7358d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.576532 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.576183 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-host-run-k8s-cni-cncf-io\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.576532 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.576213 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-host-run-netns\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.576532 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.576242 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/63886a28-9e42-48ce-8bf2-6f0984121b46-iptables-alerter-script\") pod \"iptables-alerter-v8zrl\" (UID: \"63886a28-9e42-48ce-8bf2-6f0984121b46\") " pod="openshift-network-operator/iptables-alerter-v8zrl" Jul 10 17:59:30.576532 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.576299 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-run-ovn\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.576532 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.576324 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f19c24a-b23a-435f-af34-60945898354c-ovn-node-metrics-cert\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.576532 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.576358 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0831409-aa8d-446b-9d46-cb7d1c739cbb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.576532 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.576388 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-host-run-multus-certs\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.576532 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.576416 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sght2\" (UniqueName: \"kubernetes.io/projected/52aab70c-440a-4538-ae58-11b63fafef6a-kube-api-access-sght2\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.576532 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.576478 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-host-run-ovn-kubernetes\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.576532 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.576510 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-host-cni-netd\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.577033 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.576542 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brz7m\" (UniqueName: \"kubernetes.io/projected/c0831409-aa8d-446b-9d46-cb7d1c739cbb-kube-api-access-brz7m\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.577033 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.576627 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1c3e4f0a-8381-4159-9db4-4217f1e7358d-socket-dir\") pod \"aws-ebs-csi-driver-node-m2q9m\" (UID: \"1c3e4f0a-8381-4159-9db4-4217f1e7358d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.578920 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.578743 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 17:59:30.601818 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.601800 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6rptr" Jul 10 17:59:30.609331 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.609313 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6rptr" Jul 10 17:59:30.664384 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.664363 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 17:59:30.676952 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.676927 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-lib-modules\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.677068 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.676961 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f19c24a-b23a-435f-af34-60945898354c-ovnkube-script-lib\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.677068 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.676976 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0831409-aa8d-446b-9d46-cb7d1c739cbb-os-release\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.677068 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.676992 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1c3e4f0a-8381-4159-9db4-4217f1e7358d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m2q9m\" (UID: \"1c3e4f0a-8381-4159-9db4-4217f1e7358d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.677068 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677009 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-host-run-k8s-cni-cncf-io\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.677068 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677054 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-host-run-k8s-cni-cncf-io\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.677068 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677050 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-host-run-netns\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.677349 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677087 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-host-run-netns\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.677349 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677062 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1c3e4f0a-8381-4159-9db4-4217f1e7358d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m2q9m\" (UID: \"1c3e4f0a-8381-4159-9db4-4217f1e7358d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.677349 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677093 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2418c763-f86f-480e-bd1e-1766be24925f-kubelet-config\") pod \"global-pull-secret-syncer-lkzjv\" (UID: \"2418c763-f86f-480e-bd1e-1766be24925f\") " pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:30.677349 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677116 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0831409-aa8d-446b-9d46-cb7d1c739cbb-os-release\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.677349 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677137 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lglkh\" (UniqueName: \"kubernetes.io/projected/f23e6bd7-d9dd-417b-97e3-4463a60f7236-kube-api-access-lglkh\") pod \"node-resolver-2jckr\" (UID: \"f23e6bd7-d9dd-417b-97e3-4463a60f7236\") " pod="openshift-dns/node-resolver-2jckr" Jul 10 17:59:30.677349 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677168 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/63886a28-9e42-48ce-8bf2-6f0984121b46-iptables-alerter-script\") pod \"iptables-alerter-v8zrl\" (UID: \"63886a28-9e42-48ce-8bf2-6f0984121b46\") " pod="openshift-network-operator/iptables-alerter-v8zrl" Jul 10 17:59:30.677349 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677193 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-run-ovn\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.677349 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677216 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f19c24a-b23a-435f-af34-60945898354c-ovn-node-metrics-cert\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.677349 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677241 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0831409-aa8d-446b-9d46-cb7d1c739cbb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.677349 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677264 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-host-run-multus-certs\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.677349 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677288 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sght2\" (UniqueName: \"kubernetes.io/projected/52aab70c-440a-4538-ae58-11b63fafef6a-kube-api-access-sght2\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.677349 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-host-run-ovn-kubernetes\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.677349 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677339 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-host-cni-netd\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.677967 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677362 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brz7m\" (UniqueName: \"kubernetes.io/projected/c0831409-aa8d-446b-9d46-cb7d1c739cbb-kube-api-access-brz7m\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.677967 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677386 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1c3e4f0a-8381-4159-9db4-4217f1e7358d-socket-dir\") pod \"aws-ebs-csi-driver-node-m2q9m\" (UID: \"1c3e4f0a-8381-4159-9db4-4217f1e7358d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.677967 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677409 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-sys\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.677967 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677434 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-host-kubelet\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.677967 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677456 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e71f5f58-2ce4-4387-b198-55f3ebc9ff22-serviceca\") pod \"node-ca-8crj6\" (UID: \"e71f5f58-2ce4-4387-b198-55f3ebc9ff22\") " pod="openshift-image-registry/node-ca-8crj6" Jul 10 17:59:30.677967 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677480 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c45wd\" (UniqueName: \"kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd\") pod \"network-check-target-lcvdz\" (UID: \"cf0aba2c-014d-4034-9d96-29ff4c768bb7\") " pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 17:59:30.677967 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677504 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbp8p\" (UniqueName: \"kubernetes.io/projected/9ba99d86-2f5a-439b-8bbe-5883053a5e97-kube-api-access-kbp8p\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.677967 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677540 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-var-lib-openvswitch\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.677967 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677564 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f19c24a-b23a-435f-af34-60945898354c-ovnkube-script-lib\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.677967 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677581 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-run-openvswitch\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.677967 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677564 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-host-cni-netd\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.677967 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677607 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/52aab70c-440a-4538-ae58-11b63fafef6a-cni-binary-copy\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.677967 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677262 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-run-ovn\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.677967 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677632 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-host-var-lib-cni-multus\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.677967 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677656 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret\") pod \"global-pull-secret-syncer-lkzjv\" (UID: \"2418c763-f86f-480e-bd1e-1766be24925f\") " pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:30.677967 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677658 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-host-run-multus-certs\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.677967 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677679 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-etc-sysconfig\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.678674 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677751 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/63886a28-9e42-48ce-8bf2-6f0984121b46-iptables-alerter-script\") pod \"iptables-alerter-v8zrl\" (UID: \"63886a28-9e42-48ce-8bf2-6f0984121b46\") " pod="openshift-network-operator/iptables-alerter-v8zrl" Jul 10 17:59:30.678674 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677761 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-var-lib-openvswitch\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.678674 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677803 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-run-openvswitch\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.678674 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677815 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-host-run-ovn-kubernetes\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.678674 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677841 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-host-var-lib-cni-multus\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.678674 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677886 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-host-kubelet\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.678674 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677887 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-var-lib-kubelet\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.678674 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677604 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 17:59:30.678674 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677927 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-multus-socket-dir-parent\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.678674 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677939 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1c3e4f0a-8381-4159-9db4-4217f1e7358d-socket-dir\") pod \"aws-ebs-csi-driver-node-m2q9m\" (UID: \"1c3e4f0a-8381-4159-9db4-4217f1e7358d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.678674 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.677976 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/970dcd3c-8d21-40bb-8c9c-852507ae8a1f-agent-certs\") pod \"konnectivity-agent-sz5jj\" (UID: \"970dcd3c-8d21-40bb-8c9c-852507ae8a1f\") " pod="kube-system/konnectivity-agent-sz5jj" Jul 10 17:59:30.678674 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.678000 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-etc-modprobe-d\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.678674 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.678037 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9ba99d86-2f5a-439b-8bbe-5883053a5e97-etc-tuned\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.678674 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.678066 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ba99d86-2f5a-439b-8bbe-5883053a5e97-tmp\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.678674 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.678107 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0831409-aa8d-446b-9d46-cb7d1c739cbb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.678674 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.678132 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x7zd\" (UniqueName: \"kubernetes.io/projected/ed23dc61-5837-41ea-95e3-dda5b5a90212-kube-api-access-9x7zd\") pod \"network-metrics-daemon-tcbv4\" (UID: \"ed23dc61-5837-41ea-95e3-dda5b5a90212\") " pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:30.678674 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.678179 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-multus-socket-dir-parent\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.679323 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.678226 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tclw\" (UniqueName: \"kubernetes.io/projected/1c3e4f0a-8381-4159-9db4-4217f1e7358d-kube-api-access-6tclw\") pod \"aws-ebs-csi-driver-node-m2q9m\" (UID: \"1c3e4f0a-8381-4159-9db4-4217f1e7358d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.679323 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.678331 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-os-release\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.679323 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.678331 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e71f5f58-2ce4-4387-b198-55f3ebc9ff22-serviceca\") pod \"node-ca-8crj6\" (UID: \"e71f5f58-2ce4-4387-b198-55f3ebc9ff22\") " pod="openshift-image-registry/node-ca-8crj6" Jul 10 17:59:30.679323 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.678369 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-hostroot\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.679323 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.678400 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2418c763-f86f-480e-bd1e-1766be24925f-dbus\") pod \"global-pull-secret-syncer-lkzjv\" (UID: \"2418c763-f86f-480e-bd1e-1766be24925f\") " pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:30.679323 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.678448 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/52aab70c-440a-4538-ae58-11b63fafef6a-cni-binary-copy\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.679323 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.678452 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-os-release\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.679323 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.678458 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-hostroot\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.679323 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.678484 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-etc-sysctl-conf\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.679323 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.678516 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e71f5f58-2ce4-4387-b198-55f3ebc9ff22-host\") pod \"node-ca-8crj6\" (UID: \"e71f5f58-2ce4-4387-b198-55f3ebc9ff22\") " pod="openshift-image-registry/node-ca-8crj6" Jul 10 17:59:30.679323 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.678645 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e71f5f58-2ce4-4387-b198-55f3ebc9ff22-host\") pod \"node-ca-8crj6\" (UID: \"e71f5f58-2ce4-4387-b198-55f3ebc9ff22\") " pod="openshift-image-registry/node-ca-8crj6" Jul 10 17:59:30.679323 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.678977 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1c3e4f0a-8381-4159-9db4-4217f1e7358d-registration-dir\") pod \"aws-ebs-csi-driver-node-m2q9m\" (UID: \"1c3e4f0a-8381-4159-9db4-4217f1e7358d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.679323 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679008 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/970dcd3c-8d21-40bb-8c9c-852507ae8a1f-konnectivity-ca\") pod \"konnectivity-agent-sz5jj\" (UID: \"970dcd3c-8d21-40bb-8c9c-852507ae8a1f\") " pod="kube-system/konnectivity-agent-sz5jj" Jul 10 17:59:30.679323 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679022 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1c3e4f0a-8381-4159-9db4-4217f1e7358d-registration-dir\") pod \"aws-ebs-csi-driver-node-m2q9m\" (UID: \"1c3e4f0a-8381-4159-9db4-4217f1e7358d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.679323 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679038 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-log-socket\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.679323 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679067 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f19c24a-b23a-435f-af34-60945898354c-env-overrides\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.679323 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679146 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-log-socket\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.680079 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679372 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs\") pod \"network-metrics-daemon-tcbv4\" (UID: \"ed23dc61-5837-41ea-95e3-dda5b5a90212\") " pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:30.680079 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679399 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjmw6\" (UniqueName: \"kubernetes.io/projected/e71f5f58-2ce4-4387-b198-55f3ebc9ff22-kube-api-access-sjmw6\") pod \"node-ca-8crj6\" (UID: \"e71f5f58-2ce4-4387-b198-55f3ebc9ff22\") " pod="openshift-image-registry/node-ca-8crj6" Jul 10 17:59:30.680079 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679422 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/52aab70c-440a-4538-ae58-11b63fafef6a-multus-daemon-config\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.680079 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679460 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-etc-kubernetes\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.680079 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679491 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f23e6bd7-d9dd-417b-97e3-4463a60f7236-tmp-dir\") pod \"node-resolver-2jckr\" (UID: \"f23e6bd7-d9dd-417b-97e3-4463a60f7236\") " pod="openshift-dns/node-resolver-2jckr" Jul 10 17:59:30.680079 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:30.679503 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 17:59:30.680079 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679516 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dmf8\" (UniqueName: \"kubernetes.io/projected/63886a28-9e42-48ce-8bf2-6f0984121b46-kube-api-access-7dmf8\") pod \"iptables-alerter-v8zrl\" (UID: \"63886a28-9e42-48ce-8bf2-6f0984121b46\") " pod="openshift-network-operator/iptables-alerter-v8zrl" Jul 10 17:59:30.680079 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679540 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-etc-kubernetes\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.680079 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679558 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-etc-openvswitch\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.680079 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:30.679587 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs podName:ed23dc61-5837-41ea-95e3-dda5b5a90212 nodeName:}" failed. No retries permitted until 2026-07-10 17:59:31.179550168 +0000 UTC m=+3.020378434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs") pod "network-metrics-daemon-tcbv4" (UID: "ed23dc61-5837-41ea-95e3-dda5b5a90212") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 17:59:30.680079 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679629 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-etc-openvswitch\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.680079 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679643 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f19c24a-b23a-435f-af34-60945898354c-ovnkube-config\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.680079 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679686 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0831409-aa8d-446b-9d46-cb7d1c739cbb-system-cni-dir\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.680079 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679718 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0831409-aa8d-446b-9d46-cb7d1c739cbb-cni-binary-copy\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.680079 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679745 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1c3e4f0a-8381-4159-9db4-4217f1e7358d-device-dir\") pod \"aws-ebs-csi-driver-node-m2q9m\" (UID: \"1c3e4f0a-8381-4159-9db4-4217f1e7358d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.680079 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679756 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0831409-aa8d-446b-9d46-cb7d1c739cbb-system-cni-dir\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.680079 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679771 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1c3e4f0a-8381-4159-9db4-4217f1e7358d-sys-fs\") pod \"aws-ebs-csi-driver-node-m2q9m\" (UID: \"1c3e4f0a-8381-4159-9db4-4217f1e7358d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.680864 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679798 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-run\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.680864 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679824 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1c3e4f0a-8381-4159-9db4-4217f1e7358d-etc-selinux\") pod \"aws-ebs-csi-driver-node-m2q9m\" (UID: \"1c3e4f0a-8381-4159-9db4-4217f1e7358d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.680864 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679839 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1c3e4f0a-8381-4159-9db4-4217f1e7358d-device-dir\") pod \"aws-ebs-csi-driver-node-m2q9m\" (UID: \"1c3e4f0a-8381-4159-9db4-4217f1e7358d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.680864 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679865 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-multus-cni-dir\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.680864 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679896 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1c3e4f0a-8381-4159-9db4-4217f1e7358d-sys-fs\") pod \"aws-ebs-csi-driver-node-m2q9m\" (UID: \"1c3e4f0a-8381-4159-9db4-4217f1e7358d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.680864 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679898 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-etc-sysctl-d\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.680864 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679934 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-etc-systemd\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.680864 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679955 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-host\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.680864 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679978 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-host-var-lib-cni-bin\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.680864 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.679980 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-multus-cni-dir\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.680864 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680004 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63886a28-9e42-48ce-8bf2-6f0984121b46-host-slash\") pod \"iptables-alerter-v8zrl\" (UID: \"63886a28-9e42-48ce-8bf2-6f0984121b46\") " pod="openshift-network-operator/iptables-alerter-v8zrl" Jul 10 17:59:30.680864 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680009 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1c3e4f0a-8381-4159-9db4-4217f1e7358d-etc-selinux\") pod \"aws-ebs-csi-driver-node-m2q9m\" (UID: \"1c3e4f0a-8381-4159-9db4-4217f1e7358d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.680864 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680045 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-host-var-lib-cni-bin\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.680864 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680047 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63886a28-9e42-48ce-8bf2-6f0984121b46-host-slash\") pod \"iptables-alerter-v8zrl\" (UID: \"63886a28-9e42-48ce-8bf2-6f0984121b46\") " pod="openshift-network-operator/iptables-alerter-v8zrl" Jul 10 17:59:30.680864 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680070 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-systemd-units\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.680864 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680095 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-host-slash\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.680864 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680118 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-host-run-netns\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.681472 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680127 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f19c24a-b23a-435f-af34-60945898354c-env-overrides\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.681472 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680142 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-node-log\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.681472 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680151 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-systemd-units\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.681472 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680160 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/52aab70c-440a-4538-ae58-11b63fafef6a-multus-daemon-config\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.681472 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680182 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-host-slash\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.681472 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680191 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-host-run-netns\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.681472 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680195 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0831409-aa8d-446b-9d46-cb7d1c739cbb-cnibin\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.681472 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680165 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0831409-aa8d-446b-9d46-cb7d1c739cbb-cnibin\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.681472 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680223 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-node-log\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.681472 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680245 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f19c24a-b23a-435f-af34-60945898354c-ovnkube-config\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.681472 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680245 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0831409-aa8d-446b-9d46-cb7d1c739cbb-cni-binary-copy\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.681472 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680272 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-system-cni-dir\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.681472 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680227 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-system-cni-dir\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.681472 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680311 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7nfq\" (UniqueName: \"kubernetes.io/projected/9f19c24a-b23a-435f-af34-60945898354c-kube-api-access-n7nfq\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.681472 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680335 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-multus-conf-dir\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.681472 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680379 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-multus-conf-dir\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.681472 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680491 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f23e6bd7-d9dd-417b-97e3-4463a60f7236-hosts-file\") pod \"node-resolver-2jckr\" (UID: \"f23e6bd7-d9dd-417b-97e3-4463a60f7236\") " pod="openshift-dns/node-resolver-2jckr" Jul 10 17:59:30.681472 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680524 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-host-cni-bin\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.682191 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680546 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.682191 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680574 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-cnibin\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.682191 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680601 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-host-var-lib-kubelet\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.682191 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680606 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.682191 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680575 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-host-cni-bin\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.682191 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680655 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-host-var-lib-kubelet\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.682191 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680661 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/52aab70c-440a-4538-ae58-11b63fafef6a-cnibin\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.682191 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680685 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-run-systemd\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.682191 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0831409-aa8d-446b-9d46-cb7d1c739cbb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.682191 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680735 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f19c24a-b23a-435f-af34-60945898354c-run-systemd\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.682191 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680735 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0831409-aa8d-446b-9d46-cb7d1c739cbb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.682191 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680769 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-etc-kubernetes\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.682191 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.680895 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0831409-aa8d-446b-9d46-cb7d1c739cbb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.682191 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.681197 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0831409-aa8d-446b-9d46-cb7d1c739cbb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.682191 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.682098 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f19c24a-b23a-435f-af34-60945898354c-ovn-node-metrics-cert\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.685747 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.685688 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sght2\" (UniqueName: \"kubernetes.io/projected/52aab70c-440a-4538-ae58-11b63fafef6a-kube-api-access-sght2\") pod \"multus-4gr4p\" (UID: \"52aab70c-440a-4538-ae58-11b63fafef6a\") " pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.686048 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.685983 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tclw\" (UniqueName: \"kubernetes.io/projected/1c3e4f0a-8381-4159-9db4-4217f1e7358d-kube-api-access-6tclw\") pod \"aws-ebs-csi-driver-node-m2q9m\" (UID: \"1c3e4f0a-8381-4159-9db4-4217f1e7358d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.686048 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.686023 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brz7m\" (UniqueName: \"kubernetes.io/projected/c0831409-aa8d-446b-9d46-cb7d1c739cbb-kube-api-access-brz7m\") pod \"multus-additional-cni-plugins-w9m88\" (UID: \"c0831409-aa8d-446b-9d46-cb7d1c739cbb\") " pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.686426 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.686404 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x7zd\" (UniqueName: \"kubernetes.io/projected/ed23dc61-5837-41ea-95e3-dda5b5a90212-kube-api-access-9x7zd\") pod \"network-metrics-daemon-tcbv4\" (UID: \"ed23dc61-5837-41ea-95e3-dda5b5a90212\") " pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:30.688384 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.688354 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjmw6\" (UniqueName: \"kubernetes.io/projected/e71f5f58-2ce4-4387-b198-55f3ebc9ff22-kube-api-access-sjmw6\") pod \"node-ca-8crj6\" (UID: \"e71f5f58-2ce4-4387-b198-55f3ebc9ff22\") " pod="openshift-image-registry/node-ca-8crj6" Jul 10 17:59:30.688488 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.688466 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dmf8\" (UniqueName: \"kubernetes.io/projected/63886a28-9e42-48ce-8bf2-6f0984121b46-kube-api-access-7dmf8\") pod \"iptables-alerter-v8zrl\" (UID: \"63886a28-9e42-48ce-8bf2-6f0984121b46\") " pod="openshift-network-operator/iptables-alerter-v8zrl" Jul 10 17:59:30.688557 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.688538 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7nfq\" (UniqueName: \"kubernetes.io/projected/9f19c24a-b23a-435f-af34-60945898354c-kube-api-access-n7nfq\") pod \"ovnkube-node-g7lqp\" (UID: \"9f19c24a-b23a-435f-af34-60945898354c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.781041 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781009 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-etc-kubernetes\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.781214 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781051 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-lib-modules\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.781214 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781075 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2418c763-f86f-480e-bd1e-1766be24925f-kubelet-config\") pod \"global-pull-secret-syncer-lkzjv\" (UID: \"2418c763-f86f-480e-bd1e-1766be24925f\") " pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:30.781214 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781090 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-etc-kubernetes\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.781214 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781100 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lglkh\" (UniqueName: \"kubernetes.io/projected/f23e6bd7-d9dd-417b-97e3-4463a60f7236-kube-api-access-lglkh\") pod \"node-resolver-2jckr\" (UID: \"f23e6bd7-d9dd-417b-97e3-4463a60f7236\") " pod="openshift-dns/node-resolver-2jckr" Jul 10 17:59:30.781214 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781159 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2418c763-f86f-480e-bd1e-1766be24925f-kubelet-config\") pod \"global-pull-secret-syncer-lkzjv\" (UID: \"2418c763-f86f-480e-bd1e-1766be24925f\") " pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:30.781214 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781180 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-sys\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.781534 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781217 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45wd\" (UniqueName: \"kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd\") pod \"network-check-target-lcvdz\" (UID: \"cf0aba2c-014d-4034-9d96-29ff4c768bb7\") " pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 17:59:30.781534 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781234 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-lib-modules\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.781534 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781243 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbp8p\" (UniqueName: \"kubernetes.io/projected/9ba99d86-2f5a-439b-8bbe-5883053a5e97-kube-api-access-kbp8p\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.781534 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781298 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-sys\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.781534 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781337 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret\") pod \"global-pull-secret-syncer-lkzjv\" (UID: \"2418c763-f86f-480e-bd1e-1766be24925f\") " pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:30.781534 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781363 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-etc-sysconfig\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.781534 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781380 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-var-lib-kubelet\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.781534 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781400 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/970dcd3c-8d21-40bb-8c9c-852507ae8a1f-agent-certs\") pod \"konnectivity-agent-sz5jj\" (UID: \"970dcd3c-8d21-40bb-8c9c-852507ae8a1f\") " pod="kube-system/konnectivity-agent-sz5jj" Jul 10 17:59:30.781534 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:30.781422 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 17:59:30.781534 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781451 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-etc-sysconfig\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.781534 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781424 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-etc-modprobe-d\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.781534 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:30.781491 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret podName:2418c763-f86f-480e-bd1e-1766be24925f nodeName:}" failed. No retries permitted until 2026-07-10 17:59:31.281471336 +0000 UTC m=+3.122299578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret") pod "global-pull-secret-syncer-lkzjv" (UID: "2418c763-f86f-480e-bd1e-1766be24925f") : object "kube-system"/"original-pull-secret" not registered Jul 10 17:59:30.781534 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781511 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-var-lib-kubelet\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.781534 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781519 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-etc-modprobe-d\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.781534 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781521 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9ba99d86-2f5a-439b-8bbe-5883053a5e97-etc-tuned\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.782201 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781549 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ba99d86-2f5a-439b-8bbe-5883053a5e97-tmp\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.782201 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781577 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2418c763-f86f-480e-bd1e-1766be24925f-dbus\") pod \"global-pull-secret-syncer-lkzjv\" (UID: \"2418c763-f86f-480e-bd1e-1766be24925f\") " pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:30.782201 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781596 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-etc-sysctl-conf\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.782201 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/970dcd3c-8d21-40bb-8c9c-852507ae8a1f-konnectivity-ca\") pod \"konnectivity-agent-sz5jj\" (UID: \"970dcd3c-8d21-40bb-8c9c-852507ae8a1f\") " pod="kube-system/konnectivity-agent-sz5jj" Jul 10 17:59:30.782201 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781657 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f23e6bd7-d9dd-417b-97e3-4463a60f7236-tmp-dir\") pod \"node-resolver-2jckr\" (UID: \"f23e6bd7-d9dd-417b-97e3-4463a60f7236\") " pod="openshift-dns/node-resolver-2jckr" Jul 10 17:59:30.782201 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781686 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-run\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.782201 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-etc-sysctl-d\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.782201 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781725 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2418c763-f86f-480e-bd1e-1766be24925f-dbus\") pod \"global-pull-secret-syncer-lkzjv\" (UID: \"2418c763-f86f-480e-bd1e-1766be24925f\") " pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:30.782201 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781733 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-etc-systemd\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.782201 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781766 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-host\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.782201 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781791 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-run\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.782201 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781802 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f23e6bd7-d9dd-417b-97e3-4463a60f7236-hosts-file\") pod \"node-resolver-2jckr\" (UID: \"f23e6bd7-d9dd-417b-97e3-4463a60f7236\") " pod="openshift-dns/node-resolver-2jckr" Jul 10 17:59:30.782201 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781896 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f23e6bd7-d9dd-417b-97e3-4463a60f7236-hosts-file\") pod \"node-resolver-2jckr\" (UID: \"f23e6bd7-d9dd-417b-97e3-4463a60f7236\") " pod="openshift-dns/node-resolver-2jckr" Jul 10 17:59:30.782201 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781912 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-etc-sysctl-d\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.782201 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781938 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-etc-sysctl-conf\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.782201 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781958 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-etc-systemd\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.782201 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.781965 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ba99d86-2f5a-439b-8bbe-5883053a5e97-host\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.782201 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.782032 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f23e6bd7-d9dd-417b-97e3-4463a60f7236-tmp-dir\") pod \"node-resolver-2jckr\" (UID: \"f23e6bd7-d9dd-417b-97e3-4463a60f7236\") " pod="openshift-dns/node-resolver-2jckr" Jul 10 17:59:30.783068 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.782433 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/970dcd3c-8d21-40bb-8c9c-852507ae8a1f-konnectivity-ca\") pod \"konnectivity-agent-sz5jj\" (UID: \"970dcd3c-8d21-40bb-8c9c-852507ae8a1f\") " pod="kube-system/konnectivity-agent-sz5jj" Jul 10 17:59:30.784265 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.784241 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/970dcd3c-8d21-40bb-8c9c-852507ae8a1f-agent-certs\") pod \"konnectivity-agent-sz5jj\" (UID: \"970dcd3c-8d21-40bb-8c9c-852507ae8a1f\") " pod="kube-system/konnectivity-agent-sz5jj" Jul 10 17:59:30.784420 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.784401 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ba99d86-2f5a-439b-8bbe-5883053a5e97-tmp\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.784460 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.784417 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9ba99d86-2f5a-439b-8bbe-5883053a5e97-etc-tuned\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.787073 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:30.787053 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 17:59:30.787215 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:30.787080 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 17:59:30.787215 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:30.787095 2579 projected.go:196] Error preparing data for projected volume kube-api-access-c45wd for pod openshift-network-diagnostics/network-check-target-lcvdz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 17:59:30.787215 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:30.787160 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd podName:cf0aba2c-014d-4034-9d96-29ff4c768bb7 nodeName:}" failed. No retries permitted until 2026-07-10 17:59:31.287145512 +0000 UTC m=+3.127973760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c45wd" (UniqueName: "kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd") pod "network-check-target-lcvdz" (UID: "cf0aba2c-014d-4034-9d96-29ff4c768bb7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 17:59:30.789388 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.789368 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lglkh\" (UniqueName: \"kubernetes.io/projected/f23e6bd7-d9dd-417b-97e3-4463a60f7236-kube-api-access-lglkh\") pod \"node-resolver-2jckr\" (UID: \"f23e6bd7-d9dd-417b-97e3-4463a60f7236\") " pod="openshift-dns/node-resolver-2jckr" Jul 10 17:59:30.789463 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.789436 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbp8p\" (UniqueName: \"kubernetes.io/projected/9ba99d86-2f5a-439b-8bbe-5883053a5e97-kube-api-access-kbp8p\") pod \"tuned-s6jdr\" (UID: \"9ba99d86-2f5a-439b-8bbe-5883053a5e97\") " pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:30.868138 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.868078 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w9m88" Jul 10 17:59:30.876185 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.876164 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4gr4p" Jul 10 17:59:30.885903 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.885873 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8crj6" Jul 10 17:59:30.892563 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.892547 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v8zrl" Jul 10 17:59:30.898432 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.898415 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" Jul 10 17:59:30.906379 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.906360 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:30.914228 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.914211 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2jckr" Jul 10 17:59:30.920897 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.920879 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sz5jj" Jul 10 17:59:30.927363 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:30.927345 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" Jul 10 17:59:31.185130 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:31.185046 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs\") pod \"network-metrics-daemon-tcbv4\" (UID: \"ed23dc61-5837-41ea-95e3-dda5b5a90212\") " pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:31.185278 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:31.185182 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 17:59:31.185278 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:31.185238 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs podName:ed23dc61-5837-41ea-95e3-dda5b5a90212 nodeName:}" failed. No retries permitted until 2026-07-10 17:59:32.185222838 +0000 UTC m=+4.026051070 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs") pod "network-metrics-daemon-tcbv4" (UID: "ed23dc61-5837-41ea-95e3-dda5b5a90212") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 17:59:31.285720 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:31.285684 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret\") pod \"global-pull-secret-syncer-lkzjv\" (UID: \"2418c763-f86f-480e-bd1e-1766be24925f\") " pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:31.285881 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:31.285828 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 17:59:31.285963 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:31.285924 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret podName:2418c763-f86f-480e-bd1e-1766be24925f nodeName:}" failed. No retries permitted until 2026-07-10 17:59:32.285903928 +0000 UTC m=+4.126732163 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret") pod "global-pull-secret-syncer-lkzjv" (UID: "2418c763-f86f-480e-bd1e-1766be24925f") : object "kube-system"/"original-pull-secret" not registered Jul 10 17:59:31.386536 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:31.386487 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45wd\" (UniqueName: \"kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd\") pod \"network-check-target-lcvdz\" (UID: \"cf0aba2c-014d-4034-9d96-29ff4c768bb7\") " pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 17:59:31.386684 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:31.386654 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 17:59:31.386684 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:31.386677 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 17:59:31.386785 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:31.386687 2579 projected.go:196] Error preparing data for projected volume kube-api-access-c45wd for pod openshift-network-diagnostics/network-check-target-lcvdz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 17:59:31.386785 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:31.386737 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd podName:cf0aba2c-014d-4034-9d96-29ff4c768bb7 nodeName:}" failed. No retries permitted until 2026-07-10 17:59:32.386723896 +0000 UTC m=+4.227552127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c45wd" (UniqueName: "kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd") pod "network-check-target-lcvdz" (UID: "cf0aba2c-014d-4034-9d96-29ff4c768bb7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 17:59:31.589412 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:31.589389 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f19c24a_b23a_435f_af34_60945898354c.slice/crio-67dc415128c104d406c1edc8c15e49d483b522eccd67f3ffcb523a8f67f18aa6 WatchSource:0}: Error finding container 67dc415128c104d406c1edc8c15e49d483b522eccd67f3ffcb523a8f67f18aa6: Status 404 returned error can't find the container with id 67dc415128c104d406c1edc8c15e49d483b522eccd67f3ffcb523a8f67f18aa6 Jul 10 17:59:31.590929 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:31.590894 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ba99d86_2f5a_439b_8bbe_5883053a5e97.slice/crio-1ffdbb4ea201f3381c6a65fd2365d016178982deace3d81f875f8dcf9fbce4da WatchSource:0}: Error finding container 1ffdbb4ea201f3381c6a65fd2365d016178982deace3d81f875f8dcf9fbce4da: Status 404 returned error can't find the container with id 1ffdbb4ea201f3381c6a65fd2365d016178982deace3d81f875f8dcf9fbce4da Jul 10 17:59:31.596026 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:31.596003 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode71f5f58_2ce4_4387_b198_55f3ebc9ff22.slice/crio-670abba23cea513f8014b798b273bb881474f5d79f4d47e7be685d19600b4366 WatchSource:0}: Error finding container 670abba23cea513f8014b798b273bb881474f5d79f4d47e7be685d19600b4366: Status 404 returned error can't find the container with id 670abba23cea513f8014b798b273bb881474f5d79f4d47e7be685d19600b4366 Jul 10 17:59:31.596739 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:31.596708 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf23e6bd7_d9dd_417b_97e3_4463a60f7236.slice/crio-8811efef6ed55293ae1ff8f8179c9fdd101ced69eb826a00ed0aaa798fa13095 WatchSource:0}: Error finding container 8811efef6ed55293ae1ff8f8179c9fdd101ced69eb826a00ed0aaa798fa13095: Status 404 returned error can't find the container with id 8811efef6ed55293ae1ff8f8179c9fdd101ced69eb826a00ed0aaa798fa13095 Jul 10 17:59:31.597778 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:31.597663 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c3e4f0a_8381_4159_9db4_4217f1e7358d.slice/crio-051125b2fdb8c98a287004161cd1e5c76bd3cb39e354545ec119012dd145bdcb WatchSource:0}: Error finding container 051125b2fdb8c98a287004161cd1e5c76bd3cb39e354545ec119012dd145bdcb: Status 404 returned error can't find the container with id 051125b2fdb8c98a287004161cd1e5c76bd3cb39e354545ec119012dd145bdcb Jul 10 17:59:31.599054 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:31.598634 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod970dcd3c_8d21_40bb_8c9c_852507ae8a1f.slice/crio-0b07e9bae307aceab796db364ca54816aa2208e72c7af55aaf5a32766cca6bf7 WatchSource:0}: Error finding container 0b07e9bae307aceab796db364ca54816aa2208e72c7af55aaf5a32766cca6bf7: Status 404 returned error can't find the container with id 0b07e9bae307aceab796db364ca54816aa2208e72c7af55aaf5a32766cca6bf7 Jul 10 17:59:31.600099 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:31.600076 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63886a28_9e42_48ce_8bf2_6f0984121b46.slice/crio-084402e7df2f93dcafde461a0b750073163b67af9b5e0d47036de310743e7558 WatchSource:0}: Error finding container 084402e7df2f93dcafde461a0b750073163b67af9b5e0d47036de310743e7558: Status 404 returned error can't find the container with id 084402e7df2f93dcafde461a0b750073163b67af9b5e0d47036de310743e7558 Jul 10 17:59:31.601775 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:31.601741 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0831409_aa8d_446b_9d46_cb7d1c739cbb.slice/crio-993cac76054f0aeba5af9fa3f8989702a9e95bf2a97f777814b7bd8e5b1c7b1f WatchSource:0}: Error finding container 993cac76054f0aeba5af9fa3f8989702a9e95bf2a97f777814b7bd8e5b1c7b1f: Status 404 returned error can't find the container with id 993cac76054f0aeba5af9fa3f8989702a9e95bf2a97f777814b7bd8e5b1c7b1f Jul 10 17:59:31.602921 ip-10-0-138-201 kubenswrapper[2579]: W0710 17:59:31.602485 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52aab70c_440a_4538_ae58_11b63fafef6a.slice/crio-aeb673fe28394ed4bca7eff93715c7030b4c00e1b2f609e71d8005eb3273c2a2 WatchSource:0}: Error finding container aeb673fe28394ed4bca7eff93715c7030b4c00e1b2f609e71d8005eb3273c2a2: Status 404 returned error can't find the container with id aeb673fe28394ed4bca7eff93715c7030b4c00e1b2f609e71d8005eb3273c2a2 Jul 10 17:59:31.611578 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:31.611546 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 17:54:30 +0000 UTC" deadline="2028-01-11 01:35:38.875394129 +0000 UTC" Jul 10 17:59:31.611643 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:31.611579 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13183h36m7.263819601s" Jul 10 17:59:31.676383 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:31.676182 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" event={"ID":"1c3e4f0a-8381-4159-9db4-4217f1e7358d","Type":"ContainerStarted","Data":"051125b2fdb8c98a287004161cd1e5c76bd3cb39e354545ec119012dd145bdcb"} Jul 10 17:59:31.677261 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:31.677235 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2jckr" event={"ID":"f23e6bd7-d9dd-417b-97e3-4463a60f7236","Type":"ContainerStarted","Data":"8811efef6ed55293ae1ff8f8179c9fdd101ced69eb826a00ed0aaa798fa13095"} Jul 10 17:59:31.678491 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:31.678458 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" event={"ID":"9ba99d86-2f5a-439b-8bbe-5883053a5e97","Type":"ContainerStarted","Data":"1ffdbb4ea201f3381c6a65fd2365d016178982deace3d81f875f8dcf9fbce4da"} Jul 10 17:59:31.679845 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:31.679817 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" event={"ID":"9f19c24a-b23a-435f-af34-60945898354c","Type":"ContainerStarted","Data":"67dc415128c104d406c1edc8c15e49d483b522eccd67f3ffcb523a8f67f18aa6"} Jul 10 17:59:31.686294 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:31.686267 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4gr4p" event={"ID":"52aab70c-440a-4538-ae58-11b63fafef6a","Type":"ContainerStarted","Data":"aeb673fe28394ed4bca7eff93715c7030b4c00e1b2f609e71d8005eb3273c2a2"} Jul 10 17:59:31.687355 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:31.687334 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9m88" event={"ID":"c0831409-aa8d-446b-9d46-cb7d1c739cbb","Type":"ContainerStarted","Data":"993cac76054f0aeba5af9fa3f8989702a9e95bf2a97f777814b7bd8e5b1c7b1f"} Jul 10 17:59:31.688339 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:31.688313 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sz5jj" event={"ID":"970dcd3c-8d21-40bb-8c9c-852507ae8a1f","Type":"ContainerStarted","Data":"0b07e9bae307aceab796db364ca54816aa2208e72c7af55aaf5a32766cca6bf7"} Jul 10 17:59:31.689381 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:31.689358 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v8zrl" event={"ID":"63886a28-9e42-48ce-8bf2-6f0984121b46","Type":"ContainerStarted","Data":"084402e7df2f93dcafde461a0b750073163b67af9b5e0d47036de310743e7558"} Jul 10 17:59:31.690235 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:31.690218 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8crj6" event={"ID":"e71f5f58-2ce4-4387-b198-55f3ebc9ff22","Type":"ContainerStarted","Data":"670abba23cea513f8014b798b273bb881474f5d79f4d47e7be685d19600b4366"} Jul 10 17:59:31.696997 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:31.696958 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-201.ec2.internal" podStartSLOduration=2.6969459479999998 podStartE2EDuration="2.696945948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:59:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:59:31.696540184 +0000 UTC m=+3.537368439" watchObservedRunningTime="2026-07-10 17:59:31.696945948 +0000 UTC m=+3.537774202" Jul 10 17:59:32.193298 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:32.192693 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs\") pod \"network-metrics-daemon-tcbv4\" (UID: \"ed23dc61-5837-41ea-95e3-dda5b5a90212\") " pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:32.193298 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:32.192863 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 17:59:32.193298 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:32.192930 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs podName:ed23dc61-5837-41ea-95e3-dda5b5a90212 nodeName:}" failed. No retries permitted until 2026-07-10 17:59:34.192910472 +0000 UTC m=+6.033738727 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs") pod "network-metrics-daemon-tcbv4" (UID: "ed23dc61-5837-41ea-95e3-dda5b5a90212") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 17:59:32.293398 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:32.293359 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret\") pod \"global-pull-secret-syncer-lkzjv\" (UID: \"2418c763-f86f-480e-bd1e-1766be24925f\") " pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:32.293577 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:32.293537 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 17:59:32.293644 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:32.293598 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret podName:2418c763-f86f-480e-bd1e-1766be24925f nodeName:}" failed. No retries permitted until 2026-07-10 17:59:34.293579885 +0000 UTC m=+6.134408136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret") pod "global-pull-secret-syncer-lkzjv" (UID: "2418c763-f86f-480e-bd1e-1766be24925f") : object "kube-system"/"original-pull-secret" not registered Jul 10 17:59:32.394158 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:32.394075 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45wd\" (UniqueName: \"kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd\") pod \"network-check-target-lcvdz\" (UID: \"cf0aba2c-014d-4034-9d96-29ff4c768bb7\") " pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 17:59:32.394390 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:32.394375 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 17:59:32.394459 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:32.394397 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 17:59:32.394459 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:32.394410 2579 projected.go:196] Error preparing data for projected volume kube-api-access-c45wd for pod openshift-network-diagnostics/network-check-target-lcvdz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 17:59:32.394559 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:32.394465 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd podName:cf0aba2c-014d-4034-9d96-29ff4c768bb7 nodeName:}" failed. No retries permitted until 2026-07-10 17:59:34.394446603 +0000 UTC m=+6.235274838 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c45wd" (UniqueName: "kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd") pod "network-check-target-lcvdz" (UID: "cf0aba2c-014d-4034-9d96-29ff4c768bb7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 17:59:32.612692 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:32.612628 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 17:54:30 +0000 UTC" deadline="2028-01-01 04:28:47.095960451 +0000 UTC" Jul 10 17:59:32.612692 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:32.612690 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12946h29m14.483274852s" Jul 10 17:59:32.668981 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:32.668924 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:32.669128 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:32.669047 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkzjv" podUID="2418c763-f86f-480e-bd1e-1766be24925f" Jul 10 17:59:32.669530 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:32.669422 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:32.669629 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:32.669547 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcbv4" podUID="ed23dc61-5837-41ea-95e3-dda5b5a90212" Jul 10 17:59:32.671687 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:32.671662 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 17:59:32.671799 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:32.671751 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcvdz" podUID="cf0aba2c-014d-4034-9d96-29ff4c768bb7" Jul 10 17:59:32.713354 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:32.713318 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-201.ec2.internal" event={"ID":"a72846258c46978b3a5ef8b6cbff19db","Type":"ContainerStarted","Data":"523c4eaf995b98640828b826d3d2622b3e7ea9d4c31dcaf66a31dddf8c7f06e8"} Jul 10 17:59:32.719080 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:32.719050 2579 generic.go:356] "Generic (PLEG): container finished" podID="a3907f44b0fbb7897398c7f3ac845f75" containerID="3baf5300e165319a4db1b5154b57903644c6f4796ecd9ef0f7fbfdebd795aa73" exitCode=0 Jul 10 17:59:32.719214 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:32.719095 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-201.ec2.internal" event={"ID":"a3907f44b0fbb7897398c7f3ac845f75","Type":"ContainerDied","Data":"3baf5300e165319a4db1b5154b57903644c6f4796ecd9ef0f7fbfdebd795aa73"} Jul 10 17:59:33.744914 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:33.744714 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-201.ec2.internal" event={"ID":"a3907f44b0fbb7897398c7f3ac845f75","Type":"ContainerStarted","Data":"9db8eda13fe7ef098431d247ca70017482c2300ae0d4677a66b1370eea0705d6"} Jul 10 17:59:34.210747 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:34.210703 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs\") pod \"network-metrics-daemon-tcbv4\" (UID: \"ed23dc61-5837-41ea-95e3-dda5b5a90212\") " pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:34.211011 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:34.210989 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 17:59:34.211101 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:34.211065 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs podName:ed23dc61-5837-41ea-95e3-dda5b5a90212 nodeName:}" failed. No retries permitted until 2026-07-10 17:59:38.211046187 +0000 UTC m=+10.051874425 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs") pod "network-metrics-daemon-tcbv4" (UID: "ed23dc61-5837-41ea-95e3-dda5b5a90212") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 17:59:34.311490 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:34.311452 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret\") pod \"global-pull-secret-syncer-lkzjv\" (UID: \"2418c763-f86f-480e-bd1e-1766be24925f\") " pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:34.311665 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:34.311645 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 17:59:34.311751 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:34.311715 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret podName:2418c763-f86f-480e-bd1e-1766be24925f nodeName:}" failed. No retries permitted until 2026-07-10 17:59:38.311696013 +0000 UTC m=+10.152524269 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret") pod "global-pull-secret-syncer-lkzjv" (UID: "2418c763-f86f-480e-bd1e-1766be24925f") : object "kube-system"/"original-pull-secret" not registered Jul 10 17:59:34.412808 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:34.412771 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45wd\" (UniqueName: \"kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd\") pod \"network-check-target-lcvdz\" (UID: \"cf0aba2c-014d-4034-9d96-29ff4c768bb7\") " pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 17:59:34.412978 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:34.412955 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 17:59:34.413046 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:34.412979 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 17:59:34.413046 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:34.412991 2579 projected.go:196] Error preparing data for projected volume kube-api-access-c45wd for pod openshift-network-diagnostics/network-check-target-lcvdz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 17:59:34.413046 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:34.413045 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd podName:cf0aba2c-014d-4034-9d96-29ff4c768bb7 nodeName:}" failed. No retries permitted until 2026-07-10 17:59:38.41302742 +0000 UTC m=+10.253855670 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c45wd" (UniqueName: "kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd") pod "network-check-target-lcvdz" (UID: "cf0aba2c-014d-4034-9d96-29ff4c768bb7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 17:59:34.668501 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:34.668471 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:34.668690 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:34.668602 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkzjv" podUID="2418c763-f86f-480e-bd1e-1766be24925f" Jul 10 17:59:34.668936 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:34.668832 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:34.669036 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:34.668987 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcbv4" podUID="ed23dc61-5837-41ea-95e3-dda5b5a90212" Jul 10 17:59:34.669036 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:34.669011 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 17:59:34.669152 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:34.669101 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcvdz" podUID="cf0aba2c-014d-4034-9d96-29ff4c768bb7" Jul 10 17:59:36.669050 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:36.668909 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:36.669050 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:36.668936 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 17:59:36.669557 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:36.669061 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcbv4" podUID="ed23dc61-5837-41ea-95e3-dda5b5a90212" Jul 10 17:59:36.669557 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:36.669109 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:36.669557 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:36.669187 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcvdz" podUID="cf0aba2c-014d-4034-9d96-29ff4c768bb7" Jul 10 17:59:36.669557 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:36.669250 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkzjv" podUID="2418c763-f86f-480e-bd1e-1766be24925f" Jul 10 17:59:38.247449 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:38.247415 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs\") pod \"network-metrics-daemon-tcbv4\" (UID: \"ed23dc61-5837-41ea-95e3-dda5b5a90212\") " pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:38.247942 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:38.247594 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 17:59:38.247942 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:38.247669 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs podName:ed23dc61-5837-41ea-95e3-dda5b5a90212 nodeName:}" failed. No retries permitted until 2026-07-10 17:59:46.247648096 +0000 UTC m=+18.088476342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs") pod "network-metrics-daemon-tcbv4" (UID: "ed23dc61-5837-41ea-95e3-dda5b5a90212") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 17:59:38.348741 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:38.348702 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret\") pod \"global-pull-secret-syncer-lkzjv\" (UID: \"2418c763-f86f-480e-bd1e-1766be24925f\") " pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:38.348942 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:38.348902 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 17:59:38.349005 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:38.348978 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret podName:2418c763-f86f-480e-bd1e-1766be24925f nodeName:}" failed. No retries permitted until 2026-07-10 17:59:46.348958279 +0000 UTC m=+18.189786514 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret") pod "global-pull-secret-syncer-lkzjv" (UID: "2418c763-f86f-480e-bd1e-1766be24925f") : object "kube-system"/"original-pull-secret" not registered Jul 10 17:59:38.450154 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:38.449567 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45wd\" (UniqueName: \"kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd\") pod \"network-check-target-lcvdz\" (UID: \"cf0aba2c-014d-4034-9d96-29ff4c768bb7\") " pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 17:59:38.450154 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:38.449723 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 17:59:38.450154 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:38.449741 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 17:59:38.450154 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:38.449753 2579 projected.go:196] Error preparing data for projected volume kube-api-access-c45wd for pod openshift-network-diagnostics/network-check-target-lcvdz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 17:59:38.450154 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:38.449811 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd podName:cf0aba2c-014d-4034-9d96-29ff4c768bb7 nodeName:}" failed. No retries permitted until 2026-07-10 17:59:46.449794163 +0000 UTC m=+18.290622397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c45wd" (UniqueName: "kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd") pod "network-check-target-lcvdz" (UID: "cf0aba2c-014d-4034-9d96-29ff4c768bb7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 17:59:38.670703 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:38.670106 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:38.670703 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:38.670222 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkzjv" podUID="2418c763-f86f-480e-bd1e-1766be24925f" Jul 10 17:59:38.670703 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:38.670567 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:38.670703 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:38.670665 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcbv4" podUID="ed23dc61-5837-41ea-95e3-dda5b5a90212" Jul 10 17:59:38.670703 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:38.670701 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 17:59:38.671129 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:38.670777 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcvdz" podUID="cf0aba2c-014d-4034-9d96-29ff4c768bb7" Jul 10 17:59:40.672894 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:40.672860 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:40.673459 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:40.672981 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkzjv" podUID="2418c763-f86f-480e-bd1e-1766be24925f" Jul 10 17:59:40.673459 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:40.673073 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 17:59:40.673459 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:40.673073 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:40.673459 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:40.673174 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcvdz" podUID="cf0aba2c-014d-4034-9d96-29ff4c768bb7" Jul 10 17:59:40.673459 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:40.673259 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcbv4" podUID="ed23dc61-5837-41ea-95e3-dda5b5a90212" Jul 10 17:59:42.668717 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:42.668679 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:42.668717 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:42.668716 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:42.669258 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:42.668679 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 17:59:42.669258 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:42.668813 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkzjv" podUID="2418c763-f86f-480e-bd1e-1766be24925f" Jul 10 17:59:42.669258 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:42.668898 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcvdz" podUID="cf0aba2c-014d-4034-9d96-29ff4c768bb7" Jul 10 17:59:42.669258 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:42.668998 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcbv4" podUID="ed23dc61-5837-41ea-95e3-dda5b5a90212" Jul 10 17:59:44.669419 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:44.669382 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 17:59:44.669841 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:44.669424 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:44.669841 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:44.669386 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:44.669841 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:44.669511 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcvdz" podUID="cf0aba2c-014d-4034-9d96-29ff4c768bb7" Jul 10 17:59:44.669841 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:44.669597 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkzjv" podUID="2418c763-f86f-480e-bd1e-1766be24925f" Jul 10 17:59:44.669841 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:44.669667 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcbv4" podUID="ed23dc61-5837-41ea-95e3-dda5b5a90212" Jul 10 17:59:46.315410 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:46.315369 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs\") pod \"network-metrics-daemon-tcbv4\" (UID: \"ed23dc61-5837-41ea-95e3-dda5b5a90212\") " pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:46.315865 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:46.315534 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 17:59:46.315865 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:46.315610 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs podName:ed23dc61-5837-41ea-95e3-dda5b5a90212 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:02.315592251 +0000 UTC m=+34.156420488 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs") pod "network-metrics-daemon-tcbv4" (UID: "ed23dc61-5837-41ea-95e3-dda5b5a90212") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 17:59:46.416522 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:46.416484 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret\") pod \"global-pull-secret-syncer-lkzjv\" (UID: \"2418c763-f86f-480e-bd1e-1766be24925f\") " pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:46.416716 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:46.416627 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 17:59:46.416716 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:46.416693 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret podName:2418c763-f86f-480e-bd1e-1766be24925f nodeName:}" failed. No retries permitted until 2026-07-10 18:00:02.416678473 +0000 UTC m=+34.257506705 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret") pod "global-pull-secret-syncer-lkzjv" (UID: "2418c763-f86f-480e-bd1e-1766be24925f") : object "kube-system"/"original-pull-secret" not registered Jul 10 17:59:46.517697 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:46.517662 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45wd\" (UniqueName: \"kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd\") pod \"network-check-target-lcvdz\" (UID: \"cf0aba2c-014d-4034-9d96-29ff4c768bb7\") " pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 17:59:46.517845 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:46.517783 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 17:59:46.517845 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:46.517802 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 17:59:46.517845 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:46.517814 2579 projected.go:196] Error preparing data for projected volume kube-api-access-c45wd for pod openshift-network-diagnostics/network-check-target-lcvdz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 17:59:46.518012 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:46.517882 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd podName:cf0aba2c-014d-4034-9d96-29ff4c768bb7 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:02.517867604 +0000 UTC m=+34.358695863 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c45wd" (UniqueName: "kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd") pod "network-check-target-lcvdz" (UID: "cf0aba2c-014d-4034-9d96-29ff4c768bb7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 17:59:46.668688 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:46.668593 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:46.668818 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:46.668605 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:46.668818 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:46.668744 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcbv4" podUID="ed23dc61-5837-41ea-95e3-dda5b5a90212" Jul 10 17:59:46.668818 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:46.668604 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 17:59:46.668985 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:46.668864 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkzjv" podUID="2418c763-f86f-480e-bd1e-1766be24925f" Jul 10 17:59:46.668985 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:46.668953 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcvdz" podUID="cf0aba2c-014d-4034-9d96-29ff4c768bb7" Jul 10 17:59:48.669860 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:48.669813 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:48.670247 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:48.669941 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 17:59:48.670247 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:48.669949 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcbv4" podUID="ed23dc61-5837-41ea-95e3-dda5b5a90212" Jul 10 17:59:48.670247 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:48.670038 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcvdz" podUID="cf0aba2c-014d-4034-9d96-29ff4c768bb7" Jul 10 17:59:48.670247 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:48.670068 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:48.670247 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:48.670140 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkzjv" podUID="2418c763-f86f-480e-bd1e-1766be24925f" Jul 10 17:59:50.669401 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.669058 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 17:59:50.670166 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.669065 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:50.670166 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:50.669441 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcvdz" podUID="cf0aba2c-014d-4034-9d96-29ff4c768bb7" Jul 10 17:59:50.670166 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:50.669518 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcbv4" podUID="ed23dc61-5837-41ea-95e3-dda5b5a90212" Jul 10 17:59:50.670166 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.669065 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:50.670166 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:50.669602 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkzjv" podUID="2418c763-f86f-480e-bd1e-1766be24925f" Jul 10 17:59:50.780344 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.780315 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" event={"ID":"1c3e4f0a-8381-4159-9db4-4217f1e7358d","Type":"ContainerStarted","Data":"b5bd953f0e11db75d5c0133803d72fd12ee70482bc1a7cd40093e0c1ac129625"} Jul 10 17:59:50.781903 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.781868 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2jckr" event={"ID":"f23e6bd7-d9dd-417b-97e3-4463a60f7236","Type":"ContainerStarted","Data":"bd7e7d24b97c1715a90271945238b36d34c136148684bcf28e6e55a6ef4820d4"} Jul 10 17:59:50.783474 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.783450 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" event={"ID":"9ba99d86-2f5a-439b-8bbe-5883053a5e97","Type":"ContainerStarted","Data":"d02be61e5c52c0be658ca7a3db122aaf5e510beedbbd67ec0913748f5356d98b"} Jul 10 17:59:50.786793 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.786771 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" event={"ID":"9f19c24a-b23a-435f-af34-60945898354c","Type":"ContainerStarted","Data":"fcc44b588a18cdddf5e161deaa845800069c047c59c45b478b70dbaf7f552e72"} Jul 10 17:59:50.786921 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.786842 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" event={"ID":"9f19c24a-b23a-435f-af34-60945898354c","Type":"ContainerStarted","Data":"38aab9dfc67d22c384546b508a9b6444438722333b69130cf82678fb4829a389"} Jul 10 17:59:50.786921 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.786911 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" event={"ID":"9f19c24a-b23a-435f-af34-60945898354c","Type":"ContainerStarted","Data":"b39dded8641c7de3228b415c3650cb49fe0983f9f95f0feaa5be0f0e69f792b8"} Jul 10 17:59:50.787039 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.786960 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" event={"ID":"9f19c24a-b23a-435f-af34-60945898354c","Type":"ContainerStarted","Data":"ce119d923db4e68216376f3fb6099680f99660d1bdf69d0d22a6e17eea3dfcfc"} Jul 10 17:59:50.787039 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.787010 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" event={"ID":"9f19c24a-b23a-435f-af34-60945898354c","Type":"ContainerStarted","Data":"d7a5d9b9a4296516157deec9f9f565d8f0729109036a3fb5d40ef56f61374821"} Jul 10 17:59:50.787128 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.787061 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" event={"ID":"9f19c24a-b23a-435f-af34-60945898354c","Type":"ContainerStarted","Data":"9a2eb94d632f577e0a2011d4fd8f53f692415ea4fec543ef305095a7867ba762"} Jul 10 17:59:50.788958 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.788922 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4gr4p" event={"ID":"52aab70c-440a-4538-ae58-11b63fafef6a","Type":"ContainerStarted","Data":"6a541b815d62613c80563d7225f7ea88b3fb322dcf60f3ff1336edec134d76d6"} Jul 10 17:59:50.790702 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.790675 2579 generic.go:356] "Generic (PLEG): container finished" podID="c0831409-aa8d-446b-9d46-cb7d1c739cbb" containerID="4cc101b33f4ea08dd79c5119908fccdabfeb5c31daefbe658bed4f33b5422640" exitCode=0 Jul 10 17:59:50.790791 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.790745 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9m88" event={"ID":"c0831409-aa8d-446b-9d46-cb7d1c739cbb","Type":"ContainerDied","Data":"4cc101b33f4ea08dd79c5119908fccdabfeb5c31daefbe658bed4f33b5422640"} Jul 10 17:59:50.792250 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.792206 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sz5jj" event={"ID":"970dcd3c-8d21-40bb-8c9c-852507ae8a1f","Type":"ContainerStarted","Data":"29ce1c1caad7f6e3788f83d52817c756883cc1578aae67968f0b3e40f6b20f09"} Jul 10 17:59:50.793868 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.793832 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8crj6" event={"ID":"e71f5f58-2ce4-4387-b198-55f3ebc9ff22","Type":"ContainerStarted","Data":"aa92df49b9a05083c30fd78fad7f16ebf959103411aa1a9c1a6b220930b77e1d"} Jul 10 17:59:50.796538 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.796498 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2jckr" podStartSLOduration=4.502729389 podStartE2EDuration="22.796482444s" totalImagesPullingTime="18.293753055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:59:50.796268956 +0000 UTC m=+22.637097211" watchObservedRunningTime="2026-07-10 17:59:50.796482444 +0000 UTC m=+22.637310698" Jul 10 17:59:50.796627 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.796590 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-201.ec2.internal" podStartSLOduration=21.796580281 podStartE2EDuration="21.796580281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:59:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:59:33.761157917 +0000 UTC m=+5.601986171" watchObservedRunningTime="2026-07-10 17:59:50.796580281 +0000 UTC m=+22.637408536" Jul 10 17:59:50.826729 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.826689 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sz5jj" podStartSLOduration=3.536109495 podStartE2EDuration="21.826675835s" totalImagesPullingTime="18.29056634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:59:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:59:50.826534811 +0000 UTC m=+22.667363061" watchObservedRunningTime="2026-07-10 17:59:50.826675835 +0000 UTC m=+22.667504088" Jul 10 17:59:50.842780 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.842741 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4gr4p" podStartSLOduration=4.488470943 podStartE2EDuration="22.842724331s" totalImagesPullingTime="18.354253388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:59:50.842218886 +0000 UTC m=+22.683047140" watchObservedRunningTime="2026-07-10 17:59:50.842724331 +0000 UTC m=+22.683552586" Jul 10 17:59:50.855928 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.855891 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8crj6" podStartSLOduration=4.561337161 podStartE2EDuration="22.855876227s" totalImagesPullingTime="18.294539066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:59:50.85540255 +0000 UTC m=+22.696230805" watchObservedRunningTime="2026-07-10 17:59:50.855876227 +0000 UTC m=+22.696704482" Jul 10 17:59:50.871112 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:50.871058 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s6jdr" podStartSLOduration=3.575290757 podStartE2EDuration="21.871040144s" totalImagesPullingTime="18.295749387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:59:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:59:50.870980167 +0000 UTC m=+22.711808421" watchObservedRunningTime="2026-07-10 17:59:50.871040144 +0000 UTC m=+22.711868398" Jul 10 17:59:51.564827 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:51.564792 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 17:59:51.637400 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:51.637292 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T17:59:51.564813269Z","UUID":"e738ae5f-0796-4195-bf4c-6d9d29a6a918","Handler":null,"Name":"","Endpoint":""} Jul 10 17:59:51.638912 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:51.638890 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 17:59:51.639006 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:51.638929 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 17:59:51.798070 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:51.798033 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v8zrl" event={"ID":"63886a28-9e42-48ce-8bf2-6f0984121b46","Type":"ContainerStarted","Data":"07331d194d421ca5d078c5d412aae7edec1622e6058db3ff125b1c73f5d7a683"} Jul 10 17:59:51.800264 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:51.800227 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" event={"ID":"1c3e4f0a-8381-4159-9db4-4217f1e7358d","Type":"ContainerStarted","Data":"59209edf4b831ba35bbd3a610ced2bee165c8d4fc169615dacd030d646b1d395"} Jul 10 17:59:51.811600 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:51.811554 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-v8zrl" podStartSLOduration=5.521105572 podStartE2EDuration="23.811540641s" totalImagesPullingTime="18.290435069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:59:51.810956214 +0000 UTC m=+23.651784469" watchObservedRunningTime="2026-07-10 17:59:51.811540641 +0000 UTC m=+23.652368894" Jul 10 17:59:52.669416 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:52.669372 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 17:59:52.669614 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:52.669378 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:52.669614 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:52.669503 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:52.669614 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:52.669501 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcvdz" podUID="cf0aba2c-014d-4034-9d96-29ff4c768bb7" Jul 10 17:59:52.669614 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:52.669606 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcbv4" podUID="ed23dc61-5837-41ea-95e3-dda5b5a90212" Jul 10 17:59:52.669831 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:52.669695 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkzjv" podUID="2418c763-f86f-480e-bd1e-1766be24925f" Jul 10 17:59:52.806247 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:52.806214 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" event={"ID":"9f19c24a-b23a-435f-af34-60945898354c","Type":"ContainerStarted","Data":"177efe0162d38233ea8666e867d4489de2f3c933adae1b822a7fcba5c4cdfb85"} Jul 10 17:59:52.925842 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:52.925771 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sz5jj" Jul 10 17:59:52.926438 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:52.926417 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sz5jj" Jul 10 17:59:53.814509 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:53.814285 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" event={"ID":"1c3e4f0a-8381-4159-9db4-4217f1e7358d","Type":"ContainerStarted","Data":"ff94d207af18f9c5a07205c8524d6bc9910fbf9cd68f3f6158f0c97b638a620b"} Jul 10 17:59:53.815028 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:53.814569 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sz5jj" Jul 10 17:59:53.815028 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:53.815011 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sz5jj" Jul 10 17:59:53.831985 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:53.831933 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2q9m" podStartSLOduration=4.786399496 podStartE2EDuration="25.831915179s" totalImagesPullingTime="21.045515683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:59:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:59:53.831248746 +0000 UTC m=+25.672077002" watchObservedRunningTime="2026-07-10 17:59:53.831915179 +0000 UTC m=+25.672743436" Jul 10 17:59:54.668596 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:54.668565 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 17:59:54.668783 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:54.668703 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcvdz" podUID="cf0aba2c-014d-4034-9d96-29ff4c768bb7" Jul 10 17:59:54.668783 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:54.668565 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:54.668783 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:54.668572 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:54.668976 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:54.668807 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkzjv" podUID="2418c763-f86f-480e-bd1e-1766be24925f" Jul 10 17:59:54.668976 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:54.668896 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcbv4" podUID="ed23dc61-5837-41ea-95e3-dda5b5a90212" Jul 10 17:59:56.668695 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:56.668669 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:56.669263 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:56.668670 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:56.669263 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:56.668790 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcbv4" podUID="ed23dc61-5837-41ea-95e3-dda5b5a90212" Jul 10 17:59:56.669263 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:56.668669 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 17:59:56.669263 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:56.668880 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkzjv" podUID="2418c763-f86f-480e-bd1e-1766be24925f" Jul 10 17:59:56.669263 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:56.668945 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcvdz" podUID="cf0aba2c-014d-4034-9d96-29ff4c768bb7" Jul 10 17:59:56.822201 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:56.822170 2579 generic.go:356] "Generic (PLEG): container finished" podID="c0831409-aa8d-446b-9d46-cb7d1c739cbb" containerID="500cd6a0428c6b671109b788d481d33f02e8c643497a4cfeb0c88dd7f3df9230" exitCode=0 Jul 10 17:59:56.822354 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:56.822258 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9m88" event={"ID":"c0831409-aa8d-446b-9d46-cb7d1c739cbb","Type":"ContainerDied","Data":"500cd6a0428c6b671109b788d481d33f02e8c643497a4cfeb0c88dd7f3df9230"} Jul 10 17:59:56.825829 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:56.825806 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" event={"ID":"9f19c24a-b23a-435f-af34-60945898354c","Type":"ContainerStarted","Data":"4040c70672aeab18eecc94be53b25a26e8d47873e1cd900337ff4e22dfb068ba"} Jul 10 17:59:56.826056 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:56.826027 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:56.826104 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:56.826091 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:56.840996 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:56.840977 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:57.828529 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:57.828488 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:57.843967 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:57.843941 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 17:59:57.868769 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:57.868724 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" podStartSLOduration=11.494916146 podStartE2EDuration="29.868708775s" totalImagesPullingTime="18.373792629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:59:56.867578555 +0000 UTC m=+28.708406808" watchObservedRunningTime="2026-07-10 17:59:57.868708775 +0000 UTC m=+29.709537028" Jul 10 17:59:58.384289 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:58.384217 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lcvdz"] Jul 10 17:59:58.384424 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:58.384327 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 17:59:58.384467 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:58.384415 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcvdz" podUID="cf0aba2c-014d-4034-9d96-29ff4c768bb7" Jul 10 17:59:58.402745 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:58.402715 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lkzjv"] Jul 10 17:59:58.402899 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:58.402835 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 17:59:58.402983 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:58.402960 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkzjv" podUID="2418c763-f86f-480e-bd1e-1766be24925f" Jul 10 17:59:58.403315 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:58.403292 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tcbv4"] Jul 10 17:59:58.403426 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:58.403392 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:58.403515 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:58.403492 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcbv4" podUID="ed23dc61-5837-41ea-95e3-dda5b5a90212" Jul 10 17:59:58.832311 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:58.832274 2579 generic.go:356] "Generic (PLEG): container finished" podID="c0831409-aa8d-446b-9d46-cb7d1c739cbb" containerID="73b128d3ef66afd801036b2bdb8edfa2358b43763128a1d2b62a87056cbcc1d9" exitCode=0 Jul 10 17:59:58.832691 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:58.832361 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9m88" event={"ID":"c0831409-aa8d-446b-9d46-cb7d1c739cbb","Type":"ContainerDied","Data":"73b128d3ef66afd801036b2bdb8edfa2358b43763128a1d2b62a87056cbcc1d9"} Jul 10 17:59:59.669002 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:59.668796 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 17:59:59.669152 ip-10-0-138-201 kubenswrapper[2579]: E0710 17:59:59.669088 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcbv4" podUID="ed23dc61-5837-41ea-95e3-dda5b5a90212" Jul 10 17:59:59.837308 ip-10-0-138-201 kubenswrapper[2579]: I0710 17:59:59.837281 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9m88" event={"ID":"c0831409-aa8d-446b-9d46-cb7d1c739cbb","Type":"ContainerStarted","Data":"62a9591cf4c320e5729ebac860732f5119e3c74f45f7b801b649649ac8126ad7"} Jul 10 18:00:00.669134 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:00.669057 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 18:00:00.669279 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:00.669178 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcvdz" podUID="cf0aba2c-014d-4034-9d96-29ff4c768bb7" Jul 10 18:00:00.669279 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:00.669227 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 18:00:00.669388 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:00.669313 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkzjv" podUID="2418c763-f86f-480e-bd1e-1766be24925f" Jul 10 18:00:00.841401 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:00.841367 2579 generic.go:356] "Generic (PLEG): container finished" podID="c0831409-aa8d-446b-9d46-cb7d1c739cbb" containerID="62a9591cf4c320e5729ebac860732f5119e3c74f45f7b801b649649ac8126ad7" exitCode=0 Jul 10 18:00:00.841823 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:00.841416 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9m88" event={"ID":"c0831409-aa8d-446b-9d46-cb7d1c739cbb","Type":"ContainerDied","Data":"62a9591cf4c320e5729ebac860732f5119e3c74f45f7b801b649649ac8126ad7"} Jul 10 18:00:01.668395 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:01.668361 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 18:00:01.668550 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:01.668491 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcbv4" podUID="ed23dc61-5837-41ea-95e3-dda5b5a90212" Jul 10 18:00:02.337983 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.337947 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs\") pod \"network-metrics-daemon-tcbv4\" (UID: \"ed23dc61-5837-41ea-95e3-dda5b5a90212\") " pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 18:00:02.338376 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:02.338066 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:00:02.338376 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:02.338122 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs podName:ed23dc61-5837-41ea-95e3-dda5b5a90212 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:34.338106283 +0000 UTC m=+66.178934517 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs") pod "network-metrics-daemon-tcbv4" (UID: "ed23dc61-5837-41ea-95e3-dda5b5a90212") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:00:02.438941 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.438903 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret\") pod \"global-pull-secret-syncer-lkzjv\" (UID: \"2418c763-f86f-480e-bd1e-1766be24925f\") " pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 18:00:02.439102 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:02.439039 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:00:02.439161 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:02.439118 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret podName:2418c763-f86f-480e-bd1e-1766be24925f nodeName:}" failed. No retries permitted until 2026-07-10 18:00:34.439096765 +0000 UTC m=+66.279925115 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret") pod "global-pull-secret-syncer-lkzjv" (UID: "2418c763-f86f-480e-bd1e-1766be24925f") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:00:02.481282 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.481250 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-201.ec2.internal" event="NodeReady" Jul 10 18:00:02.481436 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.481418 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 18:00:02.514232 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.514198 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6646cfb9d6-t5tvx"] Jul 10 18:00:02.521291 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.521263 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.523809 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.523785 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 10 18:00:02.523988 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.523970 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 10 18:00:02.524085 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.524064 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 10 18:00:02.524349 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.524335 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-skqd4\"" Jul 10 18:00:02.528554 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.528533 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 10 18:00:02.530102 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.530081 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r56b5"] Jul 10 18:00:02.534646 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.534620 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6646cfb9d6-t5tvx"] Jul 10 18:00:02.534746 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.534668 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qwjmc"] Jul 10 18:00:02.534805 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.534744 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r56b5" Jul 10 18:00:02.537040 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.537014 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 18:00:02.537148 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.537095 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xxlp9\"" Jul 10 18:00:02.537390 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.537372 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 18:00:02.538418 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.538400 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qwjmc" Jul 10 18:00:02.539293 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.539272 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45wd\" (UniqueName: \"kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd\") pod \"network-check-target-lcvdz\" (UID: \"cf0aba2c-014d-4034-9d96-29ff4c768bb7\") " pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 18:00:02.539541 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:02.539388 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:00:02.539541 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:02.539404 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:00:02.539541 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:02.539416 2579 projected.go:196] Error preparing data for projected volume kube-api-access-c45wd for pod openshift-network-diagnostics/network-check-target-lcvdz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:00:02.539541 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:02.539465 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd podName:cf0aba2c-014d-4034-9d96-29ff4c768bb7 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:34.539449539 +0000 UTC m=+66.380277792 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c45wd" (UniqueName: "kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd") pod "network-check-target-lcvdz" (UID: "cf0aba2c-014d-4034-9d96-29ff4c768bb7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:00:02.541012 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.540868 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 18:00:02.541012 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.540974 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 18:00:02.541171 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.541077 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 18:00:02.541171 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.541119 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mzh8h\"" Jul 10 18:00:02.545195 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.544895 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qwjmc"] Jul 10 18:00:02.545818 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.545797 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r56b5"] Jul 10 18:00:02.640422 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.640339 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/db3be39f-7610-4b71-9d5b-4087c443e47f-config-volume\") pod \"dns-default-r56b5\" (UID: \"db3be39f-7610-4b71-9d5b-4087c443e47f\") " pod="openshift-dns/dns-default-r56b5" Jul 10 18:00:02.640422 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.640390 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv2dp\" (UniqueName: \"kubernetes.io/projected/65c5cd7a-6e0d-4b74-bc87-ec84d9362897-kube-api-access-pv2dp\") pod \"ingress-canary-qwjmc\" (UID: \"65c5cd7a-6e0d-4b74-bc87-ec84d9362897\") " pod="openshift-ingress-canary/ingress-canary-qwjmc" Jul 10 18:00:02.640422 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.640413 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8e1007ee-7580-42c4-9926-3fb8bca36ed1-installation-pull-secrets\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.640678 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.640532 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8e1007ee-7580-42c4-9926-3fb8bca36ed1-ca-trust-extracted\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.640678 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.640561 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e1007ee-7580-42c4-9926-3fb8bca36ed1-trusted-ca\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.640678 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.640591 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-certificates\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.640678 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.640630 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-bound-sa-token\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.640883 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.640687 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxh52\" (UniqueName: \"kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-kube-api-access-sxh52\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.640883 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.640745 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65c5cd7a-6e0d-4b74-bc87-ec84d9362897-cert\") pod \"ingress-canary-qwjmc\" (UID: \"65c5cd7a-6e0d-4b74-bc87-ec84d9362897\") " pod="openshift-ingress-canary/ingress-canary-qwjmc" Jul 10 18:00:02.640883 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.640780 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls\") pod \"dns-default-r56b5\" (UID: \"db3be39f-7610-4b71-9d5b-4087c443e47f\") " pod="openshift-dns/dns-default-r56b5" Jul 10 18:00:02.640883 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.640803 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfkpm\" (UniqueName: \"kubernetes.io/projected/db3be39f-7610-4b71-9d5b-4087c443e47f-kube-api-access-cfkpm\") pod \"dns-default-r56b5\" (UID: \"db3be39f-7610-4b71-9d5b-4087c443e47f\") " pod="openshift-dns/dns-default-r56b5" Jul 10 18:00:02.641021 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.640894 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db3be39f-7610-4b71-9d5b-4087c443e47f-tmp-dir\") pod \"dns-default-r56b5\" (UID: \"db3be39f-7610-4b71-9d5b-4087c443e47f\") " pod="openshift-dns/dns-default-r56b5" Jul 10 18:00:02.641021 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.640928 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8e1007ee-7580-42c4-9926-3fb8bca36ed1-image-registry-private-configuration\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.641021 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.640956 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.668846 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.668812 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 18:00:02.669057 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.669038 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 18:00:02.672106 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.672080 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 18:00:02.672106 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.672092 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 18:00:02.672307 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.672245 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 18:00:02.672307 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.672256 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-25vgp\"" Jul 10 18:00:02.741420 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.741382 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8e1007ee-7580-42c4-9926-3fb8bca36ed1-installation-pull-secrets\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.741688 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.741455 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8e1007ee-7580-42c4-9926-3fb8bca36ed1-ca-trust-extracted\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.741688 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.741478 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e1007ee-7580-42c4-9926-3fb8bca36ed1-trusted-ca\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.741688 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.741506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-certificates\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.741688 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.741528 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-bound-sa-token\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.741688 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.741552 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxh52\" (UniqueName: \"kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-kube-api-access-sxh52\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.741688 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.741579 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65c5cd7a-6e0d-4b74-bc87-ec84d9362897-cert\") pod \"ingress-canary-qwjmc\" (UID: \"65c5cd7a-6e0d-4b74-bc87-ec84d9362897\") " pod="openshift-ingress-canary/ingress-canary-qwjmc" Jul 10 18:00:02.741688 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.741612 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls\") pod \"dns-default-r56b5\" (UID: \"db3be39f-7610-4b71-9d5b-4087c443e47f\") " pod="openshift-dns/dns-default-r56b5" Jul 10 18:00:02.741688 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.741640 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfkpm\" (UniqueName: \"kubernetes.io/projected/db3be39f-7610-4b71-9d5b-4087c443e47f-kube-api-access-cfkpm\") pod \"dns-default-r56b5\" (UID: \"db3be39f-7610-4b71-9d5b-4087c443e47f\") " pod="openshift-dns/dns-default-r56b5" Jul 10 18:00:02.741688 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.741665 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db3be39f-7610-4b71-9d5b-4087c443e47f-tmp-dir\") pod \"dns-default-r56b5\" (UID: \"db3be39f-7610-4b71-9d5b-4087c443e47f\") " pod="openshift-dns/dns-default-r56b5" Jul 10 18:00:02.741688 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.741686 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8e1007ee-7580-42c4-9926-3fb8bca36ed1-image-registry-private-configuration\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.742164 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.741709 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.742164 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.741746 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/db3be39f-7610-4b71-9d5b-4087c443e47f-config-volume\") pod \"dns-default-r56b5\" (UID: \"db3be39f-7610-4b71-9d5b-4087c443e47f\") " pod="openshift-dns/dns-default-r56b5" Jul 10 18:00:02.742164 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.741797 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv2dp\" (UniqueName: \"kubernetes.io/projected/65c5cd7a-6e0d-4b74-bc87-ec84d9362897-kube-api-access-pv2dp\") pod \"ingress-canary-qwjmc\" (UID: \"65c5cd7a-6e0d-4b74-bc87-ec84d9362897\") " pod="openshift-ingress-canary/ingress-canary-qwjmc" Jul 10 18:00:02.742164 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.742081 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8e1007ee-7580-42c4-9926-3fb8bca36ed1-ca-trust-extracted\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.742350 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:02.742187 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:00:02.742350 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:02.742203 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6646cfb9d6-t5tvx: secret "image-registry-tls" not found Jul 10 18:00:02.742350 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:02.742274 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls podName:8e1007ee-7580-42c4-9926-3fb8bca36ed1 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:03.242251292 +0000 UTC m=+35.083079525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls") pod "image-registry-6646cfb9d6-t5tvx" (UID: "8e1007ee-7580-42c4-9926-3fb8bca36ed1") : secret "image-registry-tls" not found Jul 10 18:00:02.742350 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.742284 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-certificates\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.742350 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.742313 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db3be39f-7610-4b71-9d5b-4087c443e47f-tmp-dir\") pod \"dns-default-r56b5\" (UID: \"db3be39f-7610-4b71-9d5b-4087c443e47f\") " pod="openshift-dns/dns-default-r56b5" Jul 10 18:00:02.742606 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:02.742387 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:00:02.742606 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:02.742453 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls podName:db3be39f-7610-4b71-9d5b-4087c443e47f nodeName:}" failed. No retries permitted until 2026-07-10 18:00:03.242433511 +0000 UTC m=+35.083261743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls") pod "dns-default-r56b5" (UID: "db3be39f-7610-4b71-9d5b-4087c443e47f") : secret "dns-default-metrics-tls" not found Jul 10 18:00:02.742705 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.742642 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/db3be39f-7610-4b71-9d5b-4087c443e47f-config-volume\") pod \"dns-default-r56b5\" (UID: \"db3be39f-7610-4b71-9d5b-4087c443e47f\") " pod="openshift-dns/dns-default-r56b5" Jul 10 18:00:02.742705 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.742644 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e1007ee-7580-42c4-9926-3fb8bca36ed1-trusted-ca\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.745821 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.745793 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8e1007ee-7580-42c4-9926-3fb8bca36ed1-image-registry-private-configuration\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.745821 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.745814 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8e1007ee-7580-42c4-9926-3fb8bca36ed1-installation-pull-secrets\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.746062 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.746016 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65c5cd7a-6e0d-4b74-bc87-ec84d9362897-cert\") pod \"ingress-canary-qwjmc\" (UID: \"65c5cd7a-6e0d-4b74-bc87-ec84d9362897\") " pod="openshift-ingress-canary/ingress-canary-qwjmc" Jul 10 18:00:02.750503 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.750465 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv2dp\" (UniqueName: \"kubernetes.io/projected/65c5cd7a-6e0d-4b74-bc87-ec84d9362897-kube-api-access-pv2dp\") pod \"ingress-canary-qwjmc\" (UID: \"65c5cd7a-6e0d-4b74-bc87-ec84d9362897\") " pod="openshift-ingress-canary/ingress-canary-qwjmc" Jul 10 18:00:02.750606 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.750543 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfkpm\" (UniqueName: \"kubernetes.io/projected/db3be39f-7610-4b71-9d5b-4087c443e47f-kube-api-access-cfkpm\") pod \"dns-default-r56b5\" (UID: \"db3be39f-7610-4b71-9d5b-4087c443e47f\") " pod="openshift-dns/dns-default-r56b5" Jul 10 18:00:02.751354 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.751311 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxh52\" (UniqueName: \"kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-kube-api-access-sxh52\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.752634 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.752613 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-bound-sa-token\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:02.853521 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:02.853488 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qwjmc" Jul 10 18:00:03.009691 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:03.009440 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qwjmc"] Jul 10 18:00:03.013936 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:00:03.013905 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65c5cd7a_6e0d_4b74_bc87_ec84d9362897.slice/crio-8b2b1ee1a6888a48145e9b9d40a4befc0293f35b55808b20b96e4095dc5dfbe0 WatchSource:0}: Error finding container 8b2b1ee1a6888a48145e9b9d40a4befc0293f35b55808b20b96e4095dc5dfbe0: Status 404 returned error can't find the container with id 8b2b1ee1a6888a48145e9b9d40a4befc0293f35b55808b20b96e4095dc5dfbe0 Jul 10 18:00:03.246912 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:03.246790 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls\") pod \"dns-default-r56b5\" (UID: \"db3be39f-7610-4b71-9d5b-4087c443e47f\") " pod="openshift-dns/dns-default-r56b5" Jul 10 18:00:03.246912 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:03.246825 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:03.247126 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:03.246949 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:00:03.247126 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:03.246955 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:00:03.247126 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:03.247029 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls podName:db3be39f-7610-4b71-9d5b-4087c443e47f nodeName:}" failed. No retries permitted until 2026-07-10 18:00:04.247010177 +0000 UTC m=+36.087838410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls") pod "dns-default-r56b5" (UID: "db3be39f-7610-4b71-9d5b-4087c443e47f") : secret "dns-default-metrics-tls" not found Jul 10 18:00:03.247126 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:03.246961 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6646cfb9d6-t5tvx: secret "image-registry-tls" not found Jul 10 18:00:03.247126 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:03.247083 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls podName:8e1007ee-7580-42c4-9926-3fb8bca36ed1 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:04.247072931 +0000 UTC m=+36.087901162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls") pod "image-registry-6646cfb9d6-t5tvx" (UID: "8e1007ee-7580-42c4-9926-3fb8bca36ed1") : secret "image-registry-tls" not found Jul 10 18:00:03.669201 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:03.669166 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 18:00:03.672224 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:03.672201 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 18:00:03.672431 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:03.672412 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s4tg5\"" Jul 10 18:00:03.849419 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:03.849381 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qwjmc" event={"ID":"65c5cd7a-6e0d-4b74-bc87-ec84d9362897","Type":"ContainerStarted","Data":"8b2b1ee1a6888a48145e9b9d40a4befc0293f35b55808b20b96e4095dc5dfbe0"} Jul 10 18:00:04.255411 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:04.255371 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls\") pod \"dns-default-r56b5\" (UID: \"db3be39f-7610-4b71-9d5b-4087c443e47f\") " pod="openshift-dns/dns-default-r56b5" Jul 10 18:00:04.255411 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:04.255420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:04.255661 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:04.255519 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:00:04.255661 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:04.255553 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:00:04.255661 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:04.255567 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6646cfb9d6-t5tvx: secret "image-registry-tls" not found Jul 10 18:00:04.255661 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:04.255595 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls podName:db3be39f-7610-4b71-9d5b-4087c443e47f nodeName:}" failed. No retries permitted until 2026-07-10 18:00:06.255576133 +0000 UTC m=+38.096404365 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls") pod "dns-default-r56b5" (UID: "db3be39f-7610-4b71-9d5b-4087c443e47f") : secret "dns-default-metrics-tls" not found Jul 10 18:00:04.255661 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:04.255611 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls podName:8e1007ee-7580-42c4-9926-3fb8bca36ed1 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:06.255605947 +0000 UTC m=+38.096434178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls") pod "image-registry-6646cfb9d6-t5tvx" (UID: "8e1007ee-7580-42c4-9926-3fb8bca36ed1") : secret "image-registry-tls" not found Jul 10 18:00:05.199222 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:05.199174 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sz5jj_970dcd3c-8d21-40bb-8c9c-852507ae8a1f/konnectivity-agent/0.log" limit=1024 Jul 10 18:00:05.480559 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:05.480530 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sz5jj_970dcd3c-8d21-40bb-8c9c-852507ae8a1f/konnectivity-agent/0.log" limit=1024 Jul 10 18:00:05.540215 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:05.540180 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sz5jj_970dcd3c-8d21-40bb-8c9c-852507ae8a1f/konnectivity-agent/0.log" limit=1024 Jul 10 18:00:05.857492 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:05.857446 2579 generic.go:356] "Generic (PLEG): container finished" podID="c0831409-aa8d-446b-9d46-cb7d1c739cbb" containerID="61efd1e057ed7dd74ea14fc98dc6aea5fbc8c485dfdeb6cb80d51637d761f289" exitCode=0 Jul 10 18:00:05.857635 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:05.857503 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9m88" event={"ID":"c0831409-aa8d-446b-9d46-cb7d1c739cbb","Type":"ContainerDied","Data":"61efd1e057ed7dd74ea14fc98dc6aea5fbc8c485dfdeb6cb80d51637d761f289"} Jul 10 18:00:06.270331 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:06.270238 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls\") pod \"dns-default-r56b5\" (UID: \"db3be39f-7610-4b71-9d5b-4087c443e47f\") " pod="openshift-dns/dns-default-r56b5" Jul 10 18:00:06.270331 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:06.270297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:06.270904 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:06.270396 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:00:06.270904 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:06.270425 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:00:06.270904 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:06.270439 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6646cfb9d6-t5tvx: secret "image-registry-tls" not found Jul 10 18:00:06.270904 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:06.270463 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls podName:db3be39f-7610-4b71-9d5b-4087c443e47f nodeName:}" failed. No retries permitted until 2026-07-10 18:00:10.270443605 +0000 UTC m=+42.111271854 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls") pod "dns-default-r56b5" (UID: "db3be39f-7610-4b71-9d5b-4087c443e47f") : secret "dns-default-metrics-tls" not found Jul 10 18:00:06.270904 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:06.270499 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls podName:8e1007ee-7580-42c4-9926-3fb8bca36ed1 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:10.270483828 +0000 UTC m=+42.111312064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls") pod "image-registry-6646cfb9d6-t5tvx" (UID: "8e1007ee-7580-42c4-9926-3fb8bca36ed1") : secret "image-registry-tls" not found Jul 10 18:00:06.863422 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:06.863387 2579 generic.go:356] "Generic (PLEG): container finished" podID="c0831409-aa8d-446b-9d46-cb7d1c739cbb" containerID="1a23b143406b6dfbbf80f58e14db7b40e904fff58dffa253fa00235d1d501101" exitCode=0 Jul 10 18:00:06.863571 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:06.863439 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9m88" event={"ID":"c0831409-aa8d-446b-9d46-cb7d1c739cbb","Type":"ContainerDied","Data":"1a23b143406b6dfbbf80f58e14db7b40e904fff58dffa253fa00235d1d501101"} Jul 10 18:00:07.655464 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:07.655426 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sz5jj_970dcd3c-8d21-40bb-8c9c-852507ae8a1f/konnectivity-agent/0.log" limit=1024 Jul 10 18:00:07.755696 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:07.755673 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sz5jj_970dcd3c-8d21-40bb-8c9c-852507ae8a1f/konnectivity-agent/0.log" limit=1024 Jul 10 18:00:07.867660 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:07.867628 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qwjmc" event={"ID":"65c5cd7a-6e0d-4b74-bc87-ec84d9362897","Type":"ContainerStarted","Data":"6a1d7c30d3461881479f352dba32d6f489fc99b9366299457c7fd9aac07b6777"} Jul 10 18:00:07.870830 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:07.870803 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9m88" event={"ID":"c0831409-aa8d-446b-9d46-cb7d1c739cbb","Type":"ContainerStarted","Data":"bc0b8bbb3531c2df0d7553f4242842883de5f355acdc7eb30ca3b090d4e685f1"} Jul 10 18:00:07.882262 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:07.882218 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qwjmc" podStartSLOduration=1.230427974 podStartE2EDuration="5.88220093s" totalImagesPullingTime="4.651772956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:00:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:00:07.88165636 +0000 UTC m=+39.722484614" watchObservedRunningTime="2026-07-10 18:00:07.88220093 +0000 UTC m=+39.723029185" Jul 10 18:00:07.902317 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:07.902273 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w9m88" podStartSLOduration=9.443951687 podStartE2EDuration="39.90225911s" totalImagesPullingTime="30.458307423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:59:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:00:07.901130575 +0000 UTC m=+39.741958828" watchObservedRunningTime="2026-07-10 18:00:07.90225911 +0000 UTC m=+39.743087365" Jul 10 18:00:08.023161 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:08.023078 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sz5jj_970dcd3c-8d21-40bb-8c9c-852507ae8a1f/konnectivity-agent/0.log" limit=1024 Jul 10 18:00:08.123734 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:08.123699 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sz5jj_970dcd3c-8d21-40bb-8c9c-852507ae8a1f/konnectivity-agent/0.log" limit=1024 Jul 10 18:00:08.226888 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:08.226841 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sz5jj_970dcd3c-8d21-40bb-8c9c-852507ae8a1f/konnectivity-agent/0.log" limit=1024 Jul 10 18:00:08.325990 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:08.325956 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sz5jj_970dcd3c-8d21-40bb-8c9c-852507ae8a1f/konnectivity-agent/0.log" limit=1024 Jul 10 18:00:08.441061 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:08.441028 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sz5jj_970dcd3c-8d21-40bb-8c9c-852507ae8a1f/konnectivity-agent/0.log" limit=1024 Jul 10 18:00:08.528985 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:08.528953 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sz5jj_970dcd3c-8d21-40bb-8c9c-852507ae8a1f/konnectivity-agent/0.log" limit=1024 Jul 10 18:00:08.976406 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:08.976366 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sz5jj_970dcd3c-8d21-40bb-8c9c-852507ae8a1f/konnectivity-agent/0.log" limit=1024 Jul 10 18:00:09.033389 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:09.033349 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sz5jj_970dcd3c-8d21-40bb-8c9c-852507ae8a1f/konnectivity-agent/0.log" limit=1024 Jul 10 18:00:09.371345 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:09.371316 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sz5jj_970dcd3c-8d21-40bb-8c9c-852507ae8a1f/konnectivity-agent/0.log" limit=1024 Jul 10 18:00:09.467269 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:09.467234 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sz5jj_970dcd3c-8d21-40bb-8c9c-852507ae8a1f/konnectivity-agent/0.log" limit=1024 Jul 10 18:00:10.165753 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:10.165717 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sz5jj_970dcd3c-8d21-40bb-8c9c-852507ae8a1f/konnectivity-agent/0.log" limit=1024 Jul 10 18:00:10.215121 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:10.215082 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sz5jj_970dcd3c-8d21-40bb-8c9c-852507ae8a1f/konnectivity-agent/0.log" limit=1024 Jul 10 18:00:10.304657 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:10.304620 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls\") pod \"dns-default-r56b5\" (UID: \"db3be39f-7610-4b71-9d5b-4087c443e47f\") " pod="openshift-dns/dns-default-r56b5" Jul 10 18:00:10.304657 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:10.304660 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:10.304903 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:10.304775 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:00:10.304903 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:10.304795 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:00:10.304903 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:10.304806 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6646cfb9d6-t5tvx: secret "image-registry-tls" not found Jul 10 18:00:10.304903 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:10.304868 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls podName:db3be39f-7610-4b71-9d5b-4087c443e47f nodeName:}" failed. No retries permitted until 2026-07-10 18:00:18.304831137 +0000 UTC m=+50.145659371 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls") pod "dns-default-r56b5" (UID: "db3be39f-7610-4b71-9d5b-4087c443e47f") : secret "dns-default-metrics-tls" not found Jul 10 18:00:10.304903 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:10.304889 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls podName:8e1007ee-7580-42c4-9926-3fb8bca36ed1 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:18.304879292 +0000 UTC m=+50.145707528 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls") pod "image-registry-6646cfb9d6-t5tvx" (UID: "8e1007ee-7580-42c4-9926-3fb8bca36ed1") : secret "image-registry-tls" not found Jul 10 18:00:10.570186 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:10.570153 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sz5jj_970dcd3c-8d21-40bb-8c9c-852507ae8a1f/konnectivity-agent/0.log" limit=1024 Jul 10 18:00:10.619212 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:10.619186 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sz5jj_970dcd3c-8d21-40bb-8c9c-852507ae8a1f/konnectivity-agent/0.log" limit=1024 Jul 10 18:00:18.362393 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:18.362350 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:18.362839 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:18.362445 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls\") pod \"dns-default-r56b5\" (UID: \"db3be39f-7610-4b71-9d5b-4087c443e47f\") " pod="openshift-dns/dns-default-r56b5" Jul 10 18:00:18.362839 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:18.362516 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:00:18.362839 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:18.362535 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6646cfb9d6-t5tvx: secret "image-registry-tls" not found Jul 10 18:00:18.362839 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:18.362543 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:00:18.362839 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:18.362592 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls podName:8e1007ee-7580-42c4-9926-3fb8bca36ed1 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:34.362576373 +0000 UTC m=+66.203404610 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls") pod "image-registry-6646cfb9d6-t5tvx" (UID: "8e1007ee-7580-42c4-9926-3fb8bca36ed1") : secret "image-registry-tls" not found Jul 10 18:00:18.362839 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:18.362605 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls podName:db3be39f-7610-4b71-9d5b-4087c443e47f nodeName:}" failed. No retries permitted until 2026-07-10 18:00:34.362599882 +0000 UTC m=+66.203428113 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls") pod "dns-default-r56b5" (UID: "db3be39f-7610-4b71-9d5b-4087c443e47f") : secret "dns-default-metrics-tls" not found Jul 10 18:00:29.847531 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:29.847505 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7lqp" Jul 10 18:00:33.734610 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.734581 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f"] Jul 10 18:00:33.738763 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.738744 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f" Jul 10 18:00:33.742274 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.742241 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 10 18:00:33.742383 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.742314 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 18:00:33.743317 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.743295 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 18:00:33.743431 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.743355 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-h8wb8\"" Jul 10 18:00:33.743431 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.743371 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 10 18:00:33.747454 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.747435 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f"] Jul 10 18:00:33.779969 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.779940 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dfc9ca45-82b1-4478-a216-1adc73054c2e-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-lps9f\" (UID: \"dfc9ca45-82b1-4478-a216-1adc73054c2e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f" Jul 10 18:00:33.780087 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.779975 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfc9ca45-82b1-4478-a216-1adc73054c2e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lps9f\" (UID: \"dfc9ca45-82b1-4478-a216-1adc73054c2e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f" Jul 10 18:00:33.780087 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.779993 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm7p9\" (UniqueName: \"kubernetes.io/projected/dfc9ca45-82b1-4478-a216-1adc73054c2e-kube-api-access-pm7p9\") pod \"cluster-monitoring-operator-5f7f494dd4-lps9f\" (UID: \"dfc9ca45-82b1-4478-a216-1adc73054c2e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f" Jul 10 18:00:33.831572 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.831545 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8glrd"] Jul 10 18:00:33.833593 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.833576 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8glrd" Jul 10 18:00:33.835902 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.835885 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:00:33.836013 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.835939 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-r77sv\"" Jul 10 18:00:33.836013 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.835939 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 10 18:00:33.836013 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.835993 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 10 18:00:33.836150 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.836043 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 10 18:00:33.849726 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.849703 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8glrd"] Jul 10 18:00:33.880390 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.880359 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f3fe76eb-7d5e-4f07-978c-60660a6a9a6c-serving-cert\") pod \"service-ca-operator-7695fc6c8c-8glrd\" (UID: \"f3fe76eb-7d5e-4f07-978c-60660a6a9a6c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8glrd" Jul 10 18:00:33.880530 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.880395 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dfc9ca45-82b1-4478-a216-1adc73054c2e-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-lps9f\" (UID: \"dfc9ca45-82b1-4478-a216-1adc73054c2e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f" Jul 10 18:00:33.880530 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.880442 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfc9ca45-82b1-4478-a216-1adc73054c2e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lps9f\" (UID: \"dfc9ca45-82b1-4478-a216-1adc73054c2e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f" Jul 10 18:00:33.880530 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.880470 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm7p9\" (UniqueName: \"kubernetes.io/projected/dfc9ca45-82b1-4478-a216-1adc73054c2e-kube-api-access-pm7p9\") pod \"cluster-monitoring-operator-5f7f494dd4-lps9f\" (UID: \"dfc9ca45-82b1-4478-a216-1adc73054c2e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f" Jul 10 18:00:33.880530 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.880500 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnxrc\" (UniqueName: \"kubernetes.io/projected/f3fe76eb-7d5e-4f07-978c-60660a6a9a6c-kube-api-access-wnxrc\") pod \"service-ca-operator-7695fc6c8c-8glrd\" (UID: \"f3fe76eb-7d5e-4f07-978c-60660a6a9a6c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8glrd" Jul 10 18:00:33.880701 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.880595 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f3fe76eb-7d5e-4f07-978c-60660a6a9a6c-config\") pod \"service-ca-operator-7695fc6c8c-8glrd\" (UID: \"f3fe76eb-7d5e-4f07-978c-60660a6a9a6c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8glrd" Jul 10 18:00:33.880701 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:33.880668 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 18:00:33.880767 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:33.880732 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfc9ca45-82b1-4478-a216-1adc73054c2e-cluster-monitoring-operator-tls podName:dfc9ca45-82b1-4478-a216-1adc73054c2e nodeName:}" failed. No retries permitted until 2026-07-10 18:00:34.380715138 +0000 UTC m=+66.221543371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dfc9ca45-82b1-4478-a216-1adc73054c2e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lps9f" (UID: "dfc9ca45-82b1-4478-a216-1adc73054c2e") : secret "cluster-monitoring-operator-tls" not found Jul 10 18:00:33.881140 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.881123 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dfc9ca45-82b1-4478-a216-1adc73054c2e-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-lps9f\" (UID: \"dfc9ca45-82b1-4478-a216-1adc73054c2e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f" Jul 10 18:00:33.893812 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.893787 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm7p9\" (UniqueName: \"kubernetes.io/projected/dfc9ca45-82b1-4478-a216-1adc73054c2e-kube-api-access-pm7p9\") pod \"cluster-monitoring-operator-5f7f494dd4-lps9f\" (UID: \"dfc9ca45-82b1-4478-a216-1adc73054c2e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f" Jul 10 18:00:33.929701 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.929676 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-xp7mh"] Jul 10 18:00:33.932037 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.932022 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-xp7mh" Jul 10 18:00:33.934342 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.934325 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 10 18:00:33.934445 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.934360 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 10 18:00:33.934445 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.934430 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-j7d66\"" Jul 10 18:00:33.939954 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.939936 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rmd8j"] Jul 10 18:00:33.942092 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.942079 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rmd8j" Jul 10 18:00:33.947822 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.947802 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-xp7mh"] Jul 10 18:00:33.951258 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.951240 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:00:33.951356 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.951241 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 10 18:00:33.951646 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.951630 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 10 18:00:33.952133 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.952117 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-h52rw\"" Jul 10 18:00:33.953237 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.953224 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 10 18:00:33.962779 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.962753 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rmd8j"] Jul 10 18:00:33.980954 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.980932 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f3fe76eb-7d5e-4f07-978c-60660a6a9a6c-serving-cert\") pod \"service-ca-operator-7695fc6c8c-8glrd\" (UID: \"f3fe76eb-7d5e-4f07-978c-60660a6a9a6c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8glrd" Jul 10 18:00:33.981043 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.980959 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0beb717-4a66-4c5e-bbd1-34fdc20582ef-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-rmd8j\" (UID: \"a0beb717-4a66-4c5e-bbd1-34fdc20582ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rmd8j" Jul 10 18:00:33.981043 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.980978 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxfcr\" (UniqueName: \"kubernetes.io/projected/a0beb717-4a66-4c5e-bbd1-34fdc20582ef-kube-api-access-kxfcr\") pod \"kube-storage-version-migrator-operator-799cb7f958-rmd8j\" (UID: \"a0beb717-4a66-4c5e-bbd1-34fdc20582ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rmd8j" Jul 10 18:00:33.981043 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.981021 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnxrc\" (UniqueName: \"kubernetes.io/projected/f3fe76eb-7d5e-4f07-978c-60660a6a9a6c-kube-api-access-wnxrc\") pod \"service-ca-operator-7695fc6c8c-8glrd\" (UID: \"f3fe76eb-7d5e-4f07-978c-60660a6a9a6c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8glrd" Jul 10 18:00:33.981153 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.981066 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xp7mh\" (UID: \"151cc011-39cc-4b5a-8d78-d79e7e53e3ec\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xp7mh" Jul 10 18:00:33.981153 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.981106 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f3fe76eb-7d5e-4f07-978c-60660a6a9a6c-config\") pod \"service-ca-operator-7695fc6c8c-8glrd\" (UID: \"f3fe76eb-7d5e-4f07-978c-60660a6a9a6c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8glrd" Jul 10 18:00:33.981153 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.981139 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a0beb717-4a66-4c5e-bbd1-34fdc20582ef-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-rmd8j\" (UID: \"a0beb717-4a66-4c5e-bbd1-34fdc20582ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rmd8j" Jul 10 18:00:33.981264 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.981173 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-nginx-conf\") pod \"networking-console-plugin-6cf856758c-xp7mh\" (UID: \"151cc011-39cc-4b5a-8d78-d79e7e53e3ec\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xp7mh" Jul 10 18:00:33.981532 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.981514 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f3fe76eb-7d5e-4f07-978c-60660a6a9a6c-config\") pod \"service-ca-operator-7695fc6c8c-8glrd\" (UID: \"f3fe76eb-7d5e-4f07-978c-60660a6a9a6c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8glrd" Jul 10 18:00:33.983077 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.983060 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f3fe76eb-7d5e-4f07-978c-60660a6a9a6c-serving-cert\") pod \"service-ca-operator-7695fc6c8c-8glrd\" (UID: \"f3fe76eb-7d5e-4f07-978c-60660a6a9a6c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8glrd" Jul 10 18:00:33.993904 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:33.993829 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnxrc\" (UniqueName: \"kubernetes.io/projected/f3fe76eb-7d5e-4f07-978c-60660a6a9a6c-kube-api-access-wnxrc\") pod \"service-ca-operator-7695fc6c8c-8glrd\" (UID: \"f3fe76eb-7d5e-4f07-978c-60660a6a9a6c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8glrd" Jul 10 18:00:34.082384 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.082331 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a0beb717-4a66-4c5e-bbd1-34fdc20582ef-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-rmd8j\" (UID: \"a0beb717-4a66-4c5e-bbd1-34fdc20582ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rmd8j" Jul 10 18:00:34.082384 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.082382 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-nginx-conf\") pod \"networking-console-plugin-6cf856758c-xp7mh\" (UID: \"151cc011-39cc-4b5a-8d78-d79e7e53e3ec\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xp7mh" Jul 10 18:00:34.082582 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.082481 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0beb717-4a66-4c5e-bbd1-34fdc20582ef-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-rmd8j\" (UID: \"a0beb717-4a66-4c5e-bbd1-34fdc20582ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rmd8j" Jul 10 18:00:34.082582 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.082506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxfcr\" (UniqueName: \"kubernetes.io/projected/a0beb717-4a66-4c5e-bbd1-34fdc20582ef-kube-api-access-kxfcr\") pod \"kube-storage-version-migrator-operator-799cb7f958-rmd8j\" (UID: \"a0beb717-4a66-4c5e-bbd1-34fdc20582ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rmd8j" Jul 10 18:00:34.082582 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.082572 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xp7mh\" (UID: \"151cc011-39cc-4b5a-8d78-d79e7e53e3ec\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xp7mh" Jul 10 18:00:34.082682 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:34.082670 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 18:00:34.082744 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:34.082732 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-networking-console-plugin-cert podName:151cc011-39cc-4b5a-8d78-d79e7e53e3ec nodeName:}" failed. No retries permitted until 2026-07-10 18:00:34.582716052 +0000 UTC m=+66.423544284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-xp7mh" (UID: "151cc011-39cc-4b5a-8d78-d79e7e53e3ec") : secret "networking-console-plugin-cert" not found Jul 10 18:00:34.083101 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.083073 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a0beb717-4a66-4c5e-bbd1-34fdc20582ef-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-rmd8j\" (UID: \"a0beb717-4a66-4c5e-bbd1-34fdc20582ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rmd8j" Jul 10 18:00:34.083205 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.083112 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-nginx-conf\") pod \"networking-console-plugin-6cf856758c-xp7mh\" (UID: \"151cc011-39cc-4b5a-8d78-d79e7e53e3ec\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xp7mh" Jul 10 18:00:34.084554 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.084538 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0beb717-4a66-4c5e-bbd1-34fdc20582ef-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-rmd8j\" (UID: \"a0beb717-4a66-4c5e-bbd1-34fdc20582ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rmd8j" Jul 10 18:00:34.093023 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.093004 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxfcr\" (UniqueName: \"kubernetes.io/projected/a0beb717-4a66-4c5e-bbd1-34fdc20582ef-kube-api-access-kxfcr\") pod \"kube-storage-version-migrator-operator-799cb7f958-rmd8j\" (UID: \"a0beb717-4a66-4c5e-bbd1-34fdc20582ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rmd8j" Jul 10 18:00:34.141953 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.141924 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8glrd" Jul 10 18:00:34.250555 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.250490 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rmd8j" Jul 10 18:00:34.269561 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.269530 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8glrd"] Jul 10 18:00:34.273103 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:00:34.273076 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3fe76eb_7d5e_4f07_978c_60660a6a9a6c.slice/crio-6b6c261af67f44184c25b99d6c338aa0eb2de39133fcdd3927b6b80dadb7800e WatchSource:0}: Error finding container 6b6c261af67f44184c25b99d6c338aa0eb2de39133fcdd3927b6b80dadb7800e: Status 404 returned error can't find the container with id 6b6c261af67f44184c25b99d6c338aa0eb2de39133fcdd3927b6b80dadb7800e Jul 10 18:00:34.373979 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.373950 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rmd8j"] Jul 10 18:00:34.376514 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:00:34.376493 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0beb717_4a66_4c5e_bbd1_34fdc20582ef.slice/crio-3118e412f8701389b832b025869326b5d7d6b813b2f7925c2446ff89e6665c4a WatchSource:0}: Error finding container 3118e412f8701389b832b025869326b5d7d6b813b2f7925c2446ff89e6665c4a: Status 404 returned error can't find the container with id 3118e412f8701389b832b025869326b5d7d6b813b2f7925c2446ff89e6665c4a Jul 10 18:00:34.384773 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.384751 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfc9ca45-82b1-4478-a216-1adc73054c2e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lps9f\" (UID: \"dfc9ca45-82b1-4478-a216-1adc73054c2e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f" Jul 10 18:00:34.384863 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.384788 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls\") pod \"dns-default-r56b5\" (UID: \"db3be39f-7610-4b71-9d5b-4087c443e47f\") " pod="openshift-dns/dns-default-r56b5" Jul 10 18:00:34.384863 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.384808 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:00:34.384964 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.384907 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs\") pod \"network-metrics-daemon-tcbv4\" (UID: \"ed23dc61-5837-41ea-95e3-dda5b5a90212\") " pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 18:00:34.384964 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:34.384911 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:00:34.384964 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:34.384920 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 18:00:34.384964 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:34.384956 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls podName:db3be39f-7610-4b71-9d5b-4087c443e47f nodeName:}" failed. No retries permitted until 2026-07-10 18:01:06.384942831 +0000 UTC m=+98.225771079 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls") pod "dns-default-r56b5" (UID: "db3be39f-7610-4b71-9d5b-4087c443e47f") : secret "dns-default-metrics-tls" not found Jul 10 18:00:34.385153 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:34.384970 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfc9ca45-82b1-4478-a216-1adc73054c2e-cluster-monitoring-operator-tls podName:dfc9ca45-82b1-4478-a216-1adc73054c2e nodeName:}" failed. No retries permitted until 2026-07-10 18:00:35.384964327 +0000 UTC m=+67.225792559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dfc9ca45-82b1-4478-a216-1adc73054c2e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lps9f" (UID: "dfc9ca45-82b1-4478-a216-1adc73054c2e") : secret "cluster-monitoring-operator-tls" not found Jul 10 18:00:34.385153 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:34.385014 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:00:34.385153 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:34.385029 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6646cfb9d6-t5tvx: secret "image-registry-tls" not found Jul 10 18:00:34.385153 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:34.385073 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls podName:8e1007ee-7580-42c4-9926-3fb8bca36ed1 nodeName:}" failed. No retries permitted until 2026-07-10 18:01:06.385057739 +0000 UTC m=+98.225885982 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls") pod "image-registry-6646cfb9d6-t5tvx" (UID: "8e1007ee-7580-42c4-9926-3fb8bca36ed1") : secret "image-registry-tls" not found Jul 10 18:00:34.387671 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.387656 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 18:00:34.395129 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:34.395112 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 18:00:34.395195 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:34.395156 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs podName:ed23dc61-5837-41ea-95e3-dda5b5a90212 nodeName:}" failed. No retries permitted until 2026-07-10 18:01:38.395142653 +0000 UTC m=+130.235970888 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs") pod "network-metrics-daemon-tcbv4" (UID: "ed23dc61-5837-41ea-95e3-dda5b5a90212") : secret "metrics-daemon-secret" not found Jul 10 18:00:34.485863 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.485794 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret\") pod \"global-pull-secret-syncer-lkzjv\" (UID: \"2418c763-f86f-480e-bd1e-1766be24925f\") " pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 18:00:34.488420 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.488401 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 18:00:34.498983 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.498965 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2418c763-f86f-480e-bd1e-1766be24925f-original-pull-secret\") pod \"global-pull-secret-syncer-lkzjv\" (UID: \"2418c763-f86f-480e-bd1e-1766be24925f\") " pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 18:00:34.586372 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.586344 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xp7mh\" (UID: \"151cc011-39cc-4b5a-8d78-d79e7e53e3ec\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xp7mh" Jul 10 18:00:34.586545 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.586383 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45wd\" (UniqueName: \"kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd\") pod \"network-check-target-lcvdz\" (UID: \"cf0aba2c-014d-4034-9d96-29ff4c768bb7\") " pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 18:00:34.586545 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:34.586509 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 18:00:34.586650 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:34.586565 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-networking-console-plugin-cert podName:151cc011-39cc-4b5a-8d78-d79e7e53e3ec nodeName:}" failed. No retries permitted until 2026-07-10 18:00:35.586549057 +0000 UTC m=+67.427377292 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-xp7mh" (UID: "151cc011-39cc-4b5a-8d78-d79e7e53e3ec") : secret "networking-console-plugin-cert" not found Jul 10 18:00:34.589010 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.588994 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 18:00:34.599624 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.599607 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 18:00:34.609000 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.608981 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c45wd\" (UniqueName: \"kubernetes.io/projected/cf0aba2c-014d-4034-9d96-29ff4c768bb7-kube-api-access-c45wd\") pod \"network-check-target-lcvdz\" (UID: \"cf0aba2c-014d-4034-9d96-29ff4c768bb7\") " pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 18:00:34.783225 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.783193 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-25vgp\"" Jul 10 18:00:34.786510 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.786493 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkzjv" Jul 10 18:00:34.791653 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.791632 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 18:00:34.931843 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.930123 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lkzjv"] Jul 10 18:00:34.936816 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:00:34.936261 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2418c763_f86f_480e_bd1e_1766be24925f.slice/crio-b7a2226f1985641fe886a8aecd9b2a6231efab6be1f5b226472bc5e1f04a01e1 WatchSource:0}: Error finding container b7a2226f1985641fe886a8aecd9b2a6231efab6be1f5b226472bc5e1f04a01e1: Status 404 returned error can't find the container with id b7a2226f1985641fe886a8aecd9b2a6231efab6be1f5b226472bc5e1f04a01e1 Jul 10 18:00:34.938376 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.938342 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rmd8j" event={"ID":"a0beb717-4a66-4c5e-bbd1-34fdc20582ef","Type":"ContainerStarted","Data":"3118e412f8701389b832b025869326b5d7d6b813b2f7925c2446ff89e6665c4a"} Jul 10 18:00:34.939714 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.939682 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8glrd" event={"ID":"f3fe76eb-7d5e-4f07-978c-60660a6a9a6c","Type":"ContainerStarted","Data":"6b6c261af67f44184c25b99d6c338aa0eb2de39133fcdd3927b6b80dadb7800e"} Jul 10 18:00:34.947490 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:34.947466 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lcvdz"] Jul 10 18:00:34.950149 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:00:34.950130 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf0aba2c_014d_4034_9d96_29ff4c768bb7.slice/crio-3a3cfc4bad215f8cdfdfb65db3a5215ba5ff3652b488517573cbce59cd92d38a WatchSource:0}: Error finding container 3a3cfc4bad215f8cdfdfb65db3a5215ba5ff3652b488517573cbce59cd92d38a: Status 404 returned error can't find the container with id 3a3cfc4bad215f8cdfdfb65db3a5215ba5ff3652b488517573cbce59cd92d38a Jul 10 18:00:35.394348 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:35.394307 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfc9ca45-82b1-4478-a216-1adc73054c2e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lps9f\" (UID: \"dfc9ca45-82b1-4478-a216-1adc73054c2e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f" Jul 10 18:00:35.394540 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:35.394474 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 18:00:35.394603 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:35.394553 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfc9ca45-82b1-4478-a216-1adc73054c2e-cluster-monitoring-operator-tls podName:dfc9ca45-82b1-4478-a216-1adc73054c2e nodeName:}" failed. No retries permitted until 2026-07-10 18:00:37.394532047 +0000 UTC m=+69.235360278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dfc9ca45-82b1-4478-a216-1adc73054c2e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lps9f" (UID: "dfc9ca45-82b1-4478-a216-1adc73054c2e") : secret "cluster-monitoring-operator-tls" not found Jul 10 18:00:35.596350 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:35.596301 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xp7mh\" (UID: \"151cc011-39cc-4b5a-8d78-d79e7e53e3ec\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xp7mh" Jul 10 18:00:35.596512 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:35.596427 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 18:00:35.596512 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:35.596503 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-networking-console-plugin-cert podName:151cc011-39cc-4b5a-8d78-d79e7e53e3ec nodeName:}" failed. No retries permitted until 2026-07-10 18:00:37.596483611 +0000 UTC m=+69.437311845 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-xp7mh" (UID: "151cc011-39cc-4b5a-8d78-d79e7e53e3ec") : secret "networking-console-plugin-cert" not found Jul 10 18:00:35.943683 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:35.943643 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lkzjv" event={"ID":"2418c763-f86f-480e-bd1e-1766be24925f","Type":"ContainerStarted","Data":"b7a2226f1985641fe886a8aecd9b2a6231efab6be1f5b226472bc5e1f04a01e1"} Jul 10 18:00:35.945136 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:35.945098 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lcvdz" event={"ID":"cf0aba2c-014d-4034-9d96-29ff4c768bb7","Type":"ContainerStarted","Data":"3a3cfc4bad215f8cdfdfb65db3a5215ba5ff3652b488517573cbce59cd92d38a"} Jul 10 18:00:37.415919 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:37.415880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfc9ca45-82b1-4478-a216-1adc73054c2e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lps9f\" (UID: \"dfc9ca45-82b1-4478-a216-1adc73054c2e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f" Jul 10 18:00:37.416352 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:37.416057 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 18:00:37.416352 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:37.416164 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfc9ca45-82b1-4478-a216-1adc73054c2e-cluster-monitoring-operator-tls podName:dfc9ca45-82b1-4478-a216-1adc73054c2e nodeName:}" failed. No retries permitted until 2026-07-10 18:00:41.416138982 +0000 UTC m=+73.256967231 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dfc9ca45-82b1-4478-a216-1adc73054c2e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lps9f" (UID: "dfc9ca45-82b1-4478-a216-1adc73054c2e") : secret "cluster-monitoring-operator-tls" not found Jul 10 18:00:37.617421 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:37.617390 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xp7mh\" (UID: \"151cc011-39cc-4b5a-8d78-d79e7e53e3ec\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xp7mh" Jul 10 18:00:37.617583 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:37.617548 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 18:00:37.617627 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:37.617616 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-networking-console-plugin-cert podName:151cc011-39cc-4b5a-8d78-d79e7e53e3ec nodeName:}" failed. No retries permitted until 2026-07-10 18:00:41.617600303 +0000 UTC m=+73.458428535 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-xp7mh" (UID: "151cc011-39cc-4b5a-8d78-d79e7e53e3ec") : secret "networking-console-plugin-cert" not found Jul 10 18:00:38.957326 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:38.957253 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8glrd" event={"ID":"f3fe76eb-7d5e-4f07-978c-60660a6a9a6c","Type":"ContainerStarted","Data":"c5d8b083f30052f761c803bbd1cc71459ba5439068711ef075f2202d5819c489"} Jul 10 18:00:38.973163 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:38.973103 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8glrd" podStartSLOduration=1.397668934 podStartE2EDuration="5.973087315s" totalImagesPullingTime="4.575418381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:00:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:00:38.971781079 +0000 UTC m=+70.812609337" watchObservedRunningTime="2026-07-10 18:00:38.973087315 +0000 UTC m=+70.813915568" Jul 10 18:00:40.965008 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:40.964971 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rmd8j" event={"ID":"a0beb717-4a66-4c5e-bbd1-34fdc20582ef","Type":"ContainerStarted","Data":"da3b1432ad923c24eb79c013837638e03477b799b9e95b6afd526d76d2cd3665"} Jul 10 18:00:40.966417 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:40.966390 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lkzjv" event={"ID":"2418c763-f86f-480e-bd1e-1766be24925f","Type":"ContainerStarted","Data":"fc9e92d4a07dbb3438afb1ce05a4931d8086bca8ab953a81b60f7b79783ebc88"} Jul 10 18:00:40.967808 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:40.967783 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lcvdz" event={"ID":"cf0aba2c-014d-4034-9d96-29ff4c768bb7","Type":"ContainerStarted","Data":"6519816ad09e933e5d5ea91093204e11a4508dee35381f8cb1bcce1fa8ee1d45"} Jul 10 18:00:40.967928 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:40.967899 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 18:00:40.984396 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:40.984360 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rmd8j" podStartSLOduration=3.505534847 podStartE2EDuration="7.984347493s" totalImagesPullingTime="4.478812646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:00:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:00:40.983786677 +0000 UTC m=+72.824614932" watchObservedRunningTime="2026-07-10 18:00:40.984347493 +0000 UTC m=+72.825175746" Jul 10 18:00:40.998324 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:40.998282 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lkzjv" podStartSLOduration=66.596383123 podStartE2EDuration="1m11.9982689s" totalImagesPullingTime="5.401885777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:59:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:00:40.997451104 +0000 UTC m=+72.838279360" watchObservedRunningTime="2026-07-10 18:00:40.9982689 +0000 UTC m=+72.839097161" Jul 10 18:00:41.011715 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:41.011676 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lcvdz" podStartSLOduration=66.67815107 podStartE2EDuration="1m12.01166291s" totalImagesPullingTime="5.33351184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:59:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:00:41.010261919 +0000 UTC m=+72.851090171" watchObservedRunningTime="2026-07-10 18:00:41.01166291 +0000 UTC m=+72.852491161" Jul 10 18:00:41.408100 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:41.408069 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-cxs4p"] Jul 10 18:00:41.410350 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:41.410333 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-cxs4p" Jul 10 18:00:41.412642 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:41.412613 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 10 18:00:41.412753 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:41.412692 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dqww4\"" Jul 10 18:00:41.412943 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:41.412928 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 10 18:00:41.421505 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:41.421486 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-cxs4p"] Jul 10 18:00:41.448774 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:41.448752 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfc9ca45-82b1-4478-a216-1adc73054c2e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lps9f\" (UID: \"dfc9ca45-82b1-4478-a216-1adc73054c2e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f" Jul 10 18:00:41.448930 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:41.448913 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 18:00:41.448977 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:41.448972 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfc9ca45-82b1-4478-a216-1adc73054c2e-cluster-monitoring-operator-tls podName:dfc9ca45-82b1-4478-a216-1adc73054c2e nodeName:}" failed. No retries permitted until 2026-07-10 18:00:49.448956735 +0000 UTC m=+81.289784967 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dfc9ca45-82b1-4478-a216-1adc73054c2e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lps9f" (UID: "dfc9ca45-82b1-4478-a216-1adc73054c2e") : secret "cluster-monitoring-operator-tls" not found Jul 10 18:00:41.549373 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:41.549349 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t5pw\" (UniqueName: \"kubernetes.io/projected/85194ad1-4bfb-4156-85a9-ebfa33430531-kube-api-access-9t5pw\") pod \"migrator-7f59b54f6c-cxs4p\" (UID: \"85194ad1-4bfb-4156-85a9-ebfa33430531\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-cxs4p" Jul 10 18:00:41.650098 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:41.650065 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xp7mh\" (UID: \"151cc011-39cc-4b5a-8d78-d79e7e53e3ec\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xp7mh" Jul 10 18:00:41.650098 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:41.650096 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t5pw\" (UniqueName: \"kubernetes.io/projected/85194ad1-4bfb-4156-85a9-ebfa33430531-kube-api-access-9t5pw\") pod \"migrator-7f59b54f6c-cxs4p\" (UID: \"85194ad1-4bfb-4156-85a9-ebfa33430531\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-cxs4p" Jul 10 18:00:41.650316 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:41.650197 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 18:00:41.650316 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:41.650253 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-networking-console-plugin-cert podName:151cc011-39cc-4b5a-8d78-d79e7e53e3ec nodeName:}" failed. No retries permitted until 2026-07-10 18:00:49.650239091 +0000 UTC m=+81.491067322 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-xp7mh" (UID: "151cc011-39cc-4b5a-8d78-d79e7e53e3ec") : secret "networking-console-plugin-cert" not found Jul 10 18:00:41.659866 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:41.659800 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t5pw\" (UniqueName: \"kubernetes.io/projected/85194ad1-4bfb-4156-85a9-ebfa33430531-kube-api-access-9t5pw\") pod \"migrator-7f59b54f6c-cxs4p\" (UID: \"85194ad1-4bfb-4156-85a9-ebfa33430531\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-cxs4p" Jul 10 18:00:41.719198 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:41.719179 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-cxs4p" Jul 10 18:00:41.836700 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:41.836652 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-cxs4p"] Jul 10 18:00:41.839681 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:00:41.839652 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85194ad1_4bfb_4156_85a9_ebfa33430531.slice/crio-ada8f8fc6a4cc44052d51dc3095d9af3466589edb48b0f3c60c97ba0d7f6219b WatchSource:0}: Error finding container ada8f8fc6a4cc44052d51dc3095d9af3466589edb48b0f3c60c97ba0d7f6219b: Status 404 returned error can't find the container with id ada8f8fc6a4cc44052d51dc3095d9af3466589edb48b0f3c60c97ba0d7f6219b Jul 10 18:00:41.971546 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:41.971477 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-cxs4p" event={"ID":"85194ad1-4bfb-4156-85a9-ebfa33430531","Type":"ContainerStarted","Data":"ada8f8fc6a4cc44052d51dc3095d9af3466589edb48b0f3c60c97ba0d7f6219b"} Jul 10 18:00:42.996088 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:42.996059 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nkmh9"] Jul 10 18:00:42.998608 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:42.998586 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:43.000899 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.000874 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 18:00:43.001026 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.000989 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 18:00:43.001990 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.001946 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 18:00:43.001990 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.001977 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 18:00:43.002226 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.002036 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pcwng\"" Jul 10 18:00:43.009160 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.009138 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nkmh9"] Jul 10 18:00:43.061717 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.061680 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e64bd07b-0c58-4b2d-a32d-49493f8a2737-crio-socket\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:43.061895 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.061726 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e64bd07b-0c58-4b2d-a32d-49493f8a2737-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:43.061952 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.061903 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6bbw\" (UniqueName: \"kubernetes.io/projected/e64bd07b-0c58-4b2d-a32d-49493f8a2737-kube-api-access-m6bbw\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:43.062003 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.061951 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e64bd07b-0c58-4b2d-a32d-49493f8a2737-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:43.062003 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.061977 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e64bd07b-0c58-4b2d-a32d-49493f8a2737-data-volume\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:43.162939 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.162906 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6bbw\" (UniqueName: \"kubernetes.io/projected/e64bd07b-0c58-4b2d-a32d-49493f8a2737-kube-api-access-m6bbw\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:43.163105 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.162948 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e64bd07b-0c58-4b2d-a32d-49493f8a2737-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:43.163105 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.162983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e64bd07b-0c58-4b2d-a32d-49493f8a2737-data-volume\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:43.163105 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.163026 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e64bd07b-0c58-4b2d-a32d-49493f8a2737-crio-socket\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:43.163105 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.163051 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e64bd07b-0c58-4b2d-a32d-49493f8a2737-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:43.163105 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:43.163084 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 18:00:43.163336 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:43.163120 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 18:00:43.163336 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:43.163153 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64bd07b-0c58-4b2d-a32d-49493f8a2737-insights-runtime-extractor-tls podName:e64bd07b-0c58-4b2d-a32d-49493f8a2737 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:43.663137176 +0000 UTC m=+75.503965407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e64bd07b-0c58-4b2d-a32d-49493f8a2737-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nkmh9" (UID: "e64bd07b-0c58-4b2d-a32d-49493f8a2737") : secret "insights-runtime-extractor-tls" not found Jul 10 18:00:43.163336 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.163151 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e64bd07b-0c58-4b2d-a32d-49493f8a2737-crio-socket\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:43.163336 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:43.163177 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e64bd07b-0c58-4b2d-a32d-49493f8a2737-kube-rbac-proxy-cm podName:e64bd07b-0c58-4b2d-a32d-49493f8a2737 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:43.663163343 +0000 UTC m=+75.503991574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e64bd07b-0c58-4b2d-a32d-49493f8a2737-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nkmh9" (UID: "e64bd07b-0c58-4b2d-a32d-49493f8a2737") : configmap "kube-rbac-proxy" not found Jul 10 18:00:43.163336 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.163288 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e64bd07b-0c58-4b2d-a32d-49493f8a2737-data-volume\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:43.175614 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.175594 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6bbw\" (UniqueName: \"kubernetes.io/projected/e64bd07b-0c58-4b2d-a32d-49493f8a2737-kube-api-access-m6bbw\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:43.667264 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.667223 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e64bd07b-0c58-4b2d-a32d-49493f8a2737-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:43.667433 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.667295 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e64bd07b-0c58-4b2d-a32d-49493f8a2737-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:43.667433 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:43.667369 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 18:00:43.667433 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:43.667432 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64bd07b-0c58-4b2d-a32d-49493f8a2737-insights-runtime-extractor-tls podName:e64bd07b-0c58-4b2d-a32d-49493f8a2737 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:44.667416186 +0000 UTC m=+76.508244417 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e64bd07b-0c58-4b2d-a32d-49493f8a2737-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nkmh9" (UID: "e64bd07b-0c58-4b2d-a32d-49493f8a2737") : secret "insights-runtime-extractor-tls" not found Jul 10 18:00:43.667535 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:43.667378 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 18:00:43.667566 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:43.667543 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e64bd07b-0c58-4b2d-a32d-49493f8a2737-kube-rbac-proxy-cm podName:e64bd07b-0c58-4b2d-a32d-49493f8a2737 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:44.6675318 +0000 UTC m=+76.508360031 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e64bd07b-0c58-4b2d-a32d-49493f8a2737-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nkmh9" (UID: "e64bd07b-0c58-4b2d-a32d-49493f8a2737") : configmap "kube-rbac-proxy" not found Jul 10 18:00:43.979344 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.979260 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-cxs4p" event={"ID":"85194ad1-4bfb-4156-85a9-ebfa33430531","Type":"ContainerStarted","Data":"e40a0408c0c3cedf9b7f81c175af776c4ae24c198753895dc00ad75abd91c906"} Jul 10 18:00:43.979344 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.979342 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-cxs4p" event={"ID":"85194ad1-4bfb-4156-85a9-ebfa33430531","Type":"ContainerStarted","Data":"d91440a000f8efc3690889349f8a502e13f586f21fc750d0487311475415a400"} Jul 10 18:00:43.995724 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:43.995680 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-cxs4p" podStartSLOduration=1.660536843 podStartE2EDuration="2.995667195s" totalImagesPullingTime="1.335130352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:00:43.994799184 +0000 UTC m=+75.835627618" watchObservedRunningTime="2026-07-10 18:00:43.995667195 +0000 UTC m=+75.836495447" Jul 10 18:00:44.675827 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:44.675796 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e64bd07b-0c58-4b2d-a32d-49493f8a2737-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:44.676201 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:44.675887 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e64bd07b-0c58-4b2d-a32d-49493f8a2737-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:44.676201 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:44.675941 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 18:00:44.676201 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:44.675957 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 18:00:44.676201 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:44.675999 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e64bd07b-0c58-4b2d-a32d-49493f8a2737-kube-rbac-proxy-cm podName:e64bd07b-0c58-4b2d-a32d-49493f8a2737 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:46.67598711 +0000 UTC m=+78.516815341 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e64bd07b-0c58-4b2d-a32d-49493f8a2737-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nkmh9" (UID: "e64bd07b-0c58-4b2d-a32d-49493f8a2737") : configmap "kube-rbac-proxy" not found Jul 10 18:00:44.676201 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:44.676012 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64bd07b-0c58-4b2d-a32d-49493f8a2737-insights-runtime-extractor-tls podName:e64bd07b-0c58-4b2d-a32d-49493f8a2737 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:46.67600711 +0000 UTC m=+78.516835341 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e64bd07b-0c58-4b2d-a32d-49493f8a2737-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nkmh9" (UID: "e64bd07b-0c58-4b2d-a32d-49493f8a2737") : secret "insights-runtime-extractor-tls" not found Jul 10 18:00:45.599738 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:45.599714 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2jckr_f23e6bd7-d9dd-417b-97e3-4463a60f7236/dns-node-resolver/0.log" Jul 10 18:00:46.600139 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:46.600112 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8crj6_e71f5f58-2ce4-4387-b198-55f3ebc9ff22/node-ca/0.log" Jul 10 18:00:46.694837 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:46.694805 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e64bd07b-0c58-4b2d-a32d-49493f8a2737-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:46.694990 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:46.694897 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e64bd07b-0c58-4b2d-a32d-49493f8a2737-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:46.694990 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:46.694923 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 18:00:46.694990 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:46.694979 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e64bd07b-0c58-4b2d-a32d-49493f8a2737-kube-rbac-proxy-cm podName:e64bd07b-0c58-4b2d-a32d-49493f8a2737 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:50.694961435 +0000 UTC m=+82.535789685 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e64bd07b-0c58-4b2d-a32d-49493f8a2737-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nkmh9" (UID: "e64bd07b-0c58-4b2d-a32d-49493f8a2737") : configmap "kube-rbac-proxy" not found Jul 10 18:00:46.695100 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:46.695011 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 18:00:46.695100 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:46.695049 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64bd07b-0c58-4b2d-a32d-49493f8a2737-insights-runtime-extractor-tls podName:e64bd07b-0c58-4b2d-a32d-49493f8a2737 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:50.695039395 +0000 UTC m=+82.535867628 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e64bd07b-0c58-4b2d-a32d-49493f8a2737-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nkmh9" (UID: "e64bd07b-0c58-4b2d-a32d-49493f8a2737") : secret "insights-runtime-extractor-tls" not found Jul 10 18:00:47.803952 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:47.803917 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qwjmc_65c5cd7a-6e0d-4b74-bc87-ec84d9362897/serve-healthcheck-canary/0.log" Jul 10 18:00:48.008006 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:48.007965 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-cxs4p_85194ad1-4bfb-4156-85a9-ebfa33430531/migrator/0.log" Jul 10 18:00:48.200635 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:48.200534 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-cxs4p_85194ad1-4bfb-4156-85a9-ebfa33430531/graceful-termination/0.log" Jul 10 18:00:48.401372 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:48.401342 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-rmd8j_a0beb717-4a66-4c5e-bbd1-34fdc20582ef/kube-storage-version-migrator-operator/0.log" Jul 10 18:00:49.516193 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:49.516146 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfc9ca45-82b1-4478-a216-1adc73054c2e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lps9f\" (UID: \"dfc9ca45-82b1-4478-a216-1adc73054c2e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f" Jul 10 18:00:49.516663 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:49.516290 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 18:00:49.516663 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:49.516349 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfc9ca45-82b1-4478-a216-1adc73054c2e-cluster-monitoring-operator-tls podName:dfc9ca45-82b1-4478-a216-1adc73054c2e nodeName:}" failed. No retries permitted until 2026-07-10 18:01:05.516334582 +0000 UTC m=+97.357162814 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dfc9ca45-82b1-4478-a216-1adc73054c2e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lps9f" (UID: "dfc9ca45-82b1-4478-a216-1adc73054c2e") : secret "cluster-monitoring-operator-tls" not found Jul 10 18:00:49.717486 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:49.717442 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xp7mh\" (UID: \"151cc011-39cc-4b5a-8d78-d79e7e53e3ec\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xp7mh" Jul 10 18:00:49.717653 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:49.717581 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 18:00:49.717653 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:49.717642 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-networking-console-plugin-cert podName:151cc011-39cc-4b5a-8d78-d79e7e53e3ec nodeName:}" failed. No retries permitted until 2026-07-10 18:01:05.717628291 +0000 UTC m=+97.558456522 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-xp7mh" (UID: "151cc011-39cc-4b5a-8d78-d79e7e53e3ec") : secret "networking-console-plugin-cert" not found Jul 10 18:00:50.724513 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:50.724403 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e64bd07b-0c58-4b2d-a32d-49493f8a2737-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:50.724513 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:50.724466 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e64bd07b-0c58-4b2d-a32d-49493f8a2737-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:50.724937 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:50.724530 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 18:00:50.724937 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:50.724566 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 18:00:50.724937 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:50.724594 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e64bd07b-0c58-4b2d-a32d-49493f8a2737-kube-rbac-proxy-cm podName:e64bd07b-0c58-4b2d-a32d-49493f8a2737 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:58.724578175 +0000 UTC m=+90.565406410 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e64bd07b-0c58-4b2d-a32d-49493f8a2737-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nkmh9" (UID: "e64bd07b-0c58-4b2d-a32d-49493f8a2737") : configmap "kube-rbac-proxy" not found Jul 10 18:00:50.724937 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:50.724608 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64bd07b-0c58-4b2d-a32d-49493f8a2737-insights-runtime-extractor-tls podName:e64bd07b-0c58-4b2d-a32d-49493f8a2737 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:58.724602384 +0000 UTC m=+90.565430615 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e64bd07b-0c58-4b2d-a32d-49493f8a2737-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nkmh9" (UID: "e64bd07b-0c58-4b2d-a32d-49493f8a2737") : secret "insights-runtime-extractor-tls" not found Jul 10 18:00:58.790455 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:58.790419 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e64bd07b-0c58-4b2d-a32d-49493f8a2737-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:58.791049 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:58.790508 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e64bd07b-0c58-4b2d-a32d-49493f8a2737-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:00:58.791049 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:58.790625 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 18:00:58.791049 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:00:58.790677 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64bd07b-0c58-4b2d-a32d-49493f8a2737-insights-runtime-extractor-tls podName:e64bd07b-0c58-4b2d-a32d-49493f8a2737 nodeName:}" failed. No retries permitted until 2026-07-10 18:01:14.790661548 +0000 UTC m=+106.631489801 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e64bd07b-0c58-4b2d-a32d-49493f8a2737-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nkmh9" (UID: "e64bd07b-0c58-4b2d-a32d-49493f8a2737") : secret "insights-runtime-extractor-tls" not found Jul 10 18:00:58.791049 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:00:58.790926 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e64bd07b-0c58-4b2d-a32d-49493f8a2737-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:01:05.546014 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:05.545975 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfc9ca45-82b1-4478-a216-1adc73054c2e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lps9f\" (UID: \"dfc9ca45-82b1-4478-a216-1adc73054c2e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f" Jul 10 18:01:05.548320 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:05.548299 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfc9ca45-82b1-4478-a216-1adc73054c2e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lps9f\" (UID: \"dfc9ca45-82b1-4478-a216-1adc73054c2e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f" Jul 10 18:01:05.747945 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:05.747907 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xp7mh\" (UID: \"151cc011-39cc-4b5a-8d78-d79e7e53e3ec\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xp7mh" Jul 10 18:01:05.750199 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:05.750180 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/151cc011-39cc-4b5a-8d78-d79e7e53e3ec-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xp7mh\" (UID: \"151cc011-39cc-4b5a-8d78-d79e7e53e3ec\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xp7mh" Jul 10 18:01:05.847697 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:05.847610 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f" Jul 10 18:01:05.966165 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:05.966135 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f"] Jul 10 18:01:05.968647 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:01:05.968619 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfc9ca45_82b1_4478_a216_1adc73054c2e.slice/crio-0a63a231f236eb09cce91369a04afb4c373e40527973edab3cec2d0f33643c6b WatchSource:0}: Error finding container 0a63a231f236eb09cce91369a04afb4c373e40527973edab3cec2d0f33643c6b: Status 404 returned error can't find the container with id 0a63a231f236eb09cce91369a04afb4c373e40527973edab3cec2d0f33643c6b Jul 10 18:01:06.040507 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:06.040484 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-xp7mh" Jul 10 18:01:06.042572 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:06.042530 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f" event={"ID":"dfc9ca45-82b1-4478-a216-1adc73054c2e","Type":"ContainerStarted","Data":"0a63a231f236eb09cce91369a04afb4c373e40527973edab3cec2d0f33643c6b"} Jul 10 18:01:06.162806 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:06.162775 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-xp7mh"] Jul 10 18:01:06.165981 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:01:06.165959 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod151cc011_39cc_4b5a_8d78_d79e7e53e3ec.slice/crio-618bb25be8d45282d61497b18edba2bb5bf195f230a38e22f7c7c04c1bfc61dd WatchSource:0}: Error finding container 618bb25be8d45282d61497b18edba2bb5bf195f230a38e22f7c7c04c1bfc61dd: Status 404 returned error can't find the container with id 618bb25be8d45282d61497b18edba2bb5bf195f230a38e22f7c7c04c1bfc61dd Jul 10 18:01:06.453450 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:06.453355 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls\") pod \"dns-default-r56b5\" (UID: \"db3be39f-7610-4b71-9d5b-4087c443e47f\") " pod="openshift-dns/dns-default-r56b5" Jul 10 18:01:06.453450 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:06.453393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:01:06.455629 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:06.455605 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db3be39f-7610-4b71-9d5b-4087c443e47f-metrics-tls\") pod \"dns-default-r56b5\" (UID: \"db3be39f-7610-4b71-9d5b-4087c443e47f\") " pod="openshift-dns/dns-default-r56b5" Jul 10 18:01:06.455781 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:06.455763 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls\") pod \"image-registry-6646cfb9d6-t5tvx\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:01:06.734162 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:06.734060 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-skqd4\"" Jul 10 18:01:06.742157 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:06.742134 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:01:06.749627 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:06.749602 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xxlp9\"" Jul 10 18:01:06.757918 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:06.757893 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r56b5" Jul 10 18:01:06.899705 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:06.899672 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6646cfb9d6-t5tvx"] Jul 10 18:01:06.903703 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:01:06.903677 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e1007ee_7580_42c4_9926_3fb8bca36ed1.slice/crio-c641b16bd3f70a9dcae71c7d45d4a6ae5c1cac5a3ef1702cac158ec1da9c3549 WatchSource:0}: Error finding container c641b16bd3f70a9dcae71c7d45d4a6ae5c1cac5a3ef1702cac158ec1da9c3549: Status 404 returned error can't find the container with id c641b16bd3f70a9dcae71c7d45d4a6ae5c1cac5a3ef1702cac158ec1da9c3549 Jul 10 18:01:06.912797 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:06.912765 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r56b5"] Jul 10 18:01:06.917741 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:01:06.917712 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb3be39f_7610_4b71_9d5b_4087c443e47f.slice/crio-dffeb335860a96819a2d258be26dca11b3b8dbf2abd1c44652aedece375cbaf6 WatchSource:0}: Error finding container dffeb335860a96819a2d258be26dca11b3b8dbf2abd1c44652aedece375cbaf6: Status 404 returned error can't find the container with id dffeb335860a96819a2d258be26dca11b3b8dbf2abd1c44652aedece375cbaf6 Jul 10 18:01:07.047476 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:07.047436 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" event={"ID":"8e1007ee-7580-42c4-9926-3fb8bca36ed1","Type":"ContainerStarted","Data":"02785f53433762af98c1b43023550fc93a99b9936cf9fc844d511622a2238c1c"} Jul 10 18:01:07.047657 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:07.047496 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" event={"ID":"8e1007ee-7580-42c4-9926-3fb8bca36ed1","Type":"ContainerStarted","Data":"c641b16bd3f70a9dcae71c7d45d4a6ae5c1cac5a3ef1702cac158ec1da9c3549"} Jul 10 18:01:07.047657 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:07.047604 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:01:07.048768 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:07.048741 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r56b5" event={"ID":"db3be39f-7610-4b71-9d5b-4087c443e47f","Type":"ContainerStarted","Data":"dffeb335860a96819a2d258be26dca11b3b8dbf2abd1c44652aedece375cbaf6"} Jul 10 18:01:07.049956 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:07.049929 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-xp7mh" event={"ID":"151cc011-39cc-4b5a-8d78-d79e7e53e3ec","Type":"ContainerStarted","Data":"618bb25be8d45282d61497b18edba2bb5bf195f230a38e22f7c7c04c1bfc61dd"} Jul 10 18:01:07.068768 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:07.068698 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" podStartSLOduration=98.068674466 podStartE2EDuration="1m38.068674466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:59:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:07.067361923 +0000 UTC m=+98.908190196" watchObservedRunningTime="2026-07-10 18:01:07.068674466 +0000 UTC m=+98.909502725" Jul 10 18:01:08.055312 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:08.055243 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-xp7mh" event={"ID":"151cc011-39cc-4b5a-8d78-d79e7e53e3ec","Type":"ContainerStarted","Data":"232d80d023512d748e6bdeb3306f1072489418179aa260054ee7f8f6e886ac9a"} Jul 10 18:01:08.069978 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:08.069886 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-xp7mh" podStartSLOduration=33.827869248 podStartE2EDuration="35.069865615s" totalImagesPullingTime="1.241996367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:00:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:08.068743482 +0000 UTC m=+99.909571735" watchObservedRunningTime="2026-07-10 18:01:08.069865615 +0000 UTC m=+99.910693861" Jul 10 18:01:09.063362 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:09.063319 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f" event={"ID":"dfc9ca45-82b1-4478-a216-1adc73054c2e","Type":"ContainerStarted","Data":"e5c6288f2316f978ed660ad5e8f914eec6f8a38ceb490404ccd2cc48e7058bb5"} Jul 10 18:01:09.078826 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:09.078772 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lps9f" podStartSLOduration=33.849447533 podStartE2EDuration="36.078752239s" totalImagesPullingTime="2.229304706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:00:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:09.077207395 +0000 UTC m=+100.918035648" watchObservedRunningTime="2026-07-10 18:01:09.078752239 +0000 UTC m=+100.919580495" Jul 10 18:01:10.067598 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:10.067566 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r56b5" event={"ID":"db3be39f-7610-4b71-9d5b-4087c443e47f","Type":"ContainerStarted","Data":"4291e23f7d810dac1a9d7d5d5a70bf5bcb941b7363b2353a00df879ddc8c83b8"} Jul 10 18:01:10.067999 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:10.067618 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r56b5" event={"ID":"db3be39f-7610-4b71-9d5b-4087c443e47f","Type":"ContainerStarted","Data":"c8e73dc87e11d054c9086c686da5ff60b8bb94c34e4540e27fcb2271609eb150"} Jul 10 18:01:10.067999 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:10.067673 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r56b5" Jul 10 18:01:10.083422 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:10.083381 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r56b5" podStartSLOduration=65.804876534 podStartE2EDuration="1m8.083367048s" totalImagesPullingTime="2.278490514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:00:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:10.082364175 +0000 UTC m=+101.923192430" watchObservedRunningTime="2026-07-10 18:01:10.083367048 +0000 UTC m=+101.924195301" Jul 10 18:01:11.975058 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:11.975029 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lcvdz" Jul 10 18:01:14.815457 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:14.815416 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e64bd07b-0c58-4b2d-a32d-49493f8a2737-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:01:14.817738 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:14.817714 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e64bd07b-0c58-4b2d-a32d-49493f8a2737-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nkmh9\" (UID: \"e64bd07b-0c58-4b2d-a32d-49493f8a2737\") " pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:01:15.109277 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:15.109183 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nkmh9" Jul 10 18:01:15.270339 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:15.269468 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nkmh9"] Jul 10 18:01:15.274184 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:01:15.274159 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64bd07b_0c58_4b2d_a32d_49493f8a2737.slice/crio-92c6413645a75c886df82004de1d6ee3b92906392ac9dc37cb8e3e9c1152f551 WatchSource:0}: Error finding container 92c6413645a75c886df82004de1d6ee3b92906392ac9dc37cb8e3e9c1152f551: Status 404 returned error can't find the container with id 92c6413645a75c886df82004de1d6ee3b92906392ac9dc37cb8e3e9c1152f551 Jul 10 18:01:16.090765 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:16.090728 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nkmh9" event={"ID":"e64bd07b-0c58-4b2d-a32d-49493f8a2737","Type":"ContainerStarted","Data":"92c6413645a75c886df82004de1d6ee3b92906392ac9dc37cb8e3e9c1152f551"} Jul 10 18:01:18.099976 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.099944 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv"] Jul 10 18:01:18.105947 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.105913 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv" Jul 10 18:01:18.108238 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.108213 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 10 18:01:18.108360 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.108215 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-c5j57\"" Jul 10 18:01:18.108360 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.108216 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 10 18:01:18.109168 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.109145 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 18:01:18.112970 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.112904 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv"] Jul 10 18:01:18.144298 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.144264 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c03069b-3ec7-4f58-acc1-3320407c6205-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-7k4qv\" (UID: \"8c03069b-3ec7-4f58-acc1-3320407c6205\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv" Jul 10 18:01:18.144474 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.144336 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c03069b-3ec7-4f58-acc1-3320407c6205-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7k4qv\" (UID: \"8c03069b-3ec7-4f58-acc1-3320407c6205\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv" Jul 10 18:01:18.144474 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.144383 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c03069b-3ec7-4f58-acc1-3320407c6205-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-7k4qv\" (UID: \"8c03069b-3ec7-4f58-acc1-3320407c6205\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv" Jul 10 18:01:18.144600 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.144470 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxkwv\" (UniqueName: \"kubernetes.io/projected/8c03069b-3ec7-4f58-acc1-3320407c6205-kube-api-access-cxkwv\") pod \"openshift-state-metrics-84bd68b896-7k4qv\" (UID: \"8c03069b-3ec7-4f58-acc1-3320407c6205\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv" Jul 10 18:01:18.145087 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.145064 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vmv7d"] Jul 10 18:01:18.148827 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.148806 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.151183 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.151126 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 18:01:18.151336 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.151184 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 18:01:18.151336 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.151284 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sqvhc\"" Jul 10 18:01:18.151494 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.151424 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 18:01:18.245454 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.245405 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c03069b-3ec7-4f58-acc1-3320407c6205-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7k4qv\" (UID: \"8c03069b-3ec7-4f58-acc1-3320407c6205\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv" Jul 10 18:01:18.245454 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.245450 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j79l\" (UniqueName: \"kubernetes.io/projected/71151d48-fd30-4518-b63e-154be37fcdee-kube-api-access-7j79l\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.245709 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.245487 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/71151d48-fd30-4518-b63e-154be37fcdee-node-exporter-tls\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.245709 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.245521 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c03069b-3ec7-4f58-acc1-3320407c6205-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-7k4qv\" (UID: \"8c03069b-3ec7-4f58-acc1-3320407c6205\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv" Jul 10 18:01:18.245709 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.245552 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxkwv\" (UniqueName: \"kubernetes.io/projected/8c03069b-3ec7-4f58-acc1-3320407c6205-kube-api-access-cxkwv\") pod \"openshift-state-metrics-84bd68b896-7k4qv\" (UID: \"8c03069b-3ec7-4f58-acc1-3320407c6205\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv" Jul 10 18:01:18.245709 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:01:18.245571 2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 10 18:01:18.245709 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.245627 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71151d48-fd30-4518-b63e-154be37fcdee-sys\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.245709 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:01:18.245650 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c03069b-3ec7-4f58-acc1-3320407c6205-openshift-state-metrics-tls podName:8c03069b-3ec7-4f58-acc1-3320407c6205 nodeName:}" failed. No retries permitted until 2026-07-10 18:01:18.74562782 +0000 UTC m=+110.586456056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8c03069b-3ec7-4f58-acc1-3320407c6205-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-7k4qv" (UID: "8c03069b-3ec7-4f58-acc1-3320407c6205") : secret "openshift-state-metrics-tls" not found Jul 10 18:01:18.245709 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.245692 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c03069b-3ec7-4f58-acc1-3320407c6205-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-7k4qv\" (UID: \"8c03069b-3ec7-4f58-acc1-3320407c6205\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv" Jul 10 18:01:18.246132 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.245730 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/71151d48-fd30-4518-b63e-154be37fcdee-root\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.246132 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.245753 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/71151d48-fd30-4518-b63e-154be37fcdee-node-exporter-textfile\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.246132 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.245802 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71151d48-fd30-4518-b63e-154be37fcdee-metrics-client-ca\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.246132 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.245831 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/71151d48-fd30-4518-b63e-154be37fcdee-node-exporter-wtmp\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.246132 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.245877 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/71151d48-fd30-4518-b63e-154be37fcdee-node-exporter-accelerators-collector-config\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.246132 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.245910 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71151d48-fd30-4518-b63e-154be37fcdee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.246453 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.246342 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c03069b-3ec7-4f58-acc1-3320407c6205-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-7k4qv\" (UID: \"8c03069b-3ec7-4f58-acc1-3320407c6205\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv" Jul 10 18:01:18.248231 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.248207 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c03069b-3ec7-4f58-acc1-3320407c6205-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-7k4qv\" (UID: \"8c03069b-3ec7-4f58-acc1-3320407c6205\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv" Jul 10 18:01:18.254463 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.254431 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxkwv\" (UniqueName: \"kubernetes.io/projected/8c03069b-3ec7-4f58-acc1-3320407c6205-kube-api-access-cxkwv\") pod \"openshift-state-metrics-84bd68b896-7k4qv\" (UID: \"8c03069b-3ec7-4f58-acc1-3320407c6205\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv" Jul 10 18:01:18.347393 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.347231 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71151d48-fd30-4518-b63e-154be37fcdee-sys\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.347393 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.347296 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/71151d48-fd30-4518-b63e-154be37fcdee-root\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.347393 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.347320 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/71151d48-fd30-4518-b63e-154be37fcdee-node-exporter-textfile\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.347393 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.347360 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71151d48-fd30-4518-b63e-154be37fcdee-metrics-client-ca\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.347740 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.347422 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/71151d48-fd30-4518-b63e-154be37fcdee-node-exporter-wtmp\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.347740 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.347456 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/71151d48-fd30-4518-b63e-154be37fcdee-node-exporter-accelerators-collector-config\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.347740 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.347527 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71151d48-fd30-4518-b63e-154be37fcdee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.347740 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.347575 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j79l\" (UniqueName: \"kubernetes.io/projected/71151d48-fd30-4518-b63e-154be37fcdee-kube-api-access-7j79l\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.347740 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.347576 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/71151d48-fd30-4518-b63e-154be37fcdee-root\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.347740 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.347612 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/71151d48-fd30-4518-b63e-154be37fcdee-node-exporter-tls\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.347740 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:01:18.347736 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 10 18:01:18.348099 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:01:18.347808 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71151d48-fd30-4518-b63e-154be37fcdee-node-exporter-tls podName:71151d48-fd30-4518-b63e-154be37fcdee nodeName:}" failed. No retries permitted until 2026-07-10 18:01:18.847786857 +0000 UTC m=+110.688615101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/71151d48-fd30-4518-b63e-154be37fcdee-node-exporter-tls") pod "node-exporter-vmv7d" (UID: "71151d48-fd30-4518-b63e-154be37fcdee") : secret "node-exporter-tls" not found Jul 10 18:01:18.348099 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.347820 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/71151d48-fd30-4518-b63e-154be37fcdee-node-exporter-textfile\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.348099 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.347883 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71151d48-fd30-4518-b63e-154be37fcdee-sys\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.348099 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.347936 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71151d48-fd30-4518-b63e-154be37fcdee-metrics-client-ca\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.348099 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.347976 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/71151d48-fd30-4518-b63e-154be37fcdee-node-exporter-wtmp\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.348501 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.348480 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/71151d48-fd30-4518-b63e-154be37fcdee-node-exporter-accelerators-collector-config\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.350591 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.350523 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71151d48-fd30-4518-b63e-154be37fcdee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.356254 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.356227 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j79l\" (UniqueName: \"kubernetes.io/projected/71151d48-fd30-4518-b63e-154be37fcdee-kube-api-access-7j79l\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.750914 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.750818 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c03069b-3ec7-4f58-acc1-3320407c6205-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7k4qv\" (UID: \"8c03069b-3ec7-4f58-acc1-3320407c6205\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv" Jul 10 18:01:18.753432 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.753398 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c03069b-3ec7-4f58-acc1-3320407c6205-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7k4qv\" (UID: \"8c03069b-3ec7-4f58-acc1-3320407c6205\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv" Jul 10 18:01:18.851458 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.851416 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/71151d48-fd30-4518-b63e-154be37fcdee-node-exporter-tls\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:18.854323 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:18.854294 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/71151d48-fd30-4518-b63e-154be37fcdee-node-exporter-tls\") pod \"node-exporter-vmv7d\" (UID: \"71151d48-fd30-4518-b63e-154be37fcdee\") " pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:19.018401 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.018304 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv" Jul 10 18:01:19.059447 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.059423 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vmv7d" Jul 10 18:01:19.071282 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:01:19.071240 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71151d48_fd30_4518_b63e_154be37fcdee.slice/crio-41b113db4fee6925dbc8cdf4cd2b851dfae0a00b877008ab4655c0ba391e1cfb WatchSource:0}: Error finding container 41b113db4fee6925dbc8cdf4cd2b851dfae0a00b877008ab4655c0ba391e1cfb: Status 404 returned error can't find the container with id 41b113db4fee6925dbc8cdf4cd2b851dfae0a00b877008ab4655c0ba391e1cfb Jul 10 18:01:19.102926 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.102886 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nkmh9" event={"ID":"e64bd07b-0c58-4b2d-a32d-49493f8a2737","Type":"ContainerStarted","Data":"d0d4b187e23dc3b0150948bb51baf7923acd0dec593a1f44db487e7ae61e8a69"} Jul 10 18:01:19.104194 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.104159 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vmv7d" event={"ID":"71151d48-fd30-4518-b63e-154be37fcdee","Type":"ContainerStarted","Data":"41b113db4fee6925dbc8cdf4cd2b851dfae0a00b877008ab4655c0ba391e1cfb"} Jul 10 18:01:19.156241 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.156157 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv"] Jul 10 18:01:19.158754 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:01:19.158731 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c03069b_3ec7_4f58_acc1_3320407c6205.slice/crio-7bdc8f0d63bd061a850d8ed66aded81d33b9495c0c05223239085c97574cf315 WatchSource:0}: Error finding container 7bdc8f0d63bd061a850d8ed66aded81d33b9495c0c05223239085c97574cf315: Status 404 returned error can't find the container with id 7bdc8f0d63bd061a850d8ed66aded81d33b9495c0c05223239085c97574cf315 Jul 10 18:01:19.204116 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.204090 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:01:19.207268 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.207250 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.209701 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.209683 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 10 18:01:19.209875 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.209834 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 10 18:01:19.209971 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.209883 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zvc2r\"" Jul 10 18:01:19.210127 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.210107 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 10 18:01:19.210127 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.210124 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 10 18:01:19.210262 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.210166 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 10 18:01:19.210262 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.210226 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 10 18:01:19.210372 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.210258 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 10 18:01:19.210499 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.210455 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 10 18:01:19.210499 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.210494 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 10 18:01:19.224877 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.224829 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:01:19.254032 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.254005 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c624d3c0-490e-4260-8d3e-6bba2d73e66f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.254200 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.254036 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.254200 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.254065 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c624d3c0-490e-4260-8d3e-6bba2d73e66f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.254200 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.254094 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.254200 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.254126 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c624d3c0-490e-4260-8d3e-6bba2d73e66f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.254200 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.254150 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c624d3c0-490e-4260-8d3e-6bba2d73e66f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.254200 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.254180 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.254611 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.254227 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c624d3c0-490e-4260-8d3e-6bba2d73e66f-config-out\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.254611 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.254264 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.254611 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.254291 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-web-config\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.254611 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.254344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.254611 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.254379 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znrnd\" (UniqueName: \"kubernetes.io/projected/c624d3c0-490e-4260-8d3e-6bba2d73e66f-kube-api-access-znrnd\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.254611 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.254420 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-config-volume\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.355637 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.355600 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-config-volume\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.355806 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.355675 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c624d3c0-490e-4260-8d3e-6bba2d73e66f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.355806 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.355704 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.355806 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.355729 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c624d3c0-490e-4260-8d3e-6bba2d73e66f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.356486 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.356143 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.356486 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.356154 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c624d3c0-490e-4260-8d3e-6bba2d73e66f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.356486 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.356218 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c624d3c0-490e-4260-8d3e-6bba2d73e66f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.356486 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.356245 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c624d3c0-490e-4260-8d3e-6bba2d73e66f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.356486 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.356283 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.356486 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.356309 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c624d3c0-490e-4260-8d3e-6bba2d73e66f-config-out\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.356486 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.356335 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.356486 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.356359 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-web-config\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.356486 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.356420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.356486 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.356447 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znrnd\" (UniqueName: \"kubernetes.io/projected/c624d3c0-490e-4260-8d3e-6bba2d73e66f-kube-api-access-znrnd\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.357149 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.356558 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c624d3c0-490e-4260-8d3e-6bba2d73e66f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.357149 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:01:19.356897 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c624d3c0-490e-4260-8d3e-6bba2d73e66f-alertmanager-trusted-ca-bundle podName:c624d3c0-490e-4260-8d3e-6bba2d73e66f nodeName:}" failed. No retries permitted until 2026-07-10 18:01:19.856841205 +0000 UTC m=+111.697669448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/c624d3c0-490e-4260-8d3e-6bba2d73e66f-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "c624d3c0-490e-4260-8d3e-6bba2d73e66f") : configmap references non-existent config key: ca-bundle.crt Jul 10 18:01:19.363011 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.362411 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.363011 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.362800 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.363011 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.362838 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c624d3c0-490e-4260-8d3e-6bba2d73e66f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.363011 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.362946 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.363301 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.363254 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.364352 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.363779 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.364352 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.364008 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-config-volume\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.364511 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.364349 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c624d3c0-490e-4260-8d3e-6bba2d73e66f-config-out\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.366467 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.366425 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-web-config\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.366887 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.366837 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znrnd\" (UniqueName: \"kubernetes.io/projected/c624d3c0-490e-4260-8d3e-6bba2d73e66f-kube-api-access-znrnd\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.859479 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.859439 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c624d3c0-490e-4260-8d3e-6bba2d73e66f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:19.860490 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:19.860433 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c624d3c0-490e-4260-8d3e-6bba2d73e66f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:20.073581 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.073555 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r56b5" Jul 10 18:01:20.111350 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.111279 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nkmh9" event={"ID":"e64bd07b-0c58-4b2d-a32d-49493f8a2737","Type":"ContainerStarted","Data":"0c8ec432cff7af7381bd3097c0ad521f01c1a4d3535ff882345ebcee9be9d422"} Jul 10 18:01:20.114913 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.114884 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv" event={"ID":"8c03069b-3ec7-4f58-acc1-3320407c6205","Type":"ContainerStarted","Data":"e972d578f3cd08e4a8e65ec6c4a6ef5ce3fc23cc918b1cb339dd6e1b1d02ec4b"} Jul 10 18:01:20.115032 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.114950 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv" event={"ID":"8c03069b-3ec7-4f58-acc1-3320407c6205","Type":"ContainerStarted","Data":"7d2974f6905b33c41b2ab65f1a3083a65ef1bd181f8b2a52742d5b7c3f91a706"} Jul 10 18:01:20.115032 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.114979 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv" event={"ID":"8c03069b-3ec7-4f58-acc1-3320407c6205","Type":"ContainerStarted","Data":"7bdc8f0d63bd061a850d8ed66aded81d33b9495c0c05223239085c97574cf315"} Jul 10 18:01:20.117358 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.117213 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:01:20.202577 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.202543 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-998794db6-9m2vr"] Jul 10 18:01:20.210592 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.210034 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.212952 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.212661 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 10 18:01:20.212952 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.212832 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 10 18:01:20.213473 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.213162 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-fkfmh\"" Jul 10 18:01:20.213473 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.213164 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 10 18:01:20.213473 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.213291 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 10 18:01:20.213473 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.213356 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9ho2va3tadrbf\"" Jul 10 18:01:20.213473 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.213401 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 10 18:01:20.218412 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.218183 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-998794db6-9m2vr"] Jul 10 18:01:20.264470 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.264425 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-secret-grpc-tls\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.264632 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.264495 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8xk6\" (UniqueName: \"kubernetes.io/projected/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-kube-api-access-b8xk6\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.264632 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.264551 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-metrics-client-ca\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.264632 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.264618 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.264809 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.264664 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.264809 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.264697 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.264809 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.264722 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.264809 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.264762 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-secret-thanos-querier-tls\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.278767 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.278560 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:01:20.365522 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.365425 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-secret-grpc-tls\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.365522 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.365500 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8xk6\" (UniqueName: \"kubernetes.io/projected/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-kube-api-access-b8xk6\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.365728 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.365548 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-metrics-client-ca\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.365728 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.365606 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.365728 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.365641 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.365728 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.365672 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.365728 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.365696 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.365728 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.365725 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-secret-thanos-querier-tls\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.366440 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.366413 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-metrics-client-ca\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.368764 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.368729 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-secret-thanos-querier-tls\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.368764 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.368753 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.369007 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.368979 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-secret-grpc-tls\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.369362 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.369340 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.369362 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.369347 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.369516 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.369483 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.373536 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.373504 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8xk6\" (UniqueName: \"kubernetes.io/projected/27bcd56e-373f-448d-8a3c-9ee5823b9ac4-kube-api-access-b8xk6\") pod \"thanos-querier-998794db6-9m2vr\" (UID: \"27bcd56e-373f-448d-8a3c-9ee5823b9ac4\") " pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.451951 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:01:20.451915 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc624d3c0_490e_4260_8d3e_6bba2d73e66f.slice/crio-17d58656175e09a8cab888949d692b9519d7ec81497447b3fd0cf519c4b4b014 WatchSource:0}: Error finding container 17d58656175e09a8cab888949d692b9519d7ec81497447b3fd0cf519c4b4b014: Status 404 returned error can't find the container with id 17d58656175e09a8cab888949d692b9519d7ec81497447b3fd0cf519c4b4b014 Jul 10 18:01:20.573198 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.573021 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:20.712236 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:20.712205 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-998794db6-9m2vr"] Jul 10 18:01:20.714897 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:01:20.714844 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27bcd56e_373f_448d_8a3c_9ee5823b9ac4.slice/crio-363597f313a7f966bd454fbab135eab49b06cc2a90347eeb05b1b446c8c68250 WatchSource:0}: Error finding container 363597f313a7f966bd454fbab135eab49b06cc2a90347eeb05b1b446c8c68250: Status 404 returned error can't find the container with id 363597f313a7f966bd454fbab135eab49b06cc2a90347eeb05b1b446c8c68250 Jul 10 18:01:21.121152 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:21.121106 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c624d3c0-490e-4260-8d3e-6bba2d73e66f","Type":"ContainerStarted","Data":"17d58656175e09a8cab888949d692b9519d7ec81497447b3fd0cf519c4b4b014"} Jul 10 18:01:21.122949 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:21.122920 2579 generic.go:356] "Generic (PLEG): container finished" podID="71151d48-fd30-4518-b63e-154be37fcdee" containerID="c938cbce48eba25ef521827d3a77555ef281c38d1c0322226a3f1dace43e9f59" exitCode=0 Jul 10 18:01:21.123096 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:21.122962 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vmv7d" event={"ID":"71151d48-fd30-4518-b63e-154be37fcdee","Type":"ContainerDied","Data":"c938cbce48eba25ef521827d3a77555ef281c38d1c0322226a3f1dace43e9f59"} Jul 10 18:01:21.125633 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:21.125604 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv" event={"ID":"8c03069b-3ec7-4f58-acc1-3320407c6205","Type":"ContainerStarted","Data":"fb19a30a69913a003962dc27a1e32d19c5972d7c4a7239e0e64384328baf27b4"} Jul 10 18:01:21.127461 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:21.127434 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" event={"ID":"27bcd56e-373f-448d-8a3c-9ee5823b9ac4","Type":"ContainerStarted","Data":"363597f313a7f966bd454fbab135eab49b06cc2a90347eeb05b1b446c8c68250"} Jul 10 18:01:21.158696 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:21.158632 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7k4qv" podStartSLOduration=1.952077723 podStartE2EDuration="3.158609338s" totalImagesPullingTime="1.206531615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:21.157298986 +0000 UTC m=+112.998127241" watchObservedRunningTime="2026-07-10 18:01:21.158609338 +0000 UTC m=+112.999437593" Jul 10 18:01:22.134728 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:22.134685 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vmv7d" event={"ID":"71151d48-fd30-4518-b63e-154be37fcdee","Type":"ContainerStarted","Data":"376e872e0b33cec2810b85f32b4bb44b8426948a763c6400b15c0b3a997ab554"} Jul 10 18:01:22.135203 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:22.134753 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vmv7d" event={"ID":"71151d48-fd30-4518-b63e-154be37fcdee","Type":"ContainerStarted","Data":"8692cb8083f89f8b54971bee48d6094666dc0f0f920aad782296804788053e9a"} Jul 10 18:01:22.154116 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:22.154073 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vmv7d" podStartSLOduration=3.100420066 podStartE2EDuration="4.154056268s" totalImagesPullingTime="966.050801ms" totalInitContainerRuntime="87.585401ms" isStatefulPod=true podCreationTimestamp="2026-07-10 18:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:22.151956814 +0000 UTC m=+113.992785098" watchObservedRunningTime="2026-07-10 18:01:22.154056268 +0000 UTC m=+113.994884557" Jul 10 18:01:22.885007 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:22.884972 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-jn5cb"] Jul 10 18:01:22.890327 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:22.890199 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jn5cb" Jul 10 18:01:22.893643 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:22.893617 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-n7ln7\"" Jul 10 18:01:22.893785 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:22.893685 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 10 18:01:22.896075 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:22.896053 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-jn5cb"] Jul 10 18:01:22.992665 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:22.992632 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fwjw\" (UniqueName: \"kubernetes.io/projected/b64aa758-5dc1-4dcd-b529-e07c8722cefb-kube-api-access-5fwjw\") pod \"monitoring-plugin-5f68df7f58-jn5cb\" (UID: \"b64aa758-5dc1-4dcd-b529-e07c8722cefb\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jn5cb" Jul 10 18:01:22.992870 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:22.992694 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b64aa758-5dc1-4dcd-b529-e07c8722cefb-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-jn5cb\" (UID: \"b64aa758-5dc1-4dcd-b529-e07c8722cefb\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jn5cb" Jul 10 18:01:23.093967 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:23.093937 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b64aa758-5dc1-4dcd-b529-e07c8722cefb-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-jn5cb\" (UID: \"b64aa758-5dc1-4dcd-b529-e07c8722cefb\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jn5cb" Jul 10 18:01:23.094142 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:23.094050 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fwjw\" (UniqueName: \"kubernetes.io/projected/b64aa758-5dc1-4dcd-b529-e07c8722cefb-kube-api-access-5fwjw\") pod \"monitoring-plugin-5f68df7f58-jn5cb\" (UID: \"b64aa758-5dc1-4dcd-b529-e07c8722cefb\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jn5cb" Jul 10 18:01:23.096895 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:23.096863 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b64aa758-5dc1-4dcd-b529-e07c8722cefb-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-jn5cb\" (UID: \"b64aa758-5dc1-4dcd-b529-e07c8722cefb\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jn5cb" Jul 10 18:01:23.102241 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:23.102220 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fwjw\" (UniqueName: \"kubernetes.io/projected/b64aa758-5dc1-4dcd-b529-e07c8722cefb-kube-api-access-5fwjw\") pod \"monitoring-plugin-5f68df7f58-jn5cb\" (UID: \"b64aa758-5dc1-4dcd-b529-e07c8722cefb\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jn5cb" Jul 10 18:01:23.203103 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:23.203025 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jn5cb" Jul 10 18:01:23.332959 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:23.332923 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6646cfb9d6-t5tvx"] Jul 10 18:01:23.338185 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:23.338159 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:01:23.573525 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:23.573496 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-jn5cb"] Jul 10 18:01:23.593219 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:01:23.593193 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb64aa758_5dc1_4dcd_b529_e07c8722cefb.slice/crio-af70a278c374cfa12a3a91a19c2f7f2bf6227eb5be96214f090856ca6ddbc9bb WatchSource:0}: Error finding container af70a278c374cfa12a3a91a19c2f7f2bf6227eb5be96214f090856ca6ddbc9bb: Status 404 returned error can't find the container with id af70a278c374cfa12a3a91a19c2f7f2bf6227eb5be96214f090856ca6ddbc9bb Jul 10 18:01:24.144183 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:24.144146 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" event={"ID":"27bcd56e-373f-448d-8a3c-9ee5823b9ac4","Type":"ContainerStarted","Data":"b74aa08f798268c1578af1622ae31a947684731e907aaf3a720d3086dbd83e30"} Jul 10 18:01:24.144369 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:24.144211 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" event={"ID":"27bcd56e-373f-448d-8a3c-9ee5823b9ac4","Type":"ContainerStarted","Data":"7e3eb188ee55a287ff9e076305f8c090e063d65d91805382c07594e3e8f7840d"} Jul 10 18:01:24.144369 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:24.144253 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" event={"ID":"27bcd56e-373f-448d-8a3c-9ee5823b9ac4","Type":"ContainerStarted","Data":"0d2a1b8fafdf6d65091a8eda079040c3072e0017f05a93ed3e2b2184bbddb17d"} Jul 10 18:01:24.145586 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:24.145557 2579 generic.go:356] "Generic (PLEG): container finished" podID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerID="c42085c6b87663f9b7a16d7008a40ac815440c2f129421c7fdf4c6e2d81d770f" exitCode=0 Jul 10 18:01:24.145689 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:24.145642 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c624d3c0-490e-4260-8d3e-6bba2d73e66f","Type":"ContainerDied","Data":"c42085c6b87663f9b7a16d7008a40ac815440c2f129421c7fdf4c6e2d81d770f"} Jul 10 18:01:24.147724 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:24.147698 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nkmh9" event={"ID":"e64bd07b-0c58-4b2d-a32d-49493f8a2737","Type":"ContainerStarted","Data":"fc45cbb485876dee16c121825f60301ff301cfdc6f0e350af92bc9bfc15fbdb5"} Jul 10 18:01:24.148772 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:24.148753 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jn5cb" event={"ID":"b64aa758-5dc1-4dcd-b529-e07c8722cefb","Type":"ContainerStarted","Data":"af70a278c374cfa12a3a91a19c2f7f2bf6227eb5be96214f090856ca6ddbc9bb"} Jul 10 18:01:24.198549 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:24.198504 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nkmh9" podStartSLOduration=34.167530074 podStartE2EDuration="42.198492201s" totalImagesPullingTime="8.030962127s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:00:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:24.198043841 +0000 UTC m=+116.038872095" watchObservedRunningTime="2026-07-10 18:01:24.198492201 +0000 UTC m=+116.039320454" Jul 10 18:01:25.162076 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:25.162026 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" event={"ID":"27bcd56e-373f-448d-8a3c-9ee5823b9ac4","Type":"ContainerStarted","Data":"7c180b6df5979e3d48f817e3cfa703f7bc63f4129cbd1a93cc0f681771eff9f6"} Jul 10 18:01:25.162525 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:25.162144 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" event={"ID":"27bcd56e-373f-448d-8a3c-9ee5823b9ac4","Type":"ContainerStarted","Data":"4081909699fa49f888c8fe7b7071630db8b65e292d4ba3b7a64efd3dcd36ebbe"} Jul 10 18:01:25.162525 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:25.162186 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" event={"ID":"27bcd56e-373f-448d-8a3c-9ee5823b9ac4","Type":"ContainerStarted","Data":"65925902d253335791dd5bf4bc5f458279f7502fdb054c64307c82446228fe18"} Jul 10 18:01:25.186113 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:25.185989 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" podStartSLOduration=1.349531394 podStartE2EDuration="5.185968548s" totalImagesPullingTime="3.836437154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:01:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:25.183280968 +0000 UTC m=+117.024109223" watchObservedRunningTime="2026-07-10 18:01:25.185968548 +0000 UTC m=+117.026796805" Jul 10 18:01:26.168191 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:26.168158 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jn5cb" event={"ID":"b64aa758-5dc1-4dcd-b529-e07c8722cefb","Type":"ContainerStarted","Data":"738b8b31c64f5a0b9c0cf18e5da6b1a55586dff96bc253d130720a4802a36936"} Jul 10 18:01:26.168561 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:26.168513 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jn5cb" Jul 10 18:01:26.172998 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:26.172969 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c624d3c0-490e-4260-8d3e-6bba2d73e66f","Type":"ContainerStarted","Data":"06cb1fc4b500012a5677afdf8d452ad8a9bf7dd765a948e0356229fb12a2ebb0"} Jul 10 18:01:26.173115 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:26.173034 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c624d3c0-490e-4260-8d3e-6bba2d73e66f","Type":"ContainerStarted","Data":"27ebdb02813057cd3c1ea3324963d68d5f628a17917f8d69b183dc5977436d05"} Jul 10 18:01:26.173115 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:26.173079 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c624d3c0-490e-4260-8d3e-6bba2d73e66f","Type":"ContainerStarted","Data":"2ef338aff9cac90d4c363a74462974e85f02376a13a64c5d16eef1f834f2b278"} Jul 10 18:01:26.173228 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:26.173115 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c624d3c0-490e-4260-8d3e-6bba2d73e66f","Type":"ContainerStarted","Data":"457445fde625ef8875d2806b8b2e8165a9ae3eb3c1338cc7f051ae920066a99c"} Jul 10 18:01:26.173228 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:26.173159 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:26.174507 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:26.174474 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jn5cb" Jul 10 18:01:26.184626 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:26.184588 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jn5cb" podStartSLOduration=2.447457023 podStartE2EDuration="4.1845734s" totalImagesPullingTime="1.737116377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:26.183926302 +0000 UTC m=+118.024754556" watchObservedRunningTime="2026-07-10 18:01:26.1845734 +0000 UTC m=+118.025401654" Jul 10 18:01:27.183345 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:27.183311 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c624d3c0-490e-4260-8d3e-6bba2d73e66f","Type":"ContainerStarted","Data":"05fa5906ae8ea09bc6298a7fc501f29c1722c328ef4dda0009d5c8bc0e7305f4"} Jul 10 18:01:27.183826 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:27.183394 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c624d3c0-490e-4260-8d3e-6bba2d73e66f","Type":"ContainerStarted","Data":"6d558685a196b941314d7e0aae04645de6ec32b890b0bdb527ae88a4410b60f9"} Jul 10 18:01:27.207376 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:27.207321 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.413488424 podStartE2EDuration="8.207304176s" totalImagesPullingTime="4.764831459s" totalInitContainerRuntime="28.984293ms" isStatefulPod=false podCreationTimestamp="2026-07-10 18:01:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:27.205778215 +0000 UTC m=+119.046606482" watchObservedRunningTime="2026-07-10 18:01:27.207304176 +0000 UTC m=+119.048132430" Jul 10 18:01:32.190370 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:32.190343 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-998794db6-9m2vr" Jul 10 18:01:32.236446 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:32.236419 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-hp7w8"] Jul 10 18:01:32.239590 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:32.239569 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-hp7w8" Jul 10 18:01:32.241826 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:32.241803 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 10 18:01:32.241929 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:32.241869 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-rfl28\"" Jul 10 18:01:32.242022 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:32.242006 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 10 18:01:32.249795 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:32.249775 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-hp7w8"] Jul 10 18:01:32.372018 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:32.371982 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csknq\" (UniqueName: \"kubernetes.io/projected/674bbc89-fae3-4931-b134-ca7eaeacba24-kube-api-access-csknq\") pod \"downloads-68c9cbb497-hp7w8\" (UID: \"674bbc89-fae3-4931-b134-ca7eaeacba24\") " pod="openshift-console/downloads-68c9cbb497-hp7w8" Jul 10 18:01:32.472712 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:32.472633 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csknq\" (UniqueName: \"kubernetes.io/projected/674bbc89-fae3-4931-b134-ca7eaeacba24-kube-api-access-csknq\") pod \"downloads-68c9cbb497-hp7w8\" (UID: \"674bbc89-fae3-4931-b134-ca7eaeacba24\") " pod="openshift-console/downloads-68c9cbb497-hp7w8" Jul 10 18:01:32.480480 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:32.480450 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csknq\" (UniqueName: \"kubernetes.io/projected/674bbc89-fae3-4931-b134-ca7eaeacba24-kube-api-access-csknq\") pod \"downloads-68c9cbb497-hp7w8\" (UID: \"674bbc89-fae3-4931-b134-ca7eaeacba24\") " pod="openshift-console/downloads-68c9cbb497-hp7w8" Jul 10 18:01:32.550116 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:32.550085 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-hp7w8" Jul 10 18:01:32.674424 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:32.674399 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-hp7w8"] Jul 10 18:01:32.675752 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:01:32.675729 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod674bbc89_fae3_4931_b134_ca7eaeacba24.slice/crio-fb1ba9f9c01eb1a13f3527f53caea185d709675a94fe6d83a44559ed7df4ec69 WatchSource:0}: Error finding container fb1ba9f9c01eb1a13f3527f53caea185d709675a94fe6d83a44559ed7df4ec69: Status 404 returned error can't find the container with id fb1ba9f9c01eb1a13f3527f53caea185d709675a94fe6d83a44559ed7df4ec69 Jul 10 18:01:33.205657 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:33.205617 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-hp7w8" event={"ID":"674bbc89-fae3-4931-b134-ca7eaeacba24","Type":"ContainerStarted","Data":"fb1ba9f9c01eb1a13f3527f53caea185d709675a94fe6d83a44559ed7df4ec69"} Jul 10 18:01:38.427636 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:38.427600 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs\") pod \"network-metrics-daemon-tcbv4\" (UID: \"ed23dc61-5837-41ea-95e3-dda5b5a90212\") " pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 18:01:38.430061 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:38.430036 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed23dc61-5837-41ea-95e3-dda5b5a90212-metrics-certs\") pod \"network-metrics-daemon-tcbv4\" (UID: \"ed23dc61-5837-41ea-95e3-dda5b5a90212\") " pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 18:01:38.482761 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:38.482732 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s4tg5\"" Jul 10 18:01:38.490895 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:38.490868 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcbv4" Jul 10 18:01:38.630247 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:38.630223 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tcbv4"] Jul 10 18:01:38.632907 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:01:38.632844 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded23dc61_5837_41ea_95e3_dda5b5a90212.slice/crio-e06a8a4cca327dfe0b626276ac017020d6e52bab7a6088f31ca653617d2960b3 WatchSource:0}: Error finding container e06a8a4cca327dfe0b626276ac017020d6e52bab7a6088f31ca653617d2960b3: Status 404 returned error can't find the container with id e06a8a4cca327dfe0b626276ac017020d6e52bab7a6088f31ca653617d2960b3 Jul 10 18:01:39.232027 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:39.231981 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tcbv4" event={"ID":"ed23dc61-5837-41ea-95e3-dda5b5a90212","Type":"ContainerStarted","Data":"e06a8a4cca327dfe0b626276ac017020d6e52bab7a6088f31ca653617d2960b3"} Jul 10 18:01:40.238640 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:40.238554 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tcbv4" event={"ID":"ed23dc61-5837-41ea-95e3-dda5b5a90212","Type":"ContainerStarted","Data":"e17a5bfacf10152c2e6bb9ff661b0268f253a2a6fb09b0c18fd6079ebb3a934b"} Jul 10 18:01:40.238640 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:40.238624 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tcbv4" event={"ID":"ed23dc61-5837-41ea-95e3-dda5b5a90212","Type":"ContainerStarted","Data":"100962c3234e112b660be1da36e5fc6a18445cb099c6afc6089e37a3b25e5812"} Jul 10 18:01:40.255740 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:40.255680 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tcbv4" podStartSLOduration=130.980523133 podStartE2EDuration="2m12.255660197s" totalImagesPullingTime="1.275137064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:40.254910871 +0000 UTC m=+132.095739126" watchObservedRunningTime="2026-07-10 18:01:40.255660197 +0000 UTC m=+132.096488452" Jul 10 18:01:42.764909 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.764876 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-686f7c5fd8-qfdk4"] Jul 10 18:01:42.767497 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.767474 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:01:42.769917 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.769890 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 10 18:01:42.771193 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.771033 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wd9cm\"" Jul 10 18:01:42.771193 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.771066 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 10 18:01:42.771193 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.771082 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 10 18:01:42.771193 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.771114 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 10 18:01:42.771427 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.771292 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 10 18:01:42.777791 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.777771 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-686f7c5fd8-qfdk4"] Jul 10 18:01:42.867357 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.867320 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/092f4bc6-2be0-4193-90ed-d378788410d0-service-ca\") pod \"console-686f7c5fd8-qfdk4\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:01:42.867581 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.867391 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/092f4bc6-2be0-4193-90ed-d378788410d0-console-serving-cert\") pod \"console-686f7c5fd8-qfdk4\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:01:42.867581 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.867476 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/092f4bc6-2be0-4193-90ed-d378788410d0-oauth-serving-cert\") pod \"console-686f7c5fd8-qfdk4\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:01:42.867581 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.867529 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvd6w\" (UniqueName: \"kubernetes.io/projected/092f4bc6-2be0-4193-90ed-d378788410d0-kube-api-access-vvd6w\") pod \"console-686f7c5fd8-qfdk4\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:01:42.867581 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.867553 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/092f4bc6-2be0-4193-90ed-d378788410d0-console-config\") pod \"console-686f7c5fd8-qfdk4\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:01:42.867792 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.867620 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/092f4bc6-2be0-4193-90ed-d378788410d0-console-oauth-config\") pod \"console-686f7c5fd8-qfdk4\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:01:42.968219 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.968184 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/092f4bc6-2be0-4193-90ed-d378788410d0-console-serving-cert\") pod \"console-686f7c5fd8-qfdk4\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:01:42.968508 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.968233 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/092f4bc6-2be0-4193-90ed-d378788410d0-oauth-serving-cert\") pod \"console-686f7c5fd8-qfdk4\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:01:42.968508 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.968276 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvd6w\" (UniqueName: \"kubernetes.io/projected/092f4bc6-2be0-4193-90ed-d378788410d0-kube-api-access-vvd6w\") pod \"console-686f7c5fd8-qfdk4\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:01:42.968508 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.968304 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/092f4bc6-2be0-4193-90ed-d378788410d0-console-config\") pod \"console-686f7c5fd8-qfdk4\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:01:42.968508 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.968346 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/092f4bc6-2be0-4193-90ed-d378788410d0-console-oauth-config\") pod \"console-686f7c5fd8-qfdk4\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:01:42.968508 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.968436 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/092f4bc6-2be0-4193-90ed-d378788410d0-service-ca\") pod \"console-686f7c5fd8-qfdk4\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:01:42.974340 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.969403 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/092f4bc6-2be0-4193-90ed-d378788410d0-console-config\") pod \"console-686f7c5fd8-qfdk4\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:01:42.974340 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.969661 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/092f4bc6-2be0-4193-90ed-d378788410d0-oauth-serving-cert\") pod \"console-686f7c5fd8-qfdk4\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:01:42.974340 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.969697 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/092f4bc6-2be0-4193-90ed-d378788410d0-service-ca\") pod \"console-686f7c5fd8-qfdk4\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:01:42.974340 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.971701 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/092f4bc6-2be0-4193-90ed-d378788410d0-console-oauth-config\") pod \"console-686f7c5fd8-qfdk4\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:01:42.975384 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.975355 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/092f4bc6-2be0-4193-90ed-d378788410d0-console-serving-cert\") pod \"console-686f7c5fd8-qfdk4\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:01:42.977481 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:42.977460 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvd6w\" (UniqueName: \"kubernetes.io/projected/092f4bc6-2be0-4193-90ed-d378788410d0-kube-api-access-vvd6w\") pod \"console-686f7c5fd8-qfdk4\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:01:43.077449 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:43.077408 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:01:48.360198 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:48.360158 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" podUID="8e1007ee-7580-42c4-9926-3fb8bca36ed1" containerName="registry" containerID="cri-o://02785f53433762af98c1b43023550fc93a99b9936cf9fc844d511622a2238c1c" gracePeriod=30 Jul 10 18:01:49.825425 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:49.825267 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-686f7c5fd8-qfdk4"] Jul 10 18:01:49.836108 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:01:49.836081 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod092f4bc6_2be0_4193_90ed_d378788410d0.slice/crio-a3e03c22b648b434ae51e88578815d8e99dc481f18b7114d55c75bf52844e3a6 WatchSource:0}: Error finding container a3e03c22b648b434ae51e88578815d8e99dc481f18b7114d55c75bf52844e3a6: Status 404 returned error can't find the container with id a3e03c22b648b434ae51e88578815d8e99dc481f18b7114d55c75bf52844e3a6 Jul 10 18:01:49.845519 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:49.845496 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:01:50.032864 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.032818 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8e1007ee-7580-42c4-9926-3fb8bca36ed1-ca-trust-extracted\") pod \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " Jul 10 18:01:50.033037 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.032912 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxh52\" (UniqueName: \"kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-kube-api-access-sxh52\") pod \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " Jul 10 18:01:50.033037 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.032942 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8e1007ee-7580-42c4-9926-3fb8bca36ed1-installation-pull-secrets\") pod \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " Jul 10 18:01:50.033037 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.032973 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e1007ee-7580-42c4-9926-3fb8bca36ed1-trusted-ca\") pod \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " Jul 10 18:01:50.033037 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.033001 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8e1007ee-7580-42c4-9926-3fb8bca36ed1-image-registry-private-configuration\") pod \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " Jul 10 18:01:50.033589 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.033236 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-bound-sa-token\") pod \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " Jul 10 18:01:50.033589 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.033295 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-certificates\") pod \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " Jul 10 18:01:50.033589 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.033337 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls\") pod \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\" (UID: \"8e1007ee-7580-42c4-9926-3fb8bca36ed1\") " Jul 10 18:01:50.033589 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.033542 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e1007ee-7580-42c4-9926-3fb8bca36ed1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8e1007ee-7580-42c4-9926-3fb8bca36ed1" (UID: "8e1007ee-7580-42c4-9926-3fb8bca36ed1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:01:50.033822 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.033711 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8e1007ee-7580-42c4-9926-3fb8bca36ed1" (UID: "8e1007ee-7580-42c4-9926-3fb8bca36ed1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:01:50.036025 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.035988 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-kube-api-access-sxh52" (OuterVolumeSpecName: "kube-api-access-sxh52") pod "8e1007ee-7580-42c4-9926-3fb8bca36ed1" (UID: "8e1007ee-7580-42c4-9926-3fb8bca36ed1"). InnerVolumeSpecName "kube-api-access-sxh52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:01:50.036180 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.036151 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e1007ee-7580-42c4-9926-3fb8bca36ed1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8e1007ee-7580-42c4-9926-3fb8bca36ed1" (UID: "8e1007ee-7580-42c4-9926-3fb8bca36ed1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:01:50.036284 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.036261 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8e1007ee-7580-42c4-9926-3fb8bca36ed1" (UID: "8e1007ee-7580-42c4-9926-3fb8bca36ed1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:01:50.036349 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.036295 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8e1007ee-7580-42c4-9926-3fb8bca36ed1" (UID: "8e1007ee-7580-42c4-9926-3fb8bca36ed1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:01:50.036445 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.036423 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e1007ee-7580-42c4-9926-3fb8bca36ed1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8e1007ee-7580-42c4-9926-3fb8bca36ed1" (UID: "8e1007ee-7580-42c4-9926-3fb8bca36ed1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:01:50.043789 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.043761 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e1007ee-7580-42c4-9926-3fb8bca36ed1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8e1007ee-7580-42c4-9926-3fb8bca36ed1" (UID: "8e1007ee-7580-42c4-9926-3fb8bca36ed1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:01:50.134235 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.134149 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-bound-sa-token\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:01:50.134235 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.134191 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-certificates\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:01:50.134235 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.134207 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-registry-tls\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:01:50.134235 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.134220 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8e1007ee-7580-42c4-9926-3fb8bca36ed1-ca-trust-extracted\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:01:50.134235 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.134236 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxh52\" (UniqueName: \"kubernetes.io/projected/8e1007ee-7580-42c4-9926-3fb8bca36ed1-kube-api-access-sxh52\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:01:50.134566 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.134250 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8e1007ee-7580-42c4-9926-3fb8bca36ed1-installation-pull-secrets\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:01:50.134566 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.134265 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e1007ee-7580-42c4-9926-3fb8bca36ed1-trusted-ca\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:01:50.134566 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.134278 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8e1007ee-7580-42c4-9926-3fb8bca36ed1-image-registry-private-configuration\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:01:50.282460 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.282418 2579 generic.go:356] "Generic (PLEG): container finished" podID="f3fe76eb-7d5e-4f07-978c-60660a6a9a6c" containerID="c5d8b083f30052f761c803bbd1cc71459ba5439068711ef075f2202d5819c489" exitCode=0 Jul 10 18:01:50.282629 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.282498 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8glrd" event={"ID":"f3fe76eb-7d5e-4f07-978c-60660a6a9a6c","Type":"ContainerDied","Data":"c5d8b083f30052f761c803bbd1cc71459ba5439068711ef075f2202d5819c489"} Jul 10 18:01:50.283027 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.282974 2579 scope.go:117] "RemoveContainer" containerID="c5d8b083f30052f761c803bbd1cc71459ba5439068711ef075f2202d5819c489" Jul 10 18:01:50.284545 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.284440 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-hp7w8" event={"ID":"674bbc89-fae3-4931-b134-ca7eaeacba24","Type":"ContainerStarted","Data":"f82aecb91d5f58a80fb4231a7a7e93f3a694e8882c5b1f3d0533299fcedc4978"} Jul 10 18:01:50.284611 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.284586 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-hp7w8" Jul 10 18:01:50.286324 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.286297 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686f7c5fd8-qfdk4" event={"ID":"092f4bc6-2be0-4193-90ed-d378788410d0","Type":"ContainerStarted","Data":"a3e03c22b648b434ae51e88578815d8e99dc481f18b7114d55c75bf52844e3a6"} Jul 10 18:01:50.287922 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.287835 2579 generic.go:356] "Generic (PLEG): container finished" podID="8e1007ee-7580-42c4-9926-3fb8bca36ed1" containerID="02785f53433762af98c1b43023550fc93a99b9936cf9fc844d511622a2238c1c" exitCode=0 Jul 10 18:01:50.287922 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.287880 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" event={"ID":"8e1007ee-7580-42c4-9926-3fb8bca36ed1","Type":"ContainerDied","Data":"02785f53433762af98c1b43023550fc93a99b9936cf9fc844d511622a2238c1c"} Jul 10 18:01:50.287922 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.287896 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" Jul 10 18:01:50.288113 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.287932 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6646cfb9d6-t5tvx" event={"ID":"8e1007ee-7580-42c4-9926-3fb8bca36ed1","Type":"ContainerDied","Data":"c641b16bd3f70a9dcae71c7d45d4a6ae5c1cac5a3ef1702cac158ec1da9c3549"} Jul 10 18:01:50.288113 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.287961 2579 scope.go:117] "RemoveContainer" containerID="02785f53433762af98c1b43023550fc93a99b9936cf9fc844d511622a2238c1c" Jul 10 18:01:50.291952 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.291927 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-hp7w8" Jul 10 18:01:50.299186 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.299162 2579 scope.go:117] "RemoveContainer" containerID="02785f53433762af98c1b43023550fc93a99b9936cf9fc844d511622a2238c1c" Jul 10 18:01:50.299551 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:01:50.299520 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02785f53433762af98c1b43023550fc93a99b9936cf9fc844d511622a2238c1c\": container with ID starting with 02785f53433762af98c1b43023550fc93a99b9936cf9fc844d511622a2238c1c not found: ID does not exist" containerID="02785f53433762af98c1b43023550fc93a99b9936cf9fc844d511622a2238c1c" Jul 10 18:01:50.299640 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.299563 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02785f53433762af98c1b43023550fc93a99b9936cf9fc844d511622a2238c1c"} err="failed to get container status \"02785f53433762af98c1b43023550fc93a99b9936cf9fc844d511622a2238c1c\": rpc error: code = NotFound desc = could not find container \"02785f53433762af98c1b43023550fc93a99b9936cf9fc844d511622a2238c1c\": container with ID starting with 02785f53433762af98c1b43023550fc93a99b9936cf9fc844d511622a2238c1c not found: ID does not exist" Jul 10 18:01:50.318274 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.317451 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-hp7w8" podStartSLOduration=1.205947509 podStartE2EDuration="18.317427392s" totalImagesPullingTime="17.111479883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:01:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:50.315593687 +0000 UTC m=+142.156421941" watchObservedRunningTime="2026-07-10 18:01:50.317427392 +0000 UTC m=+142.158255647" Jul 10 18:01:50.335844 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.335813 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6646cfb9d6-t5tvx"] Jul 10 18:01:50.341582 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.341557 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6646cfb9d6-t5tvx"] Jul 10 18:01:50.677963 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:50.677782 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e1007ee-7580-42c4-9926-3fb8bca36ed1" path="/var/lib/kubelet/pods/8e1007ee-7580-42c4-9926-3fb8bca36ed1/volumes" Jul 10 18:01:51.294719 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:51.294678 2579 generic.go:356] "Generic (PLEG): container finished" podID="a0beb717-4a66-4c5e-bbd1-34fdc20582ef" containerID="da3b1432ad923c24eb79c013837638e03477b799b9e95b6afd526d76d2cd3665" exitCode=0 Jul 10 18:01:51.295219 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:51.294753 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rmd8j" event={"ID":"a0beb717-4a66-4c5e-bbd1-34fdc20582ef","Type":"ContainerDied","Data":"da3b1432ad923c24eb79c013837638e03477b799b9e95b6afd526d76d2cd3665"} Jul 10 18:01:51.295219 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:51.295174 2579 scope.go:117] "RemoveContainer" containerID="da3b1432ad923c24eb79c013837638e03477b799b9e95b6afd526d76d2cd3665" Jul 10 18:01:51.298449 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:51.298410 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8glrd" event={"ID":"f3fe76eb-7d5e-4f07-978c-60660a6a9a6c","Type":"ContainerStarted","Data":"33b0855898902d184f1375610c530722138d76051a57f207711dd46f702f9940"} Jul 10 18:01:51.944943 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:51.944902 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7ff797c4cd-4r6x5"] Jul 10 18:01:51.945338 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:51.945317 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e1007ee-7580-42c4-9926-3fb8bca36ed1" containerName="registry" Jul 10 18:01:51.945420 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:51.945340 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e1007ee-7580-42c4-9926-3fb8bca36ed1" containerName="registry" Jul 10 18:01:51.945495 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:51.945438 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e1007ee-7580-42c4-9926-3fb8bca36ed1" containerName="registry" Jul 10 18:01:51.985580 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:51.985541 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ff797c4cd-4r6x5"] Jul 10 18:01:51.985904 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:51.985668 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:51.994764 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:51.994558 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 10 18:01:52.156191 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.156028 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-service-ca\") pod \"console-7ff797c4cd-4r6x5\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:52.156191 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.156086 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-oauth-serving-cert\") pod \"console-7ff797c4cd-4r6x5\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:52.156191 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.156119 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-console-config\") pod \"console-7ff797c4cd-4r6x5\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:52.156191 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.156151 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-trusted-ca-bundle\") pod \"console-7ff797c4cd-4r6x5\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:52.156515 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.156256 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-console-oauth-config\") pod \"console-7ff797c4cd-4r6x5\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:52.156515 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.156306 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwmwc\" (UniqueName: \"kubernetes.io/projected/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-kube-api-access-lwmwc\") pod \"console-7ff797c4cd-4r6x5\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:52.156515 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.156361 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-console-serving-cert\") pod \"console-7ff797c4cd-4r6x5\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:52.257896 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.257775 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-console-serving-cert\") pod \"console-7ff797c4cd-4r6x5\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:52.257896 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.257874 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-service-ca\") pod \"console-7ff797c4cd-4r6x5\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:52.258136 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.257912 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-oauth-serving-cert\") pod \"console-7ff797c4cd-4r6x5\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:52.258136 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.257940 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-console-config\") pod \"console-7ff797c4cd-4r6x5\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:52.258136 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.257972 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-trusted-ca-bundle\") pod \"console-7ff797c4cd-4r6x5\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:52.258136 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.258029 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-console-oauth-config\") pod \"console-7ff797c4cd-4r6x5\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:52.258136 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.258073 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwmwc\" (UniqueName: \"kubernetes.io/projected/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-kube-api-access-lwmwc\") pod \"console-7ff797c4cd-4r6x5\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:52.259508 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.259176 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-console-config\") pod \"console-7ff797c4cd-4r6x5\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:52.260165 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.260131 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-oauth-serving-cert\") pod \"console-7ff797c4cd-4r6x5\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:52.260313 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.260277 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-service-ca\") pod \"console-7ff797c4cd-4r6x5\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:52.260382 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.260331 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-trusted-ca-bundle\") pod \"console-7ff797c4cd-4r6x5\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:52.261887 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.261862 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-console-serving-cert\") pod \"console-7ff797c4cd-4r6x5\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:52.263639 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.263615 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-console-oauth-config\") pod \"console-7ff797c4cd-4r6x5\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:52.266615 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.266572 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwmwc\" (UniqueName: \"kubernetes.io/projected/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-kube-api-access-lwmwc\") pod \"console-7ff797c4cd-4r6x5\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:52.299409 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.299369 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:01:52.308110 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.307994 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rmd8j" event={"ID":"a0beb717-4a66-4c5e-bbd1-34fdc20582ef","Type":"ContainerStarted","Data":"0024413ba1d017e0cc23027467eab2608ce6a9842203ede7c03762f38a0ca3c7"} Jul 10 18:01:52.499953 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:52.499839 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ff797c4cd-4r6x5"] Jul 10 18:01:52.504625 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:01:52.504599 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a5bc15c_e794_462f_bcb5_3a6e5360e9e0.slice/crio-0b887f8bafca6b6434b4095bcba1c1efbd33bd2b724008fbc624344ac5dc6389 WatchSource:0}: Error finding container 0b887f8bafca6b6434b4095bcba1c1efbd33bd2b724008fbc624344ac5dc6389: Status 404 returned error can't find the container with id 0b887f8bafca6b6434b4095bcba1c1efbd33bd2b724008fbc624344ac5dc6389 Jul 10 18:01:53.314449 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:53.314404 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ff797c4cd-4r6x5" event={"ID":"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0","Type":"ContainerStarted","Data":"0b887f8bafca6b6434b4095bcba1c1efbd33bd2b724008fbc624344ac5dc6389"} Jul 10 18:01:53.701774 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:53.701692 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qwjmc_65c5cd7a-6e0d-4b74-bc87-ec84d9362897/serve-healthcheck-canary/0.log" Jul 10 18:01:55.325517 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:55.325460 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686f7c5fd8-qfdk4" event={"ID":"092f4bc6-2be0-4193-90ed-d378788410d0","Type":"ContainerStarted","Data":"72f5a4eb20cb64608c2c6c4325f43b298d75c43c744baba6317873d757466626"} Jul 10 18:01:55.327300 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:55.327274 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ff797c4cd-4r6x5" event={"ID":"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0","Type":"ContainerStarted","Data":"d7656020a55c5545e921c2d442c19786321063c10b596c6ac6b32973b1cc6822"} Jul 10 18:01:55.358296 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:55.358239 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-686f7c5fd8-qfdk4" podStartSLOduration=8.747029064 podStartE2EDuration="13.358220429s" totalImagesPullingTime="4.611191365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:55.342020002 +0000 UTC m=+147.182848250" watchObservedRunningTime="2026-07-10 18:01:55.358220429 +0000 UTC m=+147.199048686" Jul 10 18:01:55.359665 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:01:55.359627 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7ff797c4cd-4r6x5" podStartSLOduration=2.416468604 podStartE2EDuration="4.359616972s" totalImagesPullingTime="1.943148368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:55.357834251 +0000 UTC m=+147.198662504" watchObservedRunningTime="2026-07-10 18:01:55.359616972 +0000 UTC m=+147.200445228" Jul 10 18:02:02.300230 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:02.300188 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:02:02.300703 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:02.300266 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:02:02.304823 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:02.304796 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:02:02.359256 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:02.359228 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:02:02.401715 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:02.401683 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-686f7c5fd8-qfdk4"] Jul 10 18:02:03.078544 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:03.078508 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:02:27.424111 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:27.424004 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-686f7c5fd8-qfdk4" podUID="092f4bc6-2be0-4193-90ed-d378788410d0" containerName="console" containerID="cri-o://72f5a4eb20cb64608c2c6c4325f43b298d75c43c744baba6317873d757466626" gracePeriod=15 Jul 10 18:02:27.709288 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:27.709256 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:02:27.865090 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:27.865062 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/092f4bc6-2be0-4193-90ed-d378788410d0-console-serving-cert\") pod \"092f4bc6-2be0-4193-90ed-d378788410d0\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " Jul 10 18:02:27.865281 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:27.865113 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/092f4bc6-2be0-4193-90ed-d378788410d0-console-oauth-config\") pod \"092f4bc6-2be0-4193-90ed-d378788410d0\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " Jul 10 18:02:27.865281 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:27.865133 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/092f4bc6-2be0-4193-90ed-d378788410d0-service-ca\") pod \"092f4bc6-2be0-4193-90ed-d378788410d0\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " Jul 10 18:02:27.865281 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:27.865160 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/092f4bc6-2be0-4193-90ed-d378788410d0-console-config\") pod \"092f4bc6-2be0-4193-90ed-d378788410d0\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " Jul 10 18:02:27.865281 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:27.865213 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvd6w\" (UniqueName: \"kubernetes.io/projected/092f4bc6-2be0-4193-90ed-d378788410d0-kube-api-access-vvd6w\") pod \"092f4bc6-2be0-4193-90ed-d378788410d0\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " Jul 10 18:02:27.865281 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:27.865252 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/092f4bc6-2be0-4193-90ed-d378788410d0-oauth-serving-cert\") pod \"092f4bc6-2be0-4193-90ed-d378788410d0\" (UID: \"092f4bc6-2be0-4193-90ed-d378788410d0\") " Jul 10 18:02:27.865614 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:27.865585 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092f4bc6-2be0-4193-90ed-d378788410d0-service-ca" (OuterVolumeSpecName: "service-ca") pod "092f4bc6-2be0-4193-90ed-d378788410d0" (UID: "092f4bc6-2be0-4193-90ed-d378788410d0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:02:27.865746 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:27.865665 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092f4bc6-2be0-4193-90ed-d378788410d0-console-config" (OuterVolumeSpecName: "console-config") pod "092f4bc6-2be0-4193-90ed-d378788410d0" (UID: "092f4bc6-2be0-4193-90ed-d378788410d0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:02:27.865746 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:27.865689 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092f4bc6-2be0-4193-90ed-d378788410d0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "092f4bc6-2be0-4193-90ed-d378788410d0" (UID: "092f4bc6-2be0-4193-90ed-d378788410d0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:02:27.867284 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:27.867254 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/092f4bc6-2be0-4193-90ed-d378788410d0-kube-api-access-vvd6w" (OuterVolumeSpecName: "kube-api-access-vvd6w") pod "092f4bc6-2be0-4193-90ed-d378788410d0" (UID: "092f4bc6-2be0-4193-90ed-d378788410d0"). InnerVolumeSpecName "kube-api-access-vvd6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:02:27.867369 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:27.867304 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/092f4bc6-2be0-4193-90ed-d378788410d0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "092f4bc6-2be0-4193-90ed-d378788410d0" (UID: "092f4bc6-2be0-4193-90ed-d378788410d0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:02:27.867369 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:27.867325 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/092f4bc6-2be0-4193-90ed-d378788410d0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "092f4bc6-2be0-4193-90ed-d378788410d0" (UID: "092f4bc6-2be0-4193-90ed-d378788410d0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:02:27.966164 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:27.966088 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/092f4bc6-2be0-4193-90ed-d378788410d0-oauth-serving-cert\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:02:27.966164 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:27.966117 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/092f4bc6-2be0-4193-90ed-d378788410d0-console-serving-cert\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:02:27.966164 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:27.966128 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/092f4bc6-2be0-4193-90ed-d378788410d0-console-oauth-config\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:02:27.966164 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:27.966137 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/092f4bc6-2be0-4193-90ed-d378788410d0-service-ca\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:02:27.966164 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:27.966146 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/092f4bc6-2be0-4193-90ed-d378788410d0-console-config\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:02:27.966164 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:27.966154 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvd6w\" (UniqueName: \"kubernetes.io/projected/092f4bc6-2be0-4193-90ed-d378788410d0-kube-api-access-vvd6w\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:02:28.463985 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:28.463946 2579 generic.go:356] "Generic (PLEG): container finished" podID="092f4bc6-2be0-4193-90ed-d378788410d0" containerID="72f5a4eb20cb64608c2c6c4325f43b298d75c43c744baba6317873d757466626" exitCode=0 Jul 10 18:02:28.463985 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:28.463990 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686f7c5fd8-qfdk4" Jul 10 18:02:28.464407 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:28.464032 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686f7c5fd8-qfdk4" event={"ID":"092f4bc6-2be0-4193-90ed-d378788410d0","Type":"ContainerDied","Data":"72f5a4eb20cb64608c2c6c4325f43b298d75c43c744baba6317873d757466626"} Jul 10 18:02:28.464407 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:28.464089 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686f7c5fd8-qfdk4" event={"ID":"092f4bc6-2be0-4193-90ed-d378788410d0","Type":"ContainerDied","Data":"a3e03c22b648b434ae51e88578815d8e99dc481f18b7114d55c75bf52844e3a6"} Jul 10 18:02:28.464407 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:28.464113 2579 scope.go:117] "RemoveContainer" containerID="72f5a4eb20cb64608c2c6c4325f43b298d75c43c744baba6317873d757466626" Jul 10 18:02:28.472843 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:28.472829 2579 scope.go:117] "RemoveContainer" containerID="72f5a4eb20cb64608c2c6c4325f43b298d75c43c744baba6317873d757466626" Jul 10 18:02:28.473103 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:02:28.473087 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72f5a4eb20cb64608c2c6c4325f43b298d75c43c744baba6317873d757466626\": container with ID starting with 72f5a4eb20cb64608c2c6c4325f43b298d75c43c744baba6317873d757466626 not found: ID does not exist" containerID="72f5a4eb20cb64608c2c6c4325f43b298d75c43c744baba6317873d757466626" Jul 10 18:02:28.473149 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:28.473112 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72f5a4eb20cb64608c2c6c4325f43b298d75c43c744baba6317873d757466626"} err="failed to get container status \"72f5a4eb20cb64608c2c6c4325f43b298d75c43c744baba6317873d757466626\": rpc error: code = NotFound desc = could not find container \"72f5a4eb20cb64608c2c6c4325f43b298d75c43c744baba6317873d757466626\": container with ID starting with 72f5a4eb20cb64608c2c6c4325f43b298d75c43c744baba6317873d757466626 not found: ID does not exist" Jul 10 18:02:28.484111 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:28.484091 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-686f7c5fd8-qfdk4"] Jul 10 18:02:28.487984 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:28.487965 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-686f7c5fd8-qfdk4"] Jul 10 18:02:28.673884 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:28.673838 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="092f4bc6-2be0-4193-90ed-d378788410d0" path="/var/lib/kubelet/pods/092f4bc6-2be0-4193-90ed-d378788410d0/volumes" Jul 10 18:02:38.436355 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:38.436320 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:02:38.436886 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:38.436624 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="alertmanager" containerID="cri-o://457445fde625ef8875d2806b8b2e8165a9ae3eb3c1338cc7f051ae920066a99c" gracePeriod=120 Jul 10 18:02:38.436886 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:38.436680 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="kube-rbac-proxy-metric" containerID="cri-o://6d558685a196b941314d7e0aae04645de6ec32b890b0bdb527ae88a4410b60f9" gracePeriod=120 Jul 10 18:02:38.436886 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:38.436730 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="prom-label-proxy" containerID="cri-o://05fa5906ae8ea09bc6298a7fc501f29c1722c328ef4dda0009d5c8bc0e7305f4" gracePeriod=120 Jul 10 18:02:38.436886 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:38.436769 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="config-reloader" containerID="cri-o://2ef338aff9cac90d4c363a74462974e85f02376a13a64c5d16eef1f834f2b278" gracePeriod=120 Jul 10 18:02:38.436886 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:38.436747 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="kube-rbac-proxy-web" containerID="cri-o://27ebdb02813057cd3c1ea3324963d68d5f628a17917f8d69b183dc5977436d05" gracePeriod=120 Jul 10 18:02:38.436886 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:38.436785 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="kube-rbac-proxy" containerID="cri-o://06cb1fc4b500012a5677afdf8d452ad8a9bf7dd765a948e0356229fb12a2ebb0" gracePeriod=120 Jul 10 18:02:39.506225 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.506191 2579 generic.go:356] "Generic (PLEG): container finished" podID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerID="05fa5906ae8ea09bc6298a7fc501f29c1722c328ef4dda0009d5c8bc0e7305f4" exitCode=0 Jul 10 18:02:39.506225 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.506218 2579 generic.go:356] "Generic (PLEG): container finished" podID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerID="06cb1fc4b500012a5677afdf8d452ad8a9bf7dd765a948e0356229fb12a2ebb0" exitCode=0 Jul 10 18:02:39.506225 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.506226 2579 generic.go:356] "Generic (PLEG): container finished" podID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerID="2ef338aff9cac90d4c363a74462974e85f02376a13a64c5d16eef1f834f2b278" exitCode=0 Jul 10 18:02:39.506225 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.506233 2579 generic.go:356] "Generic (PLEG): container finished" podID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerID="457445fde625ef8875d2806b8b2e8165a9ae3eb3c1338cc7f051ae920066a99c" exitCode=0 Jul 10 18:02:39.506813 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.506262 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c624d3c0-490e-4260-8d3e-6bba2d73e66f","Type":"ContainerDied","Data":"05fa5906ae8ea09bc6298a7fc501f29c1722c328ef4dda0009d5c8bc0e7305f4"} Jul 10 18:02:39.506813 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.506346 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c624d3c0-490e-4260-8d3e-6bba2d73e66f","Type":"ContainerDied","Data":"06cb1fc4b500012a5677afdf8d452ad8a9bf7dd765a948e0356229fb12a2ebb0"} Jul 10 18:02:39.506813 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.506395 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c624d3c0-490e-4260-8d3e-6bba2d73e66f","Type":"ContainerDied","Data":"2ef338aff9cac90d4c363a74462974e85f02376a13a64c5d16eef1f834f2b278"} Jul 10 18:02:39.506813 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.506432 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c624d3c0-490e-4260-8d3e-6bba2d73e66f","Type":"ContainerDied","Data":"457445fde625ef8875d2806b8b2e8165a9ae3eb3c1338cc7f051ae920066a99c"} Jul 10 18:02:39.678581 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.678555 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:39.870806 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.870767 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " Jul 10 18:02:39.870806 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.870807 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-config-volume\") pod \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " Jul 10 18:02:39.871029 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.870845 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c624d3c0-490e-4260-8d3e-6bba2d73e66f-config-out\") pod \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " Jul 10 18:02:39.871029 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.870886 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-web-config\") pod \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " Jul 10 18:02:39.871029 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.870932 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c624d3c0-490e-4260-8d3e-6bba2d73e66f-alertmanager-trusted-ca-bundle\") pod \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " Jul 10 18:02:39.871029 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.870966 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-cluster-tls-config\") pod \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " Jul 10 18:02:39.871029 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.871003 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-kube-rbac-proxy-web\") pod \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " Jul 10 18:02:39.871298 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.871034 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c624d3c0-490e-4260-8d3e-6bba2d73e66f-metrics-client-ca\") pod \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " Jul 10 18:02:39.871298 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.871064 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-main-tls\") pod \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " Jul 10 18:02:39.871298 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.871095 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znrnd\" (UniqueName: \"kubernetes.io/projected/c624d3c0-490e-4260-8d3e-6bba2d73e66f-kube-api-access-znrnd\") pod \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " Jul 10 18:02:39.871298 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.871132 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-kube-rbac-proxy\") pod \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " Jul 10 18:02:39.871298 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.871160 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c624d3c0-490e-4260-8d3e-6bba2d73e66f-tls-assets\") pod \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " Jul 10 18:02:39.871298 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.871201 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c624d3c0-490e-4260-8d3e-6bba2d73e66f-alertmanager-main-db\") pod \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\" (UID: \"c624d3c0-490e-4260-8d3e-6bba2d73e66f\") " Jul 10 18:02:39.871615 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.871356 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c624d3c0-490e-4260-8d3e-6bba2d73e66f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c624d3c0-490e-4260-8d3e-6bba2d73e66f" (UID: "c624d3c0-490e-4260-8d3e-6bba2d73e66f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:02:39.871615 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.871484 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c624d3c0-490e-4260-8d3e-6bba2d73e66f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:02:39.871721 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.871636 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c624d3c0-490e-4260-8d3e-6bba2d73e66f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c624d3c0-490e-4260-8d3e-6bba2d73e66f" (UID: "c624d3c0-490e-4260-8d3e-6bba2d73e66f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:02:39.872282 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.872243 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c624d3c0-490e-4260-8d3e-6bba2d73e66f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c624d3c0-490e-4260-8d3e-6bba2d73e66f" (UID: "c624d3c0-490e-4260-8d3e-6bba2d73e66f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:02:39.874434 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.874408 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c624d3c0-490e-4260-8d3e-6bba2d73e66f-config-out" (OuterVolumeSpecName: "config-out") pod "c624d3c0-490e-4260-8d3e-6bba2d73e66f" (UID: "c624d3c0-490e-4260-8d3e-6bba2d73e66f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:02:39.874623 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.874415 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-config-volume" (OuterVolumeSpecName: "config-volume") pod "c624d3c0-490e-4260-8d3e-6bba2d73e66f" (UID: "c624d3c0-490e-4260-8d3e-6bba2d73e66f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:02:39.874754 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.874463 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c624d3c0-490e-4260-8d3e-6bba2d73e66f" (UID: "c624d3c0-490e-4260-8d3e-6bba2d73e66f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:02:39.874754 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.874657 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c624d3c0-490e-4260-8d3e-6bba2d73e66f" (UID: "c624d3c0-490e-4260-8d3e-6bba2d73e66f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:02:39.874950 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.874924 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c624d3c0-490e-4260-8d3e-6bba2d73e66f" (UID: "c624d3c0-490e-4260-8d3e-6bba2d73e66f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:02:39.875011 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.874949 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c624d3c0-490e-4260-8d3e-6bba2d73e66f" (UID: "c624d3c0-490e-4260-8d3e-6bba2d73e66f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:02:39.875486 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.875462 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c624d3c0-490e-4260-8d3e-6bba2d73e66f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c624d3c0-490e-4260-8d3e-6bba2d73e66f" (UID: "c624d3c0-490e-4260-8d3e-6bba2d73e66f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:02:39.875700 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.875681 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c624d3c0-490e-4260-8d3e-6bba2d73e66f-kube-api-access-znrnd" (OuterVolumeSpecName: "kube-api-access-znrnd") pod "c624d3c0-490e-4260-8d3e-6bba2d73e66f" (UID: "c624d3c0-490e-4260-8d3e-6bba2d73e66f"). InnerVolumeSpecName "kube-api-access-znrnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:02:39.878581 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.878556 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c624d3c0-490e-4260-8d3e-6bba2d73e66f" (UID: "c624d3c0-490e-4260-8d3e-6bba2d73e66f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:02:39.885045 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.885026 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-web-config" (OuterVolumeSpecName: "web-config") pod "c624d3c0-490e-4260-8d3e-6bba2d73e66f" (UID: "c624d3c0-490e-4260-8d3e-6bba2d73e66f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:02:39.972086 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.972058 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c624d3c0-490e-4260-8d3e-6bba2d73e66f-config-out\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:02:39.972086 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.972084 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-web-config\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:02:39.972086 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.972093 2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-cluster-tls-config\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:02:39.972287 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.972102 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:02:39.972287 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.972113 2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c624d3c0-490e-4260-8d3e-6bba2d73e66f-metrics-client-ca\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:02:39.972287 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.972121 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-main-tls\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:02:39.972287 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.972131 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znrnd\" (UniqueName: \"kubernetes.io/projected/c624d3c0-490e-4260-8d3e-6bba2d73e66f-kube-api-access-znrnd\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:02:39.972287 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.972139 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:02:39.972287 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.972147 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c624d3c0-490e-4260-8d3e-6bba2d73e66f-tls-assets\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:02:39.972287 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.972155 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c624d3c0-490e-4260-8d3e-6bba2d73e66f-alertmanager-main-db\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:02:39.972287 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.972164 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:02:39.972287 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:39.972175 2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c624d3c0-490e-4260-8d3e-6bba2d73e66f-config-volume\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:02:40.513177 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.513133 2579 generic.go:356] "Generic (PLEG): container finished" podID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerID="6d558685a196b941314d7e0aae04645de6ec32b890b0bdb527ae88a4410b60f9" exitCode=0 Jul 10 18:02:40.513177 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.513159 2579 generic.go:356] "Generic (PLEG): container finished" podID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerID="27ebdb02813057cd3c1ea3324963d68d5f628a17917f8d69b183dc5977436d05" exitCode=0 Jul 10 18:02:40.513615 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.513194 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c624d3c0-490e-4260-8d3e-6bba2d73e66f","Type":"ContainerDied","Data":"6d558685a196b941314d7e0aae04645de6ec32b890b0bdb527ae88a4410b60f9"} Jul 10 18:02:40.513615 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.513259 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c624d3c0-490e-4260-8d3e-6bba2d73e66f","Type":"ContainerDied","Data":"27ebdb02813057cd3c1ea3324963d68d5f628a17917f8d69b183dc5977436d05"} Jul 10 18:02:40.513615 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.513208 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.513615 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.513284 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c624d3c0-490e-4260-8d3e-6bba2d73e66f","Type":"ContainerDied","Data":"17d58656175e09a8cab888949d692b9519d7ec81497447b3fd0cf519c4b4b014"} Jul 10 18:02:40.513615 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.513316 2579 scope.go:117] "RemoveContainer" containerID="05fa5906ae8ea09bc6298a7fc501f29c1722c328ef4dda0009d5c8bc0e7305f4" Jul 10 18:02:40.521102 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.521086 2579 scope.go:117] "RemoveContainer" containerID="6d558685a196b941314d7e0aae04645de6ec32b890b0bdb527ae88a4410b60f9" Jul 10 18:02:40.531088 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.531071 2579 scope.go:117] "RemoveContainer" containerID="06cb1fc4b500012a5677afdf8d452ad8a9bf7dd765a948e0356229fb12a2ebb0" Jul 10 18:02:40.541500 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.541466 2579 scope.go:117] "RemoveContainer" containerID="27ebdb02813057cd3c1ea3324963d68d5f628a17917f8d69b183dc5977436d05" Jul 10 18:02:40.544540 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.544510 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:02:40.549940 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.549922 2579 scope.go:117] "RemoveContainer" containerID="2ef338aff9cac90d4c363a74462974e85f02376a13a64c5d16eef1f834f2b278" Jul 10 18:02:40.550264 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.550249 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:02:40.557067 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.556894 2579 scope.go:117] "RemoveContainer" containerID="457445fde625ef8875d2806b8b2e8165a9ae3eb3c1338cc7f051ae920066a99c" Jul 10 18:02:40.563561 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.563547 2579 scope.go:117] "RemoveContainer" containerID="c42085c6b87663f9b7a16d7008a40ac815440c2f129421c7fdf4c6e2d81d770f" Jul 10 18:02:40.570401 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.570385 2579 scope.go:117] "RemoveContainer" containerID="05fa5906ae8ea09bc6298a7fc501f29c1722c328ef4dda0009d5c8bc0e7305f4" Jul 10 18:02:40.570631 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:02:40.570614 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05fa5906ae8ea09bc6298a7fc501f29c1722c328ef4dda0009d5c8bc0e7305f4\": container with ID starting with 05fa5906ae8ea09bc6298a7fc501f29c1722c328ef4dda0009d5c8bc0e7305f4 not found: ID does not exist" containerID="05fa5906ae8ea09bc6298a7fc501f29c1722c328ef4dda0009d5c8bc0e7305f4" Jul 10 18:02:40.570678 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.570642 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05fa5906ae8ea09bc6298a7fc501f29c1722c328ef4dda0009d5c8bc0e7305f4"} err="failed to get container status \"05fa5906ae8ea09bc6298a7fc501f29c1722c328ef4dda0009d5c8bc0e7305f4\": rpc error: code = NotFound desc = could not find container \"05fa5906ae8ea09bc6298a7fc501f29c1722c328ef4dda0009d5c8bc0e7305f4\": container with ID starting with 05fa5906ae8ea09bc6298a7fc501f29c1722c328ef4dda0009d5c8bc0e7305f4 not found: ID does not exist" Jul 10 18:02:40.570678 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.570661 2579 scope.go:117] "RemoveContainer" containerID="6d558685a196b941314d7e0aae04645de6ec32b890b0bdb527ae88a4410b60f9" Jul 10 18:02:40.570889 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:02:40.570845 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d558685a196b941314d7e0aae04645de6ec32b890b0bdb527ae88a4410b60f9\": container with ID starting with 6d558685a196b941314d7e0aae04645de6ec32b890b0bdb527ae88a4410b60f9 not found: ID does not exist" containerID="6d558685a196b941314d7e0aae04645de6ec32b890b0bdb527ae88a4410b60f9" Jul 10 18:02:40.570971 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.570894 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d558685a196b941314d7e0aae04645de6ec32b890b0bdb527ae88a4410b60f9"} err="failed to get container status \"6d558685a196b941314d7e0aae04645de6ec32b890b0bdb527ae88a4410b60f9\": rpc error: code = NotFound desc = could not find container \"6d558685a196b941314d7e0aae04645de6ec32b890b0bdb527ae88a4410b60f9\": container with ID starting with 6d558685a196b941314d7e0aae04645de6ec32b890b0bdb527ae88a4410b60f9 not found: ID does not exist" Jul 10 18:02:40.570971 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.570910 2579 scope.go:117] "RemoveContainer" containerID="06cb1fc4b500012a5677afdf8d452ad8a9bf7dd765a948e0356229fb12a2ebb0" Jul 10 18:02:40.571124 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:02:40.571106 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06cb1fc4b500012a5677afdf8d452ad8a9bf7dd765a948e0356229fb12a2ebb0\": container with ID starting with 06cb1fc4b500012a5677afdf8d452ad8a9bf7dd765a948e0356229fb12a2ebb0 not found: ID does not exist" containerID="06cb1fc4b500012a5677afdf8d452ad8a9bf7dd765a948e0356229fb12a2ebb0" Jul 10 18:02:40.571167 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.571128 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06cb1fc4b500012a5677afdf8d452ad8a9bf7dd765a948e0356229fb12a2ebb0"} err="failed to get container status \"06cb1fc4b500012a5677afdf8d452ad8a9bf7dd765a948e0356229fb12a2ebb0\": rpc error: code = NotFound desc = could not find container \"06cb1fc4b500012a5677afdf8d452ad8a9bf7dd765a948e0356229fb12a2ebb0\": container with ID starting with 06cb1fc4b500012a5677afdf8d452ad8a9bf7dd765a948e0356229fb12a2ebb0 not found: ID does not exist" Jul 10 18:02:40.571167 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.571141 2579 scope.go:117] "RemoveContainer" containerID="27ebdb02813057cd3c1ea3324963d68d5f628a17917f8d69b183dc5977436d05" Jul 10 18:02:40.571373 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:02:40.571355 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27ebdb02813057cd3c1ea3324963d68d5f628a17917f8d69b183dc5977436d05\": container with ID starting with 27ebdb02813057cd3c1ea3324963d68d5f628a17917f8d69b183dc5977436d05 not found: ID does not exist" containerID="27ebdb02813057cd3c1ea3324963d68d5f628a17917f8d69b183dc5977436d05" Jul 10 18:02:40.571433 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.571380 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ebdb02813057cd3c1ea3324963d68d5f628a17917f8d69b183dc5977436d05"} err="failed to get container status \"27ebdb02813057cd3c1ea3324963d68d5f628a17917f8d69b183dc5977436d05\": rpc error: code = NotFound desc = could not find container \"27ebdb02813057cd3c1ea3324963d68d5f628a17917f8d69b183dc5977436d05\": container with ID starting with 27ebdb02813057cd3c1ea3324963d68d5f628a17917f8d69b183dc5977436d05 not found: ID does not exist" Jul 10 18:02:40.571433 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.571400 2579 scope.go:117] "RemoveContainer" containerID="2ef338aff9cac90d4c363a74462974e85f02376a13a64c5d16eef1f834f2b278" Jul 10 18:02:40.571669 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:02:40.571653 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ef338aff9cac90d4c363a74462974e85f02376a13a64c5d16eef1f834f2b278\": container with ID starting with 2ef338aff9cac90d4c363a74462974e85f02376a13a64c5d16eef1f834f2b278 not found: ID does not exist" containerID="2ef338aff9cac90d4c363a74462974e85f02376a13a64c5d16eef1f834f2b278" Jul 10 18:02:40.571709 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.571673 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ef338aff9cac90d4c363a74462974e85f02376a13a64c5d16eef1f834f2b278"} err="failed to get container status \"2ef338aff9cac90d4c363a74462974e85f02376a13a64c5d16eef1f834f2b278\": rpc error: code = NotFound desc = could not find container \"2ef338aff9cac90d4c363a74462974e85f02376a13a64c5d16eef1f834f2b278\": container with ID starting with 2ef338aff9cac90d4c363a74462974e85f02376a13a64c5d16eef1f834f2b278 not found: ID does not exist" Jul 10 18:02:40.571709 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.571699 2579 scope.go:117] "RemoveContainer" containerID="457445fde625ef8875d2806b8b2e8165a9ae3eb3c1338cc7f051ae920066a99c" Jul 10 18:02:40.571910 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:02:40.571887 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"457445fde625ef8875d2806b8b2e8165a9ae3eb3c1338cc7f051ae920066a99c\": container with ID starting with 457445fde625ef8875d2806b8b2e8165a9ae3eb3c1338cc7f051ae920066a99c not found: ID does not exist" containerID="457445fde625ef8875d2806b8b2e8165a9ae3eb3c1338cc7f051ae920066a99c" Jul 10 18:02:40.571977 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.571921 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"457445fde625ef8875d2806b8b2e8165a9ae3eb3c1338cc7f051ae920066a99c"} err="failed to get container status \"457445fde625ef8875d2806b8b2e8165a9ae3eb3c1338cc7f051ae920066a99c\": rpc error: code = NotFound desc = could not find container \"457445fde625ef8875d2806b8b2e8165a9ae3eb3c1338cc7f051ae920066a99c\": container with ID starting with 457445fde625ef8875d2806b8b2e8165a9ae3eb3c1338cc7f051ae920066a99c not found: ID does not exist" Jul 10 18:02:40.571977 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.571939 2579 scope.go:117] "RemoveContainer" containerID="c42085c6b87663f9b7a16d7008a40ac815440c2f129421c7fdf4c6e2d81d770f" Jul 10 18:02:40.572383 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:02:40.572346 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c42085c6b87663f9b7a16d7008a40ac815440c2f129421c7fdf4c6e2d81d770f\": container with ID starting with c42085c6b87663f9b7a16d7008a40ac815440c2f129421c7fdf4c6e2d81d770f not found: ID does not exist" containerID="c42085c6b87663f9b7a16d7008a40ac815440c2f129421c7fdf4c6e2d81d770f" Jul 10 18:02:40.572383 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.572376 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c42085c6b87663f9b7a16d7008a40ac815440c2f129421c7fdf4c6e2d81d770f"} err="failed to get container status \"c42085c6b87663f9b7a16d7008a40ac815440c2f129421c7fdf4c6e2d81d770f\": rpc error: code = NotFound desc = could not find container \"c42085c6b87663f9b7a16d7008a40ac815440c2f129421c7fdf4c6e2d81d770f\": container with ID starting with c42085c6b87663f9b7a16d7008a40ac815440c2f129421c7fdf4c6e2d81d770f not found: ID does not exist" Jul 10 18:02:40.572557 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.572390 2579 scope.go:117] "RemoveContainer" containerID="05fa5906ae8ea09bc6298a7fc501f29c1722c328ef4dda0009d5c8bc0e7305f4" Jul 10 18:02:40.572720 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.572680 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05fa5906ae8ea09bc6298a7fc501f29c1722c328ef4dda0009d5c8bc0e7305f4"} err="failed to get container status \"05fa5906ae8ea09bc6298a7fc501f29c1722c328ef4dda0009d5c8bc0e7305f4\": rpc error: code = NotFound desc = could not find container \"05fa5906ae8ea09bc6298a7fc501f29c1722c328ef4dda0009d5c8bc0e7305f4\": container with ID starting with 05fa5906ae8ea09bc6298a7fc501f29c1722c328ef4dda0009d5c8bc0e7305f4 not found: ID does not exist" Jul 10 18:02:40.572770 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.572722 2579 scope.go:117] "RemoveContainer" containerID="6d558685a196b941314d7e0aae04645de6ec32b890b0bdb527ae88a4410b60f9" Jul 10 18:02:40.573019 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.572998 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d558685a196b941314d7e0aae04645de6ec32b890b0bdb527ae88a4410b60f9"} err="failed to get container status \"6d558685a196b941314d7e0aae04645de6ec32b890b0bdb527ae88a4410b60f9\": rpc error: code = NotFound desc = could not find container \"6d558685a196b941314d7e0aae04645de6ec32b890b0bdb527ae88a4410b60f9\": container with ID starting with 6d558685a196b941314d7e0aae04645de6ec32b890b0bdb527ae88a4410b60f9 not found: ID does not exist" Jul 10 18:02:40.573074 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.573020 2579 scope.go:117] "RemoveContainer" containerID="06cb1fc4b500012a5677afdf8d452ad8a9bf7dd765a948e0356229fb12a2ebb0" Jul 10 18:02:40.573257 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.573229 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06cb1fc4b500012a5677afdf8d452ad8a9bf7dd765a948e0356229fb12a2ebb0"} err="failed to get container status \"06cb1fc4b500012a5677afdf8d452ad8a9bf7dd765a948e0356229fb12a2ebb0\": rpc error: code = NotFound desc = could not find container \"06cb1fc4b500012a5677afdf8d452ad8a9bf7dd765a948e0356229fb12a2ebb0\": container with ID starting with 06cb1fc4b500012a5677afdf8d452ad8a9bf7dd765a948e0356229fb12a2ebb0 not found: ID does not exist" Jul 10 18:02:40.573257 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.573250 2579 scope.go:117] "RemoveContainer" containerID="27ebdb02813057cd3c1ea3324963d68d5f628a17917f8d69b183dc5977436d05" Jul 10 18:02:40.573500 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.573479 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ebdb02813057cd3c1ea3324963d68d5f628a17917f8d69b183dc5977436d05"} err="failed to get container status \"27ebdb02813057cd3c1ea3324963d68d5f628a17917f8d69b183dc5977436d05\": rpc error: code = NotFound desc = could not find container \"27ebdb02813057cd3c1ea3324963d68d5f628a17917f8d69b183dc5977436d05\": container with ID starting with 27ebdb02813057cd3c1ea3324963d68d5f628a17917f8d69b183dc5977436d05 not found: ID does not exist" Jul 10 18:02:40.573548 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.573503 2579 scope.go:117] "RemoveContainer" containerID="2ef338aff9cac90d4c363a74462974e85f02376a13a64c5d16eef1f834f2b278" Jul 10 18:02:40.573742 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.573724 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ef338aff9cac90d4c363a74462974e85f02376a13a64c5d16eef1f834f2b278"} err="failed to get container status \"2ef338aff9cac90d4c363a74462974e85f02376a13a64c5d16eef1f834f2b278\": rpc error: code = NotFound desc = could not find container \"2ef338aff9cac90d4c363a74462974e85f02376a13a64c5d16eef1f834f2b278\": container with ID starting with 2ef338aff9cac90d4c363a74462974e85f02376a13a64c5d16eef1f834f2b278 not found: ID does not exist" Jul 10 18:02:40.573782 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.573744 2579 scope.go:117] "RemoveContainer" containerID="457445fde625ef8875d2806b8b2e8165a9ae3eb3c1338cc7f051ae920066a99c" Jul 10 18:02:40.573971 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.573955 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:02:40.574049 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574028 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"457445fde625ef8875d2806b8b2e8165a9ae3eb3c1338cc7f051ae920066a99c"} err="failed to get container status \"457445fde625ef8875d2806b8b2e8165a9ae3eb3c1338cc7f051ae920066a99c\": rpc error: code = NotFound desc = could not find container \"457445fde625ef8875d2806b8b2e8165a9ae3eb3c1338cc7f051ae920066a99c\": container with ID starting with 457445fde625ef8875d2806b8b2e8165a9ae3eb3c1338cc7f051ae920066a99c not found: ID does not exist" Jul 10 18:02:40.574097 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574050 2579 scope.go:117] "RemoveContainer" containerID="c42085c6b87663f9b7a16d7008a40ac815440c2f129421c7fdf4c6e2d81d770f" Jul 10 18:02:40.574283 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574268 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="kube-rbac-proxy-metric" Jul 10 18:02:40.574366 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574287 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="kube-rbac-proxy-metric" Jul 10 18:02:40.574366 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574303 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="prom-label-proxy" Jul 10 18:02:40.574366 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574310 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="prom-label-proxy" Jul 10 18:02:40.574366 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574321 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="alertmanager" Jul 10 18:02:40.574366 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574326 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="alertmanager" Jul 10 18:02:40.574366 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574332 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="config-reloader" Jul 10 18:02:40.574366 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574337 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="config-reloader" Jul 10 18:02:40.574366 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574344 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="init-config-reloader" Jul 10 18:02:40.574366 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574349 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="init-config-reloader" Jul 10 18:02:40.574366 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574358 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092f4bc6-2be0-4193-90ed-d378788410d0" containerName="console" Jul 10 18:02:40.574366 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574363 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="092f4bc6-2be0-4193-90ed-d378788410d0" containerName="console" Jul 10 18:02:40.574366 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574368 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="kube-rbac-proxy" Jul 10 18:02:40.574697 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574373 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="kube-rbac-proxy" Jul 10 18:02:40.574697 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574381 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="kube-rbac-proxy-web" Jul 10 18:02:40.574697 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574386 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="kube-rbac-proxy-web" Jul 10 18:02:40.574697 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574264 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c42085c6b87663f9b7a16d7008a40ac815440c2f129421c7fdf4c6e2d81d770f"} err="failed to get container status \"c42085c6b87663f9b7a16d7008a40ac815440c2f129421c7fdf4c6e2d81d770f\": rpc error: code = NotFound desc = could not find container \"c42085c6b87663f9b7a16d7008a40ac815440c2f129421c7fdf4c6e2d81d770f\": container with ID starting with c42085c6b87663f9b7a16d7008a40ac815440c2f129421c7fdf4c6e2d81d770f not found: ID does not exist" Jul 10 18:02:40.574697 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574433 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="kube-rbac-proxy-metric" Jul 10 18:02:40.574697 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574440 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="alertmanager" Jul 10 18:02:40.574697 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574447 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="config-reloader" Jul 10 18:02:40.574697 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574452 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="092f4bc6-2be0-4193-90ed-d378788410d0" containerName="console" Jul 10 18:02:40.574697 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574458 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="prom-label-proxy" Jul 10 18:02:40.574697 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574463 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="kube-rbac-proxy-web" Jul 10 18:02:40.574697 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.574469 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" containerName="kube-rbac-proxy" Jul 10 18:02:40.578236 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.578220 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.580642 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.580608 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 10 18:02:40.580738 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.580691 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 10 18:02:40.580738 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.580706 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 10 18:02:40.580738 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.580726 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 10 18:02:40.581028 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.581013 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 10 18:02:40.581242 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.581226 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 10 18:02:40.581319 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.581244 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zvc2r\"" Jul 10 18:02:40.581530 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.581513 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 10 18:02:40.581603 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.581518 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 10 18:02:40.586128 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.586108 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 10 18:02:40.596660 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.596637 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:02:40.673384 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.673353 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c624d3c0-490e-4260-8d3e-6bba2d73e66f" path="/var/lib/kubelet/pods/c624d3c0-490e-4260-8d3e-6bba2d73e66f/volumes" Jul 10 18:02:40.677749 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.677729 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/551582f3-62c0-4a18-82a8-349a6ea17251-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.677795 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.677772 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/551582f3-62c0-4a18-82a8-349a6ea17251-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.677832 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.677798 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/551582f3-62c0-4a18-82a8-349a6ea17251-web-config\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.677905 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.677887 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/551582f3-62c0-4a18-82a8-349a6ea17251-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.677943 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.677912 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx4tj\" (UniqueName: \"kubernetes.io/projected/551582f3-62c0-4a18-82a8-349a6ea17251-kube-api-access-wx4tj\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.677943 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.677933 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/551582f3-62c0-4a18-82a8-349a6ea17251-tls-assets\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.678005 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.677960 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/551582f3-62c0-4a18-82a8-349a6ea17251-config-out\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.678005 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.677978 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/551582f3-62c0-4a18-82a8-349a6ea17251-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.678062 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.678006 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/551582f3-62c0-4a18-82a8-349a6ea17251-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.678062 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.678026 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/551582f3-62c0-4a18-82a8-349a6ea17251-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.678062 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.678048 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/551582f3-62c0-4a18-82a8-349a6ea17251-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.678151 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.678070 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/551582f3-62c0-4a18-82a8-349a6ea17251-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.678151 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.678094 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/551582f3-62c0-4a18-82a8-349a6ea17251-config-volume\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.779482 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.779395 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/551582f3-62c0-4a18-82a8-349a6ea17251-tls-assets\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.779482 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.779433 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/551582f3-62c0-4a18-82a8-349a6ea17251-config-out\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.779482 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.779451 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/551582f3-62c0-4a18-82a8-349a6ea17251-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.779737 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.779610 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/551582f3-62c0-4a18-82a8-349a6ea17251-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.779737 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.779649 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/551582f3-62c0-4a18-82a8-349a6ea17251-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.779843 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.779774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/551582f3-62c0-4a18-82a8-349a6ea17251-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.779843 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.779824 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/551582f3-62c0-4a18-82a8-349a6ea17251-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.779986 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.779907 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/551582f3-62c0-4a18-82a8-349a6ea17251-config-volume\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.779986 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.779939 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/551582f3-62c0-4a18-82a8-349a6ea17251-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.780099 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.780003 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/551582f3-62c0-4a18-82a8-349a6ea17251-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.780099 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.780080 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/551582f3-62c0-4a18-82a8-349a6ea17251-web-config\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.780202 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.780119 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/551582f3-62c0-4a18-82a8-349a6ea17251-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.780202 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.780147 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx4tj\" (UniqueName: \"kubernetes.io/projected/551582f3-62c0-4a18-82a8-349a6ea17251-kube-api-access-wx4tj\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.780334 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.780311 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/551582f3-62c0-4a18-82a8-349a6ea17251-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.780686 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.780649 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/551582f3-62c0-4a18-82a8-349a6ea17251-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.782294 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.782265 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/551582f3-62c0-4a18-82a8-349a6ea17251-config-out\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.782930 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.782626 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/551582f3-62c0-4a18-82a8-349a6ea17251-tls-assets\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.782930 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.782781 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/551582f3-62c0-4a18-82a8-349a6ea17251-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.782930 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.782812 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/551582f3-62c0-4a18-82a8-349a6ea17251-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.783122 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.783100 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/551582f3-62c0-4a18-82a8-349a6ea17251-web-config\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.783242 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.783216 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/551582f3-62c0-4a18-82a8-349a6ea17251-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.783367 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.783342 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/551582f3-62c0-4a18-82a8-349a6ea17251-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.783470 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.783451 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/551582f3-62c0-4a18-82a8-349a6ea17251-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.783557 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.783537 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/551582f3-62c0-4a18-82a8-349a6ea17251-config-volume\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.784550 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.784524 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/551582f3-62c0-4a18-82a8-349a6ea17251-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.787951 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.787933 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx4tj\" (UniqueName: \"kubernetes.io/projected/551582f3-62c0-4a18-82a8-349a6ea17251-kube-api-access-wx4tj\") pod \"alertmanager-main-0\" (UID: \"551582f3-62c0-4a18-82a8-349a6ea17251\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:40.887627 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:40.887592 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:02:41.020502 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:41.020475 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:02:41.022600 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:02:41.022570 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod551582f3_62c0_4a18_82a8_349a6ea17251.slice/crio-654d29eb0a2c70bd6571fbac53b45238dd523d3dd6e8640522cc7524b08c4177 WatchSource:0}: Error finding container 654d29eb0a2c70bd6571fbac53b45238dd523d3dd6e8640522cc7524b08c4177: Status 404 returned error can't find the container with id 654d29eb0a2c70bd6571fbac53b45238dd523d3dd6e8640522cc7524b08c4177 Jul 10 18:02:41.518771 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:41.518736 2579 generic.go:356] "Generic (PLEG): container finished" podID="551582f3-62c0-4a18-82a8-349a6ea17251" containerID="619dfddb0f92a89ee50693e3f1a84ca8c1aa767b5d3a3fdd2f42b3ff5400ac66" exitCode=0 Jul 10 18:02:41.519163 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:41.518826 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"551582f3-62c0-4a18-82a8-349a6ea17251","Type":"ContainerDied","Data":"619dfddb0f92a89ee50693e3f1a84ca8c1aa767b5d3a3fdd2f42b3ff5400ac66"} Jul 10 18:02:41.519163 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:41.518923 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"551582f3-62c0-4a18-82a8-349a6ea17251","Type":"ContainerStarted","Data":"654d29eb0a2c70bd6571fbac53b45238dd523d3dd6e8640522cc7524b08c4177"} Jul 10 18:02:42.413587 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.413555 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6c8f689d67-vmlnz"] Jul 10 18:02:42.416081 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.416058 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.418602 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.418577 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 10 18:02:42.418687 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.418659 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 10 18:02:42.419510 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.419491 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 10 18:02:42.419690 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.419668 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vq27r\"" Jul 10 18:02:42.419796 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.419730 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 10 18:02:42.419869 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.419840 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 10 18:02:42.425174 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.425153 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 10 18:02:42.430964 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.430939 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c8f689d67-vmlnz"] Jul 10 18:02:42.493110 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.493081 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3eaefb5d-f574-419e-9506-2b15f7418322-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.493110 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.493113 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3eaefb5d-f574-419e-9506-2b15f7418322-secret-telemeter-client\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.493339 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.493136 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3eaefb5d-f574-419e-9506-2b15f7418322-metrics-client-ca\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.493339 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.493217 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3eaefb5d-f574-419e-9506-2b15f7418322-federate-client-tls\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.493339 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.493242 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3eaefb5d-f574-419e-9506-2b15f7418322-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.493339 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.493300 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3eaefb5d-f574-419e-9506-2b15f7418322-serving-certs-ca-bundle\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.493339 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.493330 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3eaefb5d-f574-419e-9506-2b15f7418322-telemeter-client-tls\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.493483 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.493348 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhn8v\" (UniqueName: \"kubernetes.io/projected/3eaefb5d-f574-419e-9506-2b15f7418322-kube-api-access-vhn8v\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.527838 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.527801 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"551582f3-62c0-4a18-82a8-349a6ea17251","Type":"ContainerStarted","Data":"dbc1e014f2c8b264660e889e5d84408df1d01b7e21ea0cc650a94000499972bf"} Jul 10 18:02:42.528216 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.527911 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"551582f3-62c0-4a18-82a8-349a6ea17251","Type":"ContainerStarted","Data":"dd28105d9e37767fbf9f0f4e26f3d889b240f16589e4c30434dc1916cdd74e3f"} Jul 10 18:02:42.528216 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.527960 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"551582f3-62c0-4a18-82a8-349a6ea17251","Type":"ContainerStarted","Data":"e58b72268e66dae557b69fbf9d61239bc6ac48d2d68fd1d694ec7ef20ff88d17"} Jul 10 18:02:42.528216 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.527997 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"551582f3-62c0-4a18-82a8-349a6ea17251","Type":"ContainerStarted","Data":"568463d012080be096c100f6940a85c55f0daea51508b760e6bfb794e6ef2050"} Jul 10 18:02:42.528216 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.528032 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"551582f3-62c0-4a18-82a8-349a6ea17251","Type":"ContainerStarted","Data":"8a138940da3ea664ed671a5ef0065f7c44446e093c77ba464b190dd0c732c398"} Jul 10 18:02:42.528216 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.528059 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"551582f3-62c0-4a18-82a8-349a6ea17251","Type":"ContainerStarted","Data":"43d64033fe2c545e7e48708b3264760bcdcc8573defcbbc91106bc0964cdfa12"} Jul 10 18:02:42.552477 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.552432 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.536496252 podStartE2EDuration="2.552412918s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.916666ms" isStatefulPod=false podCreationTimestamp="2026-07-10 18:02:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:02:42.551875081 +0000 UTC m=+194.392703331" watchObservedRunningTime="2026-07-10 18:02:42.552412918 +0000 UTC m=+194.393241173" Jul 10 18:02:42.594807 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.594774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhn8v\" (UniqueName: \"kubernetes.io/projected/3eaefb5d-f574-419e-9506-2b15f7418322-kube-api-access-vhn8v\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.594977 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.594910 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3eaefb5d-f574-419e-9506-2b15f7418322-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.595048 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.594998 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3eaefb5d-f574-419e-9506-2b15f7418322-secret-telemeter-client\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.595101 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.595051 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3eaefb5d-f574-419e-9506-2b15f7418322-metrics-client-ca\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.595577 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.595548 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3eaefb5d-f574-419e-9506-2b15f7418322-federate-client-tls\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.595701 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.595583 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3eaefb5d-f574-419e-9506-2b15f7418322-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.595701 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.595667 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3eaefb5d-f574-419e-9506-2b15f7418322-serving-certs-ca-bundle\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.595701 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.595693 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3eaefb5d-f574-419e-9506-2b15f7418322-telemeter-client-tls\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.596153 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.596124 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3eaefb5d-f574-419e-9506-2b15f7418322-metrics-client-ca\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.596443 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.596419 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3eaefb5d-f574-419e-9506-2b15f7418322-serving-certs-ca-bundle\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.596626 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.596608 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3eaefb5d-f574-419e-9506-2b15f7418322-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.598095 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.598060 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3eaefb5d-f574-419e-9506-2b15f7418322-secret-telemeter-client\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.598240 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.598213 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3eaefb5d-f574-419e-9506-2b15f7418322-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.598312 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.598269 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3eaefb5d-f574-419e-9506-2b15f7418322-telemeter-client-tls\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.598719 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.598701 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3eaefb5d-f574-419e-9506-2b15f7418322-federate-client-tls\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.602821 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.602795 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhn8v\" (UniqueName: \"kubernetes.io/projected/3eaefb5d-f574-419e-9506-2b15f7418322-kube-api-access-vhn8v\") pod \"telemeter-client-6c8f689d67-vmlnz\" (UID: \"3eaefb5d-f574-419e-9506-2b15f7418322\") " pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.726837 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.726748 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" Jul 10 18:02:42.855975 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:42.855945 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c8f689d67-vmlnz"] Jul 10 18:02:42.859201 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:02:42.859171 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eaefb5d_f574_419e_9506_2b15f7418322.slice/crio-37a11895b6205775b21aad1fa17c851276fc046f6b555df2f650aef3476403f6 WatchSource:0}: Error finding container 37a11895b6205775b21aad1fa17c851276fc046f6b555df2f650aef3476403f6: Status 404 returned error can't find the container with id 37a11895b6205775b21aad1fa17c851276fc046f6b555df2f650aef3476403f6 Jul 10 18:02:43.533409 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:43.533376 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" event={"ID":"3eaefb5d-f574-419e-9506-2b15f7418322","Type":"ContainerStarted","Data":"37a11895b6205775b21aad1fa17c851276fc046f6b555df2f650aef3476403f6"} Jul 10 18:02:45.544845 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:45.544807 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" event={"ID":"3eaefb5d-f574-419e-9506-2b15f7418322","Type":"ContainerStarted","Data":"12e78d3ef36ca248c038d87c928db32efced2f8ed15518ff7c06f8482c59dbdd"} Jul 10 18:02:45.545247 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:45.544905 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" event={"ID":"3eaefb5d-f574-419e-9506-2b15f7418322","Type":"ContainerStarted","Data":"fce7130fb226fca764570329ccba6627a8ee08e10d9ef58edcf2e623db60615d"} Jul 10 18:02:45.545247 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:45.544928 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" event={"ID":"3eaefb5d-f574-419e-9506-2b15f7418322","Type":"ContainerStarted","Data":"e5f79998d402083b402327c1e9baa2e88f81e7c92ffea7f0345a34e26cca6394"} Jul 10 18:02:45.565289 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:45.565237 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6c8f689d67-vmlnz" podStartSLOduration=1.486898869 podStartE2EDuration="3.565223707s" totalImagesPullingTime="2.078324838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:02:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:02:45.563832963 +0000 UTC m=+197.404661217" watchObservedRunningTime="2026-07-10 18:02:45.565223707 +0000 UTC m=+197.406051961" Jul 10 18:02:46.584120 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.584087 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bbfd556b7-j2wnm"] Jul 10 18:02:46.586468 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.586450 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:46.601825 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.601800 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bbfd556b7-j2wnm"] Jul 10 18:02:46.630727 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.630696 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-oauth-serving-cert\") pod \"console-7bbfd556b7-j2wnm\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:46.630875 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.630756 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-console-config\") pod \"console-7bbfd556b7-j2wnm\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:46.630966 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.630940 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8182c612-0bb2-432f-a90a-fd76d589ce41-console-oauth-config\") pod \"console-7bbfd556b7-j2wnm\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:46.631028 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.630990 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgb9q\" (UniqueName: \"kubernetes.io/projected/8182c612-0bb2-432f-a90a-fd76d589ce41-kube-api-access-pgb9q\") pod \"console-7bbfd556b7-j2wnm\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:46.631118 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.631054 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-trusted-ca-bundle\") pod \"console-7bbfd556b7-j2wnm\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:46.631118 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.631086 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-service-ca\") pod \"console-7bbfd556b7-j2wnm\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:46.631206 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.631163 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8182c612-0bb2-432f-a90a-fd76d589ce41-console-serving-cert\") pod \"console-7bbfd556b7-j2wnm\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:46.732129 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.732095 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8182c612-0bb2-432f-a90a-fd76d589ce41-console-oauth-config\") pod \"console-7bbfd556b7-j2wnm\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:46.732129 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.732133 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgb9q\" (UniqueName: \"kubernetes.io/projected/8182c612-0bb2-432f-a90a-fd76d589ce41-kube-api-access-pgb9q\") pod \"console-7bbfd556b7-j2wnm\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:46.732349 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.732163 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-trusted-ca-bundle\") pod \"console-7bbfd556b7-j2wnm\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:46.732349 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.732181 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-service-ca\") pod \"console-7bbfd556b7-j2wnm\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:46.732349 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.732200 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8182c612-0bb2-432f-a90a-fd76d589ce41-console-serving-cert\") pod \"console-7bbfd556b7-j2wnm\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:46.732349 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.732229 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-oauth-serving-cert\") pod \"console-7bbfd556b7-j2wnm\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:46.732349 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.732264 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-console-config\") pod \"console-7bbfd556b7-j2wnm\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:46.732992 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.732966 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-console-config\") pod \"console-7bbfd556b7-j2wnm\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:46.733093 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.733017 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-service-ca\") pod \"console-7bbfd556b7-j2wnm\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:46.733093 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.733046 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-oauth-serving-cert\") pod \"console-7bbfd556b7-j2wnm\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:46.733200 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.733146 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-trusted-ca-bundle\") pod \"console-7bbfd556b7-j2wnm\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:46.735057 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.735039 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8182c612-0bb2-432f-a90a-fd76d589ce41-console-oauth-config\") pod \"console-7bbfd556b7-j2wnm\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:46.735264 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.735242 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8182c612-0bb2-432f-a90a-fd76d589ce41-console-serving-cert\") pod \"console-7bbfd556b7-j2wnm\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:46.739756 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.739735 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgb9q\" (UniqueName: \"kubernetes.io/projected/8182c612-0bb2-432f-a90a-fd76d589ce41-kube-api-access-pgb9q\") pod \"console-7bbfd556b7-j2wnm\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:46.896006 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:46.895914 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:47.020918 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:47.020892 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bbfd556b7-j2wnm"] Jul 10 18:02:47.023335 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:02:47.023305 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8182c612_0bb2_432f_a90a_fd76d589ce41.slice/crio-01373ded877b98278083ea39168260b93799246e8de60e8acd3764b5262aef48 WatchSource:0}: Error finding container 01373ded877b98278083ea39168260b93799246e8de60e8acd3764b5262aef48: Status 404 returned error can't find the container with id 01373ded877b98278083ea39168260b93799246e8de60e8acd3764b5262aef48 Jul 10 18:02:47.555149 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:47.555112 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bbfd556b7-j2wnm" event={"ID":"8182c612-0bb2-432f-a90a-fd76d589ce41","Type":"ContainerStarted","Data":"e1b8b25f80b454b39d75d0462cf391dc251e72f6659d242ad85d8ae2bd77b9fa"} Jul 10 18:02:47.555291 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:47.555163 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bbfd556b7-j2wnm" event={"ID":"8182c612-0bb2-432f-a90a-fd76d589ce41","Type":"ContainerStarted","Data":"01373ded877b98278083ea39168260b93799246e8de60e8acd3764b5262aef48"} Jul 10 18:02:47.573223 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:47.573173 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bbfd556b7-j2wnm" podStartSLOduration=1.573156665 podStartE2EDuration="1.573156665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:02:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:02:47.57111418 +0000 UTC m=+199.411942447" watchObservedRunningTime="2026-07-10 18:02:47.573156665 +0000 UTC m=+199.413984918" Jul 10 18:02:56.896354 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:56.896321 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:56.896756 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:56.896605 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:56.901134 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:56.901113 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:57.598191 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:57.598162 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:02:57.643427 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:02:57.643393 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ff797c4cd-4r6x5"] Jul 10 18:03:22.664743 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:22.664678 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7ff797c4cd-4r6x5" podUID="6a5bc15c-e794-462f-bcb5-3a6e5360e9e0" containerName="console" containerID="cri-o://d7656020a55c5545e921c2d442c19786321063c10b596c6ac6b32973b1cc6822" gracePeriod=15 Jul 10 18:03:22.930576 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:22.930552 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:03:23.041094 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.041057 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-service-ca\") pod \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " Jul 10 18:03:23.041286 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.041103 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-console-serving-cert\") pod \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " Jul 10 18:03:23.041286 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.041130 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-console-oauth-config\") pod \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " Jul 10 18:03:23.041286 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.041181 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwmwc\" (UniqueName: \"kubernetes.io/projected/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-kube-api-access-lwmwc\") pod \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " Jul 10 18:03:23.041286 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.041248 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-oauth-serving-cert\") pod \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " Jul 10 18:03:23.041286 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.041280 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-trusted-ca-bundle\") pod \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " Jul 10 18:03:23.041523 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.041305 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-console-config\") pod \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\" (UID: \"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0\") " Jul 10 18:03:23.041523 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.041465 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-service-ca" (OuterVolumeSpecName: "service-ca") pod "6a5bc15c-e794-462f-bcb5-3a6e5360e9e0" (UID: "6a5bc15c-e794-462f-bcb5-3a6e5360e9e0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:03:23.041712 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.041677 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-service-ca\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:03:23.041712 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.041690 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6a5bc15c-e794-462f-bcb5-3a6e5360e9e0" (UID: "6a5bc15c-e794-462f-bcb5-3a6e5360e9e0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:03:23.041876 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.041712 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6a5bc15c-e794-462f-bcb5-3a6e5360e9e0" (UID: "6a5bc15c-e794-462f-bcb5-3a6e5360e9e0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:03:23.041876 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.041789 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-console-config" (OuterVolumeSpecName: "console-config") pod "6a5bc15c-e794-462f-bcb5-3a6e5360e9e0" (UID: "6a5bc15c-e794-462f-bcb5-3a6e5360e9e0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:03:23.043331 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.043302 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6a5bc15c-e794-462f-bcb5-3a6e5360e9e0" (UID: "6a5bc15c-e794-462f-bcb5-3a6e5360e9e0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:03:23.043767 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.043742 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-kube-api-access-lwmwc" (OuterVolumeSpecName: "kube-api-access-lwmwc") pod "6a5bc15c-e794-462f-bcb5-3a6e5360e9e0" (UID: "6a5bc15c-e794-462f-bcb5-3a6e5360e9e0"). InnerVolumeSpecName "kube-api-access-lwmwc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:03:23.043928 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.043747 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6a5bc15c-e794-462f-bcb5-3a6e5360e9e0" (UID: "6a5bc15c-e794-462f-bcb5-3a6e5360e9e0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:03:23.142485 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.142442 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-oauth-serving-cert\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:03:23.142485 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.142478 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-trusted-ca-bundle\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:03:23.142485 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.142492 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-console-config\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:03:23.142718 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.142504 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-console-serving-cert\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:03:23.142718 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.142515 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-console-oauth-config\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:03:23.142718 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.142527 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwmwc\" (UniqueName: \"kubernetes.io/projected/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0-kube-api-access-lwmwc\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:03:23.702967 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.702933 2579 generic.go:356] "Generic (PLEG): container finished" podID="6a5bc15c-e794-462f-bcb5-3a6e5360e9e0" containerID="d7656020a55c5545e921c2d442c19786321063c10b596c6ac6b32973b1cc6822" exitCode=0 Jul 10 18:03:23.703386 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.702975 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ff797c4cd-4r6x5" Jul 10 18:03:23.703386 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.703010 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ff797c4cd-4r6x5" event={"ID":"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0","Type":"ContainerDied","Data":"d7656020a55c5545e921c2d442c19786321063c10b596c6ac6b32973b1cc6822"} Jul 10 18:03:23.703386 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.703060 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ff797c4cd-4r6x5" event={"ID":"6a5bc15c-e794-462f-bcb5-3a6e5360e9e0","Type":"ContainerDied","Data":"0b887f8bafca6b6434b4095bcba1c1efbd33bd2b724008fbc624344ac5dc6389"} Jul 10 18:03:23.703386 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.703080 2579 scope.go:117] "RemoveContainer" containerID="d7656020a55c5545e921c2d442c19786321063c10b596c6ac6b32973b1cc6822" Jul 10 18:03:23.711741 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.711723 2579 scope.go:117] "RemoveContainer" containerID="d7656020a55c5545e921c2d442c19786321063c10b596c6ac6b32973b1cc6822" Jul 10 18:03:23.711986 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:03:23.711969 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7656020a55c5545e921c2d442c19786321063c10b596c6ac6b32973b1cc6822\": container with ID starting with d7656020a55c5545e921c2d442c19786321063c10b596c6ac6b32973b1cc6822 not found: ID does not exist" containerID="d7656020a55c5545e921c2d442c19786321063c10b596c6ac6b32973b1cc6822" Jul 10 18:03:23.712054 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.711992 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7656020a55c5545e921c2d442c19786321063c10b596c6ac6b32973b1cc6822"} err="failed to get container status \"d7656020a55c5545e921c2d442c19786321063c10b596c6ac6b32973b1cc6822\": rpc error: code = NotFound desc = could not find container \"d7656020a55c5545e921c2d442c19786321063c10b596c6ac6b32973b1cc6822\": container with ID starting with d7656020a55c5545e921c2d442c19786321063c10b596c6ac6b32973b1cc6822 not found: ID does not exist" Jul 10 18:03:23.723116 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.723096 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ff797c4cd-4r6x5"] Jul 10 18:03:23.726525 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:23.726506 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7ff797c4cd-4r6x5"] Jul 10 18:03:24.673982 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:03:24.673952 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a5bc15c-e794-462f-bcb5-3a6e5360e9e0" path="/var/lib/kubelet/pods/6a5bc15c-e794-462f-bcb5-3a6e5360e9e0/volumes" Jul 10 18:04:02.711741 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.711662 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c79499fd8-42flf"] Jul 10 18:04:02.712221 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.712046 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5bc15c-e794-462f-bcb5-3a6e5360e9e0" containerName="console" Jul 10 18:04:02.712221 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.712061 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5bc15c-e794-462f-bcb5-3a6e5360e9e0" containerName="console" Jul 10 18:04:02.712221 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.712112 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a5bc15c-e794-462f-bcb5-3a6e5360e9e0" containerName="console" Jul 10 18:04:02.715026 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.715010 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:02.726149 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.726118 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c79499fd8-42flf"] Jul 10 18:04:02.874109 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.874066 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-oauth-serving-cert\") pod \"console-5c79499fd8-42flf\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:02.874109 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.874113 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrh6q\" (UniqueName: \"kubernetes.io/projected/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-kube-api-access-wrh6q\") pod \"console-5c79499fd8-42flf\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:02.874319 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.874138 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-console-serving-cert\") pod \"console-5c79499fd8-42flf\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:02.874319 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.874210 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-service-ca\") pod \"console-5c79499fd8-42flf\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:02.874319 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.874261 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-console-oauth-config\") pod \"console-5c79499fd8-42flf\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:02.874319 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.874285 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-trusted-ca-bundle\") pod \"console-5c79499fd8-42flf\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:02.874319 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.874302 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-console-config\") pod \"console-5c79499fd8-42flf\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:02.975577 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.975490 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-console-oauth-config\") pod \"console-5c79499fd8-42flf\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:02.975577 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.975533 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-trusted-ca-bundle\") pod \"console-5c79499fd8-42flf\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:02.975577 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.975552 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-console-config\") pod \"console-5c79499fd8-42flf\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:02.975813 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.975592 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-oauth-serving-cert\") pod \"console-5c79499fd8-42flf\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:02.975813 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.975622 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrh6q\" (UniqueName: \"kubernetes.io/projected/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-kube-api-access-wrh6q\") pod \"console-5c79499fd8-42flf\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:02.975813 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.975670 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-console-serving-cert\") pod \"console-5c79499fd8-42flf\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:02.975813 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.975715 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-service-ca\") pod \"console-5c79499fd8-42flf\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:02.976478 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.976449 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-oauth-serving-cert\") pod \"console-5c79499fd8-42flf\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:02.976600 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.976449 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-console-config\") pod \"console-5c79499fd8-42flf\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:02.976600 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.976535 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-service-ca\") pod \"console-5c79499fd8-42flf\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:02.976600 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.976593 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-trusted-ca-bundle\") pod \"console-5c79499fd8-42flf\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:02.978070 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.978047 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-console-oauth-config\") pod \"console-5c79499fd8-42flf\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:02.978189 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.978136 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-console-serving-cert\") pod \"console-5c79499fd8-42flf\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:02.985720 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:02.985696 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrh6q\" (UniqueName: \"kubernetes.io/projected/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-kube-api-access-wrh6q\") pod \"console-5c79499fd8-42flf\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:03.024577 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:03.024535 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:03.156928 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:03.156899 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c79499fd8-42flf"] Jul 10 18:04:03.159374 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:04:03.159346 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4289ab81_8417_4ea6_9b68_f8cf21c6f1d6.slice/crio-790de6bc9f07f882da34e87ef50736a4dd5b26c77b7bed3c23478fa269c083bf WatchSource:0}: Error finding container 790de6bc9f07f882da34e87ef50736a4dd5b26c77b7bed3c23478fa269c083bf: Status 404 returned error can't find the container with id 790de6bc9f07f882da34e87ef50736a4dd5b26c77b7bed3c23478fa269c083bf Jul 10 18:04:03.864532 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:03.864489 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c79499fd8-42flf" event={"ID":"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6","Type":"ContainerStarted","Data":"0c3a1416aea1033b986db024ea4e9c5f9acc0616b50b2483cc421ab1ac032c32"} Jul 10 18:04:03.864936 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:03.864547 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c79499fd8-42flf" event={"ID":"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6","Type":"ContainerStarted","Data":"790de6bc9f07f882da34e87ef50736a4dd5b26c77b7bed3c23478fa269c083bf"} Jul 10 18:04:03.883124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:03.883076 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c79499fd8-42flf" podStartSLOduration=1.883060404 podStartE2EDuration="1.883060404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:04:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:04:03.88098348 +0000 UTC m=+275.721811733" watchObservedRunningTime="2026-07-10 18:04:03.883060404 +0000 UTC m=+275.723888657" Jul 10 18:04:13.024868 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:13.024813 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:13.025357 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:13.024896 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:13.029638 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:13.029615 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:13.908821 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:13.908795 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:04:13.956201 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:13.956165 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bbfd556b7-j2wnm"] Jul 10 18:04:28.588222 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:28.588197 2579 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 18:04:38.976464 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:38.976402 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bbfd556b7-j2wnm" podUID="8182c612-0bb2-432f-a90a-fd76d589ce41" containerName="console" containerID="cri-o://e1b8b25f80b454b39d75d0462cf391dc251e72f6659d242ad85d8ae2bd77b9fa" gracePeriod=15 Jul 10 18:04:39.223419 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:39.223395 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:04:39.267734 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:39.267662 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-oauth-serving-cert\") pod \"8182c612-0bb2-432f-a90a-fd76d589ce41\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " Jul 10 18:04:39.267734 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:39.267695 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-service-ca\") pod \"8182c612-0bb2-432f-a90a-fd76d589ce41\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " Jul 10 18:04:39.267734 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:39.267713 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-console-config\") pod \"8182c612-0bb2-432f-a90a-fd76d589ce41\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " Jul 10 18:04:39.268005 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:39.267751 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8182c612-0bb2-432f-a90a-fd76d589ce41-console-oauth-config\") pod \"8182c612-0bb2-432f-a90a-fd76d589ce41\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " Jul 10 18:04:39.268005 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:39.267811 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8182c612-0bb2-432f-a90a-fd76d589ce41-console-serving-cert\") pod \"8182c612-0bb2-432f-a90a-fd76d589ce41\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " Jul 10 18:04:39.268005 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:39.267871 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgb9q\" (UniqueName: \"kubernetes.io/projected/8182c612-0bb2-432f-a90a-fd76d589ce41-kube-api-access-pgb9q\") pod \"8182c612-0bb2-432f-a90a-fd76d589ce41\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " Jul 10 18:04:39.268005 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:39.267923 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-trusted-ca-bundle\") pod \"8182c612-0bb2-432f-a90a-fd76d589ce41\" (UID: \"8182c612-0bb2-432f-a90a-fd76d589ce41\") " Jul 10 18:04:39.268212 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:39.268151 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-service-ca" (OuterVolumeSpecName: "service-ca") pod "8182c612-0bb2-432f-a90a-fd76d589ce41" (UID: "8182c612-0bb2-432f-a90a-fd76d589ce41"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:04:39.268212 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:39.268160 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-console-config" (OuterVolumeSpecName: "console-config") pod "8182c612-0bb2-432f-a90a-fd76d589ce41" (UID: "8182c612-0bb2-432f-a90a-fd76d589ce41"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:04:39.268212 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:39.268151 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8182c612-0bb2-432f-a90a-fd76d589ce41" (UID: "8182c612-0bb2-432f-a90a-fd76d589ce41"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:04:39.268502 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:39.268475 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8182c612-0bb2-432f-a90a-fd76d589ce41" (UID: "8182c612-0bb2-432f-a90a-fd76d589ce41"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:04:39.270074 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:39.270046 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8182c612-0bb2-432f-a90a-fd76d589ce41-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8182c612-0bb2-432f-a90a-fd76d589ce41" (UID: "8182c612-0bb2-432f-a90a-fd76d589ce41"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:04:39.270187 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:39.270083 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8182c612-0bb2-432f-a90a-fd76d589ce41-kube-api-access-pgb9q" (OuterVolumeSpecName: "kube-api-access-pgb9q") pod "8182c612-0bb2-432f-a90a-fd76d589ce41" (UID: "8182c612-0bb2-432f-a90a-fd76d589ce41"). InnerVolumeSpecName "kube-api-access-pgb9q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:04:39.270187 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:39.270132 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8182c612-0bb2-432f-a90a-fd76d589ce41-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8182c612-0bb2-432f-a90a-fd76d589ce41" (UID: "8182c612-0bb2-432f-a90a-fd76d589ce41"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:04:39.368706 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:39.368669 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8182c612-0bb2-432f-a90a-fd76d589ce41-console-oauth-config\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:04:39.368706 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:39.368698 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8182c612-0bb2-432f-a90a-fd76d589ce41-console-serving-cert\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:04:39.368706 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:39.368708 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgb9q\" (UniqueName: \"kubernetes.io/projected/8182c612-0bb2-432f-a90a-fd76d589ce41-kube-api-access-pgb9q\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:04:39.368706 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:39.368717 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-trusted-ca-bundle\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:04:39.368988 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:39.368726 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-oauth-serving-cert\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:04:39.368988 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:39.368736 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-service-ca\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:04:39.368988 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:39.368743 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8182c612-0bb2-432f-a90a-fd76d589ce41-console-config\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:04:40.003900 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:40.003867 2579 generic.go:356] "Generic (PLEG): container finished" podID="8182c612-0bb2-432f-a90a-fd76d589ce41" containerID="e1b8b25f80b454b39d75d0462cf391dc251e72f6659d242ad85d8ae2bd77b9fa" exitCode=0 Jul 10 18:04:40.004348 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:40.003909 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bbfd556b7-j2wnm" Jul 10 18:04:40.004348 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:40.003944 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bbfd556b7-j2wnm" event={"ID":"8182c612-0bb2-432f-a90a-fd76d589ce41","Type":"ContainerDied","Data":"e1b8b25f80b454b39d75d0462cf391dc251e72f6659d242ad85d8ae2bd77b9fa"} Jul 10 18:04:40.004348 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:40.004006 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bbfd556b7-j2wnm" event={"ID":"8182c612-0bb2-432f-a90a-fd76d589ce41","Type":"ContainerDied","Data":"01373ded877b98278083ea39168260b93799246e8de60e8acd3764b5262aef48"} Jul 10 18:04:40.004348 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:40.004039 2579 scope.go:117] "RemoveContainer" containerID="e1b8b25f80b454b39d75d0462cf391dc251e72f6659d242ad85d8ae2bd77b9fa" Jul 10 18:04:40.012576 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:40.012559 2579 scope.go:117] "RemoveContainer" containerID="e1b8b25f80b454b39d75d0462cf391dc251e72f6659d242ad85d8ae2bd77b9fa" Jul 10 18:04:40.012826 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:04:40.012809 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1b8b25f80b454b39d75d0462cf391dc251e72f6659d242ad85d8ae2bd77b9fa\": container with ID starting with e1b8b25f80b454b39d75d0462cf391dc251e72f6659d242ad85d8ae2bd77b9fa not found: ID does not exist" containerID="e1b8b25f80b454b39d75d0462cf391dc251e72f6659d242ad85d8ae2bd77b9fa" Jul 10 18:04:40.012906 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:40.012834 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1b8b25f80b454b39d75d0462cf391dc251e72f6659d242ad85d8ae2bd77b9fa"} err="failed to get container status \"e1b8b25f80b454b39d75d0462cf391dc251e72f6659d242ad85d8ae2bd77b9fa\": rpc error: code = NotFound desc = could not find container \"e1b8b25f80b454b39d75d0462cf391dc251e72f6659d242ad85d8ae2bd77b9fa\": container with ID starting with e1b8b25f80b454b39d75d0462cf391dc251e72f6659d242ad85d8ae2bd77b9fa not found: ID does not exist" Jul 10 18:04:40.023961 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:40.023937 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bbfd556b7-j2wnm"] Jul 10 18:04:40.026220 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:40.026196 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bbfd556b7-j2wnm"] Jul 10 18:04:40.673874 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:04:40.673831 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8182c612-0bb2-432f-a90a-fd76d589ce41" path="/var/lib/kubelet/pods/8182c612-0bb2-432f-a90a-fd76d589ce41/volumes" Jul 10 18:05:11.277329 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:11.277293 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9"] Jul 10 18:05:11.277794 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:11.277608 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8182c612-0bb2-432f-a90a-fd76d589ce41" containerName="console" Jul 10 18:05:11.277794 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:11.277618 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8182c612-0bb2-432f-a90a-fd76d589ce41" containerName="console" Jul 10 18:05:11.277794 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:11.277665 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8182c612-0bb2-432f-a90a-fd76d589ce41" containerName="console" Jul 10 18:05:11.280650 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:11.280632 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9" Jul 10 18:05:11.283181 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:11.283154 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 10 18:05:11.283312 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:11.283153 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w5dtj\"" Jul 10 18:05:11.284010 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:11.283993 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 10 18:05:11.290808 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:11.290784 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9"] Jul 10 18:05:11.435872 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:11.435815 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mml8\" (UniqueName: \"kubernetes.io/projected/126d5e57-6da8-4161-9cfb-200016a7d6e7-kube-api-access-8mml8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9\" (UID: \"126d5e57-6da8-4161-9cfb-200016a7d6e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9" Jul 10 18:05:11.436055 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:11.435901 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/126d5e57-6da8-4161-9cfb-200016a7d6e7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9\" (UID: \"126d5e57-6da8-4161-9cfb-200016a7d6e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9" Jul 10 18:05:11.436055 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:11.435930 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/126d5e57-6da8-4161-9cfb-200016a7d6e7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9\" (UID: \"126d5e57-6da8-4161-9cfb-200016a7d6e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9" Jul 10 18:05:11.537425 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:11.537343 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mml8\" (UniqueName: \"kubernetes.io/projected/126d5e57-6da8-4161-9cfb-200016a7d6e7-kube-api-access-8mml8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9\" (UID: \"126d5e57-6da8-4161-9cfb-200016a7d6e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9" Jul 10 18:05:11.537425 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:11.537394 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/126d5e57-6da8-4161-9cfb-200016a7d6e7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9\" (UID: \"126d5e57-6da8-4161-9cfb-200016a7d6e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9" Jul 10 18:05:11.537425 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:11.537423 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/126d5e57-6da8-4161-9cfb-200016a7d6e7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9\" (UID: \"126d5e57-6da8-4161-9cfb-200016a7d6e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9" Jul 10 18:05:11.537789 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:11.537767 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/126d5e57-6da8-4161-9cfb-200016a7d6e7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9\" (UID: \"126d5e57-6da8-4161-9cfb-200016a7d6e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9" Jul 10 18:05:11.537891 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:11.537820 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/126d5e57-6da8-4161-9cfb-200016a7d6e7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9\" (UID: \"126d5e57-6da8-4161-9cfb-200016a7d6e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9" Jul 10 18:05:11.545494 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:11.545463 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mml8\" (UniqueName: \"kubernetes.io/projected/126d5e57-6da8-4161-9cfb-200016a7d6e7-kube-api-access-8mml8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9\" (UID: \"126d5e57-6da8-4161-9cfb-200016a7d6e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9" Jul 10 18:05:11.589535 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:11.589510 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9" Jul 10 18:05:11.715755 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:11.715698 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9"] Jul 10 18:05:11.718019 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:05:11.717993 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod126d5e57_6da8_4161_9cfb_200016a7d6e7.slice/crio-e9faac53d592922426d0e68296bf54c55290473347a05fee8c6d728a2cd4b31a WatchSource:0}: Error finding container e9faac53d592922426d0e68296bf54c55290473347a05fee8c6d728a2cd4b31a: Status 404 returned error can't find the container with id e9faac53d592922426d0e68296bf54c55290473347a05fee8c6d728a2cd4b31a Jul 10 18:05:11.719785 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:11.719768 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 18:05:12.128898 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:12.128862 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9" event={"ID":"126d5e57-6da8-4161-9cfb-200016a7d6e7","Type":"ContainerStarted","Data":"e9faac53d592922426d0e68296bf54c55290473347a05fee8c6d728a2cd4b31a"} Jul 10 18:05:17.152479 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:17.152399 2579 generic.go:356] "Generic (PLEG): container finished" podID="126d5e57-6da8-4161-9cfb-200016a7d6e7" containerID="8eecb8072936898ccd309496ec3330d33ab3d23e84b15ae1b7deb9bc911b666a" exitCode=0 Jul 10 18:05:17.152479 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:17.152443 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9" event={"ID":"126d5e57-6da8-4161-9cfb-200016a7d6e7","Type":"ContainerDied","Data":"8eecb8072936898ccd309496ec3330d33ab3d23e84b15ae1b7deb9bc911b666a"} Jul 10 18:05:20.167523 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:20.167489 2579 generic.go:356] "Generic (PLEG): container finished" podID="126d5e57-6da8-4161-9cfb-200016a7d6e7" containerID="fc29d956f9787055ce71423feca7ad85347b2e899bff49e1a8e92f625693c255" exitCode=0 Jul 10 18:05:20.167923 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:20.167565 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9" event={"ID":"126d5e57-6da8-4161-9cfb-200016a7d6e7","Type":"ContainerDied","Data":"fc29d956f9787055ce71423feca7ad85347b2e899bff49e1a8e92f625693c255"} Jul 10 18:05:28.206668 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:28.206581 2579 generic.go:356] "Generic (PLEG): container finished" podID="126d5e57-6da8-4161-9cfb-200016a7d6e7" containerID="aa57e2695cbd86fe310aa939094109d0a71f78a5a50fd0c27f96679cb8546a58" exitCode=0 Jul 10 18:05:28.207040 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:28.206668 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9" event={"ID":"126d5e57-6da8-4161-9cfb-200016a7d6e7","Type":"ContainerDied","Data":"aa57e2695cbd86fe310aa939094109d0a71f78a5a50fd0c27f96679cb8546a58"} Jul 10 18:05:29.346594 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:29.346563 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9" Jul 10 18:05:29.388562 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:29.388522 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/126d5e57-6da8-4161-9cfb-200016a7d6e7-bundle\") pod \"126d5e57-6da8-4161-9cfb-200016a7d6e7\" (UID: \"126d5e57-6da8-4161-9cfb-200016a7d6e7\") " Jul 10 18:05:29.388704 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:29.388616 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/126d5e57-6da8-4161-9cfb-200016a7d6e7-util\") pod \"126d5e57-6da8-4161-9cfb-200016a7d6e7\" (UID: \"126d5e57-6da8-4161-9cfb-200016a7d6e7\") " Jul 10 18:05:29.388704 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:29.388643 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mml8\" (UniqueName: \"kubernetes.io/projected/126d5e57-6da8-4161-9cfb-200016a7d6e7-kube-api-access-8mml8\") pod \"126d5e57-6da8-4161-9cfb-200016a7d6e7\" (UID: \"126d5e57-6da8-4161-9cfb-200016a7d6e7\") " Jul 10 18:05:29.389288 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:29.389262 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/126d5e57-6da8-4161-9cfb-200016a7d6e7-bundle" (OuterVolumeSpecName: "bundle") pod "126d5e57-6da8-4161-9cfb-200016a7d6e7" (UID: "126d5e57-6da8-4161-9cfb-200016a7d6e7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:05:29.390862 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:29.390819 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/126d5e57-6da8-4161-9cfb-200016a7d6e7-kube-api-access-8mml8" (OuterVolumeSpecName: "kube-api-access-8mml8") pod "126d5e57-6da8-4161-9cfb-200016a7d6e7" (UID: "126d5e57-6da8-4161-9cfb-200016a7d6e7"). InnerVolumeSpecName "kube-api-access-8mml8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:05:29.393561 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:29.393537 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/126d5e57-6da8-4161-9cfb-200016a7d6e7-util" (OuterVolumeSpecName: "util") pod "126d5e57-6da8-4161-9cfb-200016a7d6e7" (UID: "126d5e57-6da8-4161-9cfb-200016a7d6e7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:05:29.489611 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:29.489527 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/126d5e57-6da8-4161-9cfb-200016a7d6e7-util\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:05:29.489611 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:29.489565 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mml8\" (UniqueName: \"kubernetes.io/projected/126d5e57-6da8-4161-9cfb-200016a7d6e7-kube-api-access-8mml8\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:05:29.489611 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:29.489576 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/126d5e57-6da8-4161-9cfb-200016a7d6e7-bundle\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:05:30.216348 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:30.216323 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9" Jul 10 18:05:30.216348 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:30.216333 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ns9z9" event={"ID":"126d5e57-6da8-4161-9cfb-200016a7d6e7","Type":"ContainerDied","Data":"e9faac53d592922426d0e68296bf54c55290473347a05fee8c6d728a2cd4b31a"} Jul 10 18:05:30.216554 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:30.216378 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9faac53d592922426d0e68296bf54c55290473347a05fee8c6d728a2cd4b31a" Jul 10 18:05:34.173959 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:34.173924 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dd4q4"] Jul 10 18:05:34.174313 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:34.174253 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="126d5e57-6da8-4161-9cfb-200016a7d6e7" containerName="util" Jul 10 18:05:34.174313 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:34.174265 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="126d5e57-6da8-4161-9cfb-200016a7d6e7" containerName="util" Jul 10 18:05:34.174313 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:34.174277 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="126d5e57-6da8-4161-9cfb-200016a7d6e7" containerName="pull" Jul 10 18:05:34.174313 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:34.174282 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="126d5e57-6da8-4161-9cfb-200016a7d6e7" containerName="pull" Jul 10 18:05:34.174313 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:34.174294 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="126d5e57-6da8-4161-9cfb-200016a7d6e7" containerName="extract" Jul 10 18:05:34.174313 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:34.174299 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="126d5e57-6da8-4161-9cfb-200016a7d6e7" containerName="extract" Jul 10 18:05:34.174490 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:34.174361 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="126d5e57-6da8-4161-9cfb-200016a7d6e7" containerName="extract" Jul 10 18:05:34.224715 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:34.224680 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dd4q4"] Jul 10 18:05:34.224898 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:34.224775 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dd4q4" Jul 10 18:05:34.227246 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:34.227216 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 10 18:05:34.227423 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:34.227402 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:05:34.227553 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:34.227534 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-td5g7\"" Jul 10 18:05:34.330052 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:34.330015 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5519316-63e0-4704-af4f-beea09d2578a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dd4q4\" (UID: \"d5519316-63e0-4704-af4f-beea09d2578a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dd4q4" Jul 10 18:05:34.330213 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:34.330069 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rpzh\" (UniqueName: \"kubernetes.io/projected/d5519316-63e0-4704-af4f-beea09d2578a-kube-api-access-8rpzh\") pod \"cert-manager-operator-controller-manager-55c444bf86-dd4q4\" (UID: \"d5519316-63e0-4704-af4f-beea09d2578a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dd4q4" Jul 10 18:05:34.430832 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:34.430744 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5519316-63e0-4704-af4f-beea09d2578a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dd4q4\" (UID: \"d5519316-63e0-4704-af4f-beea09d2578a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dd4q4" Jul 10 18:05:34.430832 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:34.430809 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rpzh\" (UniqueName: \"kubernetes.io/projected/d5519316-63e0-4704-af4f-beea09d2578a-kube-api-access-8rpzh\") pod \"cert-manager-operator-controller-manager-55c444bf86-dd4q4\" (UID: \"d5519316-63e0-4704-af4f-beea09d2578a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dd4q4" Jul 10 18:05:34.431140 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:34.431122 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5519316-63e0-4704-af4f-beea09d2578a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dd4q4\" (UID: \"d5519316-63e0-4704-af4f-beea09d2578a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dd4q4" Jul 10 18:05:34.438755 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:34.438730 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rpzh\" (UniqueName: \"kubernetes.io/projected/d5519316-63e0-4704-af4f-beea09d2578a-kube-api-access-8rpzh\") pod \"cert-manager-operator-controller-manager-55c444bf86-dd4q4\" (UID: \"d5519316-63e0-4704-af4f-beea09d2578a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dd4q4" Jul 10 18:05:34.534036 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:34.534012 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dd4q4" Jul 10 18:05:34.677635 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:34.677560 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dd4q4"] Jul 10 18:05:34.680189 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:05:34.680164 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5519316_63e0_4704_af4f_beea09d2578a.slice/crio-65e55784007b4fef200c703ef42913fcdae14fec0d27188b689cac6917fcdd14 WatchSource:0}: Error finding container 65e55784007b4fef200c703ef42913fcdae14fec0d27188b689cac6917fcdd14: Status 404 returned error can't find the container with id 65e55784007b4fef200c703ef42913fcdae14fec0d27188b689cac6917fcdd14 Jul 10 18:05:35.237415 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:35.237374 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dd4q4" event={"ID":"d5519316-63e0-4704-af4f-beea09d2578a","Type":"ContainerStarted","Data":"65e55784007b4fef200c703ef42913fcdae14fec0d27188b689cac6917fcdd14"} Jul 10 18:05:37.248340 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:37.248258 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dd4q4" event={"ID":"d5519316-63e0-4704-af4f-beea09d2578a","Type":"ContainerStarted","Data":"995c907d6444db50005476d36d3ef06fc29627e9ad6a96d5b0a9abe08d1ce446"} Jul 10 18:05:37.271351 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:37.271308 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dd4q4" podStartSLOduration=1.134481801 podStartE2EDuration="3.271294103s" totalImagesPullingTime="2.136812302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:05:37.270134575 +0000 UTC m=+369.110962845" watchObservedRunningTime="2026-07-10 18:05:37.271294103 +0000 UTC m=+369.112122357" Jul 10 18:05:38.044735 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.044702 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qmvmp"] Jul 10 18:05:38.059512 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.059485 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qmvmp"] Jul 10 18:05:38.059654 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.059591 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qmvmp" Jul 10 18:05:38.061899 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.061879 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 10 18:05:38.063048 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.063025 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 10 18:05:38.063159 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.063025 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-l9b7z\"" Jul 10 18:05:38.158510 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.158472 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b"] Jul 10 18:05:38.165233 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.165197 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n4l2\" (UniqueName: \"kubernetes.io/projected/e083bea3-4653-43fa-bf3c-149f4c6b8203-kube-api-access-2n4l2\") pod \"cert-manager-webhook-6486ffd997-qmvmp\" (UID: \"e083bea3-4653-43fa-bf3c-149f4c6b8203\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qmvmp" Jul 10 18:05:38.165374 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.165284 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e083bea3-4653-43fa-bf3c-149f4c6b8203-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qmvmp\" (UID: \"e083bea3-4653-43fa-bf3c-149f4c6b8203\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qmvmp" Jul 10 18:05:38.177627 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.177602 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b"] Jul 10 18:05:38.177746 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.177696 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b" Jul 10 18:05:38.180084 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.180041 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 10 18:05:38.180293 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.180270 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 10 18:05:38.180428 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.180411 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w5dtj\"" Jul 10 18:05:38.265969 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.265944 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8761692-abe3-43b0-8647-10f713df75dc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b\" (UID: \"a8761692-abe3-43b0-8647-10f713df75dc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b" Jul 10 18:05:38.266366 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.265977 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n4l2\" (UniqueName: \"kubernetes.io/projected/e083bea3-4653-43fa-bf3c-149f4c6b8203-kube-api-access-2n4l2\") pod \"cert-manager-webhook-6486ffd997-qmvmp\" (UID: \"e083bea3-4653-43fa-bf3c-149f4c6b8203\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qmvmp" Jul 10 18:05:38.266366 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.266000 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7bvm\" (UniqueName: \"kubernetes.io/projected/a8761692-abe3-43b0-8647-10f713df75dc-kube-api-access-h7bvm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b\" (UID: \"a8761692-abe3-43b0-8647-10f713df75dc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b" Jul 10 18:05:38.266366 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.266066 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e083bea3-4653-43fa-bf3c-149f4c6b8203-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qmvmp\" (UID: \"e083bea3-4653-43fa-bf3c-149f4c6b8203\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qmvmp" Jul 10 18:05:38.266366 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.266096 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8761692-abe3-43b0-8647-10f713df75dc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b\" (UID: \"a8761692-abe3-43b0-8647-10f713df75dc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b" Jul 10 18:05:38.273481 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.273460 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n4l2\" (UniqueName: \"kubernetes.io/projected/e083bea3-4653-43fa-bf3c-149f4c6b8203-kube-api-access-2n4l2\") pod \"cert-manager-webhook-6486ffd997-qmvmp\" (UID: \"e083bea3-4653-43fa-bf3c-149f4c6b8203\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qmvmp" Jul 10 18:05:38.274027 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.274000 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e083bea3-4653-43fa-bf3c-149f4c6b8203-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qmvmp\" (UID: \"e083bea3-4653-43fa-bf3c-149f4c6b8203\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qmvmp" Jul 10 18:05:38.367297 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.367224 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8761692-abe3-43b0-8647-10f713df75dc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b\" (UID: \"a8761692-abe3-43b0-8647-10f713df75dc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b" Jul 10 18:05:38.367297 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.367291 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8761692-abe3-43b0-8647-10f713df75dc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b\" (UID: \"a8761692-abe3-43b0-8647-10f713df75dc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b" Jul 10 18:05:38.367494 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.367331 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7bvm\" (UniqueName: \"kubernetes.io/projected/a8761692-abe3-43b0-8647-10f713df75dc-kube-api-access-h7bvm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b\" (UID: \"a8761692-abe3-43b0-8647-10f713df75dc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b" Jul 10 18:05:38.367604 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.367586 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8761692-abe3-43b0-8647-10f713df75dc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b\" (UID: \"a8761692-abe3-43b0-8647-10f713df75dc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b" Jul 10 18:05:38.367678 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.367634 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8761692-abe3-43b0-8647-10f713df75dc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b\" (UID: \"a8761692-abe3-43b0-8647-10f713df75dc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b" Jul 10 18:05:38.375337 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.375317 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7bvm\" (UniqueName: \"kubernetes.io/projected/a8761692-abe3-43b0-8647-10f713df75dc-kube-api-access-h7bvm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b\" (UID: \"a8761692-abe3-43b0-8647-10f713df75dc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b" Jul 10 18:05:38.382131 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.382106 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qmvmp" Jul 10 18:05:38.487319 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.487292 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b" Jul 10 18:05:38.528896 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.528871 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qmvmp"] Jul 10 18:05:38.533678 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:05:38.533651 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode083bea3_4653_43fa_bf3c_149f4c6b8203.slice/crio-df611a620392d5dd106bcce07c27dcbc0769258a4ebf93e1380f73f4cd416c1d WatchSource:0}: Error finding container df611a620392d5dd106bcce07c27dcbc0769258a4ebf93e1380f73f4cd416c1d: Status 404 returned error can't find the container with id df611a620392d5dd106bcce07c27dcbc0769258a4ebf93e1380f73f4cd416c1d Jul 10 18:05:38.635086 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:38.635060 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b"] Jul 10 18:05:38.637118 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:05:38.637085 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8761692_abe3_43b0_8647_10f713df75dc.slice/crio-d6ca84d0f48257a66f039da622bb8eb51e572e1706adfee4f43a844eb6710a92 WatchSource:0}: Error finding container d6ca84d0f48257a66f039da622bb8eb51e572e1706adfee4f43a844eb6710a92: Status 404 returned error can't find the container with id d6ca84d0f48257a66f039da622bb8eb51e572e1706adfee4f43a844eb6710a92 Jul 10 18:05:39.258943 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:39.258897 2579 generic.go:356] "Generic (PLEG): container finished" podID="a8761692-abe3-43b0-8647-10f713df75dc" containerID="9d51e9de1fee421e19f970008fa49759c73befdde6e134fc5b1bdd09d7ffe960" exitCode=0 Jul 10 18:05:39.259130 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:39.258986 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b" event={"ID":"a8761692-abe3-43b0-8647-10f713df75dc","Type":"ContainerDied","Data":"9d51e9de1fee421e19f970008fa49759c73befdde6e134fc5b1bdd09d7ffe960"} Jul 10 18:05:39.259130 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:39.259037 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b" event={"ID":"a8761692-abe3-43b0-8647-10f713df75dc","Type":"ContainerStarted","Data":"d6ca84d0f48257a66f039da622bb8eb51e572e1706adfee4f43a844eb6710a92"} Jul 10 18:05:39.260149 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:39.260120 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qmvmp" event={"ID":"e083bea3-4653-43fa-bf3c-149f4c6b8203","Type":"ContainerStarted","Data":"df611a620392d5dd106bcce07c27dcbc0769258a4ebf93e1380f73f4cd416c1d"} Jul 10 18:05:42.276194 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:42.276161 2579 generic.go:356] "Generic (PLEG): container finished" podID="a8761692-abe3-43b0-8647-10f713df75dc" containerID="08fb823bb71824ca7a0660ee1eae00b5fc60d67080c5ab0cf530a8ab0dd780f6" exitCode=0 Jul 10 18:05:42.276573 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:42.276224 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b" event={"ID":"a8761692-abe3-43b0-8647-10f713df75dc","Type":"ContainerDied","Data":"08fb823bb71824ca7a0660ee1eae00b5fc60d67080c5ab0cf530a8ab0dd780f6"} Jul 10 18:05:42.277790 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:42.277760 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qmvmp" event={"ID":"e083bea3-4653-43fa-bf3c-149f4c6b8203","Type":"ContainerStarted","Data":"db87b9426ae587cbec8959c4ad22e3b375a819d5e4985a2d213bbd32d0cbf0ae"} Jul 10 18:05:42.280067 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:42.278297 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qmvmp" Jul 10 18:05:42.307790 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:42.307719 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-qmvmp" podStartSLOduration=0.78743716 podStartE2EDuration="4.307705381s" totalImagesPullingTime="3.520268221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:05:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:05:42.307031068 +0000 UTC m=+374.147859349" watchObservedRunningTime="2026-07-10 18:05:42.307705381 +0000 UTC m=+374.148533635" Jul 10 18:05:43.284669 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:43.284628 2579 generic.go:356] "Generic (PLEG): container finished" podID="a8761692-abe3-43b0-8647-10f713df75dc" containerID="f37071ab283f78dfcf41a26c0f4fce6f31575257985f5088a25ea8368d87ac6f" exitCode=0 Jul 10 18:05:43.285145 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:43.284708 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b" event={"ID":"a8761692-abe3-43b0-8647-10f713df75dc","Type":"ContainerDied","Data":"f37071ab283f78dfcf41a26c0f4fce6f31575257985f5088a25ea8368d87ac6f"} Jul 10 18:05:44.307800 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:44.307768 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5l6f7"] Jul 10 18:05:44.310245 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:44.310225 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5l6f7" Jul 10 18:05:44.312705 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:44.312686 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7wdwx\"" Jul 10 18:05:44.319182 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:44.319157 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5l6f7"] Jul 10 18:05:44.412838 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:44.412815 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b" Jul 10 18:05:44.420377 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:44.420352 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xhdm\" (UniqueName: \"kubernetes.io/projected/8bb24f97-6783-4995-88fd-48e98e6a4327-kube-api-access-7xhdm\") pod \"cert-manager-cainjector-559cdd8c87-5l6f7\" (UID: \"8bb24f97-6783-4995-88fd-48e98e6a4327\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5l6f7" Jul 10 18:05:44.420488 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:44.420404 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8bb24f97-6783-4995-88fd-48e98e6a4327-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5l6f7\" (UID: \"8bb24f97-6783-4995-88fd-48e98e6a4327\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5l6f7" Jul 10 18:05:44.521403 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:44.521358 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8761692-abe3-43b0-8647-10f713df75dc-util\") pod \"a8761692-abe3-43b0-8647-10f713df75dc\" (UID: \"a8761692-abe3-43b0-8647-10f713df75dc\") " Jul 10 18:05:44.521578 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:44.521427 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8761692-abe3-43b0-8647-10f713df75dc-bundle\") pod \"a8761692-abe3-43b0-8647-10f713df75dc\" (UID: \"a8761692-abe3-43b0-8647-10f713df75dc\") " Jul 10 18:05:44.521578 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:44.521460 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7bvm\" (UniqueName: \"kubernetes.io/projected/a8761692-abe3-43b0-8647-10f713df75dc-kube-api-access-h7bvm\") pod \"a8761692-abe3-43b0-8647-10f713df75dc\" (UID: \"a8761692-abe3-43b0-8647-10f713df75dc\") " Jul 10 18:05:44.521578 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:44.521540 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8bb24f97-6783-4995-88fd-48e98e6a4327-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5l6f7\" (UID: \"8bb24f97-6783-4995-88fd-48e98e6a4327\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5l6f7" Jul 10 18:05:44.521769 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:44.521598 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xhdm\" (UniqueName: \"kubernetes.io/projected/8bb24f97-6783-4995-88fd-48e98e6a4327-kube-api-access-7xhdm\") pod \"cert-manager-cainjector-559cdd8c87-5l6f7\" (UID: \"8bb24f97-6783-4995-88fd-48e98e6a4327\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5l6f7" Jul 10 18:05:44.521928 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:44.521903 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8761692-abe3-43b0-8647-10f713df75dc-bundle" (OuterVolumeSpecName: "bundle") pod "a8761692-abe3-43b0-8647-10f713df75dc" (UID: "a8761692-abe3-43b0-8647-10f713df75dc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:05:44.523713 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:44.523684 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8761692-abe3-43b0-8647-10f713df75dc-kube-api-access-h7bvm" (OuterVolumeSpecName: "kube-api-access-h7bvm") pod "a8761692-abe3-43b0-8647-10f713df75dc" (UID: "a8761692-abe3-43b0-8647-10f713df75dc"). InnerVolumeSpecName "kube-api-access-h7bvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:05:44.525496 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:44.525474 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8761692-abe3-43b0-8647-10f713df75dc-util" (OuterVolumeSpecName: "util") pod "a8761692-abe3-43b0-8647-10f713df75dc" (UID: "a8761692-abe3-43b0-8647-10f713df75dc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:05:44.529498 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:44.529470 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8bb24f97-6783-4995-88fd-48e98e6a4327-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5l6f7\" (UID: \"8bb24f97-6783-4995-88fd-48e98e6a4327\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5l6f7" Jul 10 18:05:44.529608 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:44.529593 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xhdm\" (UniqueName: \"kubernetes.io/projected/8bb24f97-6783-4995-88fd-48e98e6a4327-kube-api-access-7xhdm\") pod \"cert-manager-cainjector-559cdd8c87-5l6f7\" (UID: \"8bb24f97-6783-4995-88fd-48e98e6a4327\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5l6f7" Jul 10 18:05:44.620571 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:44.620532 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5l6f7" Jul 10 18:05:44.622240 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:44.622216 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8761692-abe3-43b0-8647-10f713df75dc-util\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:05:44.622317 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:44.622245 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8761692-abe3-43b0-8647-10f713df75dc-bundle\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:05:44.622317 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:44.622259 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7bvm\" (UniqueName: \"kubernetes.io/projected/a8761692-abe3-43b0-8647-10f713df75dc-kube-api-access-h7bvm\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:05:44.745655 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:44.745630 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5l6f7"] Jul 10 18:05:44.747606 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:05:44.747578 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8bb24f97_6783_4995_88fd_48e98e6a4327.slice/crio-4a15b3dfb019174e3758c08d1c61ad445c1fe4aeb5d5fc7815bf0ad46f035ac5 WatchSource:0}: Error finding container 4a15b3dfb019174e3758c08d1c61ad445c1fe4aeb5d5fc7815bf0ad46f035ac5: Status 404 returned error can't find the container with id 4a15b3dfb019174e3758c08d1c61ad445c1fe4aeb5d5fc7815bf0ad46f035ac5 Jul 10 18:05:45.294813 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:45.294780 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5l6f7" event={"ID":"8bb24f97-6783-4995-88fd-48e98e6a4327","Type":"ContainerStarted","Data":"cf75e3c8f63b40baca22818ef58e3a447e026f7a9eb25fe8fd41c2317e79a142"} Jul 10 18:05:45.295006 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:45.294826 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5l6f7" event={"ID":"8bb24f97-6783-4995-88fd-48e98e6a4327","Type":"ContainerStarted","Data":"4a15b3dfb019174e3758c08d1c61ad445c1fe4aeb5d5fc7815bf0ad46f035ac5"} Jul 10 18:05:45.296616 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:45.296591 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b" event={"ID":"a8761692-abe3-43b0-8647-10f713df75dc","Type":"ContainerDied","Data":"d6ca84d0f48257a66f039da622bb8eb51e572e1706adfee4f43a844eb6710a92"} Jul 10 18:05:45.296741 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:45.296621 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfq4b" Jul 10 18:05:45.296741 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:45.296627 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6ca84d0f48257a66f039da622bb8eb51e572e1706adfee4f43a844eb6710a92" Jul 10 18:05:45.311865 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:45.311795 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5l6f7" podStartSLOduration=1.311783638 podStartE2EDuration="1.311783638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:05:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:05:45.309931301 +0000 UTC m=+377.150759557" watchObservedRunningTime="2026-07-10 18:05:45.311783638 +0000 UTC m=+377.152611891" Jul 10 18:05:48.286727 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:48.286696 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qmvmp" Jul 10 18:05:49.175540 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:49.175498 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c9ld5"] Jul 10 18:05:49.175923 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:49.175905 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8761692-abe3-43b0-8647-10f713df75dc" containerName="pull" Jul 10 18:05:49.176020 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:49.175925 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8761692-abe3-43b0-8647-10f713df75dc" containerName="pull" Jul 10 18:05:49.176020 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:49.175956 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8761692-abe3-43b0-8647-10f713df75dc" containerName="extract" Jul 10 18:05:49.176020 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:49.175965 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8761692-abe3-43b0-8647-10f713df75dc" containerName="extract" Jul 10 18:05:49.176020 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:49.175985 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8761692-abe3-43b0-8647-10f713df75dc" containerName="util" Jul 10 18:05:49.176020 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:49.175993 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8761692-abe3-43b0-8647-10f713df75dc" containerName="util" Jul 10 18:05:49.176256 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:49.176069 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8761692-abe3-43b0-8647-10f713df75dc" containerName="extract" Jul 10 18:05:49.178062 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:49.178041 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-c9ld5" Jul 10 18:05:49.180413 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:49.180395 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-dsv9s\"" Jul 10 18:05:49.186383 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:49.186360 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c9ld5"] Jul 10 18:05:49.265818 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:49.265789 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfdfn\" (UniqueName: \"kubernetes.io/projected/6b66045e-da33-40c8-9f2b-6bbaedba066e-kube-api-access-rfdfn\") pod \"cert-manager-55b4d954d5-c9ld5\" (UID: \"6b66045e-da33-40c8-9f2b-6bbaedba066e\") " pod="cert-manager/cert-manager-55b4d954d5-c9ld5" Jul 10 18:05:49.265957 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:49.265889 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b66045e-da33-40c8-9f2b-6bbaedba066e-bound-sa-token\") pod \"cert-manager-55b4d954d5-c9ld5\" (UID: \"6b66045e-da33-40c8-9f2b-6bbaedba066e\") " pod="cert-manager/cert-manager-55b4d954d5-c9ld5" Jul 10 18:05:49.366686 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:49.366658 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b66045e-da33-40c8-9f2b-6bbaedba066e-bound-sa-token\") pod \"cert-manager-55b4d954d5-c9ld5\" (UID: \"6b66045e-da33-40c8-9f2b-6bbaedba066e\") " pod="cert-manager/cert-manager-55b4d954d5-c9ld5" Jul 10 18:05:49.367065 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:49.366693 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfdfn\" (UniqueName: \"kubernetes.io/projected/6b66045e-da33-40c8-9f2b-6bbaedba066e-kube-api-access-rfdfn\") pod \"cert-manager-55b4d954d5-c9ld5\" (UID: \"6b66045e-da33-40c8-9f2b-6bbaedba066e\") " pod="cert-manager/cert-manager-55b4d954d5-c9ld5" Jul 10 18:05:49.374881 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:49.374839 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b66045e-da33-40c8-9f2b-6bbaedba066e-bound-sa-token\") pod \"cert-manager-55b4d954d5-c9ld5\" (UID: \"6b66045e-da33-40c8-9f2b-6bbaedba066e\") " pod="cert-manager/cert-manager-55b4d954d5-c9ld5" Jul 10 18:05:49.374979 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:49.374960 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfdfn\" (UniqueName: \"kubernetes.io/projected/6b66045e-da33-40c8-9f2b-6bbaedba066e-kube-api-access-rfdfn\") pod \"cert-manager-55b4d954d5-c9ld5\" (UID: \"6b66045e-da33-40c8-9f2b-6bbaedba066e\") " pod="cert-manager/cert-manager-55b4d954d5-c9ld5" Jul 10 18:05:49.488131 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:49.488059 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-c9ld5" Jul 10 18:05:49.613160 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:49.613011 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c9ld5"] Jul 10 18:05:49.615767 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:05:49.615736 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b66045e_da33_40c8_9f2b_6bbaedba066e.slice/crio-b0764ced0c2cea01af444fc6afe58b4c983903dc1529f25c6592cf97aa159067 WatchSource:0}: Error finding container b0764ced0c2cea01af444fc6afe58b4c983903dc1529f25c6592cf97aa159067: Status 404 returned error can't find the container with id b0764ced0c2cea01af444fc6afe58b4c983903dc1529f25c6592cf97aa159067 Jul 10 18:05:50.323950 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:50.323915 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-c9ld5" event={"ID":"6b66045e-da33-40c8-9f2b-6bbaedba066e","Type":"ContainerStarted","Data":"518db9af4b3e62a8ff6c0b5bb33a18cc0507d942e931d201511f598808b0424f"} Jul 10 18:05:50.323950 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:50.323954 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-c9ld5" event={"ID":"6b66045e-da33-40c8-9f2b-6bbaedba066e","Type":"ContainerStarted","Data":"b0764ced0c2cea01af444fc6afe58b4c983903dc1529f25c6592cf97aa159067"} Jul 10 18:05:50.341332 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:50.341287 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-c9ld5" podStartSLOduration=1.341274343 podStartE2EDuration="1.341274343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:05:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:05:50.339422363 +0000 UTC m=+382.180250618" watchObservedRunningTime="2026-07-10 18:05:50.341274343 +0000 UTC m=+382.182102599" Jul 10 18:05:58.923895 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:58.923843 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw"] Jul 10 18:05:58.926263 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:58.926247 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw" Jul 10 18:05:58.929046 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:58.929024 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 10 18:05:58.929166 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:58.929047 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w5dtj\"" Jul 10 18:05:58.929166 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:58.929152 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 10 18:05:58.940341 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:58.940313 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw"] Jul 10 18:05:59.041578 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:59.041553 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21d1bfe2-3611-47a0-ae5b-90f7650ad99c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw\" (UID: \"21d1bfe2-3611-47a0-ae5b-90f7650ad99c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw" Jul 10 18:05:59.041691 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:59.041585 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21d1bfe2-3611-47a0-ae5b-90f7650ad99c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw\" (UID: \"21d1bfe2-3611-47a0-ae5b-90f7650ad99c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw" Jul 10 18:05:59.041732 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:59.041701 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p24bs\" (UniqueName: \"kubernetes.io/projected/21d1bfe2-3611-47a0-ae5b-90f7650ad99c-kube-api-access-p24bs\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw\" (UID: \"21d1bfe2-3611-47a0-ae5b-90f7650ad99c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw" Jul 10 18:05:59.142051 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:59.142021 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p24bs\" (UniqueName: \"kubernetes.io/projected/21d1bfe2-3611-47a0-ae5b-90f7650ad99c-kube-api-access-p24bs\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw\" (UID: \"21d1bfe2-3611-47a0-ae5b-90f7650ad99c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw" Jul 10 18:05:59.142157 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:59.142059 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21d1bfe2-3611-47a0-ae5b-90f7650ad99c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw\" (UID: \"21d1bfe2-3611-47a0-ae5b-90f7650ad99c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw" Jul 10 18:05:59.142157 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:59.142083 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21d1bfe2-3611-47a0-ae5b-90f7650ad99c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw\" (UID: \"21d1bfe2-3611-47a0-ae5b-90f7650ad99c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw" Jul 10 18:05:59.142392 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:59.142374 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21d1bfe2-3611-47a0-ae5b-90f7650ad99c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw\" (UID: \"21d1bfe2-3611-47a0-ae5b-90f7650ad99c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw" Jul 10 18:05:59.142453 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:59.142438 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21d1bfe2-3611-47a0-ae5b-90f7650ad99c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw\" (UID: \"21d1bfe2-3611-47a0-ae5b-90f7650ad99c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw" Jul 10 18:05:59.150387 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:59.150361 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p24bs\" (UniqueName: \"kubernetes.io/projected/21d1bfe2-3611-47a0-ae5b-90f7650ad99c-kube-api-access-p24bs\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw\" (UID: \"21d1bfe2-3611-47a0-ae5b-90f7650ad99c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw" Jul 10 18:05:59.242245 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:59.242188 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw" Jul 10 18:05:59.367472 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:05:59.367442 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw"] Jul 10 18:05:59.370192 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:05:59.370158 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21d1bfe2_3611_47a0_ae5b_90f7650ad99c.slice/crio-3d5052930d7d2515890fe724461f7075c381ebdc1d4f3bd060c6c5689d2bf0dc WatchSource:0}: Error finding container 3d5052930d7d2515890fe724461f7075c381ebdc1d4f3bd060c6c5689d2bf0dc: Status 404 returned error can't find the container with id 3d5052930d7d2515890fe724461f7075c381ebdc1d4f3bd060c6c5689d2bf0dc Jul 10 18:06:00.369786 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:00.369748 2579 generic.go:356] "Generic (PLEG): container finished" podID="21d1bfe2-3611-47a0-ae5b-90f7650ad99c" containerID="919b887c8ac61eeb61c510b691237b55d378859c4af9d38e4b1cabe9f1a008ee" exitCode=0 Jul 10 18:06:00.370183 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:00.369804 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw" event={"ID":"21d1bfe2-3611-47a0-ae5b-90f7650ad99c","Type":"ContainerDied","Data":"919b887c8ac61eeb61c510b691237b55d378859c4af9d38e4b1cabe9f1a008ee"} Jul 10 18:06:00.370183 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:00.369888 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw" event={"ID":"21d1bfe2-3611-47a0-ae5b-90f7650ad99c","Type":"ContainerStarted","Data":"3d5052930d7d2515890fe724461f7075c381ebdc1d4f3bd060c6c5689d2bf0dc"} Jul 10 18:06:01.377192 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:01.377156 2579 generic.go:356] "Generic (PLEG): container finished" podID="21d1bfe2-3611-47a0-ae5b-90f7650ad99c" containerID="0d29f8a7d97c13b7ac9ce5d7749eab4518101805f958265416240643c8a13bc6" exitCode=0 Jul 10 18:06:01.377609 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:01.377243 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw" event={"ID":"21d1bfe2-3611-47a0-ae5b-90f7650ad99c","Type":"ContainerDied","Data":"0d29f8a7d97c13b7ac9ce5d7749eab4518101805f958265416240643c8a13bc6"} Jul 10 18:06:02.383697 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:02.383663 2579 generic.go:356] "Generic (PLEG): container finished" podID="21d1bfe2-3611-47a0-ae5b-90f7650ad99c" containerID="90dd773356e3d673b8fb2b686bcfa9873d7b3d0052a0744a421678e813248696" exitCode=0 Jul 10 18:06:02.384083 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:02.383736 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw" event={"ID":"21d1bfe2-3611-47a0-ae5b-90f7650ad99c","Type":"ContainerDied","Data":"90dd773356e3d673b8fb2b686bcfa9873d7b3d0052a0744a421678e813248696"} Jul 10 18:06:03.510956 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:03.510931 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw" Jul 10 18:06:03.577691 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:03.577655 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p24bs\" (UniqueName: \"kubernetes.io/projected/21d1bfe2-3611-47a0-ae5b-90f7650ad99c-kube-api-access-p24bs\") pod \"21d1bfe2-3611-47a0-ae5b-90f7650ad99c\" (UID: \"21d1bfe2-3611-47a0-ae5b-90f7650ad99c\") " Jul 10 18:06:03.577899 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:03.577707 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21d1bfe2-3611-47a0-ae5b-90f7650ad99c-util\") pod \"21d1bfe2-3611-47a0-ae5b-90f7650ad99c\" (UID: \"21d1bfe2-3611-47a0-ae5b-90f7650ad99c\") " Jul 10 18:06:03.577899 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:03.577753 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21d1bfe2-3611-47a0-ae5b-90f7650ad99c-bundle\") pod \"21d1bfe2-3611-47a0-ae5b-90f7650ad99c\" (UID: \"21d1bfe2-3611-47a0-ae5b-90f7650ad99c\") " Jul 10 18:06:03.578512 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:03.578490 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21d1bfe2-3611-47a0-ae5b-90f7650ad99c-bundle" (OuterVolumeSpecName: "bundle") pod "21d1bfe2-3611-47a0-ae5b-90f7650ad99c" (UID: "21d1bfe2-3611-47a0-ae5b-90f7650ad99c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:06:03.579687 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:03.579664 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21d1bfe2-3611-47a0-ae5b-90f7650ad99c-kube-api-access-p24bs" (OuterVolumeSpecName: "kube-api-access-p24bs") pod "21d1bfe2-3611-47a0-ae5b-90f7650ad99c" (UID: "21d1bfe2-3611-47a0-ae5b-90f7650ad99c"). InnerVolumeSpecName "kube-api-access-p24bs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:06:03.583092 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:03.583069 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21d1bfe2-3611-47a0-ae5b-90f7650ad99c-util" (OuterVolumeSpecName: "util") pod "21d1bfe2-3611-47a0-ae5b-90f7650ad99c" (UID: "21d1bfe2-3611-47a0-ae5b-90f7650ad99c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:06:03.678938 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:03.678836 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p24bs\" (UniqueName: \"kubernetes.io/projected/21d1bfe2-3611-47a0-ae5b-90f7650ad99c-kube-api-access-p24bs\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:06:03.678938 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:03.678884 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21d1bfe2-3611-47a0-ae5b-90f7650ad99c-util\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:06:03.678938 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:03.678894 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21d1bfe2-3611-47a0-ae5b-90f7650ad99c-bundle\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:06:04.393943 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:04.393908 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw" event={"ID":"21d1bfe2-3611-47a0-ae5b-90f7650ad99c","Type":"ContainerDied","Data":"3d5052930d7d2515890fe724461f7075c381ebdc1d4f3bd060c6c5689d2bf0dc"} Jul 10 18:06:04.393943 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:04.393943 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn6chw" Jul 10 18:06:04.394139 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:04.393954 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d5052930d7d2515890fe724461f7075c381ebdc1d4f3bd060c6c5689d2bf0dc" Jul 10 18:06:10.817888 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:10.817841 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x"] Jul 10 18:06:10.818248 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:10.818202 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21d1bfe2-3611-47a0-ae5b-90f7650ad99c" containerName="util" Jul 10 18:06:10.818248 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:10.818213 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="21d1bfe2-3611-47a0-ae5b-90f7650ad99c" containerName="util" Jul 10 18:06:10.818248 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:10.818238 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21d1bfe2-3611-47a0-ae5b-90f7650ad99c" containerName="extract" Jul 10 18:06:10.818248 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:10.818244 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="21d1bfe2-3611-47a0-ae5b-90f7650ad99c" containerName="extract" Jul 10 18:06:10.818377 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:10.818258 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21d1bfe2-3611-47a0-ae5b-90f7650ad99c" containerName="pull" Jul 10 18:06:10.818377 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:10.818264 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="21d1bfe2-3611-47a0-ae5b-90f7650ad99c" containerName="pull" Jul 10 18:06:10.818377 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:10.818329 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="21d1bfe2-3611-47a0-ae5b-90f7650ad99c" containerName="extract" Jul 10 18:06:10.825509 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:10.825490 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" Jul 10 18:06:10.829789 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:10.829761 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 10 18:06:10.829789 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:10.829780 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 10 18:06:10.829989 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:10.829846 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8cfxm\"" Jul 10 18:06:10.829989 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:10.829878 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 10 18:06:10.830184 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:10.830165 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 10 18:06:10.835874 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:10.835840 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x"] Jul 10 18:06:10.937822 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:10.937781 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a7996f9b-d966-491e-821d-5dd96cd11d23-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-8sn5x\" (UID: \"a7996f9b-d966-491e-821d-5dd96cd11d23\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" Jul 10 18:06:10.937822 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:10.937825 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7996f9b-d966-491e-821d-5dd96cd11d23-tmp\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-8sn5x\" (UID: \"a7996f9b-d966-491e-821d-5dd96cd11d23\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" Jul 10 18:06:10.938073 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:10.937872 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97qgz\" (UniqueName: \"kubernetes.io/projected/a7996f9b-d966-491e-821d-5dd96cd11d23-kube-api-access-97qgz\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-8sn5x\" (UID: \"a7996f9b-d966-491e-821d-5dd96cd11d23\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" Jul 10 18:06:10.938073 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:10.937934 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7996f9b-d966-491e-821d-5dd96cd11d23-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-8sn5x\" (UID: \"a7996f9b-d966-491e-821d-5dd96cd11d23\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" Jul 10 18:06:10.938073 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:10.937988 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a7996f9b-d966-491e-821d-5dd96cd11d23-manifests\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-8sn5x\" (UID: \"a7996f9b-d966-491e-821d-5dd96cd11d23\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" Jul 10 18:06:11.038957 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:11.038921 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7996f9b-d966-491e-821d-5dd96cd11d23-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-8sn5x\" (UID: \"a7996f9b-d966-491e-821d-5dd96cd11d23\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" Jul 10 18:06:11.039140 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:11.038974 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a7996f9b-d966-491e-821d-5dd96cd11d23-manifests\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-8sn5x\" (UID: \"a7996f9b-d966-491e-821d-5dd96cd11d23\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" Jul 10 18:06:11.039140 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:11.039038 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a7996f9b-d966-491e-821d-5dd96cd11d23-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-8sn5x\" (UID: \"a7996f9b-d966-491e-821d-5dd96cd11d23\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" Jul 10 18:06:11.039140 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:11.039064 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7996f9b-d966-491e-821d-5dd96cd11d23-tmp\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-8sn5x\" (UID: \"a7996f9b-d966-491e-821d-5dd96cd11d23\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" Jul 10 18:06:11.039140 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:11.039087 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97qgz\" (UniqueName: \"kubernetes.io/projected/a7996f9b-d966-491e-821d-5dd96cd11d23-kube-api-access-97qgz\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-8sn5x\" (UID: \"a7996f9b-d966-491e-821d-5dd96cd11d23\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" Jul 10 18:06:11.039495 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:11.039464 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a7996f9b-d966-491e-821d-5dd96cd11d23-manifests\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-8sn5x\" (UID: \"a7996f9b-d966-491e-821d-5dd96cd11d23\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" Jul 10 18:06:11.041347 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:11.041321 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7996f9b-d966-491e-821d-5dd96cd11d23-tmp\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-8sn5x\" (UID: \"a7996f9b-d966-491e-821d-5dd96cd11d23\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" Jul 10 18:06:11.041443 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:11.041427 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a7996f9b-d966-491e-821d-5dd96cd11d23-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-8sn5x\" (UID: \"a7996f9b-d966-491e-821d-5dd96cd11d23\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" Jul 10 18:06:11.041568 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:11.041548 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7996f9b-d966-491e-821d-5dd96cd11d23-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-8sn5x\" (UID: \"a7996f9b-d966-491e-821d-5dd96cd11d23\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" Jul 10 18:06:11.046657 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:11.046635 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97qgz\" (UniqueName: \"kubernetes.io/projected/a7996f9b-d966-491e-821d-5dd96cd11d23-kube-api-access-97qgz\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-8sn5x\" (UID: \"a7996f9b-d966-491e-821d-5dd96cd11d23\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" Jul 10 18:06:11.137024 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:11.136952 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" Jul 10 18:06:11.293384 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:11.293348 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x"] Jul 10 18:06:11.297059 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:06:11.297034 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7996f9b_d966_491e_821d_5dd96cd11d23.slice/crio-aa76d4479fb0c494e22e3e6ebbdd73a8c60cd0bdbe3c11db16ef80a894f18e8d WatchSource:0}: Error finding container aa76d4479fb0c494e22e3e6ebbdd73a8c60cd0bdbe3c11db16ef80a894f18e8d: Status 404 returned error can't find the container with id aa76d4479fb0c494e22e3e6ebbdd73a8c60cd0bdbe3c11db16ef80a894f18e8d Jul 10 18:06:11.427972 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:11.427880 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" event={"ID":"a7996f9b-d966-491e-821d-5dd96cd11d23","Type":"ContainerStarted","Data":"aa76d4479fb0c494e22e3e6ebbdd73a8c60cd0bdbe3c11db16ef80a894f18e8d"} Jul 10 18:06:15.452016 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:15.451978 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" event={"ID":"a7996f9b-d966-491e-821d-5dd96cd11d23","Type":"ContainerStarted","Data":"e22f7c86ae8a31c7e957795d4c8fa5bf69b878c9952f74d304751d815455979b"} Jul 10 18:06:16.458410 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:16.458369 2579 generic.go:356] "Generic (PLEG): container finished" podID="a7996f9b-d966-491e-821d-5dd96cd11d23" containerID="e22f7c86ae8a31c7e957795d4c8fa5bf69b878c9952f74d304751d815455979b" exitCode=0 Jul 10 18:06:16.458834 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:16.458464 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" event={"ID":"a7996f9b-d966-491e-821d-5dd96cd11d23","Type":"ContainerDied","Data":"e22f7c86ae8a31c7e957795d4c8fa5bf69b878c9952f74d304751d815455979b"} Jul 10 18:06:17.465462 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:17.465423 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" event={"ID":"a7996f9b-d966-491e-821d-5dd96cd11d23","Type":"ContainerStarted","Data":"6679805caa16436d948babfaff3dc0322a029fde97b09bb4e1f82d4103ea6570"} Jul 10 18:06:17.465949 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:17.465564 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" Jul 10 18:06:17.490623 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:17.490584 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" podStartSLOduration=2.891681361 podStartE2EDuration="7.490570237s" totalImagesPullingTime="3.55722217s" totalInitContainerRuntime="1.041666706s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:06:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:06:17.489109454 +0000 UTC m=+409.329937711" watchObservedRunningTime="2026-07-10 18:06:17.490570237 +0000 UTC m=+409.331398490" Jul 10 18:06:28.473408 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:28.473376 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-8sn5x" Jul 10 18:06:29.817152 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:29.817118 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d79ff4f99-mcs64"] Jul 10 18:06:29.821935 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:29.821915 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d79ff4f99-mcs64" Jul 10 18:06:29.825679 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:29.825655 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 10 18:06:29.825794 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:29.825710 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 10 18:06:29.825794 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:29.825783 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 10 18:06:29.825936 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:29.825711 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 10 18:06:29.825936 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:29.825667 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:06:29.825936 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:29.825821 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hljzz\"" Jul 10 18:06:29.835268 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:29.835246 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d79ff4f99-mcs64"] Jul 10 18:06:29.905425 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:29.905388 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ce6cbed-6ea6-4c6a-9604-5e279b73140e-cert\") pod \"lws-controller-manager-6d79ff4f99-mcs64\" (UID: \"2ce6cbed-6ea6-4c6a-9604-5e279b73140e\") " pod="openshift-lws-operator/lws-controller-manager-6d79ff4f99-mcs64" Jul 10 18:06:29.905609 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:29.905428 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2ce6cbed-6ea6-4c6a-9604-5e279b73140e-manager-config\") pod \"lws-controller-manager-6d79ff4f99-mcs64\" (UID: \"2ce6cbed-6ea6-4c6a-9604-5e279b73140e\") " pod="openshift-lws-operator/lws-controller-manager-6d79ff4f99-mcs64" Jul 10 18:06:29.905609 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:29.905461 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ce6cbed-6ea6-4c6a-9604-5e279b73140e-metrics-cert\") pod \"lws-controller-manager-6d79ff4f99-mcs64\" (UID: \"2ce6cbed-6ea6-4c6a-9604-5e279b73140e\") " pod="openshift-lws-operator/lws-controller-manager-6d79ff4f99-mcs64" Jul 10 18:06:29.905609 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:29.905568 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64kfz\" (UniqueName: \"kubernetes.io/projected/2ce6cbed-6ea6-4c6a-9604-5e279b73140e-kube-api-access-64kfz\") pod \"lws-controller-manager-6d79ff4f99-mcs64\" (UID: \"2ce6cbed-6ea6-4c6a-9604-5e279b73140e\") " pod="openshift-lws-operator/lws-controller-manager-6d79ff4f99-mcs64" Jul 10 18:06:30.006166 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:30.006128 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2ce6cbed-6ea6-4c6a-9604-5e279b73140e-manager-config\") pod \"lws-controller-manager-6d79ff4f99-mcs64\" (UID: \"2ce6cbed-6ea6-4c6a-9604-5e279b73140e\") " pod="openshift-lws-operator/lws-controller-manager-6d79ff4f99-mcs64" Jul 10 18:06:30.006166 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:30.006162 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ce6cbed-6ea6-4c6a-9604-5e279b73140e-metrics-cert\") pod \"lws-controller-manager-6d79ff4f99-mcs64\" (UID: \"2ce6cbed-6ea6-4c6a-9604-5e279b73140e\") " pod="openshift-lws-operator/lws-controller-manager-6d79ff4f99-mcs64" Jul 10 18:06:30.006381 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:30.006304 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64kfz\" (UniqueName: \"kubernetes.io/projected/2ce6cbed-6ea6-4c6a-9604-5e279b73140e-kube-api-access-64kfz\") pod \"lws-controller-manager-6d79ff4f99-mcs64\" (UID: \"2ce6cbed-6ea6-4c6a-9604-5e279b73140e\") " pod="openshift-lws-operator/lws-controller-manager-6d79ff4f99-mcs64" Jul 10 18:06:30.006449 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:30.006430 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ce6cbed-6ea6-4c6a-9604-5e279b73140e-cert\") pod \"lws-controller-manager-6d79ff4f99-mcs64\" (UID: \"2ce6cbed-6ea6-4c6a-9604-5e279b73140e\") " pod="openshift-lws-operator/lws-controller-manager-6d79ff4f99-mcs64" Jul 10 18:06:30.006748 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:30.006724 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2ce6cbed-6ea6-4c6a-9604-5e279b73140e-manager-config\") pod \"lws-controller-manager-6d79ff4f99-mcs64\" (UID: \"2ce6cbed-6ea6-4c6a-9604-5e279b73140e\") " pod="openshift-lws-operator/lws-controller-manager-6d79ff4f99-mcs64" Jul 10 18:06:30.008687 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:30.008664 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ce6cbed-6ea6-4c6a-9604-5e279b73140e-metrics-cert\") pod \"lws-controller-manager-6d79ff4f99-mcs64\" (UID: \"2ce6cbed-6ea6-4c6a-9604-5e279b73140e\") " pod="openshift-lws-operator/lws-controller-manager-6d79ff4f99-mcs64" Jul 10 18:06:30.008809 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:30.008750 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ce6cbed-6ea6-4c6a-9604-5e279b73140e-cert\") pod \"lws-controller-manager-6d79ff4f99-mcs64\" (UID: \"2ce6cbed-6ea6-4c6a-9604-5e279b73140e\") " pod="openshift-lws-operator/lws-controller-manager-6d79ff4f99-mcs64" Jul 10 18:06:30.032159 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:30.032129 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64kfz\" (UniqueName: \"kubernetes.io/projected/2ce6cbed-6ea6-4c6a-9604-5e279b73140e-kube-api-access-64kfz\") pod \"lws-controller-manager-6d79ff4f99-mcs64\" (UID: \"2ce6cbed-6ea6-4c6a-9604-5e279b73140e\") " pod="openshift-lws-operator/lws-controller-manager-6d79ff4f99-mcs64" Jul 10 18:06:30.131275 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:30.131195 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d79ff4f99-mcs64" Jul 10 18:06:30.279496 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:30.279456 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d79ff4f99-mcs64"] Jul 10 18:06:30.284509 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:06:30.284479 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce6cbed_6ea6_4c6a_9604_5e279b73140e.slice/crio-31f6facb7582b6db6486040c0dbe29d47a6798d9d4b78daa2e04785406957444 WatchSource:0}: Error finding container 31f6facb7582b6db6486040c0dbe29d47a6798d9d4b78daa2e04785406957444: Status 404 returned error can't find the container with id 31f6facb7582b6db6486040c0dbe29d47a6798d9d4b78daa2e04785406957444 Jul 10 18:06:30.532289 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:30.532202 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d79ff4f99-mcs64" event={"ID":"2ce6cbed-6ea6-4c6a-9604-5e279b73140e","Type":"ContainerStarted","Data":"31f6facb7582b6db6486040c0dbe29d47a6798d9d4b78daa2e04785406957444"} Jul 10 18:06:32.544019 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:32.543976 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d79ff4f99-mcs64" event={"ID":"2ce6cbed-6ea6-4c6a-9604-5e279b73140e","Type":"ContainerStarted","Data":"cc6f3f331c00273135d3b60fed5239e36c505587eaf62fb3be215a646652f1a4"} Jul 10 18:06:32.544431 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:32.544089 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6d79ff4f99-mcs64" Jul 10 18:06:32.565154 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:32.565105 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6d79ff4f99-mcs64" podStartSLOduration=1.899599695 podStartE2EDuration="3.565089555s" totalImagesPullingTime="1.66548986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:06:32.562811931 +0000 UTC m=+424.403640185" watchObservedRunningTime="2026-07-10 18:06:32.565089555 +0000 UTC m=+424.405917808" Jul 10 18:06:33.223956 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:33.223917 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-92zwc"] Jul 10 18:06:33.228650 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:33.228627 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-92zwc" Jul 10 18:06:33.231151 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:33.231124 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 10 18:06:33.239737 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:33.239706 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-92zwc"] Jul 10 18:06:33.338938 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:33.338899 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdbgr\" (UniqueName: \"kubernetes.io/projected/e0b12bf0-69de-424d-89bd-a20b52e11fc7-kube-api-access-kdbgr\") pod \"model-serving-api-54d89bd5fc-92zwc\" (UID: \"e0b12bf0-69de-424d-89bd-a20b52e11fc7\") " pod="opendatahub/model-serving-api-54d89bd5fc-92zwc" Jul 10 18:06:33.339111 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:33.338966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0b12bf0-69de-424d-89bd-a20b52e11fc7-tls-certs\") pod \"model-serving-api-54d89bd5fc-92zwc\" (UID: \"e0b12bf0-69de-424d-89bd-a20b52e11fc7\") " pod="opendatahub/model-serving-api-54d89bd5fc-92zwc" Jul 10 18:06:33.440287 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:33.440247 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0b12bf0-69de-424d-89bd-a20b52e11fc7-tls-certs\") pod \"model-serving-api-54d89bd5fc-92zwc\" (UID: \"e0b12bf0-69de-424d-89bd-a20b52e11fc7\") " pod="opendatahub/model-serving-api-54d89bd5fc-92zwc" Jul 10 18:06:33.440448 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:33.440366 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdbgr\" (UniqueName: \"kubernetes.io/projected/e0b12bf0-69de-424d-89bd-a20b52e11fc7-kube-api-access-kdbgr\") pod \"model-serving-api-54d89bd5fc-92zwc\" (UID: \"e0b12bf0-69de-424d-89bd-a20b52e11fc7\") " pod="opendatahub/model-serving-api-54d89bd5fc-92zwc" Jul 10 18:06:33.440448 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:06:33.440409 2579 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 10 18:06:33.440516 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:06:33.440482 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0b12bf0-69de-424d-89bd-a20b52e11fc7-tls-certs podName:e0b12bf0-69de-424d-89bd-a20b52e11fc7 nodeName:}" failed. No retries permitted until 2026-07-10 18:06:33.940460142 +0000 UTC m=+425.781288377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/e0b12bf0-69de-424d-89bd-a20b52e11fc7-tls-certs") pod "model-serving-api-54d89bd5fc-92zwc" (UID: "e0b12bf0-69de-424d-89bd-a20b52e11fc7") : secret "model-serving-api-tls" not found Jul 10 18:06:33.451434 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:33.451395 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdbgr\" (UniqueName: \"kubernetes.io/projected/e0b12bf0-69de-424d-89bd-a20b52e11fc7-kube-api-access-kdbgr\") pod \"model-serving-api-54d89bd5fc-92zwc\" (UID: \"e0b12bf0-69de-424d-89bd-a20b52e11fc7\") " pod="opendatahub/model-serving-api-54d89bd5fc-92zwc" Jul 10 18:06:33.946258 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:33.946220 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0b12bf0-69de-424d-89bd-a20b52e11fc7-tls-certs\") pod \"model-serving-api-54d89bd5fc-92zwc\" (UID: \"e0b12bf0-69de-424d-89bd-a20b52e11fc7\") " pod="opendatahub/model-serving-api-54d89bd5fc-92zwc" Jul 10 18:06:33.948607 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:33.948589 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0b12bf0-69de-424d-89bd-a20b52e11fc7-tls-certs\") pod \"model-serving-api-54d89bd5fc-92zwc\" (UID: \"e0b12bf0-69de-424d-89bd-a20b52e11fc7\") " pod="opendatahub/model-serving-api-54d89bd5fc-92zwc" Jul 10 18:06:34.141405 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:34.141369 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-92zwc" Jul 10 18:06:34.293723 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:34.293688 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-92zwc"] Jul 10 18:06:34.296719 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:06:34.296691 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0b12bf0_69de_424d_89bd_a20b52e11fc7.slice/crio-44f68b31f3963555807bceb924a17073f17de2d66212c469e1725385e30f51e0 WatchSource:0}: Error finding container 44f68b31f3963555807bceb924a17073f17de2d66212c469e1725385e30f51e0: Status 404 returned error can't find the container with id 44f68b31f3963555807bceb924a17073f17de2d66212c469e1725385e30f51e0 Jul 10 18:06:34.558231 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:34.558198 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-92zwc" event={"ID":"e0b12bf0-69de-424d-89bd-a20b52e11fc7","Type":"ContainerStarted","Data":"44f68b31f3963555807bceb924a17073f17de2d66212c469e1725385e30f51e0"} Jul 10 18:06:36.569934 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:36.569887 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-92zwc" event={"ID":"e0b12bf0-69de-424d-89bd-a20b52e11fc7","Type":"ContainerStarted","Data":"5563ec1183acd31602eebf408003f22001ec1bbbd9991d796d9d2fb828e93c5e"} Jul 10 18:06:36.570324 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:36.569978 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-92zwc" Jul 10 18:06:36.587765 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:36.587716 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-92zwc" podStartSLOduration=1.772851044 podStartE2EDuration="3.587702162s" totalImagesPullingTime="1.814851118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:06:36.586191702 +0000 UTC m=+428.427019956" watchObservedRunningTime="2026-07-10 18:06:36.587702162 +0000 UTC m=+428.428530455" Jul 10 18:06:39.277670 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.277634 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv"] Jul 10 18:06:39.281357 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.281338 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.284068 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.284048 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 10 18:06:39.284188 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.284166 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 10 18:06:39.284246 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.284185 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 10 18:06:39.284321 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.284305 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-jtwq8\"" Jul 10 18:06:39.287694 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.287673 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln"] Jul 10 18:06:39.291058 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.291040 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.293516 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.293499 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 10 18:06:39.293937 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.293921 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 10 18:06:39.294075 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.294061 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 10 18:06:39.294283 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.294269 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bf92w\"" Jul 10 18:06:39.298953 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.298933 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv"] Jul 10 18:06:39.306494 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.306474 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln"] Jul 10 18:06:39.399094 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.399054 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.399269 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.399108 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e7947dff-eec4-43f0-8a0c-582b58078fe1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-s77ln\" (UID: \"e7947dff-eec4-43f0-8a0c-582b58078fe1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.399269 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.399135 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.399269 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.399171 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.399269 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.399204 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7947dff-eec4-43f0-8a0c-582b58078fe1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-s77ln\" (UID: \"e7947dff-eec4-43f0-8a0c-582b58078fe1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.399269 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.399229 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e7947dff-eec4-43f0-8a0c-582b58078fe1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-s77ln\" (UID: \"e7947dff-eec4-43f0-8a0c-582b58078fe1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.399269 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.399248 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.399498 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.399324 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.399498 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.399392 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.399498 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.399419 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7947dff-eec4-43f0-8a0c-582b58078fe1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-s77ln\" (UID: \"e7947dff-eec4-43f0-8a0c-582b58078fe1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.399498 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.399465 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v787w\" (UniqueName: \"kubernetes.io/projected/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-kube-api-access-v787w\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.399641 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.399506 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e7947dff-eec4-43f0-8a0c-582b58078fe1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-s77ln\" (UID: \"e7947dff-eec4-43f0-8a0c-582b58078fe1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.399641 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.399535 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2tl7\" (UniqueName: \"kubernetes.io/projected/e7947dff-eec4-43f0-8a0c-582b58078fe1-kube-api-access-v2tl7\") pod \"istiod-openshift-gateway-94bb8fbfd-s77ln\" (UID: \"e7947dff-eec4-43f0-8a0c-582b58078fe1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.399641 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.399550 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7947dff-eec4-43f0-8a0c-582b58078fe1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-s77ln\" (UID: \"e7947dff-eec4-43f0-8a0c-582b58078fe1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.399641 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.399566 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.399785 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.399646 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.500105 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.500072 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e7947dff-eec4-43f0-8a0c-582b58078fe1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-s77ln\" (UID: \"e7947dff-eec4-43f0-8a0c-582b58078fe1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.500302 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.500117 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2tl7\" (UniqueName: \"kubernetes.io/projected/e7947dff-eec4-43f0-8a0c-582b58078fe1-kube-api-access-v2tl7\") pod \"istiod-openshift-gateway-94bb8fbfd-s77ln\" (UID: \"e7947dff-eec4-43f0-8a0c-582b58078fe1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.500302 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.500134 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7947dff-eec4-43f0-8a0c-582b58078fe1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-s77ln\" (UID: \"e7947dff-eec4-43f0-8a0c-582b58078fe1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.500302 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.500243 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.500302 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.500284 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.500526 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.500334 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.500526 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.500384 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e7947dff-eec4-43f0-8a0c-582b58078fe1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-s77ln\" (UID: \"e7947dff-eec4-43f0-8a0c-582b58078fe1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.500526 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.500410 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.500526 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.500457 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.500526 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.500486 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7947dff-eec4-43f0-8a0c-582b58078fe1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-s77ln\" (UID: \"e7947dff-eec4-43f0-8a0c-582b58078fe1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.500526 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.500512 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e7947dff-eec4-43f0-8a0c-582b58078fe1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-s77ln\" (UID: \"e7947dff-eec4-43f0-8a0c-582b58078fe1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.500839 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.500537 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.500839 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.500582 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.500839 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.500614 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.500839 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.500643 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7947dff-eec4-43f0-8a0c-582b58078fe1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-s77ln\" (UID: \"e7947dff-eec4-43f0-8a0c-582b58078fe1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.500839 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.500689 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v787w\" (UniqueName: \"kubernetes.io/projected/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-kube-api-access-v787w\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.501374 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.500904 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.501374 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.501063 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.501374 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.501176 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.501374 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.501299 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.501374 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.501348 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.501700 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.501677 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e7947dff-eec4-43f0-8a0c-582b58078fe1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-s77ln\" (UID: \"e7947dff-eec4-43f0-8a0c-582b58078fe1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.503172 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.503135 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7947dff-eec4-43f0-8a0c-582b58078fe1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-s77ln\" (UID: \"e7947dff-eec4-43f0-8a0c-582b58078fe1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.503498 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.503472 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.503588 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.503564 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e7947dff-eec4-43f0-8a0c-582b58078fe1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-s77ln\" (UID: \"e7947dff-eec4-43f0-8a0c-582b58078fe1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.503769 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.503751 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e7947dff-eec4-43f0-8a0c-582b58078fe1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-s77ln\" (UID: \"e7947dff-eec4-43f0-8a0c-582b58078fe1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.503933 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.503913 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7947dff-eec4-43f0-8a0c-582b58078fe1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-s77ln\" (UID: \"e7947dff-eec4-43f0-8a0c-582b58078fe1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.504019 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.503994 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.508692 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.508666 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2tl7\" (UniqueName: \"kubernetes.io/projected/e7947dff-eec4-43f0-8a0c-582b58078fe1-kube-api-access-v2tl7\") pod \"istiod-openshift-gateway-94bb8fbfd-s77ln\" (UID: \"e7947dff-eec4-43f0-8a0c-582b58078fe1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.510021 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.510002 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.510720 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.510698 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7947dff-eec4-43f0-8a0c-582b58078fe1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-s77ln\" (UID: \"e7947dff-eec4-43f0-8a0c-582b58078fe1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.510826 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.510753 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v787w\" (UniqueName: \"kubernetes.io/projected/f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea-kube-api-access-v787w\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bl6zv\" (UID: \"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.593126 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.593101 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:39.600358 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.600332 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:39.743185 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.743157 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv"] Jul 10 18:06:39.745366 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:06:39.745337 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0ccfcdf_563e_42be_82ab_d6c7ff1b0dea.slice/crio-c3a88006f4bbe038239339965232d89069277f53cff56d73d6e0e22256bc4bc9 WatchSource:0}: Error finding container c3a88006f4bbe038239339965232d89069277f53cff56d73d6e0e22256bc4bc9: Status 404 returned error can't find the container with id c3a88006f4bbe038239339965232d89069277f53cff56d73d6e0e22256bc4bc9 Jul 10 18:06:39.762793 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:39.762766 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln"] Jul 10 18:06:39.764278 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:06:39.764254 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7947dff_eec4_43f0_8a0c_582b58078fe1.slice/crio-aea1b4f91e4b2b546b08c142ab20f317299d3e802536b538d87ec8c57bc72e11 WatchSource:0}: Error finding container aea1b4f91e4b2b546b08c142ab20f317299d3e802536b538d87ec8c57bc72e11: Status 404 returned error can't find the container with id aea1b4f91e4b2b546b08c142ab20f317299d3e802536b538d87ec8c57bc72e11 Jul 10 18:06:40.593560 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:40.593525 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" event={"ID":"e7947dff-eec4-43f0-8a0c-582b58078fe1","Type":"ContainerStarted","Data":"aea1b4f91e4b2b546b08c142ab20f317299d3e802536b538d87ec8c57bc72e11"} Jul 10 18:06:40.595595 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:40.595513 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" event={"ID":"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea","Type":"ContainerStarted","Data":"c3a88006f4bbe038239339965232d89069277f53cff56d73d6e0e22256bc4bc9"} Jul 10 18:06:43.202362 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:43.202317 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:06:43.202628 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:43.202395 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:06:43.202628 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:43.202428 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:06:43.204616 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:43.204586 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:06:43.204726 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:43.204640 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:06:43.553225 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:43.553195 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6d79ff4f99-mcs64" Jul 10 18:06:43.615649 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:43.615599 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" event={"ID":"f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea","Type":"ContainerStarted","Data":"be6d82d74ebf1c187e2340c3bb5e90299ec0f6959c9f042627d81624c4553122"} Jul 10 18:06:43.617553 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:43.617527 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" event={"ID":"e7947dff-eec4-43f0-8a0c-582b58078fe1","Type":"ContainerStarted","Data":"2b7e5db2bccf1efa8aabf214d4f8c68aacb052c2767e337a3ba64c7f9724fd11"} Jul 10 18:06:43.617685 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:43.617652 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:43.638138 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:43.638091 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" podStartSLOduration=1.183834191 podStartE2EDuration="4.638076006s" totalImagesPullingTime="3.454241815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:06:43.635605861 +0000 UTC m=+435.476434116" watchObservedRunningTime="2026-07-10 18:06:43.638076006 +0000 UTC m=+435.478904260" Jul 10 18:06:43.656100 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:43.656057 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" podStartSLOduration=1.218060022 podStartE2EDuration="4.656043258s" totalImagesPullingTime="3.437983236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:06:43.653973844 +0000 UTC m=+435.494802101" watchObservedRunningTime="2026-07-10 18:06:43.656043258 +0000 UTC m=+435.496871511" Jul 10 18:06:44.593372 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:44.593335 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:44.597936 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:44.597912 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:44.623153 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:44.623123 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:44.623923 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:44.623901 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bl6zv" Jul 10 18:06:44.624524 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:44.624506 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s77ln" Jul 10 18:06:47.579507 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:06:47.579480 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-92zwc" Jul 10 18:07:47.955243 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:47.955205 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55cb8c785f-qqxg7"] Jul 10 18:07:47.958035 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:47.958015 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:47.970171 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:47.970141 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55cb8c785f-qqxg7"] Jul 10 18:07:47.997380 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:47.997353 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c86d38f2-7a54-4563-b84c-69e6f033ac6b-console-oauth-config\") pod \"console-55cb8c785f-qqxg7\" (UID: \"c86d38f2-7a54-4563-b84c-69e6f033ac6b\") " pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:47.997496 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:47.997398 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b26mv\" (UniqueName: \"kubernetes.io/projected/c86d38f2-7a54-4563-b84c-69e6f033ac6b-kube-api-access-b26mv\") pod \"console-55cb8c785f-qqxg7\" (UID: \"c86d38f2-7a54-4563-b84c-69e6f033ac6b\") " pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:47.997496 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:47.997465 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c86d38f2-7a54-4563-b84c-69e6f033ac6b-console-config\") pod \"console-55cb8c785f-qqxg7\" (UID: \"c86d38f2-7a54-4563-b84c-69e6f033ac6b\") " pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:47.997579 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:47.997500 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c86d38f2-7a54-4563-b84c-69e6f033ac6b-service-ca\") pod \"console-55cb8c785f-qqxg7\" (UID: \"c86d38f2-7a54-4563-b84c-69e6f033ac6b\") " pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:47.997579 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:47.997535 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c86d38f2-7a54-4563-b84c-69e6f033ac6b-oauth-serving-cert\") pod \"console-55cb8c785f-qqxg7\" (UID: \"c86d38f2-7a54-4563-b84c-69e6f033ac6b\") " pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:47.997579 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:47.997558 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c86d38f2-7a54-4563-b84c-69e6f033ac6b-trusted-ca-bundle\") pod \"console-55cb8c785f-qqxg7\" (UID: \"c86d38f2-7a54-4563-b84c-69e6f033ac6b\") " pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:47.997711 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:47.997589 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c86d38f2-7a54-4563-b84c-69e6f033ac6b-console-serving-cert\") pod \"console-55cb8c785f-qqxg7\" (UID: \"c86d38f2-7a54-4563-b84c-69e6f033ac6b\") " pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:48.098967 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.098923 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c86d38f2-7a54-4563-b84c-69e6f033ac6b-oauth-serving-cert\") pod \"console-55cb8c785f-qqxg7\" (UID: \"c86d38f2-7a54-4563-b84c-69e6f033ac6b\") " pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:48.099172 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.098983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c86d38f2-7a54-4563-b84c-69e6f033ac6b-trusted-ca-bundle\") pod \"console-55cb8c785f-qqxg7\" (UID: \"c86d38f2-7a54-4563-b84c-69e6f033ac6b\") " pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:48.099172 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.099010 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c86d38f2-7a54-4563-b84c-69e6f033ac6b-console-serving-cert\") pod \"console-55cb8c785f-qqxg7\" (UID: \"c86d38f2-7a54-4563-b84c-69e6f033ac6b\") " pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:48.099172 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.099050 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c86d38f2-7a54-4563-b84c-69e6f033ac6b-console-oauth-config\") pod \"console-55cb8c785f-qqxg7\" (UID: \"c86d38f2-7a54-4563-b84c-69e6f033ac6b\") " pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:48.099172 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.099152 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b26mv\" (UniqueName: \"kubernetes.io/projected/c86d38f2-7a54-4563-b84c-69e6f033ac6b-kube-api-access-b26mv\") pod \"console-55cb8c785f-qqxg7\" (UID: \"c86d38f2-7a54-4563-b84c-69e6f033ac6b\") " pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:48.099433 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.099204 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c86d38f2-7a54-4563-b84c-69e6f033ac6b-console-config\") pod \"console-55cb8c785f-qqxg7\" (UID: \"c86d38f2-7a54-4563-b84c-69e6f033ac6b\") " pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:48.099433 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.099330 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c86d38f2-7a54-4563-b84c-69e6f033ac6b-service-ca\") pod \"console-55cb8c785f-qqxg7\" (UID: \"c86d38f2-7a54-4563-b84c-69e6f033ac6b\") " pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:48.099871 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.099817 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c86d38f2-7a54-4563-b84c-69e6f033ac6b-console-config\") pod \"console-55cb8c785f-qqxg7\" (UID: \"c86d38f2-7a54-4563-b84c-69e6f033ac6b\") " pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:48.100074 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.100048 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c86d38f2-7a54-4563-b84c-69e6f033ac6b-service-ca\") pod \"console-55cb8c785f-qqxg7\" (UID: \"c86d38f2-7a54-4563-b84c-69e6f033ac6b\") " pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:48.100147 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.100122 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c86d38f2-7a54-4563-b84c-69e6f033ac6b-trusted-ca-bundle\") pod \"console-55cb8c785f-qqxg7\" (UID: \"c86d38f2-7a54-4563-b84c-69e6f033ac6b\") " pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:48.100198 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.100148 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c86d38f2-7a54-4563-b84c-69e6f033ac6b-oauth-serving-cert\") pod \"console-55cb8c785f-qqxg7\" (UID: \"c86d38f2-7a54-4563-b84c-69e6f033ac6b\") " pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:48.101627 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.101602 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c86d38f2-7a54-4563-b84c-69e6f033ac6b-console-serving-cert\") pod \"console-55cb8c785f-qqxg7\" (UID: \"c86d38f2-7a54-4563-b84c-69e6f033ac6b\") " pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:48.101723 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.101609 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c86d38f2-7a54-4563-b84c-69e6f033ac6b-console-oauth-config\") pod \"console-55cb8c785f-qqxg7\" (UID: \"c86d38f2-7a54-4563-b84c-69e6f033ac6b\") " pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:48.108204 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.108183 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b26mv\" (UniqueName: \"kubernetes.io/projected/c86d38f2-7a54-4563-b84c-69e6f033ac6b-kube-api-access-b26mv\") pod \"console-55cb8c785f-qqxg7\" (UID: \"c86d38f2-7a54-4563-b84c-69e6f033ac6b\") " pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:48.267066 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.266976 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:48.402411 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.402380 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55cb8c785f-qqxg7"] Jul 10 18:07:48.404676 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:07:48.404649 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc86d38f2_7a54_4563_b84c_69e6f033ac6b.slice/crio-87cde9db74092c1bde29c46bebf10131926dc532eda201a85885df6c1347e2a8 WatchSource:0}: Error finding container 87cde9db74092c1bde29c46bebf10131926dc532eda201a85885df6c1347e2a8: Status 404 returned error can't find the container with id 87cde9db74092c1bde29c46bebf10131926dc532eda201a85885df6c1347e2a8 Jul 10 18:07:48.488366 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.488326 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5"] Jul 10 18:07:48.491378 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.491356 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5" Jul 10 18:07:48.493963 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.493943 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fcbzs\"" Jul 10 18:07:48.494079 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.493988 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 10 18:07:48.494079 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.493988 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 10 18:07:48.500378 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.500354 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5"] Jul 10 18:07:48.603183 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.603145 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8116c3d-62d7-4108-9d00-c07c28b8c529-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5\" (UID: \"e8116c3d-62d7-4108-9d00-c07c28b8c529\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5" Jul 10 18:07:48.603183 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.603185 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjkjc\" (UniqueName: \"kubernetes.io/projected/e8116c3d-62d7-4108-9d00-c07c28b8c529-kube-api-access-zjkjc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5\" (UID: \"e8116c3d-62d7-4108-9d00-c07c28b8c529\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5" Jul 10 18:07:48.603401 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.603215 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8116c3d-62d7-4108-9d00-c07c28b8c529-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5\" (UID: \"e8116c3d-62d7-4108-9d00-c07c28b8c529\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5" Jul 10 18:07:48.704754 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.704721 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8116c3d-62d7-4108-9d00-c07c28b8c529-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5\" (UID: \"e8116c3d-62d7-4108-9d00-c07c28b8c529\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5" Jul 10 18:07:48.704754 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.704750 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjkjc\" (UniqueName: \"kubernetes.io/projected/e8116c3d-62d7-4108-9d00-c07c28b8c529-kube-api-access-zjkjc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5\" (UID: \"e8116c3d-62d7-4108-9d00-c07c28b8c529\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5" Jul 10 18:07:48.705032 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.704777 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8116c3d-62d7-4108-9d00-c07c28b8c529-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5\" (UID: \"e8116c3d-62d7-4108-9d00-c07c28b8c529\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5" Jul 10 18:07:48.705092 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.705074 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8116c3d-62d7-4108-9d00-c07c28b8c529-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5\" (UID: \"e8116c3d-62d7-4108-9d00-c07c28b8c529\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5" Jul 10 18:07:48.705128 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.705103 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8116c3d-62d7-4108-9d00-c07c28b8c529-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5\" (UID: \"e8116c3d-62d7-4108-9d00-c07c28b8c529\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5" Jul 10 18:07:48.713068 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.713047 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjkjc\" (UniqueName: \"kubernetes.io/projected/e8116c3d-62d7-4108-9d00-c07c28b8c529-kube-api-access-zjkjc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5\" (UID: \"e8116c3d-62d7-4108-9d00-c07c28b8c529\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5" Jul 10 18:07:48.802722 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.802692 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5" Jul 10 18:07:48.929465 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.929427 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55cb8c785f-qqxg7" event={"ID":"c86d38f2-7a54-4563-b84c-69e6f033ac6b","Type":"ContainerStarted","Data":"0253cbb1cd8e22fa00f50a9ff56becf5fb175e6290f8460726d7d6ea84ff21ac"} Jul 10 18:07:48.929541 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.929486 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55cb8c785f-qqxg7" event={"ID":"c86d38f2-7a54-4563-b84c-69e6f033ac6b","Type":"ContainerStarted","Data":"87cde9db74092c1bde29c46bebf10131926dc532eda201a85885df6c1347e2a8"} Jul 10 18:07:48.929792 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.929773 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5"] Jul 10 18:07:48.931932 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:07:48.931908 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8116c3d_62d7_4108_9d00_c07c28b8c529.slice/crio-29380fe715498ecf5e8aa2b607e3409cb8f48602e2f6deb72de971ded77677af WatchSource:0}: Error finding container 29380fe715498ecf5e8aa2b607e3409cb8f48602e2f6deb72de971ded77677af: Status 404 returned error can't find the container with id 29380fe715498ecf5e8aa2b607e3409cb8f48602e2f6deb72de971ded77677af Jul 10 18:07:48.947287 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:48.947247 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55cb8c785f-qqxg7" podStartSLOduration=1.9472320079999998 podStartE2EDuration="1.947232008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:07:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:07:48.945613285 +0000 UTC m=+500.786441540" watchObservedRunningTime="2026-07-10 18:07:48.947232008 +0000 UTC m=+500.788060262" Jul 10 18:07:49.091902 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.091869 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn"] Jul 10 18:07:49.094376 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.094359 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn" Jul 10 18:07:49.102943 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.102921 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn"] Jul 10 18:07:49.209110 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.209015 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmwd9\" (UniqueName: \"kubernetes.io/projected/86d0f3de-37ea-443c-9922-a33555090907-kube-api-access-nmwd9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn\" (UID: \"86d0f3de-37ea-443c-9922-a33555090907\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn" Jul 10 18:07:49.209110 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.209088 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86d0f3de-37ea-443c-9922-a33555090907-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn\" (UID: \"86d0f3de-37ea-443c-9922-a33555090907\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn" Jul 10 18:07:49.209300 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.209156 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86d0f3de-37ea-443c-9922-a33555090907-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn\" (UID: \"86d0f3de-37ea-443c-9922-a33555090907\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn" Jul 10 18:07:49.310463 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.310416 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86d0f3de-37ea-443c-9922-a33555090907-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn\" (UID: \"86d0f3de-37ea-443c-9922-a33555090907\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn" Jul 10 18:07:49.310648 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.310492 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86d0f3de-37ea-443c-9922-a33555090907-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn\" (UID: \"86d0f3de-37ea-443c-9922-a33555090907\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn" Jul 10 18:07:49.310648 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.310574 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmwd9\" (UniqueName: \"kubernetes.io/projected/86d0f3de-37ea-443c-9922-a33555090907-kube-api-access-nmwd9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn\" (UID: \"86d0f3de-37ea-443c-9922-a33555090907\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn" Jul 10 18:07:49.310909 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.310878 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86d0f3de-37ea-443c-9922-a33555090907-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn\" (UID: \"86d0f3de-37ea-443c-9922-a33555090907\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn" Jul 10 18:07:49.310993 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.310887 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86d0f3de-37ea-443c-9922-a33555090907-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn\" (UID: \"86d0f3de-37ea-443c-9922-a33555090907\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn" Jul 10 18:07:49.318667 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.318642 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmwd9\" (UniqueName: \"kubernetes.io/projected/86d0f3de-37ea-443c-9922-a33555090907-kube-api-access-nmwd9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn\" (UID: \"86d0f3de-37ea-443c-9922-a33555090907\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn" Jul 10 18:07:49.420809 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.420773 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn" Jul 10 18:07:49.555312 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.555287 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn"] Jul 10 18:07:49.557476 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:07:49.557442 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d0f3de_37ea_443c_9922_a33555090907.slice/crio-247909b5e5255d71483cadaba7d665e3fceadf7573365a24ef50ebb621a4a75d WatchSource:0}: Error finding container 247909b5e5255d71483cadaba7d665e3fceadf7573365a24ef50ebb621a4a75d: Status 404 returned error can't find the container with id 247909b5e5255d71483cadaba7d665e3fceadf7573365a24ef50ebb621a4a75d Jul 10 18:07:49.693426 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.693388 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm"] Jul 10 18:07:49.696000 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.695985 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm" Jul 10 18:07:49.706875 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.706821 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm"] Jul 10 18:07:49.814822 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.814785 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxpjt\" (UniqueName: \"kubernetes.io/projected/15e75816-b35f-49e7-8dec-0f2080d3ca32-kube-api-access-jxpjt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm\" (UID: \"15e75816-b35f-49e7-8dec-0f2080d3ca32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm" Jul 10 18:07:49.815021 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.814878 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15e75816-b35f-49e7-8dec-0f2080d3ca32-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm\" (UID: \"15e75816-b35f-49e7-8dec-0f2080d3ca32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm" Jul 10 18:07:49.815021 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.814935 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15e75816-b35f-49e7-8dec-0f2080d3ca32-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm\" (UID: \"15e75816-b35f-49e7-8dec-0f2080d3ca32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm" Jul 10 18:07:49.915568 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.915532 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxpjt\" (UniqueName: \"kubernetes.io/projected/15e75816-b35f-49e7-8dec-0f2080d3ca32-kube-api-access-jxpjt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm\" (UID: \"15e75816-b35f-49e7-8dec-0f2080d3ca32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm" Jul 10 18:07:49.915752 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.915583 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15e75816-b35f-49e7-8dec-0f2080d3ca32-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm\" (UID: \"15e75816-b35f-49e7-8dec-0f2080d3ca32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm" Jul 10 18:07:49.915752 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.915604 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15e75816-b35f-49e7-8dec-0f2080d3ca32-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm\" (UID: \"15e75816-b35f-49e7-8dec-0f2080d3ca32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm" Jul 10 18:07:49.916045 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.916016 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15e75816-b35f-49e7-8dec-0f2080d3ca32-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm\" (UID: \"15e75816-b35f-49e7-8dec-0f2080d3ca32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm" Jul 10 18:07:49.916045 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.916026 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15e75816-b35f-49e7-8dec-0f2080d3ca32-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm\" (UID: \"15e75816-b35f-49e7-8dec-0f2080d3ca32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm" Jul 10 18:07:49.924325 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.924303 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxpjt\" (UniqueName: \"kubernetes.io/projected/15e75816-b35f-49e7-8dec-0f2080d3ca32-kube-api-access-jxpjt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm\" (UID: \"15e75816-b35f-49e7-8dec-0f2080d3ca32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm" Jul 10 18:07:49.936222 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.936195 2579 generic.go:356] "Generic (PLEG): container finished" podID="e8116c3d-62d7-4108-9d00-c07c28b8c529" containerID="ee231edf45b53c693d66606e039419da06010b20f42f5101a822f8585249ac9d" exitCode=0 Jul 10 18:07:49.936310 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.936272 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5" event={"ID":"e8116c3d-62d7-4108-9d00-c07c28b8c529","Type":"ContainerDied","Data":"ee231edf45b53c693d66606e039419da06010b20f42f5101a822f8585249ac9d"} Jul 10 18:07:49.936357 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.936317 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5" event={"ID":"e8116c3d-62d7-4108-9d00-c07c28b8c529","Type":"ContainerStarted","Data":"29380fe715498ecf5e8aa2b607e3409cb8f48602e2f6deb72de971ded77677af"} Jul 10 18:07:49.937830 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.937810 2579 generic.go:356] "Generic (PLEG): container finished" podID="86d0f3de-37ea-443c-9922-a33555090907" containerID="a5fdd5806c31c4313d43bbc5f0d893c37c2baa2d177e905ec5ae556df66abc7f" exitCode=0 Jul 10 18:07:49.937938 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.937883 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn" event={"ID":"86d0f3de-37ea-443c-9922-a33555090907","Type":"ContainerDied","Data":"a5fdd5806c31c4313d43bbc5f0d893c37c2baa2d177e905ec5ae556df66abc7f"} Jul 10 18:07:49.937938 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:49.937927 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn" event={"ID":"86d0f3de-37ea-443c-9922-a33555090907","Type":"ContainerStarted","Data":"247909b5e5255d71483cadaba7d665e3fceadf7573365a24ef50ebb621a4a75d"} Jul 10 18:07:50.015323 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.015298 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm" Jul 10 18:07:50.086256 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.086223 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5"] Jul 10 18:07:50.089336 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.089318 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5" Jul 10 18:07:50.098970 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.098944 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5"] Jul 10 18:07:50.116956 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.116926 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hpf4\" (UniqueName: \"kubernetes.io/projected/90dc343f-73fa-453a-9e58-26a7ce2a031b-kube-api-access-8hpf4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5\" (UID: \"90dc343f-73fa-453a-9e58-26a7ce2a031b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5" Jul 10 18:07:50.117071 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.116981 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90dc343f-73fa-453a-9e58-26a7ce2a031b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5\" (UID: \"90dc343f-73fa-453a-9e58-26a7ce2a031b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5" Jul 10 18:07:50.117071 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.117038 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90dc343f-73fa-453a-9e58-26a7ce2a031b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5\" (UID: \"90dc343f-73fa-453a-9e58-26a7ce2a031b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5" Jul 10 18:07:50.160170 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.160141 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm"] Jul 10 18:07:50.161314 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:07:50.161291 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e75816_b35f_49e7_8dec_0f2080d3ca32.slice/crio-3abc50f189eaedbf973393be61025eeae9c8c9a3fa17ef12565480a4d87540ca WatchSource:0}: Error finding container 3abc50f189eaedbf973393be61025eeae9c8c9a3fa17ef12565480a4d87540ca: Status 404 returned error can't find the container with id 3abc50f189eaedbf973393be61025eeae9c8c9a3fa17ef12565480a4d87540ca Jul 10 18:07:50.217747 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.217719 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hpf4\" (UniqueName: \"kubernetes.io/projected/90dc343f-73fa-453a-9e58-26a7ce2a031b-kube-api-access-8hpf4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5\" (UID: \"90dc343f-73fa-453a-9e58-26a7ce2a031b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5" Jul 10 18:07:50.217886 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.217757 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90dc343f-73fa-453a-9e58-26a7ce2a031b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5\" (UID: \"90dc343f-73fa-453a-9e58-26a7ce2a031b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5" Jul 10 18:07:50.217937 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.217893 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90dc343f-73fa-453a-9e58-26a7ce2a031b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5\" (UID: \"90dc343f-73fa-453a-9e58-26a7ce2a031b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5" Jul 10 18:07:50.218152 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.218132 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90dc343f-73fa-453a-9e58-26a7ce2a031b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5\" (UID: \"90dc343f-73fa-453a-9e58-26a7ce2a031b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5" Jul 10 18:07:50.218188 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.218177 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90dc343f-73fa-453a-9e58-26a7ce2a031b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5\" (UID: \"90dc343f-73fa-453a-9e58-26a7ce2a031b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5" Jul 10 18:07:50.226551 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.226522 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hpf4\" (UniqueName: \"kubernetes.io/projected/90dc343f-73fa-453a-9e58-26a7ce2a031b-kube-api-access-8hpf4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5\" (UID: \"90dc343f-73fa-453a-9e58-26a7ce2a031b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5" Jul 10 18:07:50.400408 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.400309 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5" Jul 10 18:07:50.530817 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.530790 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5"] Jul 10 18:07:50.532690 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:07:50.532668 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90dc343f_73fa_453a_9e58_26a7ce2a031b.slice/crio-1ca00d7849bc02220fdab510f85cda94575624c90d41499caf74c17361e71e1d WatchSource:0}: Error finding container 1ca00d7849bc02220fdab510f85cda94575624c90d41499caf74c17361e71e1d: Status 404 returned error can't find the container with id 1ca00d7849bc02220fdab510f85cda94575624c90d41499caf74c17361e71e1d Jul 10 18:07:50.948070 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.948040 2579 generic.go:356] "Generic (PLEG): container finished" podID="e8116c3d-62d7-4108-9d00-c07c28b8c529" containerID="774e452a6a33ad3dcf22b445b6ca7230dc23199f7d4d28b9d4f9dcd630275191" exitCode=0 Jul 10 18:07:50.948193 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.948129 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5" event={"ID":"e8116c3d-62d7-4108-9d00-c07c28b8c529","Type":"ContainerDied","Data":"774e452a6a33ad3dcf22b445b6ca7230dc23199f7d4d28b9d4f9dcd630275191"} Jul 10 18:07:50.949670 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.949561 2579 generic.go:356] "Generic (PLEG): container finished" podID="90dc343f-73fa-453a-9e58-26a7ce2a031b" containerID="e48040aa3759f9ec246160340f5a3620ccdcf37fe225e39bb481e8b6eca98f71" exitCode=0 Jul 10 18:07:50.949738 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.949691 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5" event={"ID":"90dc343f-73fa-453a-9e58-26a7ce2a031b","Type":"ContainerDied","Data":"e48040aa3759f9ec246160340f5a3620ccdcf37fe225e39bb481e8b6eca98f71"} Jul 10 18:07:50.949738 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.949724 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5" event={"ID":"90dc343f-73fa-453a-9e58-26a7ce2a031b","Type":"ContainerStarted","Data":"1ca00d7849bc02220fdab510f85cda94575624c90d41499caf74c17361e71e1d"} Jul 10 18:07:50.951081 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.951059 2579 generic.go:356] "Generic (PLEG): container finished" podID="15e75816-b35f-49e7-8dec-0f2080d3ca32" containerID="261fc5a7d6734e473060a32ca9af778325a8579959d8afa746e61196c1485c7a" exitCode=0 Jul 10 18:07:50.951188 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.951130 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm" event={"ID":"15e75816-b35f-49e7-8dec-0f2080d3ca32","Type":"ContainerDied","Data":"261fc5a7d6734e473060a32ca9af778325a8579959d8afa746e61196c1485c7a"} Jul 10 18:07:50.951188 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.951167 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm" event={"ID":"15e75816-b35f-49e7-8dec-0f2080d3ca32","Type":"ContainerStarted","Data":"3abc50f189eaedbf973393be61025eeae9c8c9a3fa17ef12565480a4d87540ca"} Jul 10 18:07:50.953159 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.953137 2579 generic.go:356] "Generic (PLEG): container finished" podID="86d0f3de-37ea-443c-9922-a33555090907" containerID="e69d8bf4238559afbacd0e59980fcdd046e683794c133874af753b135b1136f6" exitCode=0 Jul 10 18:07:50.953237 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:50.953174 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn" event={"ID":"86d0f3de-37ea-443c-9922-a33555090907","Type":"ContainerDied","Data":"e69d8bf4238559afbacd0e59980fcdd046e683794c133874af753b135b1136f6"} Jul 10 18:07:51.960870 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:51.960814 2579 generic.go:356] "Generic (PLEG): container finished" podID="15e75816-b35f-49e7-8dec-0f2080d3ca32" containerID="b9018f0d380ef1a8968c688aea84aa9416854bcfb777bcf17b88e6add8d378c6" exitCode=0 Jul 10 18:07:51.961192 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:51.960876 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm" event={"ID":"15e75816-b35f-49e7-8dec-0f2080d3ca32","Type":"ContainerDied","Data":"b9018f0d380ef1a8968c688aea84aa9416854bcfb777bcf17b88e6add8d378c6"} Jul 10 18:07:51.963180 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:51.963162 2579 generic.go:356] "Generic (PLEG): container finished" podID="86d0f3de-37ea-443c-9922-a33555090907" containerID="8d28f21d9958c1e5e74596d60627a944b69005d19d7f7b11a54bce6a6cce332a" exitCode=0 Jul 10 18:07:51.963287 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:51.963255 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn" event={"ID":"86d0f3de-37ea-443c-9922-a33555090907","Type":"ContainerDied","Data":"8d28f21d9958c1e5e74596d60627a944b69005d19d7f7b11a54bce6a6cce332a"} Jul 10 18:07:51.965588 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:51.965565 2579 generic.go:356] "Generic (PLEG): container finished" podID="e8116c3d-62d7-4108-9d00-c07c28b8c529" containerID="24b08b0228c26a52f1ffeedb63ad33cd4ff2554f4514b904617ddbf12c9c319c" exitCode=0 Jul 10 18:07:51.965876 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:51.965601 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5" event={"ID":"e8116c3d-62d7-4108-9d00-c07c28b8c529","Type":"ContainerDied","Data":"24b08b0228c26a52f1ffeedb63ad33cd4ff2554f4514b904617ddbf12c9c319c"} Jul 10 18:07:52.972986 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:52.972950 2579 generic.go:356] "Generic (PLEG): container finished" podID="90dc343f-73fa-453a-9e58-26a7ce2a031b" containerID="d357960ac2300ae46afef7067d9bec7e43967725ed6ea380c7b23e0e45683cf5" exitCode=0 Jul 10 18:07:52.973386 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:52.973033 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5" event={"ID":"90dc343f-73fa-453a-9e58-26a7ce2a031b","Type":"ContainerDied","Data":"d357960ac2300ae46afef7067d9bec7e43967725ed6ea380c7b23e0e45683cf5"} Jul 10 18:07:52.975240 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:52.975215 2579 generic.go:356] "Generic (PLEG): container finished" podID="15e75816-b35f-49e7-8dec-0f2080d3ca32" containerID="babe4251fc5a8a9fb2b272b2fb29fd9eda42e436cf5077ef4ed2609088b2ac27" exitCode=0 Jul 10 18:07:52.975334 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:52.975295 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm" event={"ID":"15e75816-b35f-49e7-8dec-0f2080d3ca32","Type":"ContainerDied","Data":"babe4251fc5a8a9fb2b272b2fb29fd9eda42e436cf5077ef4ed2609088b2ac27"} Jul 10 18:07:53.118277 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.118249 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn" Jul 10 18:07:53.201909 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.201885 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5" Jul 10 18:07:53.245500 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.245428 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjkjc\" (UniqueName: \"kubernetes.io/projected/e8116c3d-62d7-4108-9d00-c07c28b8c529-kube-api-access-zjkjc\") pod \"e8116c3d-62d7-4108-9d00-c07c28b8c529\" (UID: \"e8116c3d-62d7-4108-9d00-c07c28b8c529\") " Jul 10 18:07:53.245500 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.245464 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86d0f3de-37ea-443c-9922-a33555090907-bundle\") pod \"86d0f3de-37ea-443c-9922-a33555090907\" (UID: \"86d0f3de-37ea-443c-9922-a33555090907\") " Jul 10 18:07:53.245669 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.245507 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8116c3d-62d7-4108-9d00-c07c28b8c529-bundle\") pod \"e8116c3d-62d7-4108-9d00-c07c28b8c529\" (UID: \"e8116c3d-62d7-4108-9d00-c07c28b8c529\") " Jul 10 18:07:53.245669 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.245544 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8116c3d-62d7-4108-9d00-c07c28b8c529-util\") pod \"e8116c3d-62d7-4108-9d00-c07c28b8c529\" (UID: \"e8116c3d-62d7-4108-9d00-c07c28b8c529\") " Jul 10 18:07:53.245669 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.245609 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmwd9\" (UniqueName: \"kubernetes.io/projected/86d0f3de-37ea-443c-9922-a33555090907-kube-api-access-nmwd9\") pod \"86d0f3de-37ea-443c-9922-a33555090907\" (UID: \"86d0f3de-37ea-443c-9922-a33555090907\") " Jul 10 18:07:53.245669 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.245624 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86d0f3de-37ea-443c-9922-a33555090907-util\") pod \"86d0f3de-37ea-443c-9922-a33555090907\" (UID: \"86d0f3de-37ea-443c-9922-a33555090907\") " Jul 10 18:07:53.246148 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.246117 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86d0f3de-37ea-443c-9922-a33555090907-bundle" (OuterVolumeSpecName: "bundle") pod "86d0f3de-37ea-443c-9922-a33555090907" (UID: "86d0f3de-37ea-443c-9922-a33555090907"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:07:53.246369 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.246345 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8116c3d-62d7-4108-9d00-c07c28b8c529-bundle" (OuterVolumeSpecName: "bundle") pod "e8116c3d-62d7-4108-9d00-c07c28b8c529" (UID: "e8116c3d-62d7-4108-9d00-c07c28b8c529"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:07:53.247783 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.247752 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86d0f3de-37ea-443c-9922-a33555090907-kube-api-access-nmwd9" (OuterVolumeSpecName: "kube-api-access-nmwd9") pod "86d0f3de-37ea-443c-9922-a33555090907" (UID: "86d0f3de-37ea-443c-9922-a33555090907"). InnerVolumeSpecName "kube-api-access-nmwd9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:07:53.248098 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.247783 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8116c3d-62d7-4108-9d00-c07c28b8c529-kube-api-access-zjkjc" (OuterVolumeSpecName: "kube-api-access-zjkjc") pod "e8116c3d-62d7-4108-9d00-c07c28b8c529" (UID: "e8116c3d-62d7-4108-9d00-c07c28b8c529"). InnerVolumeSpecName "kube-api-access-zjkjc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:07:53.251326 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.251305 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86d0f3de-37ea-443c-9922-a33555090907-util" (OuterVolumeSpecName: "util") pod "86d0f3de-37ea-443c-9922-a33555090907" (UID: "86d0f3de-37ea-443c-9922-a33555090907"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:07:53.251428 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.251407 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8116c3d-62d7-4108-9d00-c07c28b8c529-util" (OuterVolumeSpecName: "util") pod "e8116c3d-62d7-4108-9d00-c07c28b8c529" (UID: "e8116c3d-62d7-4108-9d00-c07c28b8c529"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:07:53.346410 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.346375 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmwd9\" (UniqueName: \"kubernetes.io/projected/86d0f3de-37ea-443c-9922-a33555090907-kube-api-access-nmwd9\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:07:53.346410 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.346403 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86d0f3de-37ea-443c-9922-a33555090907-util\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:07:53.346410 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.346414 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjkjc\" (UniqueName: \"kubernetes.io/projected/e8116c3d-62d7-4108-9d00-c07c28b8c529-kube-api-access-zjkjc\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:07:53.346611 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.346424 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86d0f3de-37ea-443c-9922-a33555090907-bundle\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:07:53.346611 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.346432 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8116c3d-62d7-4108-9d00-c07c28b8c529-bundle\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:07:53.346611 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.346440 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8116c3d-62d7-4108-9d00-c07c28b8c529-util\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:07:53.983451 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.983423 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5" Jul 10 18:07:53.983864 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.983424 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5" event={"ID":"e8116c3d-62d7-4108-9d00-c07c28b8c529","Type":"ContainerDied","Data":"29380fe715498ecf5e8aa2b607e3409cb8f48602e2f6deb72de971ded77677af"} Jul 10 18:07:53.983864 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.983549 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29380fe715498ecf5e8aa2b607e3409cb8f48602e2f6deb72de971ded77677af" Jul 10 18:07:53.985575 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.985548 2579 generic.go:356] "Generic (PLEG): container finished" podID="90dc343f-73fa-453a-9e58-26a7ce2a031b" containerID="26f54b82007edab2ff82a5578324908acee571739334614997763367b957b9ee" exitCode=0 Jul 10 18:07:53.985691 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.985617 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5" event={"ID":"90dc343f-73fa-453a-9e58-26a7ce2a031b","Type":"ContainerDied","Data":"26f54b82007edab2ff82a5578324908acee571739334614997763367b957b9ee"} Jul 10 18:07:53.987540 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.987523 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn" Jul 10 18:07:53.987637 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.987557 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn" event={"ID":"86d0f3de-37ea-443c-9922-a33555090907","Type":"ContainerDied","Data":"247909b5e5255d71483cadaba7d665e3fceadf7573365a24ef50ebb621a4a75d"} Jul 10 18:07:53.987637 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:53.987591 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="247909b5e5255d71483cadaba7d665e3fceadf7573365a24ef50ebb621a4a75d" Jul 10 18:07:54.129316 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:54.129288 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm" Jul 10 18:07:54.254105 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:54.254018 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15e75816-b35f-49e7-8dec-0f2080d3ca32-bundle\") pod \"15e75816-b35f-49e7-8dec-0f2080d3ca32\" (UID: \"15e75816-b35f-49e7-8dec-0f2080d3ca32\") " Jul 10 18:07:54.254105 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:54.254056 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15e75816-b35f-49e7-8dec-0f2080d3ca32-util\") pod \"15e75816-b35f-49e7-8dec-0f2080d3ca32\" (UID: \"15e75816-b35f-49e7-8dec-0f2080d3ca32\") " Jul 10 18:07:54.254332 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:54.254119 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxpjt\" (UniqueName: \"kubernetes.io/projected/15e75816-b35f-49e7-8dec-0f2080d3ca32-kube-api-access-jxpjt\") pod \"15e75816-b35f-49e7-8dec-0f2080d3ca32\" (UID: \"15e75816-b35f-49e7-8dec-0f2080d3ca32\") " Jul 10 18:07:54.254615 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:54.254582 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15e75816-b35f-49e7-8dec-0f2080d3ca32-bundle" (OuterVolumeSpecName: "bundle") pod "15e75816-b35f-49e7-8dec-0f2080d3ca32" (UID: "15e75816-b35f-49e7-8dec-0f2080d3ca32"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:07:54.256797 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:54.256771 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15e75816-b35f-49e7-8dec-0f2080d3ca32-kube-api-access-jxpjt" (OuterVolumeSpecName: "kube-api-access-jxpjt") pod "15e75816-b35f-49e7-8dec-0f2080d3ca32" (UID: "15e75816-b35f-49e7-8dec-0f2080d3ca32"). InnerVolumeSpecName "kube-api-access-jxpjt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:07:54.260107 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:54.260084 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15e75816-b35f-49e7-8dec-0f2080d3ca32-util" (OuterVolumeSpecName: "util") pod "15e75816-b35f-49e7-8dec-0f2080d3ca32" (UID: "15e75816-b35f-49e7-8dec-0f2080d3ca32"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:07:54.354911 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:54.354874 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15e75816-b35f-49e7-8dec-0f2080d3ca32-bundle\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:07:54.354911 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:54.354904 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15e75816-b35f-49e7-8dec-0f2080d3ca32-util\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:07:54.354911 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:54.354913 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxpjt\" (UniqueName: \"kubernetes.io/projected/15e75816-b35f-49e7-8dec-0f2080d3ca32-kube-api-access-jxpjt\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:07:54.994547 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:54.994459 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm" Jul 10 18:07:54.994547 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:54.994467 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm" event={"ID":"15e75816-b35f-49e7-8dec-0f2080d3ca32","Type":"ContainerDied","Data":"3abc50f189eaedbf973393be61025eeae9c8c9a3fa17ef12565480a4d87540ca"} Jul 10 18:07:54.994547 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:54.994536 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3abc50f189eaedbf973393be61025eeae9c8c9a3fa17ef12565480a4d87540ca" Jul 10 18:07:55.127181 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:55.127154 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5" Jul 10 18:07:55.161983 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:55.161953 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90dc343f-73fa-453a-9e58-26a7ce2a031b-bundle\") pod \"90dc343f-73fa-453a-9e58-26a7ce2a031b\" (UID: \"90dc343f-73fa-453a-9e58-26a7ce2a031b\") " Jul 10 18:07:55.162139 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:55.161991 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90dc343f-73fa-453a-9e58-26a7ce2a031b-util\") pod \"90dc343f-73fa-453a-9e58-26a7ce2a031b\" (UID: \"90dc343f-73fa-453a-9e58-26a7ce2a031b\") " Jul 10 18:07:55.162139 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:55.162028 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hpf4\" (UniqueName: \"kubernetes.io/projected/90dc343f-73fa-453a-9e58-26a7ce2a031b-kube-api-access-8hpf4\") pod \"90dc343f-73fa-453a-9e58-26a7ce2a031b\" (UID: \"90dc343f-73fa-453a-9e58-26a7ce2a031b\") " Jul 10 18:07:55.162520 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:55.162473 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90dc343f-73fa-453a-9e58-26a7ce2a031b-bundle" (OuterVolumeSpecName: "bundle") pod "90dc343f-73fa-453a-9e58-26a7ce2a031b" (UID: "90dc343f-73fa-453a-9e58-26a7ce2a031b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:07:55.164176 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:55.164145 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90dc343f-73fa-453a-9e58-26a7ce2a031b-kube-api-access-8hpf4" (OuterVolumeSpecName: "kube-api-access-8hpf4") pod "90dc343f-73fa-453a-9e58-26a7ce2a031b" (UID: "90dc343f-73fa-453a-9e58-26a7ce2a031b"). InnerVolumeSpecName "kube-api-access-8hpf4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:07:55.167688 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:55.167664 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90dc343f-73fa-453a-9e58-26a7ce2a031b-util" (OuterVolumeSpecName: "util") pod "90dc343f-73fa-453a-9e58-26a7ce2a031b" (UID: "90dc343f-73fa-453a-9e58-26a7ce2a031b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:07:55.262967 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:55.262883 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90dc343f-73fa-453a-9e58-26a7ce2a031b-bundle\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:07:55.262967 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:55.262912 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90dc343f-73fa-453a-9e58-26a7ce2a031b-util\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:07:55.262967 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:55.262921 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hpf4\" (UniqueName: \"kubernetes.io/projected/90dc343f-73fa-453a-9e58-26a7ce2a031b-kube-api-access-8hpf4\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:07:56.000915 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:56.000882 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5" Jul 10 18:07:56.001268 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:56.000883 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5" event={"ID":"90dc343f-73fa-453a-9e58-26a7ce2a031b","Type":"ContainerDied","Data":"1ca00d7849bc02220fdab510f85cda94575624c90d41499caf74c17361e71e1d"} Jul 10 18:07:56.001268 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:56.001000 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ca00d7849bc02220fdab510f85cda94575624c90d41499caf74c17361e71e1d" Jul 10 18:07:58.267570 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:58.267531 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:58.267960 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:58.267800 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:58.272382 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:58.272361 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:59.020928 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:59.020894 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55cb8c785f-qqxg7" Jul 10 18:07:59.070840 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:07:59.070807 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c79499fd8-42flf"] Jul 10 18:08:24.092209 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.092121 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c79499fd8-42flf" podUID="4289ab81-8417-4ea6-9b68-f8cf21c6f1d6" containerName="console" containerID="cri-o://0c3a1416aea1033b986db024ea4e9c5f9acc0616b50b2483cc421ab1ac032c32" gracePeriod=15 Jul 10 18:08:24.347937 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.347877 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:08:24.426808 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.426770 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-service-ca\") pod \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " Jul 10 18:08:24.426982 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.426843 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-oauth-serving-cert\") pod \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " Jul 10 18:08:24.426982 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.426890 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-console-serving-cert\") pod \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " Jul 10 18:08:24.426982 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.426926 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrh6q\" (UniqueName: \"kubernetes.io/projected/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-kube-api-access-wrh6q\") pod \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " Jul 10 18:08:24.427098 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.426980 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-console-oauth-config\") pod \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " Jul 10 18:08:24.427098 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.427023 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-console-config\") pod \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " Jul 10 18:08:24.427098 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.427068 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-trusted-ca-bundle\") pod \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\" (UID: \"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6\") " Jul 10 18:08:24.427429 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.427278 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-service-ca" (OuterVolumeSpecName: "service-ca") pod "4289ab81-8417-4ea6-9b68-f8cf21c6f1d6" (UID: "4289ab81-8417-4ea6-9b68-f8cf21c6f1d6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:08:24.427429 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.427323 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4289ab81-8417-4ea6-9b68-f8cf21c6f1d6" (UID: "4289ab81-8417-4ea6-9b68-f8cf21c6f1d6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:08:24.427429 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.427345 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-service-ca\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:08:24.427632 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.427448 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-console-config" (OuterVolumeSpecName: "console-config") pod "4289ab81-8417-4ea6-9b68-f8cf21c6f1d6" (UID: "4289ab81-8417-4ea6-9b68-f8cf21c6f1d6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:08:24.427632 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.427613 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4289ab81-8417-4ea6-9b68-f8cf21c6f1d6" (UID: "4289ab81-8417-4ea6-9b68-f8cf21c6f1d6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:08:24.429208 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.429182 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4289ab81-8417-4ea6-9b68-f8cf21c6f1d6" (UID: "4289ab81-8417-4ea6-9b68-f8cf21c6f1d6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:08:24.429307 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.429224 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4289ab81-8417-4ea6-9b68-f8cf21c6f1d6" (UID: "4289ab81-8417-4ea6-9b68-f8cf21c6f1d6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:08:24.429307 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.429228 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-kube-api-access-wrh6q" (OuterVolumeSpecName: "kube-api-access-wrh6q") pod "4289ab81-8417-4ea6-9b68-f8cf21c6f1d6" (UID: "4289ab81-8417-4ea6-9b68-f8cf21c6f1d6"). InnerVolumeSpecName "kube-api-access-wrh6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:08:24.527836 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.527807 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-oauth-serving-cert\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:08:24.527836 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.527833 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-console-serving-cert\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:08:24.528037 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.527842 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrh6q\" (UniqueName: \"kubernetes.io/projected/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-kube-api-access-wrh6q\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:08:24.528037 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.527875 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-console-oauth-config\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:08:24.528037 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.527885 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-console-config\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:08:24.528037 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:24.527893 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6-trusted-ca-bundle\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:08:25.157660 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:25.157626 2579 generic.go:356] "Generic (PLEG): container finished" podID="4289ab81-8417-4ea6-9b68-f8cf21c6f1d6" containerID="0c3a1416aea1033b986db024ea4e9c5f9acc0616b50b2483cc421ab1ac032c32" exitCode=0 Jul 10 18:08:25.158073 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:25.157667 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c79499fd8-42flf" event={"ID":"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6","Type":"ContainerDied","Data":"0c3a1416aea1033b986db024ea4e9c5f9acc0616b50b2483cc421ab1ac032c32"} Jul 10 18:08:25.158073 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:25.157672 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c79499fd8-42flf" Jul 10 18:08:25.158073 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:25.157709 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c79499fd8-42flf" event={"ID":"4289ab81-8417-4ea6-9b68-f8cf21c6f1d6","Type":"ContainerDied","Data":"790de6bc9f07f882da34e87ef50736a4dd5b26c77b7bed3c23478fa269c083bf"} Jul 10 18:08:25.158073 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:25.157733 2579 scope.go:117] "RemoveContainer" containerID="0c3a1416aea1033b986db024ea4e9c5f9acc0616b50b2483cc421ab1ac032c32" Jul 10 18:08:25.166238 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:25.166219 2579 scope.go:117] "RemoveContainer" containerID="0c3a1416aea1033b986db024ea4e9c5f9acc0616b50b2483cc421ab1ac032c32" Jul 10 18:08:25.166493 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:08:25.166471 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c3a1416aea1033b986db024ea4e9c5f9acc0616b50b2483cc421ab1ac032c32\": container with ID starting with 0c3a1416aea1033b986db024ea4e9c5f9acc0616b50b2483cc421ab1ac032c32 not found: ID does not exist" containerID="0c3a1416aea1033b986db024ea4e9c5f9acc0616b50b2483cc421ab1ac032c32" Jul 10 18:08:25.166556 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:25.166503 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c3a1416aea1033b986db024ea4e9c5f9acc0616b50b2483cc421ab1ac032c32"} err="failed to get container status \"0c3a1416aea1033b986db024ea4e9c5f9acc0616b50b2483cc421ab1ac032c32\": rpc error: code = NotFound desc = could not find container \"0c3a1416aea1033b986db024ea4e9c5f9acc0616b50b2483cc421ab1ac032c32\": container with ID starting with 0c3a1416aea1033b986db024ea4e9c5f9acc0616b50b2483cc421ab1ac032c32 not found: ID does not exist" Jul 10 18:08:25.174839 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:25.174818 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c79499fd8-42flf"] Jul 10 18:08:25.179044 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:25.179024 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c79499fd8-42flf"] Jul 10 18:08:26.675346 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:08:26.675311 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4289ab81-8417-4ea6-9b68-f8cf21c6f1d6" path="/var/lib/kubelet/pods/4289ab81-8417-4ea6-9b68-f8cf21c6f1d6/volumes" Jul 10 18:09:00.582657 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.582622 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch"] Jul 10 18:09:00.583124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583005 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90dc343f-73fa-453a-9e58-26a7ce2a031b" containerName="pull" Jul 10 18:09:00.583124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583018 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="90dc343f-73fa-453a-9e58-26a7ce2a031b" containerName="pull" Jul 10 18:09:00.583124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583029 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e75816-b35f-49e7-8dec-0f2080d3ca32" containerName="extract" Jul 10 18:09:00.583124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583035 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e75816-b35f-49e7-8dec-0f2080d3ca32" containerName="extract" Jul 10 18:09:00.583124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583042 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d0f3de-37ea-443c-9922-a33555090907" containerName="util" Jul 10 18:09:00.583124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583048 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d0f3de-37ea-443c-9922-a33555090907" containerName="util" Jul 10 18:09:00.583124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583059 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e75816-b35f-49e7-8dec-0f2080d3ca32" containerName="util" Jul 10 18:09:00.583124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583066 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e75816-b35f-49e7-8dec-0f2080d3ca32" containerName="util" Jul 10 18:09:00.583124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583074 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90dc343f-73fa-453a-9e58-26a7ce2a031b" containerName="util" Jul 10 18:09:00.583124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583079 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="90dc343f-73fa-453a-9e58-26a7ce2a031b" containerName="util" Jul 10 18:09:00.583124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583084 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d0f3de-37ea-443c-9922-a33555090907" containerName="pull" Jul 10 18:09:00.583124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583089 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d0f3de-37ea-443c-9922-a33555090907" containerName="pull" Jul 10 18:09:00.583124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583096 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8116c3d-62d7-4108-9d00-c07c28b8c529" containerName="pull" Jul 10 18:09:00.583124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583101 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8116c3d-62d7-4108-9d00-c07c28b8c529" containerName="pull" Jul 10 18:09:00.583124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583107 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d0f3de-37ea-443c-9922-a33555090907" containerName="extract" Jul 10 18:09:00.583124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583111 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d0f3de-37ea-443c-9922-a33555090907" containerName="extract" Jul 10 18:09:00.583124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583117 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8116c3d-62d7-4108-9d00-c07c28b8c529" containerName="extract" Jul 10 18:09:00.583124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583122 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8116c3d-62d7-4108-9d00-c07c28b8c529" containerName="extract" Jul 10 18:09:00.583124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583130 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4289ab81-8417-4ea6-9b68-f8cf21c6f1d6" containerName="console" Jul 10 18:09:00.583124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583134 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4289ab81-8417-4ea6-9b68-f8cf21c6f1d6" containerName="console" Jul 10 18:09:00.583705 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583140 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e75816-b35f-49e7-8dec-0f2080d3ca32" containerName="pull" Jul 10 18:09:00.583705 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583144 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e75816-b35f-49e7-8dec-0f2080d3ca32" containerName="pull" Jul 10 18:09:00.583705 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583152 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8116c3d-62d7-4108-9d00-c07c28b8c529" containerName="util" Jul 10 18:09:00.583705 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583157 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8116c3d-62d7-4108-9d00-c07c28b8c529" containerName="util" Jul 10 18:09:00.583705 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583164 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90dc343f-73fa-453a-9e58-26a7ce2a031b" containerName="extract" Jul 10 18:09:00.583705 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583169 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="90dc343f-73fa-453a-9e58-26a7ce2a031b" containerName="extract" Jul 10 18:09:00.583705 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583227 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="15e75816-b35f-49e7-8dec-0f2080d3ca32" containerName="extract" Jul 10 18:09:00.583705 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583234 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8116c3d-62d7-4108-9d00-c07c28b8c529" containerName="extract" Jul 10 18:09:00.583705 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583241 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4289ab81-8417-4ea6-9b68-f8cf21c6f1d6" containerName="console" Jul 10 18:09:00.583705 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583247 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="86d0f3de-37ea-443c-9922-a33555090907" containerName="extract" Jul 10 18:09:00.583705 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.583252 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="90dc343f-73fa-453a-9e58-26a7ce2a031b" containerName="extract" Jul 10 18:09:00.586402 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.586384 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.588961 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.588944 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-bztpf\"" Jul 10 18:09:00.597179 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.597153 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch"] Jul 10 18:09:00.745934 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.745902 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/849be59f-f5c9-4317-9c40-4035f553b744-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.746103 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.745955 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/849be59f-f5c9-4317-9c40-4035f553b744-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.746103 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.745988 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/849be59f-f5c9-4317-9c40-4035f553b744-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.746103 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.746020 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/849be59f-f5c9-4317-9c40-4035f553b744-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.746103 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.746034 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss765\" (UniqueName: \"kubernetes.io/projected/849be59f-f5c9-4317-9c40-4035f553b744-kube-api-access-ss765\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.746103 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.746085 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/849be59f-f5c9-4317-9c40-4035f553b744-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.746103 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.746101 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/849be59f-f5c9-4317-9c40-4035f553b744-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.746295 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.746121 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/849be59f-f5c9-4317-9c40-4035f553b744-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.746295 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.746140 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/849be59f-f5c9-4317-9c40-4035f553b744-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.847293 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.847214 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/849be59f-f5c9-4317-9c40-4035f553b744-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.847293 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.847267 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/849be59f-f5c9-4317-9c40-4035f553b744-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.847293 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.847291 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/849be59f-f5c9-4317-9c40-4035f553b744-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.847557 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.847321 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/849be59f-f5c9-4317-9c40-4035f553b744-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.847557 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.847339 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss765\" (UniqueName: \"kubernetes.io/projected/849be59f-f5c9-4317-9c40-4035f553b744-kube-api-access-ss765\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.847557 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.847368 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/849be59f-f5c9-4317-9c40-4035f553b744-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.847557 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.847393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/849be59f-f5c9-4317-9c40-4035f553b744-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.847557 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.847421 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/849be59f-f5c9-4317-9c40-4035f553b744-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.847557 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.847449 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/849be59f-f5c9-4317-9c40-4035f553b744-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.847909 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.847882 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/849be59f-f5c9-4317-9c40-4035f553b744-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.847990 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.847951 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/849be59f-f5c9-4317-9c40-4035f553b744-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.847990 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.847983 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/849be59f-f5c9-4317-9c40-4035f553b744-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.848101 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.848057 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/849be59f-f5c9-4317-9c40-4035f553b744-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.848248 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.848225 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/849be59f-f5c9-4317-9c40-4035f553b744-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.849686 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.849656 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/849be59f-f5c9-4317-9c40-4035f553b744-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.849895 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.849877 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/849be59f-f5c9-4317-9c40-4035f553b744-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.855387 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.855359 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss765\" (UniqueName: \"kubernetes.io/projected/849be59f-f5c9-4317-9c40-4035f553b744-kube-api-access-ss765\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.855467 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.855401 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/849be59f-f5c9-4317-9c40-4035f553b744-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ggjch\" (UID: \"849be59f-f5c9-4317-9c40-4035f553b744\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:00.897519 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:00.897494 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:01.032283 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:01.032257 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch"] Jul 10 18:09:01.033605 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:09:01.033573 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod849be59f_f5c9_4317_9c40_4035f553b744.slice/crio-16f424b7a67067d35bbdf56196a169a432c9aa12249ec61d2fd22e781f2b3f69 WatchSource:0}: Error finding container 16f424b7a67067d35bbdf56196a169a432c9aa12249ec61d2fd22e781f2b3f69: Status 404 returned error can't find the container with id 16f424b7a67067d35bbdf56196a169a432c9aa12249ec61d2fd22e781f2b3f69 Jul 10 18:09:01.035764 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:01.035732 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:09:01.035840 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:01.035796 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:09:01.035840 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:01.035825 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:09:01.344643 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:01.344601 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" event={"ID":"849be59f-f5c9-4317-9c40-4035f553b744","Type":"ContainerStarted","Data":"9910a0806d01d6d1cc2e9a650f51482982144cff152fc3f9df436eece035b820"} Jul 10 18:09:01.344819 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:01.344668 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" event={"ID":"849be59f-f5c9-4317-9c40-4035f553b744","Type":"ContainerStarted","Data":"16f424b7a67067d35bbdf56196a169a432c9aa12249ec61d2fd22e781f2b3f69"} Jul 10 18:09:01.364822 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:01.364766 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" podStartSLOduration=1.364748574 podStartE2EDuration="1.364748574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:09:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:09:01.361506358 +0000 UTC m=+573.202334613" watchObservedRunningTime="2026-07-10 18:09:01.364748574 +0000 UTC m=+573.205576829" Jul 10 18:09:01.897977 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:01.897948 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:02.902809 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:02.902777 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:03.355605 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:03.355575 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:09:03.356688 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:09:03.356671 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:10:37.857561 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:37.857485 2579 generic.go:356] "Generic (PLEG): container finished" podID="849be59f-f5c9-4317-9c40-4035f553b744" containerID="9910a0806d01d6d1cc2e9a650f51482982144cff152fc3f9df436eece035b820" exitCode=0 Jul 10 18:10:37.857561 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:37.857526 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" event={"ID":"849be59f-f5c9-4317-9c40-4035f553b744","Type":"ContainerDied","Data":"9910a0806d01d6d1cc2e9a650f51482982144cff152fc3f9df436eece035b820"} Jul 10 18:10:37.858009 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:37.857914 2579 scope.go:117] "RemoveContainer" containerID="9910a0806d01d6d1cc2e9a650f51482982144cff152fc3f9df436eece035b820" Jul 10 18:10:37.858982 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:37.858955 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:10:37.859063 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:37.859024 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:10:37.859063 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:37.859057 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:10:38.871022 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:38.870985 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" event={"ID":"849be59f-f5c9-4317-9c40-4035f553b744","Type":"ContainerStarted","Data":"b48ca2ccbc4dde3fa04df5e7f5659779daa73006a3aabf7dd16d42cafb4a7478"} Jul 10 18:10:38.898443 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:38.898417 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:10:38.898612 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:38.898589 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-ggjch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 10 18:10:38.898669 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:38.898649 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" podUID="849be59f-f5c9-4317-9c40-4035f553b744" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 10 18:10:39.898653 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:39.898619 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-ggjch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 10 18:10:39.899056 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:39.898689 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" podUID="849be59f-f5c9-4317-9c40-4035f553b744" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 10 18:10:40.898611 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:40.898573 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-ggjch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 10 18:10:40.898792 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:40.898626 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" podUID="849be59f-f5c9-4317-9c40-4035f553b744" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 10 18:10:41.898293 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:41.898260 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-ggjch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 10 18:10:41.898455 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:41.898308 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" podUID="849be59f-f5c9-4317-9c40-4035f553b744" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 10 18:10:42.901144 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:42.901113 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:10:42.901527 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:42.901377 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:10:42.902089 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:42.902070 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ggjch" Jul 10 18:10:55.645755 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.645710 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6"] Jul 10 18:10:55.648378 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.648361 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:10:55.651127 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.651100 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 10 18:10:55.651261 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.651178 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 10 18:10:55.652310 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.652280 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 10 18:10:55.652405 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.652314 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-n65md\"" Jul 10 18:10:55.663387 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.663365 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6"] Jul 10 18:10:55.754252 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.754223 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28621025-6cad-440f-8665-a2e253511c96-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vlph6\" (UID: \"28621025-6cad-440f-8665-a2e253511c96\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:10:55.754252 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.754254 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7xdq\" (UniqueName: \"kubernetes.io/projected/28621025-6cad-440f-8665-a2e253511c96-kube-api-access-w7xdq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vlph6\" (UID: \"28621025-6cad-440f-8665-a2e253511c96\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:10:55.754420 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.754280 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28621025-6cad-440f-8665-a2e253511c96-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vlph6\" (UID: \"28621025-6cad-440f-8665-a2e253511c96\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:10:55.754420 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.754299 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28621025-6cad-440f-8665-a2e253511c96-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vlph6\" (UID: \"28621025-6cad-440f-8665-a2e253511c96\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:10:55.754420 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.754335 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28621025-6cad-440f-8665-a2e253511c96-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vlph6\" (UID: \"28621025-6cad-440f-8665-a2e253511c96\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:10:55.754420 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.754366 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28621025-6cad-440f-8665-a2e253511c96-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vlph6\" (UID: \"28621025-6cad-440f-8665-a2e253511c96\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:10:55.854969 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.854937 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28621025-6cad-440f-8665-a2e253511c96-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vlph6\" (UID: \"28621025-6cad-440f-8665-a2e253511c96\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:10:55.854969 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.854970 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7xdq\" (UniqueName: \"kubernetes.io/projected/28621025-6cad-440f-8665-a2e253511c96-kube-api-access-w7xdq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vlph6\" (UID: \"28621025-6cad-440f-8665-a2e253511c96\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:10:55.855167 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.854997 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28621025-6cad-440f-8665-a2e253511c96-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vlph6\" (UID: \"28621025-6cad-440f-8665-a2e253511c96\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:10:55.855167 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.855015 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28621025-6cad-440f-8665-a2e253511c96-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vlph6\" (UID: \"28621025-6cad-440f-8665-a2e253511c96\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:10:55.855167 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.855051 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28621025-6cad-440f-8665-a2e253511c96-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vlph6\" (UID: \"28621025-6cad-440f-8665-a2e253511c96\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:10:55.855167 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.855098 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28621025-6cad-440f-8665-a2e253511c96-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vlph6\" (UID: \"28621025-6cad-440f-8665-a2e253511c96\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:10:55.855380 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.855359 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28621025-6cad-440f-8665-a2e253511c96-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vlph6\" (UID: \"28621025-6cad-440f-8665-a2e253511c96\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:10:55.855416 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.855392 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28621025-6cad-440f-8665-a2e253511c96-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vlph6\" (UID: \"28621025-6cad-440f-8665-a2e253511c96\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:10:55.855450 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.855439 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28621025-6cad-440f-8665-a2e253511c96-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vlph6\" (UID: \"28621025-6cad-440f-8665-a2e253511c96\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:10:55.857379 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.857355 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28621025-6cad-440f-8665-a2e253511c96-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vlph6\" (UID: \"28621025-6cad-440f-8665-a2e253511c96\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:10:55.857474 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.857461 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28621025-6cad-440f-8665-a2e253511c96-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vlph6\" (UID: \"28621025-6cad-440f-8665-a2e253511c96\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:10:55.865722 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.865697 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7xdq\" (UniqueName: \"kubernetes.io/projected/28621025-6cad-440f-8665-a2e253511c96-kube-api-access-w7xdq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vlph6\" (UID: \"28621025-6cad-440f-8665-a2e253511c96\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:10:55.959028 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:55.958953 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:10:56.092770 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:56.092739 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6"] Jul 10 18:10:56.095788 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:10:56.095756 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28621025_6cad_440f_8665_a2e253511c96.slice/crio-e7458d8181535c0eb311142a79907010eebd2b258d2794038f3daaa0406e3dc5 WatchSource:0}: Error finding container e7458d8181535c0eb311142a79907010eebd2b258d2794038f3daaa0406e3dc5: Status 404 returned error can't find the container with id e7458d8181535c0eb311142a79907010eebd2b258d2794038f3daaa0406e3dc5 Jul 10 18:10:56.097584 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:56.097565 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 18:10:56.966072 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:56.966033 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" event={"ID":"28621025-6cad-440f-8665-a2e253511c96","Type":"ContainerStarted","Data":"e7458d8181535c0eb311142a79907010eebd2b258d2794038f3daaa0406e3dc5"} Jul 10 18:10:57.972596 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:57.972559 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" event={"ID":"28621025-6cad-440f-8665-a2e253511c96","Type":"ContainerStarted","Data":"5766221122d2d01c9ae15faa6f51ff7d3d4749f4abcd9f7ae1d017f13b9f29f6"} Jul 10 18:10:58.000553 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:10:58.000503 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" podStartSLOduration=1.992803759 podStartE2EDuration="3.000489215s" totalImagesPullingTime="1.007685456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:10:57.997632266 +0000 UTC m=+689.838460521" watchObservedRunningTime="2026-07-10 18:10:58.000489215 +0000 UTC m=+689.841317468" Jul 10 18:11:05.959754 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:05.959713 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:11:05.960238 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:05.959818 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:11:05.972092 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:05.972070 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:11:06.025745 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:06.025721 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vlph6" Jul 10 18:11:08.859025 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:08.858984 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb"] Jul 10 18:11:08.861656 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:08.861628 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:08.864757 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:08.864739 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 10 18:11:08.869979 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:08.869958 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ee3f050-6072-4abb-ae91-dca9edda998f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb\" (UID: \"7ee3f050-6072-4abb-ae91-dca9edda998f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:08.870086 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:08.869986 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ee3f050-6072-4abb-ae91-dca9edda998f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb\" (UID: \"7ee3f050-6072-4abb-ae91-dca9edda998f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:08.870086 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:08.870007 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ee3f050-6072-4abb-ae91-dca9edda998f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb\" (UID: \"7ee3f050-6072-4abb-ae91-dca9edda998f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:08.870171 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:08.870101 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v474k\" (UniqueName: \"kubernetes.io/projected/7ee3f050-6072-4abb-ae91-dca9edda998f-kube-api-access-v474k\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb\" (UID: \"7ee3f050-6072-4abb-ae91-dca9edda998f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:08.870171 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:08.870140 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ee3f050-6072-4abb-ae91-dca9edda998f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb\" (UID: \"7ee3f050-6072-4abb-ae91-dca9edda998f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:08.870171 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:08.870163 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ee3f050-6072-4abb-ae91-dca9edda998f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb\" (UID: \"7ee3f050-6072-4abb-ae91-dca9edda998f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:08.884741 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:08.884715 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb"] Jul 10 18:11:08.971145 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:08.971113 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v474k\" (UniqueName: \"kubernetes.io/projected/7ee3f050-6072-4abb-ae91-dca9edda998f-kube-api-access-v474k\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb\" (UID: \"7ee3f050-6072-4abb-ae91-dca9edda998f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:08.971306 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:08.971150 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ee3f050-6072-4abb-ae91-dca9edda998f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb\" (UID: \"7ee3f050-6072-4abb-ae91-dca9edda998f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:08.971306 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:08.971170 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ee3f050-6072-4abb-ae91-dca9edda998f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb\" (UID: \"7ee3f050-6072-4abb-ae91-dca9edda998f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:08.971306 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:08.971274 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ee3f050-6072-4abb-ae91-dca9edda998f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb\" (UID: \"7ee3f050-6072-4abb-ae91-dca9edda998f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:08.971306 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:08.971297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ee3f050-6072-4abb-ae91-dca9edda998f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb\" (UID: \"7ee3f050-6072-4abb-ae91-dca9edda998f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:08.971593 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:08.971325 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ee3f050-6072-4abb-ae91-dca9edda998f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb\" (UID: \"7ee3f050-6072-4abb-ae91-dca9edda998f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:08.971652 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:08.971607 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ee3f050-6072-4abb-ae91-dca9edda998f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb\" (UID: \"7ee3f050-6072-4abb-ae91-dca9edda998f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:08.971711 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:08.971691 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ee3f050-6072-4abb-ae91-dca9edda998f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb\" (UID: \"7ee3f050-6072-4abb-ae91-dca9edda998f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:08.971760 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:08.971742 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ee3f050-6072-4abb-ae91-dca9edda998f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb\" (UID: \"7ee3f050-6072-4abb-ae91-dca9edda998f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:08.973401 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:08.973380 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ee3f050-6072-4abb-ae91-dca9edda998f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb\" (UID: \"7ee3f050-6072-4abb-ae91-dca9edda998f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:08.973694 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:08.973676 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ee3f050-6072-4abb-ae91-dca9edda998f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb\" (UID: \"7ee3f050-6072-4abb-ae91-dca9edda998f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:08.987389 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:08.987363 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v474k\" (UniqueName: \"kubernetes.io/projected/7ee3f050-6072-4abb-ae91-dca9edda998f-kube-api-access-v474k\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb\" (UID: \"7ee3f050-6072-4abb-ae91-dca9edda998f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:09.171400 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:09.171318 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:09.304121 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:09.304095 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb"] Jul 10 18:11:09.305430 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:11:09.305405 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ee3f050_6072_4abb_ae91_dca9edda998f.slice/crio-31247d35b7801da13d33acd11aa4a168eeba3fc5e5b463b90fccde048ef2a7ac WatchSource:0}: Error finding container 31247d35b7801da13d33acd11aa4a168eeba3fc5e5b463b90fccde048ef2a7ac: Status 404 returned error can't find the container with id 31247d35b7801da13d33acd11aa4a168eeba3fc5e5b463b90fccde048ef2a7ac Jul 10 18:11:10.036476 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:10.036440 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" event={"ID":"7ee3f050-6072-4abb-ae91-dca9edda998f","Type":"ContainerStarted","Data":"57ed845650a195a277ec0f300d7ab02c4f9024c63d4972f851aef9532480df71"} Jul 10 18:11:10.036893 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:10.036489 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" event={"ID":"7ee3f050-6072-4abb-ae91-dca9edda998f","Type":"ContainerStarted","Data":"31247d35b7801da13d33acd11aa4a168eeba3fc5e5b463b90fccde048ef2a7ac"} Jul 10 18:11:10.065352 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:10.065306 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" podStartSLOduration=1.8361248570000002 podStartE2EDuration="2.065291877s" totalImagesPullingTime="229.16702ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:11:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:11:10.062283176 +0000 UTC m=+701.903111442" watchObservedRunningTime="2026-07-10 18:11:10.065291877 +0000 UTC m=+701.906120150" Jul 10 18:11:19.172320 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:19.172278 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:19.172799 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:19.172346 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:19.184980 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:19.184954 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:11:20.099151 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:11:20.099121 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb" Jul 10 18:26:21.472199 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.472162 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z"] Jul 10 18:26:21.475734 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.475714 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.479356 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.479334 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-033a05f0-openshift-default-dockercfg-kmh95\"" Jul 10 18:26:21.501710 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.501682 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z"] Jul 10 18:26:21.503678 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.503653 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-istio-data\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.503772 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.503694 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ae51860-721e-46ae-a26f-60706752d6c2-istiod-ca-cert\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.503819 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.503798 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-workload-certs\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.503887 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.503839 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-workload-socket\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.503930 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.503898 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ae51860-721e-46ae-a26f-60706752d6c2-istio-podinfo\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.503965 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.503934 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-credential-socket\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.504022 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.504004 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dvfx\" (UniqueName: \"kubernetes.io/projected/4ae51860-721e-46ae-a26f-60706752d6c2-kube-api-access-8dvfx\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.504060 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.504038 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ae51860-721e-46ae-a26f-60706752d6c2-istio-token\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.504060 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.504056 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-istio-envoy\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.604893 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.604833 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-istio-data\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.604893 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.604901 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ae51860-721e-46ae-a26f-60706752d6c2-istiod-ca-cert\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.605141 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.604938 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-workload-certs\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.605141 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.604955 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-workload-socket\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.605141 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.604973 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ae51860-721e-46ae-a26f-60706752d6c2-istio-podinfo\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.605141 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.605057 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-credential-socket\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.605349 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.605145 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dvfx\" (UniqueName: \"kubernetes.io/projected/4ae51860-721e-46ae-a26f-60706752d6c2-kube-api-access-8dvfx\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.605349 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.605181 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ae51860-721e-46ae-a26f-60706752d6c2-istio-token\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.605349 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.605205 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-istio-envoy\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.605349 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.605310 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-istio-data\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.605349 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.605335 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-workload-socket\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.605567 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.605413 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-workload-certs\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.605695 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.605675 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ae51860-721e-46ae-a26f-60706752d6c2-istiod-ca-cert\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.605788 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.605769 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-credential-socket\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.607364 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.607338 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-istio-envoy\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.607364 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.607361 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ae51860-721e-46ae-a26f-60706752d6c2-istio-podinfo\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.614723 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.614702 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dvfx\" (UniqueName: \"kubernetes.io/projected/4ae51860-721e-46ae-a26f-60706752d6c2-kube-api-access-8dvfx\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.618470 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.618445 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ae51860-721e-46ae-a26f-60706752d6c2-istio-token\") pod \"e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.786393 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.786330 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:21.921622 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.921593 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z"] Jul 10 18:26:21.922876 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:26:21.922838 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ae51860_721e_46ae_a26f_60706752d6c2.slice/crio-58f9eff8884e288a38a946e35147eb4e9ff117f335e57403efa4459b2d5b2fa7 WatchSource:0}: Error finding container 58f9eff8884e288a38a946e35147eb4e9ff117f335e57403efa4459b2d5b2fa7: Status 404 returned error can't find the container with id 58f9eff8884e288a38a946e35147eb4e9ff117f335e57403efa4459b2d5b2fa7 Jul 10 18:26:21.924942 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.924907 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:26:21.925039 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.924988 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:26:21.925100 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:21.925035 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:26:22.901200 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:22.901164 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" event={"ID":"4ae51860-721e-46ae-a26f-60706752d6c2","Type":"ContainerStarted","Data":"a5e9e956b4ecfc2ee15c2728606dd247805691f9175642ed86d27fd8ac6dfa4e"} Jul 10 18:26:22.901579 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:22.901217 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" event={"ID":"4ae51860-721e-46ae-a26f-60706752d6c2","Type":"ContainerStarted","Data":"58f9eff8884e288a38a946e35147eb4e9ff117f335e57403efa4459b2d5b2fa7"} Jul 10 18:26:22.927499 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:22.927446 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" podStartSLOduration=1.927431319 podStartE2EDuration="1.927431319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:26:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:26:22.924817008 +0000 UTC m=+1614.765645261" watchObservedRunningTime="2026-07-10 18:26:22.927431319 +0000 UTC m=+1614.768259573" Jul 10 18:26:23.786777 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:23.786742 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:23.791345 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:23.791319 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:23.906673 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:23.906646 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:23.907542 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:23.907526 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:27.778894 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:27.778859 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z"] Jul 10 18:26:27.779298 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:27.779075 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" podUID="4ae51860-721e-46ae-a26f-60706752d6c2" containerName="istio-proxy" containerID="cri-o://a5e9e956b4ecfc2ee15c2728606dd247805691f9175642ed86d27fd8ac6dfa4e" gracePeriod=30 Jul 10 18:26:32.958740 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:32.958704 2579 generic.go:356] "Generic (PLEG): container finished" podID="4ae51860-721e-46ae-a26f-60706752d6c2" containerID="a5e9e956b4ecfc2ee15c2728606dd247805691f9175642ed86d27fd8ac6dfa4e" exitCode=0 Jul 10 18:26:32.959067 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:32.958773 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" event={"ID":"4ae51860-721e-46ae-a26f-60706752d6c2","Type":"ContainerDied","Data":"a5e9e956b4ecfc2ee15c2728606dd247805691f9175642ed86d27fd8ac6dfa4e"} Jul 10 18:26:33.016885 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.016838 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:33.120662 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.120635 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-credential-socket\") pod \"4ae51860-721e-46ae-a26f-60706752d6c2\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " Jul 10 18:26:33.120801 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.120668 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ae51860-721e-46ae-a26f-60706752d6c2-istio-podinfo\") pod \"4ae51860-721e-46ae-a26f-60706752d6c2\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " Jul 10 18:26:33.120801 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.120710 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ae51860-721e-46ae-a26f-60706752d6c2-istiod-ca-cert\") pod \"4ae51860-721e-46ae-a26f-60706752d6c2\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " Jul 10 18:26:33.120801 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.120744 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ae51860-721e-46ae-a26f-60706752d6c2-istio-token\") pod \"4ae51860-721e-46ae-a26f-60706752d6c2\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " Jul 10 18:26:33.120801 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.120780 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-istio-envoy\") pod \"4ae51860-721e-46ae-a26f-60706752d6c2\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " Jul 10 18:26:33.121026 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.120807 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-workload-certs\") pod \"4ae51860-721e-46ae-a26f-60706752d6c2\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " Jul 10 18:26:33.121026 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.120845 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-istio-data\") pod \"4ae51860-721e-46ae-a26f-60706752d6c2\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " Jul 10 18:26:33.121026 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.120896 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-workload-socket\") pod \"4ae51860-721e-46ae-a26f-60706752d6c2\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " Jul 10 18:26:33.121026 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.120940 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4ae51860-721e-46ae-a26f-60706752d6c2" (UID: "4ae51860-721e-46ae-a26f-60706752d6c2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:26:33.121026 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.120965 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dvfx\" (UniqueName: \"kubernetes.io/projected/4ae51860-721e-46ae-a26f-60706752d6c2-kube-api-access-8dvfx\") pod \"4ae51860-721e-46ae-a26f-60706752d6c2\" (UID: \"4ae51860-721e-46ae-a26f-60706752d6c2\") " Jul 10 18:26:33.121275 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.121111 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4ae51860-721e-46ae-a26f-60706752d6c2" (UID: "4ae51860-721e-46ae-a26f-60706752d6c2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:26:33.121275 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.121177 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4ae51860-721e-46ae-a26f-60706752d6c2" (UID: "4ae51860-721e-46ae-a26f-60706752d6c2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:26:33.121275 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.121202 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-istio-data" (OuterVolumeSpecName: "istio-data") pod "4ae51860-721e-46ae-a26f-60706752d6c2" (UID: "4ae51860-721e-46ae-a26f-60706752d6c2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:26:33.121275 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.121218 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ae51860-721e-46ae-a26f-60706752d6c2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4ae51860-721e-46ae-a26f-60706752d6c2" (UID: "4ae51860-721e-46ae-a26f-60706752d6c2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:26:33.121466 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.121428 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-credential-socket\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:26:33.121466 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.121450 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ae51860-721e-46ae-a26f-60706752d6c2-istiod-ca-cert\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:26:33.121569 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.121465 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-workload-certs\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:26:33.121569 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.121479 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-istio-data\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:26:33.121569 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.121492 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-workload-socket\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:26:33.123127 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.123103 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ae51860-721e-46ae-a26f-60706752d6c2-kube-api-access-8dvfx" (OuterVolumeSpecName: "kube-api-access-8dvfx") pod "4ae51860-721e-46ae-a26f-60706752d6c2" (UID: "4ae51860-721e-46ae-a26f-60706752d6c2"). InnerVolumeSpecName "kube-api-access-8dvfx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:26:33.123127 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.123111 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4ae51860-721e-46ae-a26f-60706752d6c2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4ae51860-721e-46ae-a26f-60706752d6c2" (UID: "4ae51860-721e-46ae-a26f-60706752d6c2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 18:26:33.123273 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.123153 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ae51860-721e-46ae-a26f-60706752d6c2-istio-token" (OuterVolumeSpecName: "istio-token") pod "4ae51860-721e-46ae-a26f-60706752d6c2" (UID: "4ae51860-721e-46ae-a26f-60706752d6c2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:26:33.123358 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.123341 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4ae51860-721e-46ae-a26f-60706752d6c2" (UID: "4ae51860-721e-46ae-a26f-60706752d6c2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:26:33.222673 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.222644 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dvfx\" (UniqueName: \"kubernetes.io/projected/4ae51860-721e-46ae-a26f-60706752d6c2-kube-api-access-8dvfx\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:26:33.222673 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.222670 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ae51860-721e-46ae-a26f-60706752d6c2-istio-podinfo\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:26:33.222819 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.222685 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ae51860-721e-46ae-a26f-60706752d6c2-istio-token\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:26:33.222819 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.222697 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ae51860-721e-46ae-a26f-60706752d6c2-istio-envoy\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:26:33.905338 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.905304 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh"] Jul 10 18:26:33.905944 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.905925 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae51860-721e-46ae-a26f-60706752d6c2" containerName="istio-proxy" Jul 10 18:26:33.906006 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.905947 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae51860-721e-46ae-a26f-60706752d6c2" containerName="istio-proxy" Jul 10 18:26:33.906057 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.906045 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ae51860-721e-46ae-a26f-60706752d6c2" containerName="istio-proxy" Jul 10 18:26:33.909784 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.909762 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:33.912117 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.912098 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-65827bae-openshift-default-dockercfg-5vgfm\"" Jul 10 18:26:33.924163 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.924138 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh"] Jul 10 18:26:33.964764 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.964740 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" Jul 10 18:26:33.965109 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.964789 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z" event={"ID":"4ae51860-721e-46ae-a26f-60706752d6c2","Type":"ContainerDied","Data":"58f9eff8884e288a38a946e35147eb4e9ff117f335e57403efa4459b2d5b2fa7"} Jul 10 18:26:33.965109 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:33.964842 2579 scope.go:117] "RemoveContainer" containerID="a5e9e956b4ecfc2ee15c2728606dd247805691f9175642ed86d27fd8ac6dfa4e" Jul 10 18:26:34.013378 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.013346 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z"] Jul 10 18:26:34.028535 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.028512 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-033a05f0-openshift-default-857859b4d7-5jq7z"] Jul 10 18:26:34.028898 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.028876 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-podinfo\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.029002 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.028917 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-token\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.029002 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.028939 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-credential-socket\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.029002 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.028984 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istiod-ca-cert\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.029169 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.029047 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-envoy\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.029169 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.029119 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-workload-socket\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.029247 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.029177 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-data\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.029247 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.029215 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcs6j\" (UniqueName: \"kubernetes.io/projected/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-kube-api-access-mcs6j\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.029341 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.029319 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-workload-certs\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.129901 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.129873 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-workload-certs\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.130090 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.129906 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-podinfo\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.130090 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.129933 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-token\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.130215 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.130104 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-credential-socket\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.130215 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.130123 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istiod-ca-cert\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.130215 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.130141 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-envoy\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.130215 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.130172 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-workload-socket\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.130425 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.130231 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-data\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.130425 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.130279 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcs6j\" (UniqueName: \"kubernetes.io/projected/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-kube-api-access-mcs6j\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.130425 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.130340 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-workload-certs\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.130577 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.130475 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-credential-socket\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.130629 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.130590 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-workload-socket\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.130669 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.130639 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-data\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.130960 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.130934 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istiod-ca-cert\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.132332 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.132310 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-envoy\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.132618 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.132601 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-podinfo\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.139527 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.139503 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-token\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.142120 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.142102 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcs6j\" (UniqueName: \"kubernetes.io/projected/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-kube-api-access-mcs6j\") pod \"e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.222009 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.221939 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:34.359412 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.359382 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh"] Jul 10 18:26:34.360350 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:26:34.360326 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac4b3fe6_9399_4086_bf99_ff86ed982bd4.slice/crio-cfa35dcbd3d422a17f69b825388466120bf22d2b5d186d173069ef11aee0bebe WatchSource:0}: Error finding container cfa35dcbd3d422a17f69b825388466120bf22d2b5d186d173069ef11aee0bebe: Status 404 returned error can't find the container with id cfa35dcbd3d422a17f69b825388466120bf22d2b5d186d173069ef11aee0bebe Jul 10 18:26:34.362449 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.362418 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:26:34.362543 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.362479 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:26:34.362543 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.362507 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:26:34.680157 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.680121 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ae51860-721e-46ae-a26f-60706752d6c2" path="/var/lib/kubelet/pods/4ae51860-721e-46ae-a26f-60706752d6c2/volumes" Jul 10 18:26:34.972385 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.972294 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" event={"ID":"ac4b3fe6-9399-4086-bf99-ff86ed982bd4","Type":"ContainerStarted","Data":"0e369544dcb4fb8432cf6567e79098726e62905e7ab02a070c8d48f321fdc620"} Jul 10 18:26:34.972385 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:34.972351 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" event={"ID":"ac4b3fe6-9399-4086-bf99-ff86ed982bd4","Type":"ContainerStarted","Data":"cfa35dcbd3d422a17f69b825388466120bf22d2b5d186d173069ef11aee0bebe"} Jul 10 18:26:35.000145 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:35.000097 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" podStartSLOduration=2.000080716 podStartE2EDuration="2.000080716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:26:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:26:34.997984499 +0000 UTC m=+1626.838812777" watchObservedRunningTime="2026-07-10 18:26:35.000080716 +0000 UTC m=+1626.840908994" Jul 10 18:26:35.222252 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:35.222213 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:35.226948 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:35.226876 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:35.978602 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:35.978573 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:35.979532 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:35.979512 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:46.038329 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:46.038242 2579 generic.go:356] "Generic (PLEG): container finished" podID="ac4b3fe6-9399-4086-bf99-ff86ed982bd4" containerID="0e369544dcb4fb8432cf6567e79098726e62905e7ab02a070c8d48f321fdc620" exitCode=0 Jul 10 18:26:46.038329 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:46.038313 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" event={"ID":"ac4b3fe6-9399-4086-bf99-ff86ed982bd4","Type":"ContainerDied","Data":"0e369544dcb4fb8432cf6567e79098726e62905e7ab02a070c8d48f321fdc620"} Jul 10 18:26:46.038730 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:46.038710 2579 scope.go:117] "RemoveContainer" containerID="0e369544dcb4fb8432cf6567e79098726e62905e7ab02a070c8d48f321fdc620" Jul 10 18:26:46.039801 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:46.039771 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:26:46.039904 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:46.039884 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:26:46.039948 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:46.039938 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:26:46.162562 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:46.162523 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh"] Jul 10 18:26:47.045345 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:47.045312 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" event={"ID":"ac4b3fe6-9399-4086-bf99-ff86ed982bd4","Type":"ContainerStarted","Data":"a40d9bed553118850f81738583f28e334b0c8f070fb6c64c00d4888e6c95c780"} Jul 10 18:26:47.045791 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:47.045385 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" podUID="ac4b3fe6-9399-4086-bf99-ff86ed982bd4" containerName="istio-proxy" containerID="cri-o://a40d9bed553118850f81738583f28e334b0c8f070fb6c64c00d4888e6c95c780" gracePeriod=30 Jul 10 18:26:50.978942 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:50.978910 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:52.304826 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.304772 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:52.403137 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.403091 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-data\") pod \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " Jul 10 18:26:52.403316 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.403155 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-workload-socket\") pod \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " Jul 10 18:26:52.403316 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.403199 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-token\") pod \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " Jul 10 18:26:52.403316 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.403258 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istiod-ca-cert\") pod \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " Jul 10 18:26:52.403472 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.403327 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcs6j\" (UniqueName: \"kubernetes.io/projected/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-kube-api-access-mcs6j\") pod \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " Jul 10 18:26:52.403472 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.403359 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-envoy\") pod \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " Jul 10 18:26:52.403472 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.403384 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-workload-certs\") pod \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " Jul 10 18:26:52.403472 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.403420 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ac4b3fe6-9399-4086-bf99-ff86ed982bd4" (UID: "ac4b3fe6-9399-4086-bf99-ff86ed982bd4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:26:52.403472 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.403429 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-podinfo\") pod \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " Jul 10 18:26:52.404193 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.404086 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-credential-socket\") pod \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\" (UID: \"ac4b3fe6-9399-4086-bf99-ff86ed982bd4\") " Jul 10 18:26:52.404193 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.404117 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ac4b3fe6-9399-4086-bf99-ff86ed982bd4" (UID: "ac4b3fe6-9399-4086-bf99-ff86ed982bd4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:26:52.404520 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.404467 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-workload-socket\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:26:52.404520 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.404495 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istiod-ca-cert\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:26:52.404712 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.404670 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ac4b3fe6-9399-4086-bf99-ff86ed982bd4" (UID: "ac4b3fe6-9399-4086-bf99-ff86ed982bd4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:26:52.404974 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.404948 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ac4b3fe6-9399-4086-bf99-ff86ed982bd4" (UID: "ac4b3fe6-9399-4086-bf99-ff86ed982bd4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:26:52.405519 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.405493 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-data" (OuterVolumeSpecName: "istio-data") pod "ac4b3fe6-9399-4086-bf99-ff86ed982bd4" (UID: "ac4b3fe6-9399-4086-bf99-ff86ed982bd4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:26:52.406198 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.406173 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-kube-api-access-mcs6j" (OuterVolumeSpecName: "kube-api-access-mcs6j") pod "ac4b3fe6-9399-4086-bf99-ff86ed982bd4" (UID: "ac4b3fe6-9399-4086-bf99-ff86ed982bd4"). InnerVolumeSpecName "kube-api-access-mcs6j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:26:52.406347 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.406221 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-token" (OuterVolumeSpecName: "istio-token") pod "ac4b3fe6-9399-4086-bf99-ff86ed982bd4" (UID: "ac4b3fe6-9399-4086-bf99-ff86ed982bd4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:26:52.407532 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.407490 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ac4b3fe6-9399-4086-bf99-ff86ed982bd4" (UID: "ac4b3fe6-9399-4086-bf99-ff86ed982bd4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:26:52.407618 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.407530 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ac4b3fe6-9399-4086-bf99-ff86ed982bd4" (UID: "ac4b3fe6-9399-4086-bf99-ff86ed982bd4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 18:26:52.418945 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.418921 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5"] Jul 10 18:26:52.419571 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.419533 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac4b3fe6-9399-4086-bf99-ff86ed982bd4" containerName="istio-proxy" Jul 10 18:26:52.419571 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.419558 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac4b3fe6-9399-4086-bf99-ff86ed982bd4" containerName="istio-proxy" Jul 10 18:26:52.419711 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.419663 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac4b3fe6-9399-4086-bf99-ff86ed982bd4" containerName="istio-proxy" Jul 10 18:26:52.419711 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.419679 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac4b3fe6-9399-4086-bf99-ff86ed982bd4" containerName="istio-proxy" Jul 10 18:26:52.423548 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.423527 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.425919 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.425900 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-20053c97-openshift-default-dockercfg-crbzn\"" Jul 10 18:26:52.439240 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.439217 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5"] Jul 10 18:26:52.505915 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.505892 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-workload-certs\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.506031 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.505933 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-istio-data\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.506031 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.505962 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-istio-envoy\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.506031 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.506013 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-credential-socket\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.506168 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.506061 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d26e977-af5e-4573-9535-814dae17368d-istiod-ca-cert\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.506168 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.506081 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-workload-socket\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.506168 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.506100 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f46wq\" (UniqueName: \"kubernetes.io/projected/5d26e977-af5e-4573-9535-814dae17368d-kube-api-access-f46wq\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.506280 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.506170 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d26e977-af5e-4573-9535-814dae17368d-istio-token\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.506280 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.506234 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d26e977-af5e-4573-9535-814dae17368d-istio-podinfo\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.506356 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.506294 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-token\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:26:52.506356 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.506327 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcs6j\" (UniqueName: \"kubernetes.io/projected/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-kube-api-access-mcs6j\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:26:52.506356 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.506336 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-envoy\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:26:52.506356 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.506344 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-workload-certs\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:26:52.506494 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.506356 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-podinfo\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:26:52.506494 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.506368 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-credential-socket\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:26:52.506494 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.506381 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac4b3fe6-9399-4086-bf99-ff86ed982bd4-istio-data\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:26:52.607081 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.607000 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-istio-data\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.607081 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.607037 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-istio-envoy\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.607081 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.607062 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-credential-socket\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.607362 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.607094 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d26e977-af5e-4573-9535-814dae17368d-istiod-ca-cert\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.607362 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.607112 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-workload-socket\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.607362 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.607134 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f46wq\" (UniqueName: \"kubernetes.io/projected/5d26e977-af5e-4573-9535-814dae17368d-kube-api-access-f46wq\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.607362 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.607178 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d26e977-af5e-4573-9535-814dae17368d-istio-token\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.607362 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.607211 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d26e977-af5e-4573-9535-814dae17368d-istio-podinfo\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.607362 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.607277 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-workload-certs\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.607665 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.607538 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-workload-socket\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.607665 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.607575 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-credential-socket\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.607773 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.607713 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-workload-certs\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.607876 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.607822 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-istio-data\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.608084 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.608065 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d26e977-af5e-4573-9535-814dae17368d-istiod-ca-cert\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.609476 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.609452 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-istio-envoy\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.609913 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.609896 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d26e977-af5e-4573-9535-814dae17368d-istio-podinfo\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.615351 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.615326 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d26e977-af5e-4573-9535-814dae17368d-istio-token\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.615546 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.615527 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f46wq\" (UniqueName: \"kubernetes.io/projected/5d26e977-af5e-4573-9535-814dae17368d-kube-api-access-f46wq\") pod \"e2e-derive-20053c97-openshift-default-55bc95568c-62zr5\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.738542 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.738519 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:52.889693 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.889669 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5"] Jul 10 18:26:52.891889 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:26:52.891865 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d26e977_af5e_4573_9535_814dae17368d.slice/crio-09a4ca4521e118e2de9692fc1b1a7de9b40bb0f7a2e9914e514d9c0f8dd761c5 WatchSource:0}: Error finding container 09a4ca4521e118e2de9692fc1b1a7de9b40bb0f7a2e9914e514d9c0f8dd761c5: Status 404 returned error can't find the container with id 09a4ca4521e118e2de9692fc1b1a7de9b40bb0f7a2e9914e514d9c0f8dd761c5 Jul 10 18:26:52.893970 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.893934 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:26:52.894062 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.894002 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:26:52.894062 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:52.894036 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:26:53.079033 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:53.078999 2579 generic.go:356] "Generic (PLEG): container finished" podID="ac4b3fe6-9399-4086-bf99-ff86ed982bd4" containerID="a40d9bed553118850f81738583f28e334b0c8f070fb6c64c00d4888e6c95c780" exitCode=0 Jul 10 18:26:53.079203 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:53.079041 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" Jul 10 18:26:53.079203 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:53.079077 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" event={"ID":"ac4b3fe6-9399-4086-bf99-ff86ed982bd4","Type":"ContainerDied","Data":"a40d9bed553118850f81738583f28e334b0c8f070fb6c64c00d4888e6c95c780"} Jul 10 18:26:53.079203 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:53.079142 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh" event={"ID":"ac4b3fe6-9399-4086-bf99-ff86ed982bd4","Type":"ContainerDied","Data":"cfa35dcbd3d422a17f69b825388466120bf22d2b5d186d173069ef11aee0bebe"} Jul 10 18:26:53.079203 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:53.079159 2579 scope.go:117] "RemoveContainer" containerID="a40d9bed553118850f81738583f28e334b0c8f070fb6c64c00d4888e6c95c780" Jul 10 18:26:53.081202 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:53.081098 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" event={"ID":"5d26e977-af5e-4573-9535-814dae17368d","Type":"ContainerStarted","Data":"02eff10278b3d558d31f33f96f16afa911456ee925f7a3425bf571076cc5c95a"} Jul 10 18:26:53.081202 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:53.081156 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" event={"ID":"5d26e977-af5e-4573-9535-814dae17368d","Type":"ContainerStarted","Data":"09a4ca4521e118e2de9692fc1b1a7de9b40bb0f7a2e9914e514d9c0f8dd761c5"} Jul 10 18:26:53.088541 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:53.088519 2579 scope.go:117] "RemoveContainer" containerID="0e369544dcb4fb8432cf6567e79098726e62905e7ab02a070c8d48f321fdc620" Jul 10 18:26:53.098916 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:53.098894 2579 scope.go:117] "RemoveContainer" containerID="a40d9bed553118850f81738583f28e334b0c8f070fb6c64c00d4888e6c95c780" Jul 10 18:26:53.099318 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:26:53.099174 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a40d9bed553118850f81738583f28e334b0c8f070fb6c64c00d4888e6c95c780\": container with ID starting with a40d9bed553118850f81738583f28e334b0c8f070fb6c64c00d4888e6c95c780 not found: ID does not exist" containerID="a40d9bed553118850f81738583f28e334b0c8f070fb6c64c00d4888e6c95c780" Jul 10 18:26:53.099318 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:53.099196 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a40d9bed553118850f81738583f28e334b0c8f070fb6c64c00d4888e6c95c780"} err="failed to get container status \"a40d9bed553118850f81738583f28e334b0c8f070fb6c64c00d4888e6c95c780\": rpc error: code = NotFound desc = could not find container \"a40d9bed553118850f81738583f28e334b0c8f070fb6c64c00d4888e6c95c780\": container with ID starting with a40d9bed553118850f81738583f28e334b0c8f070fb6c64c00d4888e6c95c780 not found: ID does not exist" Jul 10 18:26:53.099318 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:53.099212 2579 scope.go:117] "RemoveContainer" containerID="0e369544dcb4fb8432cf6567e79098726e62905e7ab02a070c8d48f321fdc620" Jul 10 18:26:53.099504 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:26:53.099429 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e369544dcb4fb8432cf6567e79098726e62905e7ab02a070c8d48f321fdc620\": container with ID starting with 0e369544dcb4fb8432cf6567e79098726e62905e7ab02a070c8d48f321fdc620 not found: ID does not exist" containerID="0e369544dcb4fb8432cf6567e79098726e62905e7ab02a070c8d48f321fdc620" Jul 10 18:26:53.099504 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:53.099449 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e369544dcb4fb8432cf6567e79098726e62905e7ab02a070c8d48f321fdc620"} err="failed to get container status \"0e369544dcb4fb8432cf6567e79098726e62905e7ab02a070c8d48f321fdc620\": rpc error: code = NotFound desc = could not find container \"0e369544dcb4fb8432cf6567e79098726e62905e7ab02a070c8d48f321fdc620\": container with ID starting with 0e369544dcb4fb8432cf6567e79098726e62905e7ab02a070c8d48f321fdc620 not found: ID does not exist" Jul 10 18:26:53.101180 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:53.101153 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh"] Jul 10 18:26:53.108541 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:53.108517 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-65827bae-openshift-default-fb945fff5-lpqjh"] Jul 10 18:26:53.125666 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:53.125612 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" podStartSLOduration=1.1255936260000001 podStartE2EDuration="1.125593626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:26:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:26:53.125088654 +0000 UTC m=+1644.965916906" watchObservedRunningTime="2026-07-10 18:26:53.125593626 +0000 UTC m=+1644.966421881" Jul 10 18:26:53.739527 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:53.739497 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:53.758573 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:53.758541 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:54.087992 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:54.087962 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:54.089008 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:54.088981 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:26:54.681049 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:54.681019 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac4b3fe6-9399-4086-bf99-ff86ed982bd4" path="/var/lib/kubelet/pods/ac4b3fe6-9399-4086-bf99-ff86ed982bd4/volumes" Jul 10 18:26:58.156089 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:58.156052 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5"] Jul 10 18:26:58.156481 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:26:58.156227 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" podUID="5d26e977-af5e-4573-9535-814dae17368d" containerName="istio-proxy" containerID="cri-o://02eff10278b3d558d31f33f96f16afa911456ee925f7a3425bf571076cc5c95a" gracePeriod=30 Jul 10 18:27:04.706327 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.706304 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:27:04.815892 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.815808 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-workload-socket\") pod \"5d26e977-af5e-4573-9535-814dae17368d\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " Jul 10 18:27:04.815892 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.815846 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d26e977-af5e-4573-9535-814dae17368d-istiod-ca-cert\") pod \"5d26e977-af5e-4573-9535-814dae17368d\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " Jul 10 18:27:04.816105 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.815907 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f46wq\" (UniqueName: \"kubernetes.io/projected/5d26e977-af5e-4573-9535-814dae17368d-kube-api-access-f46wq\") pod \"5d26e977-af5e-4573-9535-814dae17368d\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " Jul 10 18:27:04.816105 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.815956 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-istio-data\") pod \"5d26e977-af5e-4573-9535-814dae17368d\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " Jul 10 18:27:04.816105 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.815984 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-workload-certs\") pod \"5d26e977-af5e-4573-9535-814dae17368d\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " Jul 10 18:27:04.816105 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.816000 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d26e977-af5e-4573-9535-814dae17368d-istio-token\") pod \"5d26e977-af5e-4573-9535-814dae17368d\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " Jul 10 18:27:04.816105 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.816020 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-credential-socket\") pod \"5d26e977-af5e-4573-9535-814dae17368d\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " Jul 10 18:27:04.816105 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.816089 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-istio-envoy\") pod \"5d26e977-af5e-4573-9535-814dae17368d\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " Jul 10 18:27:04.816422 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.816113 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d26e977-af5e-4573-9535-814dae17368d-istio-podinfo\") pod \"5d26e977-af5e-4573-9535-814dae17368d\" (UID: \"5d26e977-af5e-4573-9535-814dae17368d\") " Jul 10 18:27:04.816422 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.816154 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5d26e977-af5e-4573-9535-814dae17368d" (UID: "5d26e977-af5e-4573-9535-814dae17368d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:27:04.816422 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.816321 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5d26e977-af5e-4573-9535-814dae17368d" (UID: "5d26e977-af5e-4573-9535-814dae17368d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:27:04.816422 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.816357 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d26e977-af5e-4573-9535-814dae17368d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5d26e977-af5e-4573-9535-814dae17368d" (UID: "5d26e977-af5e-4573-9535-814dae17368d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:27:04.816422 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.816415 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5d26e977-af5e-4573-9535-814dae17368d" (UID: "5d26e977-af5e-4573-9535-814dae17368d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:27:04.816633 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.816488 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-workload-socket\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:27:04.816633 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.816505 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d26e977-af5e-4573-9535-814dae17368d-istiod-ca-cert\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:27:04.816633 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.816515 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-workload-certs\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:27:04.816633 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.816525 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-credential-socket\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:27:04.816844 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.816821 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-istio-data" (OuterVolumeSpecName: "istio-data") pod "5d26e977-af5e-4573-9535-814dae17368d" (UID: "5d26e977-af5e-4573-9535-814dae17368d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:27:04.818429 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.818404 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5d26e977-af5e-4573-9535-814dae17368d" (UID: "5d26e977-af5e-4573-9535-814dae17368d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:27:04.818557 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.818523 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d26e977-af5e-4573-9535-814dae17368d-kube-api-access-f46wq" (OuterVolumeSpecName: "kube-api-access-f46wq") pod "5d26e977-af5e-4573-9535-814dae17368d" (UID: "5d26e977-af5e-4573-9535-814dae17368d"). InnerVolumeSpecName "kube-api-access-f46wq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:27:04.818752 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.818726 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5d26e977-af5e-4573-9535-814dae17368d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5d26e977-af5e-4573-9535-814dae17368d" (UID: "5d26e977-af5e-4573-9535-814dae17368d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 18:27:04.818843 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.818759 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d26e977-af5e-4573-9535-814dae17368d-istio-token" (OuterVolumeSpecName: "istio-token") pod "5d26e977-af5e-4573-9535-814dae17368d" (UID: "5d26e977-af5e-4573-9535-814dae17368d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:27:04.917134 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.917106 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d26e977-af5e-4573-9535-814dae17368d-istio-token\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:27:04.917134 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.917130 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-istio-envoy\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:27:04.917134 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.917139 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d26e977-af5e-4573-9535-814dae17368d-istio-podinfo\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:27:04.917327 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.917147 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f46wq\" (UniqueName: \"kubernetes.io/projected/5d26e977-af5e-4573-9535-814dae17368d-kube-api-access-f46wq\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:27:04.917327 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:04.917156 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d26e977-af5e-4573-9535-814dae17368d-istio-data\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:27:05.157581 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:05.157499 2579 generic.go:356] "Generic (PLEG): container finished" podID="5d26e977-af5e-4573-9535-814dae17368d" containerID="02eff10278b3d558d31f33f96f16afa911456ee925f7a3425bf571076cc5c95a" exitCode=0 Jul 10 18:27:05.157581 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:05.157554 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" Jul 10 18:27:05.157745 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:05.157583 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" event={"ID":"5d26e977-af5e-4573-9535-814dae17368d","Type":"ContainerDied","Data":"02eff10278b3d558d31f33f96f16afa911456ee925f7a3425bf571076cc5c95a"} Jul 10 18:27:05.157745 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:05.157638 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5" event={"ID":"5d26e977-af5e-4573-9535-814dae17368d","Type":"ContainerDied","Data":"09a4ca4521e118e2de9692fc1b1a7de9b40bb0f7a2e9914e514d9c0f8dd761c5"} Jul 10 18:27:05.157745 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:05.157659 2579 scope.go:117] "RemoveContainer" containerID="02eff10278b3d558d31f33f96f16afa911456ee925f7a3425bf571076cc5c95a" Jul 10 18:27:05.166929 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:05.166905 2579 scope.go:117] "RemoveContainer" containerID="02eff10278b3d558d31f33f96f16afa911456ee925f7a3425bf571076cc5c95a" Jul 10 18:27:05.167178 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:27:05.167158 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02eff10278b3d558d31f33f96f16afa911456ee925f7a3425bf571076cc5c95a\": container with ID starting with 02eff10278b3d558d31f33f96f16afa911456ee925f7a3425bf571076cc5c95a not found: ID does not exist" containerID="02eff10278b3d558d31f33f96f16afa911456ee925f7a3425bf571076cc5c95a" Jul 10 18:27:05.167269 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:05.167189 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02eff10278b3d558d31f33f96f16afa911456ee925f7a3425bf571076cc5c95a"} err="failed to get container status \"02eff10278b3d558d31f33f96f16afa911456ee925f7a3425bf571076cc5c95a\": rpc error: code = NotFound desc = could not find container \"02eff10278b3d558d31f33f96f16afa911456ee925f7a3425bf571076cc5c95a\": container with ID starting with 02eff10278b3d558d31f33f96f16afa911456ee925f7a3425bf571076cc5c95a not found: ID does not exist" Jul 10 18:27:05.181523 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:05.181500 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5"] Jul 10 18:27:05.187678 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:05.187656 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-20053c97-openshift-default-55bc95568c-62zr5"] Jul 10 18:27:06.674680 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:27:06.674644 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d26e977-af5e-4573-9535-814dae17368d" path="/var/lib/kubelet/pods/5d26e977-af5e-4573-9535-814dae17368d/volumes" Jul 10 18:28:39.372221 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.372186 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc"] Jul 10 18:28:39.372686 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.372568 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d26e977-af5e-4573-9535-814dae17368d" containerName="istio-proxy" Jul 10 18:28:39.372686 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.372579 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d26e977-af5e-4573-9535-814dae17368d" containerName="istio-proxy" Jul 10 18:28:39.372686 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.372600 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac4b3fe6-9399-4086-bf99-ff86ed982bd4" containerName="istio-proxy" Jul 10 18:28:39.372686 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.372606 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac4b3fe6-9399-4086-bf99-ff86ed982bd4" containerName="istio-proxy" Jul 10 18:28:39.372686 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.372681 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d26e977-af5e-4573-9535-814dae17368d" containerName="istio-proxy" Jul 10 18:28:39.374752 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.374736 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.379000 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.378979 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e737ea6a-openshift-default-dockercfg-gnfhc\"" Jul 10 18:28:39.398370 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.398347 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc"] Jul 10 18:28:39.450628 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.450596 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq9ww\" (UniqueName: \"kubernetes.io/projected/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-kube-api-access-kq9ww\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.450771 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.450667 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-workload-socket\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.450841 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.450821 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-workload-certs\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.450948 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.450910 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-data\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.451013 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.450947 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istiod-ca-cert\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.451013 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.450976 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-podinfo\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.451132 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.451057 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-token\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.451132 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.451116 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-envoy\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.451246 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.451142 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-credential-socket\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.551827 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.551794 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq9ww\" (UniqueName: \"kubernetes.io/projected/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-kube-api-access-kq9ww\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.552022 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.551843 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-workload-socket\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.552022 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.551904 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-workload-certs\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.552022 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.551935 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-data\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.552022 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.551957 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istiod-ca-cert\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.552022 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.551985 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-podinfo\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.552268 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.552032 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-token\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.552268 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.552070 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-envoy\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.552268 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.552091 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-credential-socket\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.552434 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.552352 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-workload-socket\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.552434 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.552402 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-workload-certs\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.552537 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.552484 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-data\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.552628 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.552598 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-credential-socket\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.552790 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.552771 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istiod-ca-cert\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.554386 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.554370 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-envoy\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.554629 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.554602 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-podinfo\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.561394 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.561368 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq9ww\" (UniqueName: \"kubernetes.io/projected/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-kube-api-access-kq9ww\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.561476 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.561423 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-token\") pod \"e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.685524 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.685457 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:39.823841 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.823809 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc"] Jul 10 18:28:39.825426 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:28:39.825400 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6193c7a7_2ece_4e6d_a111_8cbe6e6ed81b.slice/crio-822b077332af7ffd0b1e6428fe05ca9598385ea8076e8e2f848b923f3f3e174b WatchSource:0}: Error finding container 822b077332af7ffd0b1e6428fe05ca9598385ea8076e8e2f848b923f3f3e174b: Status 404 returned error can't find the container with id 822b077332af7ffd0b1e6428fe05ca9598385ea8076e8e2f848b923f3f3e174b Jul 10 18:28:39.828019 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.827983 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:28:39.828100 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.828052 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:28:39.828100 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:39.828083 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:28:40.674753 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:40.674725 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" event={"ID":"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b","Type":"ContainerStarted","Data":"6fb71339d85438928df7dc66d2d6b01c28e371b1ac7a0ce148bc073e21cbc133"} Jul 10 18:28:40.675125 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:40.674778 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" event={"ID":"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b","Type":"ContainerStarted","Data":"822b077332af7ffd0b1e6428fe05ca9598385ea8076e8e2f848b923f3f3e174b"} Jul 10 18:28:40.685900 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:40.685883 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:40.690518 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:40.690498 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:40.696910 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:40.696838 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" podStartSLOduration=1.696823574 podStartE2EDuration="1.696823574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:28:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:28:40.694637981 +0000 UTC m=+1752.535466238" watchObservedRunningTime="2026-07-10 18:28:40.696823574 +0000 UTC m=+1752.537651828" Jul 10 18:28:41.677312 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:41.677279 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:41.678098 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:41.678080 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:28:57.719030 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:57.718990 2579 patch_prober.go:28] interesting pod/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 10 18:28:57.719467 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:57.719074 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" podUID="6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 10 18:28:58.774335 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:58.774300 2579 generic.go:356] "Generic (PLEG): container finished" podID="6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b" containerID="6fb71339d85438928df7dc66d2d6b01c28e371b1ac7a0ce148bc073e21cbc133" exitCode=0 Jul 10 18:28:58.774772 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:58.774372 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" event={"ID":"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b","Type":"ContainerDied","Data":"6fb71339d85438928df7dc66d2d6b01c28e371b1ac7a0ce148bc073e21cbc133"} Jul 10 18:28:58.774772 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:58.774746 2579 scope.go:117] "RemoveContainer" containerID="6fb71339d85438928df7dc66d2d6b01c28e371b1ac7a0ce148bc073e21cbc133" Jul 10 18:28:58.775691 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:58.775661 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:28:58.775789 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:58.775745 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:28:58.775868 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:58.775792 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:28:59.782180 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:28:59.782148 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" event={"ID":"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b","Type":"ContainerStarted","Data":"5002254b0b1631cdc53080f458a11ea82cc4cf519364d25138fd74b583380433"} Jul 10 18:29:00.686134 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:00.686099 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:29:00.686345 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:00.686324 2579 patch_prober.go:28] interesting pod/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 10 18:29:00.686393 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:00.686374 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" podUID="6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 10 18:29:01.333875 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:01.333517 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc"] Jul 10 18:29:01.685972 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:01.685885 2579 patch_prober.go:28] interesting pod/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 10 18:29:01.685972 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:01.685943 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" podUID="6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 10 18:29:01.793251 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:01.793184 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" podUID="6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b" containerName="istio-proxy" containerID="cri-o://5002254b0b1631cdc53080f458a11ea82cc4cf519364d25138fd74b583380433" gracePeriod=30 Jul 10 18:29:09.045372 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.045347 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:29:09.229527 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.229436 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-credential-socket\") pod \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " Jul 10 18:29:09.229527 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.229470 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-workload-certs\") pod \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " Jul 10 18:29:09.229527 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.229495 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-envoy\") pod \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " Jul 10 18:29:09.229819 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.229564 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-token\") pod \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " Jul 10 18:29:09.229819 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.229602 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-workload-socket\") pod \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " Jul 10 18:29:09.229819 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.229642 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istiod-ca-cert\") pod \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " Jul 10 18:29:09.229819 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.229690 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-data\") pod \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " Jul 10 18:29:09.229819 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.229723 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-podinfo\") pod \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " Jul 10 18:29:09.229819 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.229750 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kq9ww\" (UniqueName: \"kubernetes.io/projected/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-kube-api-access-kq9ww\") pod \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\" (UID: \"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b\") " Jul 10 18:29:09.229819 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.229752 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b" (UID: "6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:29:09.230194 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.229908 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b" (UID: "6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:29:09.230194 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.230024 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b" (UID: "6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:29:09.230194 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.230092 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b" (UID: "6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:29:09.230194 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.230182 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-workload-socket\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:29:09.230371 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.230202 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istiod-ca-cert\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:29:09.230371 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.230215 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-credential-socket\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:29:09.230371 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.230228 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-workload-certs\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:29:09.230651 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.230629 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-data" (OuterVolumeSpecName: "istio-data") pod "6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b" (UID: "6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:29:09.232319 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.232288 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b" (UID: "6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:29:09.232319 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.232307 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-token" (OuterVolumeSpecName: "istio-token") pod "6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b" (UID: "6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:29:09.232468 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.232351 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b" (UID: "6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 18:29:09.232468 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.232375 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-kube-api-access-kq9ww" (OuterVolumeSpecName: "kube-api-access-kq9ww") pod "6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b" (UID: "6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b"). InnerVolumeSpecName "kube-api-access-kq9ww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:29:09.331250 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.331223 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-data\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:29:09.331250 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.331245 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-podinfo\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:29:09.331391 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.331254 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq9ww\" (UniqueName: \"kubernetes.io/projected/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-kube-api-access-kq9ww\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:29:09.331391 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.331264 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-envoy\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:29:09.331391 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.331272 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b-istio-token\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:29:09.838486 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.838452 2579 generic.go:356] "Generic (PLEG): container finished" podID="6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b" containerID="5002254b0b1631cdc53080f458a11ea82cc4cf519364d25138fd74b583380433" exitCode=0 Jul 10 18:29:09.838685 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.838492 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" Jul 10 18:29:09.838685 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.838528 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" event={"ID":"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b","Type":"ContainerDied","Data":"5002254b0b1631cdc53080f458a11ea82cc4cf519364d25138fd74b583380433"} Jul 10 18:29:09.838685 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.838576 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc" event={"ID":"6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b","Type":"ContainerDied","Data":"822b077332af7ffd0b1e6428fe05ca9598385ea8076e8e2f848b923f3f3e174b"} Jul 10 18:29:09.838685 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.838596 2579 scope.go:117] "RemoveContainer" containerID="5002254b0b1631cdc53080f458a11ea82cc4cf519364d25138fd74b583380433" Jul 10 18:29:09.848351 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.848337 2579 scope.go:117] "RemoveContainer" containerID="6fb71339d85438928df7dc66d2d6b01c28e371b1ac7a0ce148bc073e21cbc133" Jul 10 18:29:09.856556 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.856541 2579 scope.go:117] "RemoveContainer" containerID="5002254b0b1631cdc53080f458a11ea82cc4cf519364d25138fd74b583380433" Jul 10 18:29:09.856793 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:29:09.856775 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5002254b0b1631cdc53080f458a11ea82cc4cf519364d25138fd74b583380433\": container with ID starting with 5002254b0b1631cdc53080f458a11ea82cc4cf519364d25138fd74b583380433 not found: ID does not exist" containerID="5002254b0b1631cdc53080f458a11ea82cc4cf519364d25138fd74b583380433" Jul 10 18:29:09.856869 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.856800 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5002254b0b1631cdc53080f458a11ea82cc4cf519364d25138fd74b583380433"} err="failed to get container status \"5002254b0b1631cdc53080f458a11ea82cc4cf519364d25138fd74b583380433\": rpc error: code = NotFound desc = could not find container \"5002254b0b1631cdc53080f458a11ea82cc4cf519364d25138fd74b583380433\": container with ID starting with 5002254b0b1631cdc53080f458a11ea82cc4cf519364d25138fd74b583380433 not found: ID does not exist" Jul 10 18:29:09.856869 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.856815 2579 scope.go:117] "RemoveContainer" containerID="6fb71339d85438928df7dc66d2d6b01c28e371b1ac7a0ce148bc073e21cbc133" Jul 10 18:29:09.857086 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:29:09.857069 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fb71339d85438928df7dc66d2d6b01c28e371b1ac7a0ce148bc073e21cbc133\": container with ID starting with 6fb71339d85438928df7dc66d2d6b01c28e371b1ac7a0ce148bc073e21cbc133 not found: ID does not exist" containerID="6fb71339d85438928df7dc66d2d6b01c28e371b1ac7a0ce148bc073e21cbc133" Jul 10 18:29:09.857128 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.857095 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fb71339d85438928df7dc66d2d6b01c28e371b1ac7a0ce148bc073e21cbc133"} err="failed to get container status \"6fb71339d85438928df7dc66d2d6b01c28e371b1ac7a0ce148bc073e21cbc133\": rpc error: code = NotFound desc = could not find container \"6fb71339d85438928df7dc66d2d6b01c28e371b1ac7a0ce148bc073e21cbc133\": container with ID starting with 6fb71339d85438928df7dc66d2d6b01c28e371b1ac7a0ce148bc073e21cbc133 not found: ID does not exist" Jul 10 18:29:09.862286 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.862263 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc"] Jul 10 18:29:09.870487 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:09.870467 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e737ea6a-openshift-default-5b6f96687f-pjnnc"] Jul 10 18:29:10.674993 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:10.674959 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b" path="/var/lib/kubelet/pods/6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b/volumes" Jul 10 18:29:20.730631 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.730553 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv"] Jul 10 18:29:20.731145 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.731124 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b" containerName="istio-proxy" Jul 10 18:29:20.731239 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.731147 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b" containerName="istio-proxy" Jul 10 18:29:20.731239 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.731169 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b" containerName="istio-proxy" Jul 10 18:29:20.731239 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.731178 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b" containerName="istio-proxy" Jul 10 18:29:20.731393 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.731300 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b" containerName="istio-proxy" Jul 10 18:29:20.734243 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.734225 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.736662 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.736642 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-95637065-openshift-default-dockercfg-pzjdz\"" Jul 10 18:29:20.745802 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.745781 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv"] Jul 10 18:29:20.832318 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.832283 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-workload-certs\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.832473 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.832373 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d460a3f-c391-411f-b598-a363df86f6fd-istio-token\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.832473 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.832421 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-credential-socket\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.832473 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.832439 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-istio-envoy\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.832473 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.832461 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d460a3f-c391-411f-b598-a363df86f6fd-istiod-ca-cert\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.832707 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.832573 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7l7j\" (UniqueName: \"kubernetes.io/projected/8d460a3f-c391-411f-b598-a363df86f6fd-kube-api-access-h7l7j\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.832707 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.832626 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-istio-data\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.832707 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.832665 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d460a3f-c391-411f-b598-a363df86f6fd-istio-podinfo\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.832707 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.832699 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-workload-socket\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.934184 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.934146 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d460a3f-c391-411f-b598-a363df86f6fd-istiod-ca-cert\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.934364 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.934202 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7l7j\" (UniqueName: \"kubernetes.io/projected/8d460a3f-c391-411f-b598-a363df86f6fd-kube-api-access-h7l7j\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.934364 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.934229 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-istio-data\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.934364 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.934249 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d460a3f-c391-411f-b598-a363df86f6fd-istio-podinfo\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.934364 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.934265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-workload-socket\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.934364 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.934311 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-workload-certs\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.934364 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.934357 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d460a3f-c391-411f-b598-a363df86f6fd-istio-token\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.934697 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.934389 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-credential-socket\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.934697 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.934414 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-istio-envoy\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.934803 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.934718 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-workload-socket\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.934803 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.934763 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-workload-certs\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.934951 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.934814 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-credential-socket\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.935009 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.934954 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-istio-data\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.935009 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.934997 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d460a3f-c391-411f-b598-a363df86f6fd-istiod-ca-cert\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.937339 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.937308 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-istio-envoy\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.937453 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.937434 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d460a3f-c391-411f-b598-a363df86f6fd-istio-podinfo\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.943106 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.943083 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d460a3f-c391-411f-b598-a363df86f6fd-istio-token\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:20.943415 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:20.943399 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7l7j\" (UniqueName: \"kubernetes.io/projected/8d460a3f-c391-411f-b598-a363df86f6fd-kube-api-access-h7l7j\") pod \"e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:21.044451 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:21.044428 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:21.175682 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:21.175652 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv"] Jul 10 18:29:21.176750 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:29:21.176725 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d460a3f_c391_411f_b598_a363df86f6fd.slice/crio-c9f3f217218fda2df95b428cc23772fc8bfa506b01d75f2bed6e5601b47c2bbf WatchSource:0}: Error finding container c9f3f217218fda2df95b428cc23772fc8bfa506b01d75f2bed6e5601b47c2bbf: Status 404 returned error can't find the container with id c9f3f217218fda2df95b428cc23772fc8bfa506b01d75f2bed6e5601b47c2bbf Jul 10 18:29:21.178976 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:21.178940 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:29:21.179077 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:21.179021 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:29:21.179077 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:21.179069 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:29:21.905705 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:21.905661 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" event={"ID":"8d460a3f-c391-411f-b598-a363df86f6fd","Type":"ContainerStarted","Data":"93c09e456c652c4abf3f55ad9bd6932e1f179427e128ba750c6d2655af20fcfe"} Jul 10 18:29:21.905705 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:21.905713 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" event={"ID":"8d460a3f-c391-411f-b598-a363df86f6fd","Type":"ContainerStarted","Data":"c9f3f217218fda2df95b428cc23772fc8bfa506b01d75f2bed6e5601b47c2bbf"} Jul 10 18:29:21.926655 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:21.926602 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" podStartSLOduration=1.926588687 podStartE2EDuration="1.926588687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:29:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:29:21.924639862 +0000 UTC m=+1793.765468119" watchObservedRunningTime="2026-07-10 18:29:21.926588687 +0000 UTC m=+1793.767416941" Jul 10 18:29:22.045315 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:22.045279 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:22.049987 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:22.049962 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:22.913512 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:22.913476 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:22.914531 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:22.914514 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:38.955029 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:38.954982 2579 patch_prober.go:28] interesting pod/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 10 18:29:38.955501 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:38.955058 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" podUID="8d460a3f-c391-411f-b598-a363df86f6fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 10 18:29:40.017890 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:40.017833 2579 generic.go:356] "Generic (PLEG): container finished" podID="8d460a3f-c391-411f-b598-a363df86f6fd" containerID="93c09e456c652c4abf3f55ad9bd6932e1f179427e128ba750c6d2655af20fcfe" exitCode=0 Jul 10 18:29:40.018323 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:40.017905 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" event={"ID":"8d460a3f-c391-411f-b598-a363df86f6fd","Type":"ContainerDied","Data":"93c09e456c652c4abf3f55ad9bd6932e1f179427e128ba750c6d2655af20fcfe"} Jul 10 18:29:40.018323 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:40.018290 2579 scope.go:117] "RemoveContainer" containerID="93c09e456c652c4abf3f55ad9bd6932e1f179427e128ba750c6d2655af20fcfe" Jul 10 18:29:40.019261 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:40.019235 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:29:40.019322 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:40.019300 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:29:40.019364 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:40.019332 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:29:41.026442 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:41.026403 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" event={"ID":"8d460a3f-c391-411f-b598-a363df86f6fd","Type":"ContainerStarted","Data":"e0024627c77f0ce038b589216143590b7f7052584b2597f76eb31ccf98b685d7"} Jul 10 18:29:41.045350 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:41.045323 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:41.045502 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:41.045479 2579 patch_prober.go:28] interesting pod/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 10 18:29:41.045552 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:41.045527 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" podUID="8d460a3f-c391-411f-b598-a363df86f6fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 10 18:29:42.044988 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:42.044950 2579 patch_prober.go:28] interesting pod/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 10 18:29:42.045438 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:42.045010 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" podUID="8d460a3f-c391-411f-b598-a363df86f6fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 10 18:29:43.045039 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:43.045004 2579 patch_prober.go:28] interesting pod/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 10 18:29:43.045420 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:43.045054 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" podUID="8d460a3f-c391-411f-b598-a363df86f6fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 10 18:29:44.044802 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:44.044765 2579 patch_prober.go:28] interesting pod/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 10 18:29:44.044996 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:44.044819 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" podUID="8d460a3f-c391-411f-b598-a363df86f6fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 10 18:29:45.045795 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:45.045762 2579 patch_prober.go:28] interesting pod/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 10 18:29:45.046217 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:45.045816 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" podUID="8d460a3f-c391-411f-b598-a363df86f6fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 10 18:29:46.048473 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:46.048441 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:46.048967 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:46.048904 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:29:46.049648 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:29:46.049627 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:31:01.012035 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:01.011941 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv"] Jul 10 18:31:01.012558 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:01.012150 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" podUID="8d460a3f-c391-411f-b598-a363df86f6fd" containerName="istio-proxy" containerID="cri-o://e0024627c77f0ce038b589216143590b7f7052584b2597f76eb31ccf98b685d7" gracePeriod=30 Jul 10 18:31:01.051017 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:01.050988 2579 patch_prober.go:28] interesting pod/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 10 18:31:01.051181 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:01.051054 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" podUID="8d460a3f-c391-411f-b598-a363df86f6fd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 18:31:06.270289 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.270252 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:31:06.384315 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.384286 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d460a3f-c391-411f-b598-a363df86f6fd-istio-token\") pod \"8d460a3f-c391-411f-b598-a363df86f6fd\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " Jul 10 18:31:06.384495 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.384335 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7l7j\" (UniqueName: \"kubernetes.io/projected/8d460a3f-c391-411f-b598-a363df86f6fd-kube-api-access-h7l7j\") pod \"8d460a3f-c391-411f-b598-a363df86f6fd\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " Jul 10 18:31:06.384495 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.384399 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-workload-certs\") pod \"8d460a3f-c391-411f-b598-a363df86f6fd\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " Jul 10 18:31:06.384495 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.384422 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-credential-socket\") pod \"8d460a3f-c391-411f-b598-a363df86f6fd\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " Jul 10 18:31:06.384495 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.384452 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-istio-data\") pod \"8d460a3f-c391-411f-b598-a363df86f6fd\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " Jul 10 18:31:06.384495 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.384474 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d460a3f-c391-411f-b598-a363df86f6fd-istio-podinfo\") pod \"8d460a3f-c391-411f-b598-a363df86f6fd\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " Jul 10 18:31:06.384702 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.384521 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d460a3f-c391-411f-b598-a363df86f6fd-istiod-ca-cert\") pod \"8d460a3f-c391-411f-b598-a363df86f6fd\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " Jul 10 18:31:06.384702 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.384575 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-workload-socket\") pod \"8d460a3f-c391-411f-b598-a363df86f6fd\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " Jul 10 18:31:06.384702 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.384614 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-istio-envoy\") pod \"8d460a3f-c391-411f-b598-a363df86f6fd\" (UID: \"8d460a3f-c391-411f-b598-a363df86f6fd\") " Jul 10 18:31:06.385077 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.385044 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8d460a3f-c391-411f-b598-a363df86f6fd" (UID: "8d460a3f-c391-411f-b598-a363df86f6fd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:31:06.385219 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.385160 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8d460a3f-c391-411f-b598-a363df86f6fd" (UID: "8d460a3f-c391-411f-b598-a363df86f6fd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:31:06.385389 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.385305 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d460a3f-c391-411f-b598-a363df86f6fd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8d460a3f-c391-411f-b598-a363df86f6fd" (UID: "8d460a3f-c391-411f-b598-a363df86f6fd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:31:06.385558 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.385534 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8d460a3f-c391-411f-b598-a363df86f6fd" (UID: "8d460a3f-c391-411f-b598-a363df86f6fd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:31:06.386285 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.386258 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-istio-data" (OuterVolumeSpecName: "istio-data") pod "8d460a3f-c391-411f-b598-a363df86f6fd" (UID: "8d460a3f-c391-411f-b598-a363df86f6fd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:31:06.387275 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.387155 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d460a3f-c391-411f-b598-a363df86f6fd-istio-token" (OuterVolumeSpecName: "istio-token") pod "8d460a3f-c391-411f-b598-a363df86f6fd" (UID: "8d460a3f-c391-411f-b598-a363df86f6fd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:31:06.387275 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.387186 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8d460a3f-c391-411f-b598-a363df86f6fd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8d460a3f-c391-411f-b598-a363df86f6fd" (UID: "8d460a3f-c391-411f-b598-a363df86f6fd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 18:31:06.387275 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.387246 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d460a3f-c391-411f-b598-a363df86f6fd-kube-api-access-h7l7j" (OuterVolumeSpecName: "kube-api-access-h7l7j") pod "8d460a3f-c391-411f-b598-a363df86f6fd" (UID: "8d460a3f-c391-411f-b598-a363df86f6fd"). InnerVolumeSpecName "kube-api-access-h7l7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:31:06.387488 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.387408 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8d460a3f-c391-411f-b598-a363df86f6fd" (UID: "8d460a3f-c391-411f-b598-a363df86f6fd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:31:06.485629 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.485598 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7l7j\" (UniqueName: \"kubernetes.io/projected/8d460a3f-c391-411f-b598-a363df86f6fd-kube-api-access-h7l7j\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:31:06.485629 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.485626 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-workload-certs\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:31:06.485825 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.485639 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-credential-socket\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:31:06.485825 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.485650 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-istio-data\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:31:06.485825 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.485661 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d460a3f-c391-411f-b598-a363df86f6fd-istio-podinfo\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:31:06.485825 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.485672 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d460a3f-c391-411f-b598-a363df86f6fd-istiod-ca-cert\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:31:06.485825 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.485683 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-workload-socket\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:31:06.485825 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.485694 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d460a3f-c391-411f-b598-a363df86f6fd-istio-envoy\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:31:06.485825 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.485707 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d460a3f-c391-411f-b598-a363df86f6fd-istio-token\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:31:06.501756 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.501724 2579 generic.go:356] "Generic (PLEG): container finished" podID="8d460a3f-c391-411f-b598-a363df86f6fd" containerID="e0024627c77f0ce038b589216143590b7f7052584b2597f76eb31ccf98b685d7" exitCode=0 Jul 10 18:31:06.501896 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.501754 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" event={"ID":"8d460a3f-c391-411f-b598-a363df86f6fd","Type":"ContainerDied","Data":"e0024627c77f0ce038b589216143590b7f7052584b2597f76eb31ccf98b685d7"} Jul 10 18:31:06.501896 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.501780 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" Jul 10 18:31:06.501896 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.501810 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv" event={"ID":"8d460a3f-c391-411f-b598-a363df86f6fd","Type":"ContainerDied","Data":"c9f3f217218fda2df95b428cc23772fc8bfa506b01d75f2bed6e5601b47c2bbf"} Jul 10 18:31:06.501896 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.501834 2579 scope.go:117] "RemoveContainer" containerID="e0024627c77f0ce038b589216143590b7f7052584b2597f76eb31ccf98b685d7" Jul 10 18:31:06.511841 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.511825 2579 scope.go:117] "RemoveContainer" containerID="93c09e456c652c4abf3f55ad9bd6932e1f179427e128ba750c6d2655af20fcfe" Jul 10 18:31:06.520090 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.520074 2579 scope.go:117] "RemoveContainer" containerID="e0024627c77f0ce038b589216143590b7f7052584b2597f76eb31ccf98b685d7" Jul 10 18:31:06.520301 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:31:06.520285 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0024627c77f0ce038b589216143590b7f7052584b2597f76eb31ccf98b685d7\": container with ID starting with e0024627c77f0ce038b589216143590b7f7052584b2597f76eb31ccf98b685d7 not found: ID does not exist" containerID="e0024627c77f0ce038b589216143590b7f7052584b2597f76eb31ccf98b685d7" Jul 10 18:31:06.520346 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.520307 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0024627c77f0ce038b589216143590b7f7052584b2597f76eb31ccf98b685d7"} err="failed to get container status \"e0024627c77f0ce038b589216143590b7f7052584b2597f76eb31ccf98b685d7\": rpc error: code = NotFound desc = could not find container \"e0024627c77f0ce038b589216143590b7f7052584b2597f76eb31ccf98b685d7\": container with ID starting with e0024627c77f0ce038b589216143590b7f7052584b2597f76eb31ccf98b685d7 not found: ID does not exist" Jul 10 18:31:06.520346 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.520322 2579 scope.go:117] "RemoveContainer" containerID="93c09e456c652c4abf3f55ad9bd6932e1f179427e128ba750c6d2655af20fcfe" Jul 10 18:31:06.520524 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:31:06.520505 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93c09e456c652c4abf3f55ad9bd6932e1f179427e128ba750c6d2655af20fcfe\": container with ID starting with 93c09e456c652c4abf3f55ad9bd6932e1f179427e128ba750c6d2655af20fcfe not found: ID does not exist" containerID="93c09e456c652c4abf3f55ad9bd6932e1f179427e128ba750c6d2655af20fcfe" Jul 10 18:31:06.520580 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.520533 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93c09e456c652c4abf3f55ad9bd6932e1f179427e128ba750c6d2655af20fcfe"} err="failed to get container status \"93c09e456c652c4abf3f55ad9bd6932e1f179427e128ba750c6d2655af20fcfe\": rpc error: code = NotFound desc = could not find container \"93c09e456c652c4abf3f55ad9bd6932e1f179427e128ba750c6d2655af20fcfe\": container with ID starting with 93c09e456c652c4abf3f55ad9bd6932e1f179427e128ba750c6d2655af20fcfe not found: ID does not exist" Jul 10 18:31:06.525996 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.525973 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv"] Jul 10 18:31:06.535364 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.535342 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-95637065-openshift-default-754cd9cbdc-26rdv"] Jul 10 18:31:06.674826 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:06.674733 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d460a3f-c391-411f-b598-a363df86f6fd" path="/var/lib/kubelet/pods/8d460a3f-c391-411f-b598-a363df86f6fd/volumes" Jul 10 18:31:55.348882 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.348830 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw"] Jul 10 18:31:55.349273 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.349228 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d460a3f-c391-411f-b598-a363df86f6fd" containerName="istio-proxy" Jul 10 18:31:55.349273 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.349239 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d460a3f-c391-411f-b598-a363df86f6fd" containerName="istio-proxy" Jul 10 18:31:55.349347 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.349311 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d460a3f-c391-411f-b598-a363df86f6fd" containerName="istio-proxy" Jul 10 18:31:55.349347 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.349319 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6193c7a7-2ece-4e6d-a111-8cbe6e6ed81b" containerName="istio-proxy" Jul 10 18:31:55.352283 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.352267 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.354711 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.354691 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-ea8030-openshift-default-dockercfg-b755h\"" Jul 10 18:31:55.367625 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.367599 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw"] Jul 10 18:31:55.432587 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.432549 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-workload-certs\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.432796 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.432643 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istiod-ca-cert\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.432796 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.432718 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsbjp\" (UniqueName: \"kubernetes.io/projected/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-kube-api-access-hsbjp\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.432960 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.432799 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-data\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.432960 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.432826 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-token\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.433070 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.432958 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-envoy\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.433070 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.432986 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-podinfo\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.433070 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.433031 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-credential-socket\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.433070 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.433060 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-workload-socket\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.533618 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.533577 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-workload-certs\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.533813 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.533627 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istiod-ca-cert\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.533813 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.533664 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsbjp\" (UniqueName: \"kubernetes.io/projected/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-kube-api-access-hsbjp\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.533813 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.533729 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-data\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.533813 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.533756 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-token\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.534081 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.533826 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-envoy\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.534081 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.533880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-podinfo\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.534081 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.533925 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-credential-socket\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.534081 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.533953 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-workload-socket\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.534081 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.534066 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-workload-certs\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.534350 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.534222 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-data\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.534350 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.534327 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-credential-socket\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.534350 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.534339 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-workload-socket\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.534513 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.534478 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istiod-ca-cert\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.536099 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.536079 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-envoy\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.536323 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.536304 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-podinfo\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.541892 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.541865 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-token\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.541975 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.541952 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsbjp\" (UniqueName: \"kubernetes.io/projected/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-kube-api-access-hsbjp\") pod \"e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.662516 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.662445 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:55.800749 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.800721 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw"] Jul 10 18:31:55.801805 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:31:55.801772 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0d7c0d_1942_4e7c_ab59_61d0abe36066.slice/crio-480bd8c7d3b9d6c70b4238ed2955e96edc0409c069c8231abface22ffda9b39c WatchSource:0}: Error finding container 480bd8c7d3b9d6c70b4238ed2955e96edc0409c069c8231abface22ffda9b39c: Status 404 returned error can't find the container with id 480bd8c7d3b9d6c70b4238ed2955e96edc0409c069c8231abface22ffda9b39c Jul 10 18:31:55.803973 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.803940 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:31:55.804047 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.804004 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:31:55.804047 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:55.804033 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:31:56.777362 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:56.777325 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" event={"ID":"7e0d7c0d-1942-4e7c-ab59-61d0abe36066","Type":"ContainerStarted","Data":"2ff18dfe0da025654901a80c52ae292b525766b18d7e6923a286004ec28ec6c3"} Jul 10 18:31:56.777764 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:56.777378 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" event={"ID":"7e0d7c0d-1942-4e7c-ab59-61d0abe36066","Type":"ContainerStarted","Data":"480bd8c7d3b9d6c70b4238ed2955e96edc0409c069c8231abface22ffda9b39c"} Jul 10 18:31:56.797423 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:56.797368 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" podStartSLOduration=1.797350971 podStartE2EDuration="1.797350971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:31:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:56.796255288 +0000 UTC m=+1948.637083543" watchObservedRunningTime="2026-07-10 18:31:56.797350971 +0000 UTC m=+1948.638179226" Jul 10 18:31:57.663227 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:57.663197 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:57.667689 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:57.667668 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:57.782646 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:57.782615 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:31:57.789635 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:31:57.789612 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:32:03.758771 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:03.758736 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq"] Jul 10 18:32:03.759394 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:03.759144 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d460a3f-c391-411f-b598-a363df86f6fd" containerName="istio-proxy" Jul 10 18:32:03.759394 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:03.759156 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d460a3f-c391-411f-b598-a363df86f6fd" containerName="istio-proxy" Jul 10 18:32:03.759394 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:03.759216 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d460a3f-c391-411f-b598-a363df86f6fd" containerName="istio-proxy" Jul 10 18:32:03.762267 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:03.762243 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:03.764731 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:03.764712 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-76cdbe-openshift-default-dockercfg-n55g5\"" Jul 10 18:32:03.774005 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:03.773982 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq"] Jul 10 18:32:03.907862 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:03.907811 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-envoy\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:03.908427 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:03.908391 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-workload-socket\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:03.908626 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:03.908609 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-data\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:03.908766 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:03.908751 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-token\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:03.908957 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:03.908941 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istiod-ca-cert\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:03.909123 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:03.909107 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-credential-socket\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:03.909229 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:03.909215 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66h5n\" (UniqueName: \"kubernetes.io/projected/367c4ff5-aa03-4a24-aed0-73acf2431b4d-kube-api-access-66h5n\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:03.909343 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:03.909319 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-workload-certs\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:03.909462 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:03.909449 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-podinfo\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:04.010276 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.010185 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-workload-socket\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:04.010276 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.010228 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-data\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:04.010276 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.010246 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-token\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:04.010570 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.010282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istiod-ca-cert\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:04.010570 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.010318 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-credential-socket\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:04.010570 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.010333 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66h5n\" (UniqueName: \"kubernetes.io/projected/367c4ff5-aa03-4a24-aed0-73acf2431b4d-kube-api-access-66h5n\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:04.010570 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.010504 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-workload-certs\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:04.010570 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.010558 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-podinfo\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:04.010840 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.010606 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-envoy\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:04.010840 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.010617 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-workload-socket\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:04.010840 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.010675 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-data\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:04.011069 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.010892 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-credential-socket\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:04.011069 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.010909 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-workload-certs\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:04.011182 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.011145 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istiod-ca-cert\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:04.012898 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.012875 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-envoy\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:04.013044 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.013028 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-podinfo\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:04.018733 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.018711 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66h5n\" (UniqueName: \"kubernetes.io/projected/367c4ff5-aa03-4a24-aed0-73acf2431b4d-kube-api-access-66h5n\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:04.018832 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.018764 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-token\") pod \"e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:04.074122 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.074072 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:04.218940 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.218915 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq"] Jul 10 18:32:04.220705 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:32:04.220681 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod367c4ff5_aa03_4a24_aed0_73acf2431b4d.slice/crio-2e00c0dcb19d925bc49675921d5dc1b0e1ebf71e795a3c7ec2e064d4ed9d476a WatchSource:0}: Error finding container 2e00c0dcb19d925bc49675921d5dc1b0e1ebf71e795a3c7ec2e064d4ed9d476a: Status 404 returned error can't find the container with id 2e00c0dcb19d925bc49675921d5dc1b0e1ebf71e795a3c7ec2e064d4ed9d476a Jul 10 18:32:04.223276 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.223240 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:32:04.223358 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.223310 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:32:04.223358 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.223338 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:32:04.822817 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.822779 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" event={"ID":"367c4ff5-aa03-4a24-aed0-73acf2431b4d","Type":"ContainerStarted","Data":"8066ee15f96ba5ab0083e7077f55546231970141bbcac8853194641a5fdefc94"} Jul 10 18:32:04.823211 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.822837 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" event={"ID":"367c4ff5-aa03-4a24-aed0-73acf2431b4d","Type":"ContainerStarted","Data":"2e00c0dcb19d925bc49675921d5dc1b0e1ebf71e795a3c7ec2e064d4ed9d476a"} Jul 10 18:32:04.844873 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:04.844805 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" podStartSLOduration=1.8447903829999999 podStartE2EDuration="1.844790383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:32:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:32:04.842030113 +0000 UTC m=+1956.682858370" watchObservedRunningTime="2026-07-10 18:32:04.844790383 +0000 UTC m=+1956.685618636" Jul 10 18:32:05.074690 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:05.074606 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:05.079435 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:05.079409 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:05.828885 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:05.828838 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:05.829677 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:05.829658 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:13.824031 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:13.823981 2579 patch_prober.go:28] interesting pod/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 10 18:32:13.824445 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:13.824054 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" podUID="7e0d7c0d-1942-4e7c-ab59-61d0abe36066" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 10 18:32:15.888729 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:15.888692 2579 generic.go:356] "Generic (PLEG): container finished" podID="7e0d7c0d-1942-4e7c-ab59-61d0abe36066" containerID="2ff18dfe0da025654901a80c52ae292b525766b18d7e6923a286004ec28ec6c3" exitCode=0 Jul 10 18:32:15.889214 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:15.888768 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" event={"ID":"7e0d7c0d-1942-4e7c-ab59-61d0abe36066","Type":"ContainerDied","Data":"2ff18dfe0da025654901a80c52ae292b525766b18d7e6923a286004ec28ec6c3"} Jul 10 18:32:15.889214 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:15.889205 2579 scope.go:117] "RemoveContainer" containerID="2ff18dfe0da025654901a80c52ae292b525766b18d7e6923a286004ec28ec6c3" Jul 10 18:32:15.890198 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:15.890166 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:32:15.890252 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:15.890237 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:32:15.890295 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:15.890268 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:32:16.896256 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:16.896224 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" event={"ID":"7e0d7c0d-1942-4e7c-ab59-61d0abe36066","Type":"ContainerStarted","Data":"4bed4b3fbc8fee91d6f921aa5abf818e6dffea0ed2ccde1e21620d5813569fa5"} Jul 10 18:32:17.662811 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:17.662773 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:32:17.663032 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:17.662904 2579 patch_prober.go:28] interesting pod/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 10 18:32:17.663032 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:17.662941 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" podUID="7e0d7c0d-1942-4e7c-ab59-61d0abe36066" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 10 18:32:18.663124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:18.663086 2579 patch_prober.go:28] interesting pod/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 10 18:32:18.663517 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:18.663133 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" podUID="7e0d7c0d-1942-4e7c-ab59-61d0abe36066" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 10 18:32:19.664024 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:19.663994 2579 patch_prober.go:28] interesting pod/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 10 18:32:19.664468 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:19.664444 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" podUID="7e0d7c0d-1942-4e7c-ab59-61d0abe36066" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 10 18:32:20.663356 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:20.663261 2579 patch_prober.go:28] interesting pod/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 10 18:32:20.663514 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:20.663339 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" podUID="7e0d7c0d-1942-4e7c-ab59-61d0abe36066" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 10 18:32:21.667899 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:21.667836 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:32:21.668346 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:21.668288 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:32:21.669044 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:21.669024 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:32:23.944398 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:23.944363 2579 generic.go:356] "Generic (PLEG): container finished" podID="367c4ff5-aa03-4a24-aed0-73acf2431b4d" containerID="8066ee15f96ba5ab0083e7077f55546231970141bbcac8853194641a5fdefc94" exitCode=0 Jul 10 18:32:23.944973 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:23.944411 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" event={"ID":"367c4ff5-aa03-4a24-aed0-73acf2431b4d","Type":"ContainerDied","Data":"8066ee15f96ba5ab0083e7077f55546231970141bbcac8853194641a5fdefc94"} Jul 10 18:32:23.944973 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:23.944955 2579 scope.go:117] "RemoveContainer" containerID="8066ee15f96ba5ab0083e7077f55546231970141bbcac8853194641a5fdefc94" Jul 10 18:32:23.945992 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:23.945965 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:32:23.946061 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:23.946031 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:32:23.946099 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:23.946059 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:32:24.951649 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:24.951616 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" event={"ID":"367c4ff5-aa03-4a24-aed0-73acf2431b4d","Type":"ContainerStarted","Data":"a2ac1b0fc632c3aa18e4fcb46db6da3609ac2625015352805b6ebb1e9342489b"} Jul 10 18:32:25.074604 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:25.074557 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:25.074843 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:25.074814 2579 patch_prober.go:28] interesting pod/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 10 18:32:25.074926 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:25.074905 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" podUID="367c4ff5-aa03-4a24-aed0-73acf2431b4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 10 18:32:26.075154 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:26.075116 2579 patch_prober.go:28] interesting pod/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 10 18:32:26.075618 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:26.075181 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" podUID="367c4ff5-aa03-4a24-aed0-73acf2431b4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 10 18:32:27.075300 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:27.075261 2579 patch_prober.go:28] interesting pod/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 10 18:32:27.075684 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:27.075326 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" podUID="367c4ff5-aa03-4a24-aed0-73acf2431b4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 10 18:32:28.075060 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:28.075028 2579 patch_prober.go:28] interesting pod/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 10 18:32:28.075228 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:28.075078 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" podUID="367c4ff5-aa03-4a24-aed0-73acf2431b4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 10 18:32:29.142209 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:29.142179 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:29.142677 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:29.142486 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:32:29.143367 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:32:29.143351 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:34:03.582142 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:03.582058 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw"] Jul 10 18:34:03.582618 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:03.582326 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" podUID="7e0d7c0d-1942-4e7c-ab59-61d0abe36066" containerName="istio-proxy" containerID="cri-o://4bed4b3fbc8fee91d6f921aa5abf818e6dffea0ed2ccde1e21620d5813569fa5" gracePeriod=30 Jul 10 18:34:06.670733 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:06.670694 2579 patch_prober.go:28] interesting pod/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 10 18:34:06.671162 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:06.670771 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" podUID="7e0d7c0d-1942-4e7c-ab59-61d0abe36066" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 18:34:08.843552 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.843529 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:34:08.971386 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.971317 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-podinfo\") pod \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " Jul 10 18:34:08.971386 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.971360 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-workload-socket\") pod \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " Jul 10 18:34:08.971386 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.971379 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-credential-socket\") pod \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " Jul 10 18:34:08.971708 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.971433 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-data\") pod \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " Jul 10 18:34:08.971708 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.971453 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-workload-certs\") pod \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " Jul 10 18:34:08.971708 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.971478 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-token\") pod \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " Jul 10 18:34:08.971708 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.971649 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istiod-ca-cert\") pod \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " Jul 10 18:34:08.971708 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.971685 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsbjp\" (UniqueName: \"kubernetes.io/projected/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-kube-api-access-hsbjp\") pod \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " Jul 10 18:34:08.971708 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.971669 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7e0d7c0d-1942-4e7c-ab59-61d0abe36066" (UID: "7e0d7c0d-1942-4e7c-ab59-61d0abe36066"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:34:08.972051 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.971728 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-envoy\") pod \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\" (UID: \"7e0d7c0d-1942-4e7c-ab59-61d0abe36066\") " Jul 10 18:34:08.972051 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.971771 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7e0d7c0d-1942-4e7c-ab59-61d0abe36066" (UID: "7e0d7c0d-1942-4e7c-ab59-61d0abe36066"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:34:08.972051 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.971821 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7e0d7c0d-1942-4e7c-ab59-61d0abe36066" (UID: "7e0d7c0d-1942-4e7c-ab59-61d0abe36066"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:34:08.972051 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.971999 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7e0d7c0d-1942-4e7c-ab59-61d0abe36066" (UID: "7e0d7c0d-1942-4e7c-ab59-61d0abe36066"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:34:08.972271 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.972162 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-workload-socket\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:08.972271 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.972182 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-credential-socket\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:08.972271 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.972195 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-workload-certs\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:08.972271 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.972209 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istiod-ca-cert\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:08.972616 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.972590 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-data" (OuterVolumeSpecName: "istio-data") pod "7e0d7c0d-1942-4e7c-ab59-61d0abe36066" (UID: "7e0d7c0d-1942-4e7c-ab59-61d0abe36066"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:34:08.973698 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.973663 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-token" (OuterVolumeSpecName: "istio-token") pod "7e0d7c0d-1942-4e7c-ab59-61d0abe36066" (UID: "7e0d7c0d-1942-4e7c-ab59-61d0abe36066"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:34:08.973809 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.973716 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7e0d7c0d-1942-4e7c-ab59-61d0abe36066" (UID: "7e0d7c0d-1942-4e7c-ab59-61d0abe36066"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:34:08.973966 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.973948 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7e0d7c0d-1942-4e7c-ab59-61d0abe36066" (UID: "7e0d7c0d-1942-4e7c-ab59-61d0abe36066"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 18:34:08.974085 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:08.974059 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-kube-api-access-hsbjp" (OuterVolumeSpecName: "kube-api-access-hsbjp") pod "7e0d7c0d-1942-4e7c-ab59-61d0abe36066" (UID: "7e0d7c0d-1942-4e7c-ab59-61d0abe36066"). InnerVolumeSpecName "kube-api-access-hsbjp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:34:09.072628 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:09.072604 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-envoy\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:09.072628 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:09.072625 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-podinfo\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:09.072775 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:09.072635 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-data\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:09.072775 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:09.072653 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-istio-token\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:09.072775 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:09.072662 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsbjp\" (UniqueName: \"kubernetes.io/projected/7e0d7c0d-1942-4e7c-ab59-61d0abe36066-kube-api-access-hsbjp\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:09.546820 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:09.546789 2579 generic.go:356] "Generic (PLEG): container finished" podID="7e0d7c0d-1942-4e7c-ab59-61d0abe36066" containerID="4bed4b3fbc8fee91d6f921aa5abf818e6dffea0ed2ccde1e21620d5813569fa5" exitCode=0 Jul 10 18:34:09.546998 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:09.546832 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" Jul 10 18:34:09.546998 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:09.546884 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" event={"ID":"7e0d7c0d-1942-4e7c-ab59-61d0abe36066","Type":"ContainerDied","Data":"4bed4b3fbc8fee91d6f921aa5abf818e6dffea0ed2ccde1e21620d5813569fa5"} Jul 10 18:34:09.546998 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:09.546943 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw" event={"ID":"7e0d7c0d-1942-4e7c-ab59-61d0abe36066","Type":"ContainerDied","Data":"480bd8c7d3b9d6c70b4238ed2955e96edc0409c069c8231abface22ffda9b39c"} Jul 10 18:34:09.546998 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:09.546966 2579 scope.go:117] "RemoveContainer" containerID="4bed4b3fbc8fee91d6f921aa5abf818e6dffea0ed2ccde1e21620d5813569fa5" Jul 10 18:34:09.556631 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:09.556614 2579 scope.go:117] "RemoveContainer" containerID="2ff18dfe0da025654901a80c52ae292b525766b18d7e6923a286004ec28ec6c3" Jul 10 18:34:09.567640 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:09.567613 2579 scope.go:117] "RemoveContainer" containerID="4bed4b3fbc8fee91d6f921aa5abf818e6dffea0ed2ccde1e21620d5813569fa5" Jul 10 18:34:09.567895 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:34:09.567874 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bed4b3fbc8fee91d6f921aa5abf818e6dffea0ed2ccde1e21620d5813569fa5\": container with ID starting with 4bed4b3fbc8fee91d6f921aa5abf818e6dffea0ed2ccde1e21620d5813569fa5 not found: ID does not exist" containerID="4bed4b3fbc8fee91d6f921aa5abf818e6dffea0ed2ccde1e21620d5813569fa5" Jul 10 18:34:09.567979 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:09.567904 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bed4b3fbc8fee91d6f921aa5abf818e6dffea0ed2ccde1e21620d5813569fa5"} err="failed to get container status \"4bed4b3fbc8fee91d6f921aa5abf818e6dffea0ed2ccde1e21620d5813569fa5\": rpc error: code = NotFound desc = could not find container \"4bed4b3fbc8fee91d6f921aa5abf818e6dffea0ed2ccde1e21620d5813569fa5\": container with ID starting with 4bed4b3fbc8fee91d6f921aa5abf818e6dffea0ed2ccde1e21620d5813569fa5 not found: ID does not exist" Jul 10 18:34:09.567979 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:09.567921 2579 scope.go:117] "RemoveContainer" containerID="2ff18dfe0da025654901a80c52ae292b525766b18d7e6923a286004ec28ec6c3" Jul 10 18:34:09.568161 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:34:09.568139 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ff18dfe0da025654901a80c52ae292b525766b18d7e6923a286004ec28ec6c3\": container with ID starting with 2ff18dfe0da025654901a80c52ae292b525766b18d7e6923a286004ec28ec6c3 not found: ID does not exist" containerID="2ff18dfe0da025654901a80c52ae292b525766b18d7e6923a286004ec28ec6c3" Jul 10 18:34:09.568216 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:09.568166 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ff18dfe0da025654901a80c52ae292b525766b18d7e6923a286004ec28ec6c3"} err="failed to get container status \"2ff18dfe0da025654901a80c52ae292b525766b18d7e6923a286004ec28ec6c3\": rpc error: code = NotFound desc = could not find container \"2ff18dfe0da025654901a80c52ae292b525766b18d7e6923a286004ec28ec6c3\": container with ID starting with 2ff18dfe0da025654901a80c52ae292b525766b18d7e6923a286004ec28ec6c3 not found: ID does not exist" Jul 10 18:34:09.569226 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:09.569203 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw"] Jul 10 18:34:09.573101 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:09.573080 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-ea8030-openshift-default-58cd967d79-dcdjw"] Jul 10 18:34:10.469841 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:10.469799 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq"] Jul 10 18:34:10.470298 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:10.470125 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" podUID="367c4ff5-aa03-4a24-aed0-73acf2431b4d" containerName="istio-proxy" containerID="cri-o://a2ac1b0fc632c3aa18e4fcb46db6da3609ac2625015352805b6ebb1e9342489b" gracePeriod=30 Jul 10 18:34:10.675014 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:10.674976 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e0d7c0d-1942-4e7c-ab59-61d0abe36066" path="/var/lib/kubelet/pods/7e0d7c0d-1942-4e7c-ab59-61d0abe36066/volumes" Jul 10 18:34:11.400718 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.400686 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h"] Jul 10 18:34:11.401126 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.401112 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e0d7c0d-1942-4e7c-ab59-61d0abe36066" containerName="istio-proxy" Jul 10 18:34:11.401356 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.401127 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e0d7c0d-1942-4e7c-ab59-61d0abe36066" containerName="istio-proxy" Jul 10 18:34:11.401356 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.401145 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e0d7c0d-1942-4e7c-ab59-61d0abe36066" containerName="istio-proxy" Jul 10 18:34:11.401356 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.401151 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e0d7c0d-1942-4e7c-ab59-61d0abe36066" containerName="istio-proxy" Jul 10 18:34:11.401356 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.401220 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e0d7c0d-1942-4e7c-ab59-61d0abe36066" containerName="istio-proxy" Jul 10 18:34:11.405934 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.405915 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.409294 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.409272 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-487078-openshift-default-dockercfg-h9dfw\"" Jul 10 18:34:11.426199 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.426178 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h"] Jul 10 18:34:11.597057 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.597024 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f844\" (UniqueName: \"kubernetes.io/projected/9b0fcfec-0e68-4b3c-8531-e361278a78e6-kube-api-access-6f844\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.597448 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.597073 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-envoy\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.597448 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.597147 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-podinfo\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.597448 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.597177 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-data\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.597448 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.597230 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-workload-certs\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.597448 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.597333 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-credential-socket\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.597448 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.597371 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istiod-ca-cert\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.597448 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.597405 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-workload-socket\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.597448 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.597425 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-token\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.698355 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.698273 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f844\" (UniqueName: \"kubernetes.io/projected/9b0fcfec-0e68-4b3c-8531-e361278a78e6-kube-api-access-6f844\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.698355 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.698310 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-envoy\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.698355 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.698339 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-podinfo\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.698355 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.698357 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-data\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.698692 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.698383 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-workload-certs\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.698692 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.698451 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-credential-socket\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.698692 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.698478 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istiod-ca-cert\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.698692 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.698505 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-workload-socket\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.698692 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.698525 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-token\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.698990 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.698815 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-data\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.698990 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.698840 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-credential-socket\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.699147 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.699124 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-workload-certs\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.699204 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.699160 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-workload-socket\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.699256 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.699233 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istiod-ca-cert\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.700867 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.700835 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-envoy\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.700975 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.700913 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-podinfo\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.707106 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.707084 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-token\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.707188 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.707092 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f844\" (UniqueName: \"kubernetes.io/projected/9b0fcfec-0e68-4b3c-8531-e361278a78e6-kube-api-access-6f844\") pod \"e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.716001 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.715981 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:11.850919 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.850891 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h"] Jul 10 18:34:11.851943 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:34:11.851917 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b0fcfec_0e68_4b3c_8531_e361278a78e6.slice/crio-d65820b5d3fd6fa91b6b06d32ecc40eb6c551dcfc7af70dfdfca56cf03fc2bf3 WatchSource:0}: Error finding container d65820b5d3fd6fa91b6b06d32ecc40eb6c551dcfc7af70dfdfca56cf03fc2bf3: Status 404 returned error can't find the container with id d65820b5d3fd6fa91b6b06d32ecc40eb6c551dcfc7af70dfdfca56cf03fc2bf3 Jul 10 18:34:11.854031 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.854000 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:34:11.854112 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.854077 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:34:11.854112 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:11.854106 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:34:12.564829 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:12.564792 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" event={"ID":"9b0fcfec-0e68-4b3c-8531-e361278a78e6","Type":"ContainerStarted","Data":"233e4a08ec5307f851791ff55aefc91e5eced25f6b559fe5f9efee66e9facfc2"} Jul 10 18:34:12.565007 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:12.564843 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" event={"ID":"9b0fcfec-0e68-4b3c-8531-e361278a78e6","Type":"ContainerStarted","Data":"d65820b5d3fd6fa91b6b06d32ecc40eb6c551dcfc7af70dfdfca56cf03fc2bf3"} Jul 10 18:34:12.586475 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:12.586424 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" podStartSLOduration=1.586409162 podStartE2EDuration="1.586409162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:34:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:34:12.584423697 +0000 UTC m=+2084.425251951" watchObservedRunningTime="2026-07-10 18:34:12.586409162 +0000 UTC m=+2084.427237416" Jul 10 18:34:12.716920 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:12.716888 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:12.721543 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:12.721523 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:13.569864 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:13.569824 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:13.570794 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:13.570775 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:14.144402 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:14.144362 2579 patch_prober.go:28] interesting pod/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 10 18:34:14.144784 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:14.144417 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" podUID="367c4ff5-aa03-4a24-aed0-73acf2431b4d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 18:34:15.734478 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.734419 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:34:15.836757 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.836726 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-data\") pod \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " Jul 10 18:34:15.836944 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.836767 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66h5n\" (UniqueName: \"kubernetes.io/projected/367c4ff5-aa03-4a24-aed0-73acf2431b4d-kube-api-access-66h5n\") pod \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " Jul 10 18:34:15.836944 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.836822 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-workload-socket\") pod \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " Jul 10 18:34:15.836944 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.836879 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-podinfo\") pod \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " Jul 10 18:34:15.837124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.836966 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-workload-certs\") pod \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " Jul 10 18:34:15.837124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.837018 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-token\") pod \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " Jul 10 18:34:15.837124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.837047 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istiod-ca-cert\") pod \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " Jul 10 18:34:15.837124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.837073 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-credential-socket\") pod \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " Jul 10 18:34:15.837124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.837109 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-envoy\") pod \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\" (UID: \"367c4ff5-aa03-4a24-aed0-73acf2431b4d\") " Jul 10 18:34:15.837377 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.837339 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "367c4ff5-aa03-4a24-aed0-73acf2431b4d" (UID: "367c4ff5-aa03-4a24-aed0-73acf2431b4d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:34:15.837453 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.837419 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "367c4ff5-aa03-4a24-aed0-73acf2431b4d" (UID: "367c4ff5-aa03-4a24-aed0-73acf2431b4d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:34:15.837709 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.837524 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-workload-socket\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:15.837709 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.837613 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istiod-ca-cert\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:15.837709 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.837534 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "367c4ff5-aa03-4a24-aed0-73acf2431b4d" (UID: "367c4ff5-aa03-4a24-aed0-73acf2431b4d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:34:15.837709 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.837685 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-data" (OuterVolumeSpecName: "istio-data") pod "367c4ff5-aa03-4a24-aed0-73acf2431b4d" (UID: "367c4ff5-aa03-4a24-aed0-73acf2431b4d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:34:15.838042 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.837713 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "367c4ff5-aa03-4a24-aed0-73acf2431b4d" (UID: "367c4ff5-aa03-4a24-aed0-73acf2431b4d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:34:15.839273 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.839243 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "367c4ff5-aa03-4a24-aed0-73acf2431b4d" (UID: "367c4ff5-aa03-4a24-aed0-73acf2431b4d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 18:34:15.839388 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.839317 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-token" (OuterVolumeSpecName: "istio-token") pod "367c4ff5-aa03-4a24-aed0-73acf2431b4d" (UID: "367c4ff5-aa03-4a24-aed0-73acf2431b4d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:34:15.839548 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.839528 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "367c4ff5-aa03-4a24-aed0-73acf2431b4d" (UID: "367c4ff5-aa03-4a24-aed0-73acf2431b4d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:34:15.839606 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.839566 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/367c4ff5-aa03-4a24-aed0-73acf2431b4d-kube-api-access-66h5n" (OuterVolumeSpecName: "kube-api-access-66h5n") pod "367c4ff5-aa03-4a24-aed0-73acf2431b4d" (UID: "367c4ff5-aa03-4a24-aed0-73acf2431b4d"). InnerVolumeSpecName "kube-api-access-66h5n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:34:15.939090 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.939063 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-workload-certs\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:15.939090 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.939085 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-token\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:15.939090 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.939093 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-credential-socket\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:15.939247 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.939101 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-envoy\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:15.939247 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.939110 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-data\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:15.939247 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.939117 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66h5n\" (UniqueName: \"kubernetes.io/projected/367c4ff5-aa03-4a24-aed0-73acf2431b4d-kube-api-access-66h5n\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:15.939247 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:15.939127 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/367c4ff5-aa03-4a24-aed0-73acf2431b4d-istio-podinfo\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:16.588462 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:16.588430 2579 generic.go:356] "Generic (PLEG): container finished" podID="367c4ff5-aa03-4a24-aed0-73acf2431b4d" containerID="a2ac1b0fc632c3aa18e4fcb46db6da3609ac2625015352805b6ebb1e9342489b" exitCode=0 Jul 10 18:34:16.588653 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:16.588476 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" Jul 10 18:34:16.588653 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:16.588508 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" event={"ID":"367c4ff5-aa03-4a24-aed0-73acf2431b4d","Type":"ContainerDied","Data":"a2ac1b0fc632c3aa18e4fcb46db6da3609ac2625015352805b6ebb1e9342489b"} Jul 10 18:34:16.588653 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:16.588574 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq" event={"ID":"367c4ff5-aa03-4a24-aed0-73acf2431b4d","Type":"ContainerDied","Data":"2e00c0dcb19d925bc49675921d5dc1b0e1ebf71e795a3c7ec2e064d4ed9d476a"} Jul 10 18:34:16.588653 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:16.588596 2579 scope.go:117] "RemoveContainer" containerID="a2ac1b0fc632c3aa18e4fcb46db6da3609ac2625015352805b6ebb1e9342489b" Jul 10 18:34:16.598365 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:16.598349 2579 scope.go:117] "RemoveContainer" containerID="8066ee15f96ba5ab0083e7077f55546231970141bbcac8853194641a5fdefc94" Jul 10 18:34:16.607434 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:16.607407 2579 scope.go:117] "RemoveContainer" containerID="a2ac1b0fc632c3aa18e4fcb46db6da3609ac2625015352805b6ebb1e9342489b" Jul 10 18:34:16.607717 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:34:16.607691 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2ac1b0fc632c3aa18e4fcb46db6da3609ac2625015352805b6ebb1e9342489b\": container with ID starting with a2ac1b0fc632c3aa18e4fcb46db6da3609ac2625015352805b6ebb1e9342489b not found: ID does not exist" containerID="a2ac1b0fc632c3aa18e4fcb46db6da3609ac2625015352805b6ebb1e9342489b" Jul 10 18:34:16.607785 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:16.607720 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2ac1b0fc632c3aa18e4fcb46db6da3609ac2625015352805b6ebb1e9342489b"} err="failed to get container status \"a2ac1b0fc632c3aa18e4fcb46db6da3609ac2625015352805b6ebb1e9342489b\": rpc error: code = NotFound desc = could not find container \"a2ac1b0fc632c3aa18e4fcb46db6da3609ac2625015352805b6ebb1e9342489b\": container with ID starting with a2ac1b0fc632c3aa18e4fcb46db6da3609ac2625015352805b6ebb1e9342489b not found: ID does not exist" Jul 10 18:34:16.607785 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:16.607737 2579 scope.go:117] "RemoveContainer" containerID="8066ee15f96ba5ab0083e7077f55546231970141bbcac8853194641a5fdefc94" Jul 10 18:34:16.608033 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:34:16.608014 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8066ee15f96ba5ab0083e7077f55546231970141bbcac8853194641a5fdefc94\": container with ID starting with 8066ee15f96ba5ab0083e7077f55546231970141bbcac8853194641a5fdefc94 not found: ID does not exist" containerID="8066ee15f96ba5ab0083e7077f55546231970141bbcac8853194641a5fdefc94" Jul 10 18:34:16.608105 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:16.608038 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8066ee15f96ba5ab0083e7077f55546231970141bbcac8853194641a5fdefc94"} err="failed to get container status \"8066ee15f96ba5ab0083e7077f55546231970141bbcac8853194641a5fdefc94\": rpc error: code = NotFound desc = could not find container \"8066ee15f96ba5ab0083e7077f55546231970141bbcac8853194641a5fdefc94\": container with ID starting with 8066ee15f96ba5ab0083e7077f55546231970141bbcac8853194641a5fdefc94 not found: ID does not exist" Jul 10 18:34:16.614919 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:16.614898 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq"] Jul 10 18:34:16.618756 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:16.618737 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-76cdbe-openshift-default-76996f9565-v68dq"] Jul 10 18:34:16.675022 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:16.675002 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="367c4ff5-aa03-4a24-aed0-73acf2431b4d" path="/var/lib/kubelet/pods/367c4ff5-aa03-4a24-aed0-73acf2431b4d/volumes" Jul 10 18:34:19.711756 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.711714 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv"] Jul 10 18:34:19.712258 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.712136 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="367c4ff5-aa03-4a24-aed0-73acf2431b4d" containerName="istio-proxy" Jul 10 18:34:19.712258 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.712150 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="367c4ff5-aa03-4a24-aed0-73acf2431b4d" containerName="istio-proxy" Jul 10 18:34:19.712258 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.712164 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="367c4ff5-aa03-4a24-aed0-73acf2431b4d" containerName="istio-proxy" Jul 10 18:34:19.712258 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.712171 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="367c4ff5-aa03-4a24-aed0-73acf2431b4d" containerName="istio-proxy" Jul 10 18:34:19.712258 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.712257 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e0d7c0d-1942-4e7c-ab59-61d0abe36066" containerName="istio-proxy" Jul 10 18:34:19.712536 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.712264 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="367c4ff5-aa03-4a24-aed0-73acf2431b4d" containerName="istio-proxy" Jul 10 18:34:19.712536 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.712275 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="367c4ff5-aa03-4a24-aed0-73acf2431b4d" containerName="istio-proxy" Jul 10 18:34:19.717500 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.717478 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.719804 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.719785 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-c93b3e-openshift-default-dockercfg-8qzmk\"" Jul 10 18:34:19.727822 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.727795 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv"] Jul 10 18:34:19.769527 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.769503 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mkqf\" (UniqueName: \"kubernetes.io/projected/caebc366-49de-4f67-a740-c4c7411477a4-kube-api-access-7mkqf\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.769644 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.769534 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-istio-envoy\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.769644 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.769552 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caebc366-49de-4f67-a740-c4c7411477a4-istio-podinfo\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.769644 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.769585 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-istio-data\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.769749 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.769645 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-credential-socket\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.769749 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.769681 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caebc366-49de-4f67-a740-c4c7411477a4-istio-token\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.769749 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.769708 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-workload-socket\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.769749 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.769727 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-workload-certs\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.769941 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.769771 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caebc366-49de-4f67-a740-c4c7411477a4-istiod-ca-cert\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.870823 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.870785 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-istio-data\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.870978 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.870832 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-credential-socket\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.870978 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.870874 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caebc366-49de-4f67-a740-c4c7411477a4-istio-token\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.870978 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.870897 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-workload-socket\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.870978 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.870918 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-workload-certs\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.870978 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.870941 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caebc366-49de-4f67-a740-c4c7411477a4-istiod-ca-cert\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.871261 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.870986 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mkqf\" (UniqueName: \"kubernetes.io/projected/caebc366-49de-4f67-a740-c4c7411477a4-kube-api-access-7mkqf\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.871261 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.871014 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-istio-envoy\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.871261 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.871042 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caebc366-49de-4f67-a740-c4c7411477a4-istio-podinfo\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.871261 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.871207 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-istio-data\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.871474 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.871264 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-credential-socket\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.871546 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.871470 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-workload-socket\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.871610 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.871547 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-workload-certs\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.871725 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.871696 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caebc366-49de-4f67-a740-c4c7411477a4-istiod-ca-cert\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.873437 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.873415 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-istio-envoy\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.873593 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.873577 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caebc366-49de-4f67-a740-c4c7411477a4-istio-podinfo\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.879462 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.879443 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mkqf\" (UniqueName: \"kubernetes.io/projected/caebc366-49de-4f67-a740-c4c7411477a4-kube-api-access-7mkqf\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:19.879619 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:19.879602 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caebc366-49de-4f67-a740-c4c7411477a4-istio-token\") pod \"e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:20.028620 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:20.028536 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:20.168093 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:20.168062 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv"] Jul 10 18:34:20.170221 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:34:20.170195 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaebc366_49de_4f67_a740_c4c7411477a4.slice/crio-22365827ab50b470a5259010477912f14e3b6e6216ef7151d107120203ab2eb7 WatchSource:0}: Error finding container 22365827ab50b470a5259010477912f14e3b6e6216ef7151d107120203ab2eb7: Status 404 returned error can't find the container with id 22365827ab50b470a5259010477912f14e3b6e6216ef7151d107120203ab2eb7 Jul 10 18:34:20.172493 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:20.172461 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:34:20.172564 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:20.172525 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:34:20.172604 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:20.172560 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:34:20.612931 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:20.612895 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" event={"ID":"caebc366-49de-4f67-a740-c4c7411477a4","Type":"ContainerStarted","Data":"1caa234c45d8d7b3849c6b95a86ed6b4cc9013a5e2976487641e0387f0dd3955"} Jul 10 18:34:20.613171 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:20.612953 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" event={"ID":"caebc366-49de-4f67-a740-c4c7411477a4","Type":"ContainerStarted","Data":"22365827ab50b470a5259010477912f14e3b6e6216ef7151d107120203ab2eb7"} Jul 10 18:34:20.637387 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:20.637329 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" podStartSLOduration=1.637310796 podStartE2EDuration="1.637310796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:34:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:34:20.634690938 +0000 UTC m=+2092.475519193" watchObservedRunningTime="2026-07-10 18:34:20.637310796 +0000 UTC m=+2092.478139052" Jul 10 18:34:21.031756 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:21.031645 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:21.035358 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:21.035332 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:21.622929 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:21.622890 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:21.632671 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:21.632395 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:27.660191 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:27.660159 2579 generic.go:356] "Generic (PLEG): container finished" podID="9b0fcfec-0e68-4b3c-8531-e361278a78e6" containerID="233e4a08ec5307f851791ff55aefc91e5eced25f6b559fe5f9efee66e9facfc2" exitCode=0 Jul 10 18:34:27.660529 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:27.660217 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" event={"ID":"9b0fcfec-0e68-4b3c-8531-e361278a78e6","Type":"ContainerDied","Data":"233e4a08ec5307f851791ff55aefc91e5eced25f6b559fe5f9efee66e9facfc2"} Jul 10 18:34:27.660604 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:27.660590 2579 scope.go:117] "RemoveContainer" containerID="233e4a08ec5307f851791ff55aefc91e5eced25f6b559fe5f9efee66e9facfc2" Jul 10 18:34:27.661589 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:27.661561 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:34:27.661648 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:27.661635 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:34:27.661685 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:27.661670 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:34:28.570254 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:28.570216 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:28.668164 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:28.668126 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" event={"ID":"9b0fcfec-0e68-4b3c-8531-e361278a78e6","Type":"ContainerStarted","Data":"462d92050881c4b96197069eb47304950ab890b43c37aac740153d65b10c3cb3"} Jul 10 18:34:28.721067 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:28.721028 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:28.722224 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:28.722186 2579 patch_prober.go:28] interesting pod/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 10 18:34:28.722327 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:28.722246 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" podUID="9b0fcfec-0e68-4b3c-8531-e361278a78e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 10 18:34:29.717295 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:29.717251 2579 patch_prober.go:28] interesting pod/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 10 18:34:29.717821 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:29.717327 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" podUID="9b0fcfec-0e68-4b3c-8531-e361278a78e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 10 18:34:30.716834 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:30.716795 2579 patch_prober.go:28] interesting pod/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 10 18:34:30.717155 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:30.717120 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" podUID="9b0fcfec-0e68-4b3c-8531-e361278a78e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 10 18:34:31.717483 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:31.717445 2579 patch_prober.go:28] interesting pod/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 10 18:34:31.718110 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:31.718076 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" podUID="9b0fcfec-0e68-4b3c-8531-e361278a78e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 10 18:34:32.732237 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:32.732202 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:32.732999 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:32.732979 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:32.735472 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:32.735450 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:37.664010 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:37.663972 2579 patch_prober.go:28] interesting pod/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 10 18:34:37.664509 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:37.664062 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" podUID="caebc366-49de-4f67-a740-c4c7411477a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 10 18:34:38.726473 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:38.726433 2579 generic.go:356] "Generic (PLEG): container finished" podID="caebc366-49de-4f67-a740-c4c7411477a4" containerID="1caa234c45d8d7b3849c6b95a86ed6b4cc9013a5e2976487641e0387f0dd3955" exitCode=0 Jul 10 18:34:38.726913 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:38.726484 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" event={"ID":"caebc366-49de-4f67-a740-c4c7411477a4","Type":"ContainerDied","Data":"1caa234c45d8d7b3849c6b95a86ed6b4cc9013a5e2976487641e0387f0dd3955"} Jul 10 18:34:38.726913 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:38.726844 2579 scope.go:117] "RemoveContainer" containerID="1caa234c45d8d7b3849c6b95a86ed6b4cc9013a5e2976487641e0387f0dd3955" Jul 10 18:34:38.727829 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:38.727796 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:34:38.727942 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:38.727876 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:34:38.727942 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:38.727921 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:34:39.734898 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:39.734844 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" event={"ID":"caebc366-49de-4f67-a740-c4c7411477a4","Type":"ContainerStarted","Data":"a0e15fb1313184beda9da93062cc64f74bb2db55ee6c3a1c3873c5abf6b3c05f"} Jul 10 18:34:40.028723 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:40.028628 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:40.028973 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:40.028950 2579 patch_prober.go:28] interesting pod/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 10 18:34:40.029025 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:40.029009 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" podUID="caebc366-49de-4f67-a740-c4c7411477a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 10 18:34:41.029345 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:41.029306 2579 patch_prober.go:28] interesting pod/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 10 18:34:41.029992 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:41.029949 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" podUID="caebc366-49de-4f67-a740-c4c7411477a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 10 18:34:41.649887 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:41.649212 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h"] Jul 10 18:34:41.649887 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:41.649584 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" podUID="9b0fcfec-0e68-4b3c-8531-e361278a78e6" containerName="istio-proxy" containerID="cri-o://462d92050881c4b96197069eb47304950ab890b43c37aac740153d65b10c3cb3" gracePeriod=30 Jul 10 18:34:42.029222 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:42.029135 2579 patch_prober.go:28] interesting pod/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 10 18:34:42.029516 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:42.029478 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" podUID="caebc366-49de-4f67-a740-c4c7411477a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 10 18:34:43.029356 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:43.029317 2579 patch_prober.go:28] interesting pod/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 10 18:34:43.029676 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:43.029643 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" podUID="caebc366-49de-4f67-a740-c4c7411477a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 10 18:34:44.029347 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:44.029307 2579 patch_prober.go:28] interesting pod/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 10 18:34:44.029638 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:44.029609 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" podUID="caebc366-49de-4f67-a740-c4c7411477a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 10 18:34:45.033401 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:45.033368 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:45.033806 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:45.033718 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:45.034346 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:45.034328 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:46.778186 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.778155 2579 generic.go:356] "Generic (PLEG): container finished" podID="9b0fcfec-0e68-4b3c-8531-e361278a78e6" containerID="462d92050881c4b96197069eb47304950ab890b43c37aac740153d65b10c3cb3" exitCode=0 Jul 10 18:34:46.778574 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.778226 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" event={"ID":"9b0fcfec-0e68-4b3c-8531-e361278a78e6","Type":"ContainerDied","Data":"462d92050881c4b96197069eb47304950ab890b43c37aac740153d65b10c3cb3"} Jul 10 18:34:46.778574 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.778303 2579 scope.go:117] "RemoveContainer" containerID="233e4a08ec5307f851791ff55aefc91e5eced25f6b559fe5f9efee66e9facfc2" Jul 10 18:34:46.919399 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.919327 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:46.964665 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.964628 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istiod-ca-cert\") pod \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " Jul 10 18:34:46.964830 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.964676 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-workload-socket\") pod \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " Jul 10 18:34:46.964830 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.964703 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-envoy\") pod \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " Jul 10 18:34:46.964830 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.964817 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-workload-certs\") pod \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " Jul 10 18:34:46.965049 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.964910 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-podinfo\") pod \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " Jul 10 18:34:46.965049 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.964963 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-credential-socket\") pod \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " Jul 10 18:34:46.965049 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.965022 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-token\") pod \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " Jul 10 18:34:46.965212 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.965061 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f844\" (UniqueName: \"kubernetes.io/projected/9b0fcfec-0e68-4b3c-8531-e361278a78e6-kube-api-access-6f844\") pod \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " Jul 10 18:34:46.965212 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.965023 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9b0fcfec-0e68-4b3c-8531-e361278a78e6" (UID: "9b0fcfec-0e68-4b3c-8531-e361278a78e6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:34:46.965212 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.965062 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9b0fcfec-0e68-4b3c-8531-e361278a78e6" (UID: "9b0fcfec-0e68-4b3c-8531-e361278a78e6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:34:46.965212 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.965091 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9b0fcfec-0e68-4b3c-8531-e361278a78e6" (UID: "9b0fcfec-0e68-4b3c-8531-e361278a78e6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:34:46.965212 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.965139 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-data\") pod \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\" (UID: \"9b0fcfec-0e68-4b3c-8531-e361278a78e6\") " Jul 10 18:34:46.965490 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.965217 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9b0fcfec-0e68-4b3c-8531-e361278a78e6" (UID: "9b0fcfec-0e68-4b3c-8531-e361278a78e6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:34:46.965631 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.965608 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istiod-ca-cert\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:46.965708 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.965636 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-workload-socket\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:46.965708 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.965651 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-workload-certs\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:46.965708 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.965667 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-credential-socket\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:46.966109 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.966070 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-data" (OuterVolumeSpecName: "istio-data") pod "9b0fcfec-0e68-4b3c-8531-e361278a78e6" (UID: "9b0fcfec-0e68-4b3c-8531-e361278a78e6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:34:46.967202 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.967181 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9b0fcfec-0e68-4b3c-8531-e361278a78e6" (UID: "9b0fcfec-0e68-4b3c-8531-e361278a78e6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:34:46.967315 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.967293 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b0fcfec-0e68-4b3c-8531-e361278a78e6-kube-api-access-6f844" (OuterVolumeSpecName: "kube-api-access-6f844") pod "9b0fcfec-0e68-4b3c-8531-e361278a78e6" (UID: "9b0fcfec-0e68-4b3c-8531-e361278a78e6"). InnerVolumeSpecName "kube-api-access-6f844". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:34:46.967625 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.967608 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9b0fcfec-0e68-4b3c-8531-e361278a78e6" (UID: "9b0fcfec-0e68-4b3c-8531-e361278a78e6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 18:34:46.967820 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:46.967797 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-token" (OuterVolumeSpecName: "istio-token") pod "9b0fcfec-0e68-4b3c-8531-e361278a78e6" (UID: "9b0fcfec-0e68-4b3c-8531-e361278a78e6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:34:47.066193 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:47.066165 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-podinfo\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:47.066193 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:47.066190 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-token\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:47.066353 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:47.066200 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f844\" (UniqueName: \"kubernetes.io/projected/9b0fcfec-0e68-4b3c-8531-e361278a78e6-kube-api-access-6f844\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:47.066353 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:47.066209 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-data\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:47.066353 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:47.066217 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b0fcfec-0e68-4b3c-8531-e361278a78e6-istio-envoy\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:47.784514 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:47.784480 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" Jul 10 18:34:47.784514 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:47.784504 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h" event={"ID":"9b0fcfec-0e68-4b3c-8531-e361278a78e6","Type":"ContainerDied","Data":"d65820b5d3fd6fa91b6b06d32ecc40eb6c551dcfc7af70dfdfca56cf03fc2bf3"} Jul 10 18:34:47.785034 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:47.784567 2579 scope.go:117] "RemoveContainer" containerID="462d92050881c4b96197069eb47304950ab890b43c37aac740153d65b10c3cb3" Jul 10 18:34:47.808434 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:47.808411 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h"] Jul 10 18:34:47.813890 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:47.813869 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-487078-openshift-default-6b7d47cfd7-xtw4h"] Jul 10 18:34:48.674841 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:48.674805 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b0fcfec-0e68-4b3c-8531-e361278a78e6" path="/var/lib/kubelet/pods/9b0fcfec-0e68-4b3c-8531-e361278a78e6/volumes" Jul 10 18:34:48.885003 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:48.884973 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv"] Jul 10 18:34:48.885387 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:48.885172 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" podUID="caebc366-49de-4f67-a740-c4c7411477a4" containerName="istio-proxy" containerID="cri-o://a0e15fb1313184beda9da93062cc64f74bb2db55ee6c3a1c3873c5abf6b3c05f" gracePeriod=30 Jul 10 18:34:49.720615 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.720536 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99"] Jul 10 18:34:49.721180 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.721162 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b0fcfec-0e68-4b3c-8531-e361278a78e6" containerName="istio-proxy" Jul 10 18:34:49.721234 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.721184 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b0fcfec-0e68-4b3c-8531-e361278a78e6" containerName="istio-proxy" Jul 10 18:34:49.721234 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.721220 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b0fcfec-0e68-4b3c-8531-e361278a78e6" containerName="istio-proxy" Jul 10 18:34:49.721234 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.721228 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b0fcfec-0e68-4b3c-8531-e361278a78e6" containerName="istio-proxy" Jul 10 18:34:49.721333 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.721314 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b0fcfec-0e68-4b3c-8531-e361278a78e6" containerName="istio-proxy" Jul 10 18:34:49.725442 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.725424 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.727880 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.727845 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-48683a-openshift-default-dockercfg-fvbjf\"" Jul 10 18:34:49.736113 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.736086 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99"] Jul 10 18:34:49.792068 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.792033 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-workload-socket\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.792236 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.792081 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-credential-socket\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.792236 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.792107 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-istio-data\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.792236 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.792155 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-istio-envoy\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.792398 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.792232 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0208e802-168d-477a-a28e-71aaa75dfb49-istio-podinfo\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.792398 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.792285 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv6mh\" (UniqueName: \"kubernetes.io/projected/0208e802-168d-477a-a28e-71aaa75dfb49-kube-api-access-nv6mh\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.792398 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.792381 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-workload-certs\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.792525 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.792422 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0208e802-168d-477a-a28e-71aaa75dfb49-istio-token\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.792525 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.792473 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0208e802-168d-477a-a28e-71aaa75dfb49-istiod-ca-cert\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.893154 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.893122 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-istio-envoy\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.893154 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.893167 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0208e802-168d-477a-a28e-71aaa75dfb49-istio-podinfo\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.893718 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.893197 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv6mh\" (UniqueName: \"kubernetes.io/projected/0208e802-168d-477a-a28e-71aaa75dfb49-kube-api-access-nv6mh\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.893718 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.893373 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-workload-certs\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.893718 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.893442 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0208e802-168d-477a-a28e-71aaa75dfb49-istio-token\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.893718 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.893494 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0208e802-168d-477a-a28e-71aaa75dfb49-istiod-ca-cert\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.893718 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.893564 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-workload-socket\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.893718 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.893596 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-credential-socket\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.893718 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.893627 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-istio-data\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.894104 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.894032 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-istio-data\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.894104 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.894092 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-workload-socket\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.894374 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.894351 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-credential-socket\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.894772 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.894727 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0208e802-168d-477a-a28e-71aaa75dfb49-istiod-ca-cert\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.895592 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.894942 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-workload-certs\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.896539 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.896487 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0208e802-168d-477a-a28e-71aaa75dfb49-istio-podinfo\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.896978 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.896954 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-istio-envoy\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.903171 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.903140 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0208e802-168d-477a-a28e-71aaa75dfb49-istio-token\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:49.903675 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:49.903651 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv6mh\" (UniqueName: \"kubernetes.io/projected/0208e802-168d-477a-a28e-71aaa75dfb49-kube-api-access-nv6mh\") pod \"e2e-shared-a-48683a-openshift-default-846c78d675-jvk99\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:50.036395 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:50.036317 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:50.180719 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:50.180688 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99"] Jul 10 18:34:50.182183 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:34:50.182156 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0208e802_168d_477a_a28e_71aaa75dfb49.slice/crio-1df59cd775d2381db3df9eb0404fa3cfdd01ca3e449e80aa204876111de5fca1 WatchSource:0}: Error finding container 1df59cd775d2381db3df9eb0404fa3cfdd01ca3e449e80aa204876111de5fca1: Status 404 returned error can't find the container with id 1df59cd775d2381db3df9eb0404fa3cfdd01ca3e449e80aa204876111de5fca1 Jul 10 18:34:50.184362 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:50.184328 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:34:50.184420 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:50.184397 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:34:50.184462 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:50.184429 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:34:50.804517 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:50.804482 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" event={"ID":"0208e802-168d-477a-a28e-71aaa75dfb49","Type":"ContainerStarted","Data":"787ce023d7a0ab814efcb35dd9fa6bc2be465802e9f1963ec5c9fc33e40ccf0c"} Jul 10 18:34:50.804723 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:50.804529 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" event={"ID":"0208e802-168d-477a-a28e-71aaa75dfb49","Type":"ContainerStarted","Data":"1df59cd775d2381db3df9eb0404fa3cfdd01ca3e449e80aa204876111de5fca1"} Jul 10 18:34:50.828274 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:50.828226 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" podStartSLOduration=1.828210185 podStartE2EDuration="1.828210185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:34:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:34:50.826625352 +0000 UTC m=+2122.667453607" watchObservedRunningTime="2026-07-10 18:34:50.828210185 +0000 UTC m=+2122.669038439" Jul 10 18:34:51.037519 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:51.037485 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:51.042358 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:51.042329 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:51.810472 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:51.810438 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:51.811523 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:51.811507 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:34:54.144593 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.144524 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:54.237669 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.237639 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-istio-data\") pod \"caebc366-49de-4f67-a740-c4c7411477a4\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " Jul 10 18:34:54.237884 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.237677 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-credential-socket\") pod \"caebc366-49de-4f67-a740-c4c7411477a4\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " Jul 10 18:34:54.237884 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.237701 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caebc366-49de-4f67-a740-c4c7411477a4-istiod-ca-cert\") pod \"caebc366-49de-4f67-a740-c4c7411477a4\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " Jul 10 18:34:54.237884 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.237731 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caebc366-49de-4f67-a740-c4c7411477a4-istio-podinfo\") pod \"caebc366-49de-4f67-a740-c4c7411477a4\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " Jul 10 18:34:54.237884 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.237765 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-workload-certs\") pod \"caebc366-49de-4f67-a740-c4c7411477a4\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " Jul 10 18:34:54.237884 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.237783 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-workload-socket\") pod \"caebc366-49de-4f67-a740-c4c7411477a4\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " Jul 10 18:34:54.237884 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.237834 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mkqf\" (UniqueName: \"kubernetes.io/projected/caebc366-49de-4f67-a740-c4c7411477a4-kube-api-access-7mkqf\") pod \"caebc366-49de-4f67-a740-c4c7411477a4\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " Jul 10 18:34:54.238210 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.237925 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caebc366-49de-4f67-a740-c4c7411477a4-istio-token\") pod \"caebc366-49de-4f67-a740-c4c7411477a4\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " Jul 10 18:34:54.238210 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.237980 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-istio-envoy\") pod \"caebc366-49de-4f67-a740-c4c7411477a4\" (UID: \"caebc366-49de-4f67-a740-c4c7411477a4\") " Jul 10 18:34:54.238210 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.238070 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "caebc366-49de-4f67-a740-c4c7411477a4" (UID: "caebc366-49de-4f67-a740-c4c7411477a4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:34:54.238210 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.238118 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caebc366-49de-4f67-a740-c4c7411477a4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "caebc366-49de-4f67-a740-c4c7411477a4" (UID: "caebc366-49de-4f67-a740-c4c7411477a4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:34:54.238450 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.238355 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "caebc366-49de-4f67-a740-c4c7411477a4" (UID: "caebc366-49de-4f67-a740-c4c7411477a4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:34:54.238450 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.238427 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "caebc366-49de-4f67-a740-c4c7411477a4" (UID: "caebc366-49de-4f67-a740-c4c7411477a4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:34:54.238553 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.238489 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-credential-socket\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:54.238553 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.238511 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caebc366-49de-4f67-a740-c4c7411477a4-istiod-ca-cert\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:54.238553 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.238526 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-workload-socket\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:54.238743 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.238721 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-istio-data" (OuterVolumeSpecName: "istio-data") pod "caebc366-49de-4f67-a740-c4c7411477a4" (UID: "caebc366-49de-4f67-a740-c4c7411477a4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:34:54.240166 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.240137 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caebc366-49de-4f67-a740-c4c7411477a4-kube-api-access-7mkqf" (OuterVolumeSpecName: "kube-api-access-7mkqf") pod "caebc366-49de-4f67-a740-c4c7411477a4" (UID: "caebc366-49de-4f67-a740-c4c7411477a4"). InnerVolumeSpecName "kube-api-access-7mkqf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:34:54.240294 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.240217 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "caebc366-49de-4f67-a740-c4c7411477a4" (UID: "caebc366-49de-4f67-a740-c4c7411477a4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:34:54.240465 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.240432 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/caebc366-49de-4f67-a740-c4c7411477a4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "caebc366-49de-4f67-a740-c4c7411477a4" (UID: "caebc366-49de-4f67-a740-c4c7411477a4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 18:34:54.240557 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.240533 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caebc366-49de-4f67-a740-c4c7411477a4-istio-token" (OuterVolumeSpecName: "istio-token") pod "caebc366-49de-4f67-a740-c4c7411477a4" (UID: "caebc366-49de-4f67-a740-c4c7411477a4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:34:54.339157 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.339126 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caebc366-49de-4f67-a740-c4c7411477a4-istio-token\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:54.339157 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.339152 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-istio-envoy\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:54.339157 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.339160 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-istio-data\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:54.339157 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.339168 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caebc366-49de-4f67-a740-c4c7411477a4-istio-podinfo\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:54.339420 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.339177 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caebc366-49de-4f67-a740-c4c7411477a4-workload-certs\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:54.339420 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.339185 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mkqf\" (UniqueName: \"kubernetes.io/projected/caebc366-49de-4f67-a740-c4c7411477a4-kube-api-access-7mkqf\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:34:54.829033 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.828997 2579 generic.go:356] "Generic (PLEG): container finished" podID="caebc366-49de-4f67-a740-c4c7411477a4" containerID="a0e15fb1313184beda9da93062cc64f74bb2db55ee6c3a1c3873c5abf6b3c05f" exitCode=0 Jul 10 18:34:54.829209 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.829048 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" Jul 10 18:34:54.829209 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.829080 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" event={"ID":"caebc366-49de-4f67-a740-c4c7411477a4","Type":"ContainerDied","Data":"a0e15fb1313184beda9da93062cc64f74bb2db55ee6c3a1c3873c5abf6b3c05f"} Jul 10 18:34:54.829209 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.829139 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv" event={"ID":"caebc366-49de-4f67-a740-c4c7411477a4","Type":"ContainerDied","Data":"22365827ab50b470a5259010477912f14e3b6e6216ef7151d107120203ab2eb7"} Jul 10 18:34:54.829209 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.829164 2579 scope.go:117] "RemoveContainer" containerID="a0e15fb1313184beda9da93062cc64f74bb2db55ee6c3a1c3873c5abf6b3c05f" Jul 10 18:34:54.838657 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.838638 2579 scope.go:117] "RemoveContainer" containerID="1caa234c45d8d7b3849c6b95a86ed6b4cc9013a5e2976487641e0387f0dd3955" Jul 10 18:34:54.846890 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.846867 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv"] Jul 10 18:34:54.847548 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.847530 2579 scope.go:117] "RemoveContainer" containerID="a0e15fb1313184beda9da93062cc64f74bb2db55ee6c3a1c3873c5abf6b3c05f" Jul 10 18:34:54.848109 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:34:54.848077 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0e15fb1313184beda9da93062cc64f74bb2db55ee6c3a1c3873c5abf6b3c05f\": container with ID starting with a0e15fb1313184beda9da93062cc64f74bb2db55ee6c3a1c3873c5abf6b3c05f not found: ID does not exist" containerID="a0e15fb1313184beda9da93062cc64f74bb2db55ee6c3a1c3873c5abf6b3c05f" Jul 10 18:34:54.848218 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.848117 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0e15fb1313184beda9da93062cc64f74bb2db55ee6c3a1c3873c5abf6b3c05f"} err="failed to get container status \"a0e15fb1313184beda9da93062cc64f74bb2db55ee6c3a1c3873c5abf6b3c05f\": rpc error: code = NotFound desc = could not find container \"a0e15fb1313184beda9da93062cc64f74bb2db55ee6c3a1c3873c5abf6b3c05f\": container with ID starting with a0e15fb1313184beda9da93062cc64f74bb2db55ee6c3a1c3873c5abf6b3c05f not found: ID does not exist" Jul 10 18:34:54.848218 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.848140 2579 scope.go:117] "RemoveContainer" containerID="1caa234c45d8d7b3849c6b95a86ed6b4cc9013a5e2976487641e0387f0dd3955" Jul 10 18:34:54.848466 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:34:54.848439 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1caa234c45d8d7b3849c6b95a86ed6b4cc9013a5e2976487641e0387f0dd3955\": container with ID starting with 1caa234c45d8d7b3849c6b95a86ed6b4cc9013a5e2976487641e0387f0dd3955 not found: ID does not exist" containerID="1caa234c45d8d7b3849c6b95a86ed6b4cc9013a5e2976487641e0387f0dd3955" Jul 10 18:34:54.848534 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.848474 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1caa234c45d8d7b3849c6b95a86ed6b4cc9013a5e2976487641e0387f0dd3955"} err="failed to get container status \"1caa234c45d8d7b3849c6b95a86ed6b4cc9013a5e2976487641e0387f0dd3955\": rpc error: code = NotFound desc = could not find container \"1caa234c45d8d7b3849c6b95a86ed6b4cc9013a5e2976487641e0387f0dd3955\": container with ID starting with 1caa234c45d8d7b3849c6b95a86ed6b4cc9013a5e2976487641e0387f0dd3955 not found: ID does not exist" Jul 10 18:34:54.850496 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:54.850475 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-c93b3e-openshift-default-566dbf858c-ftnsv"] Jul 10 18:34:56.674912 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:56.674880 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caebc366-49de-4f67-a740-c4c7411477a4" path="/var/lib/kubelet/pods/caebc366-49de-4f67-a740-c4c7411477a4/volumes" Jul 10 18:34:57.760420 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.760387 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q"] Jul 10 18:34:57.760969 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.760951 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caebc366-49de-4f67-a740-c4c7411477a4" containerName="istio-proxy" Jul 10 18:34:57.761067 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.760970 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="caebc366-49de-4f67-a740-c4c7411477a4" containerName="istio-proxy" Jul 10 18:34:57.761067 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.760995 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caebc366-49de-4f67-a740-c4c7411477a4" containerName="istio-proxy" Jul 10 18:34:57.761067 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.761001 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="caebc366-49de-4f67-a740-c4c7411477a4" containerName="istio-proxy" Jul 10 18:34:57.761239 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.761086 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b0fcfec-0e68-4b3c-8531-e361278a78e6" containerName="istio-proxy" Jul 10 18:34:57.761239 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.761106 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="caebc366-49de-4f67-a740-c4c7411477a4" containerName="istio-proxy" Jul 10 18:34:57.761239 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.761120 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="caebc366-49de-4f67-a740-c4c7411477a4" containerName="istio-proxy" Jul 10 18:34:57.768737 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.768703 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.771877 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.771829 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-35792e-openshift-default-dockercfg-f8clf\"" Jul 10 18:34:57.774109 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.774086 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q"] Jul 10 18:34:57.874970 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.874929 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-data\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.875189 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.874998 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istiod-ca-cert\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.875189 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.875026 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-podinfo\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.875189 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.875072 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-envoy\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.875189 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.875139 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-workload-certs\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.875189 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.875159 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-credential-socket\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.875471 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.875198 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp868\" (UniqueName: \"kubernetes.io/projected/716fb973-aa5c-4a25-a0ff-80c2438b83cc-kube-api-access-kp868\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.875471 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.875314 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-workload-socket\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.875471 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.875402 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-token\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.976783 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.976746 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istiod-ca-cert\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.976783 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.976785 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-podinfo\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.977047 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.976808 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-envoy\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.977047 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.976834 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-workload-certs\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.977047 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.976878 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-credential-socket\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.977047 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.976923 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp868\" (UniqueName: \"kubernetes.io/projected/716fb973-aa5c-4a25-a0ff-80c2438b83cc-kube-api-access-kp868\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.977047 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.976980 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-workload-socket\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.977317 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.977053 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-token\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.977317 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.977082 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-data\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.977430 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.977350 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-workload-certs\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.977513 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.977488 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-data\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.977575 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.977520 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-workload-socket\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.977631 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.977600 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istiod-ca-cert\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.977631 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.977622 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-credential-socket\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.979712 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.979688 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-envoy\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.980046 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.980026 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-podinfo\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.988507 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.988481 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-token\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:57.988628 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:57.988555 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp868\" (UniqueName: \"kubernetes.io/projected/716fb973-aa5c-4a25-a0ff-80c2438b83cc-kube-api-access-kp868\") pod \"e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:58.080336 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:58.080304 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:58.220961 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:58.220935 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q"] Jul 10 18:34:58.222711 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:34:58.222679 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod716fb973_aa5c_4a25_a0ff_80c2438b83cc.slice/crio-4a10efab0244a285dc3b0d57f35020e5774497c2ab629c6796176e8b7de27ead WatchSource:0}: Error finding container 4a10efab0244a285dc3b0d57f35020e5774497c2ab629c6796176e8b7de27ead: Status 404 returned error can't find the container with id 4a10efab0244a285dc3b0d57f35020e5774497c2ab629c6796176e8b7de27ead Jul 10 18:34:58.225105 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:58.225067 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:34:58.225235 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:58.225137 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:34:58.225235 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:58.225166 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:34:58.856892 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:58.856843 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" event={"ID":"716fb973-aa5c-4a25-a0ff-80c2438b83cc","Type":"ContainerStarted","Data":"789b178b40cc3da4fee57384bca6d6ee51f0b514e7731ddbc1ad61dab9cfbcd8"} Jul 10 18:34:58.857285 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:58.856906 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" event={"ID":"716fb973-aa5c-4a25-a0ff-80c2438b83cc","Type":"ContainerStarted","Data":"4a10efab0244a285dc3b0d57f35020e5774497c2ab629c6796176e8b7de27ead"} Jul 10 18:34:58.878781 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:58.878725 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" podStartSLOduration=1.878707494 podStartE2EDuration="1.878707494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:34:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:34:58.876791812 +0000 UTC m=+2130.717620067" watchObservedRunningTime="2026-07-10 18:34:58.878707494 +0000 UTC m=+2130.719535750" Jul 10 18:34:59.081259 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:59.081224 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:59.086204 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:59.086175 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:59.863213 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:59.863188 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:34:59.864053 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:34:59.864035 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:35:07.852035 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:07.851992 2579 patch_prober.go:28] interesting pod/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 10 18:35:07.852561 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:07.852072 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" podUID="0208e802-168d-477a-a28e-71aaa75dfb49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 10 18:35:08.921220 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:08.921182 2579 generic.go:356] "Generic (PLEG): container finished" podID="0208e802-168d-477a-a28e-71aaa75dfb49" containerID="787ce023d7a0ab814efcb35dd9fa6bc2be465802e9f1963ec5c9fc33e40ccf0c" exitCode=0 Jul 10 18:35:08.921867 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:08.921821 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" event={"ID":"0208e802-168d-477a-a28e-71aaa75dfb49","Type":"ContainerDied","Data":"787ce023d7a0ab814efcb35dd9fa6bc2be465802e9f1963ec5c9fc33e40ccf0c"} Jul 10 18:35:08.922470 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:08.922449 2579 scope.go:117] "RemoveContainer" containerID="787ce023d7a0ab814efcb35dd9fa6bc2be465802e9f1963ec5c9fc33e40ccf0c" Jul 10 18:35:08.924054 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:08.924016 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:35:08.924132 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:08.924111 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:35:08.924195 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:08.924162 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:35:09.933399 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:09.933356 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" event={"ID":"0208e802-168d-477a-a28e-71aaa75dfb49","Type":"ContainerStarted","Data":"6f0720197f52fe1c5da06132b4b35a47b2460517441e0adf93cabdc099d32bcb"} Jul 10 18:35:10.037134 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:10.037096 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:35:10.037519 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:10.037433 2579 patch_prober.go:28] interesting pod/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 10 18:35:10.037685 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:10.037662 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" podUID="0208e802-168d-477a-a28e-71aaa75dfb49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 10 18:35:11.037285 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:11.037247 2579 patch_prober.go:28] interesting pod/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 10 18:35:11.037896 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:11.037813 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" podUID="0208e802-168d-477a-a28e-71aaa75dfb49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 10 18:35:12.037409 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:12.037366 2579 patch_prober.go:28] interesting pod/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 10 18:35:12.037940 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:12.037432 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" podUID="0208e802-168d-477a-a28e-71aaa75dfb49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 10 18:35:13.037711 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:13.037615 2579 patch_prober.go:28] interesting pod/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 10 18:35:13.037711 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:13.037688 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" podUID="0208e802-168d-477a-a28e-71aaa75dfb49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 10 18:35:14.041259 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:14.041228 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:35:14.041716 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:14.041568 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:35:14.042329 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:14.042308 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:35:15.598258 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:15.597510 2579 patch_prober.go:28] interesting pod/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": read tcp 10.132.0.2:60020->10.132.0.56:15021: read: connection reset by peer" start-of-body= Jul 10 18:35:15.598258 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:15.597582 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" podUID="716fb973-aa5c-4a25-a0ff-80c2438b83cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": read tcp 10.132.0.2:60020->10.132.0.56:15021: read: connection reset by peer" Jul 10 18:35:15.975161 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:15.975076 2579 generic.go:356] "Generic (PLEG): container finished" podID="716fb973-aa5c-4a25-a0ff-80c2438b83cc" containerID="789b178b40cc3da4fee57384bca6d6ee51f0b514e7731ddbc1ad61dab9cfbcd8" exitCode=0 Jul 10 18:35:15.975161 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:15.975145 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" event={"ID":"716fb973-aa5c-4a25-a0ff-80c2438b83cc","Type":"ContainerDied","Data":"789b178b40cc3da4fee57384bca6d6ee51f0b514e7731ddbc1ad61dab9cfbcd8"} Jul 10 18:35:15.975556 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:15.975542 2579 scope.go:117] "RemoveContainer" containerID="789b178b40cc3da4fee57384bca6d6ee51f0b514e7731ddbc1ad61dab9cfbcd8" Jul 10 18:35:15.976500 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:15.976470 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:35:15.976604 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:15.976550 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:35:15.976673 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:15.976620 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 18:35:16.983190 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:16.983154 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" event={"ID":"716fb973-aa5c-4a25-a0ff-80c2438b83cc","Type":"ContainerStarted","Data":"c54d9b29b826272b5937c4502f1f136fc733d0f97957a43ae79baecd03c045da"} Jul 10 18:35:17.081003 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:17.080969 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:35:17.081173 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:17.081109 2579 patch_prober.go:28] interesting pod/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 10 18:35:17.081173 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:17.081153 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" podUID="716fb973-aa5c-4a25-a0ff-80c2438b83cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 10 18:35:18.080928 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:18.080889 2579 patch_prober.go:28] interesting pod/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 10 18:35:18.081330 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:18.080952 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" podUID="716fb973-aa5c-4a25-a0ff-80c2438b83cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 10 18:35:19.081592 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:19.081556 2579 patch_prober.go:28] interesting pod/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 10 18:35:19.082042 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:19.081610 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" podUID="716fb973-aa5c-4a25-a0ff-80c2438b83cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 10 18:35:20.081435 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:20.081396 2579 patch_prober.go:28] interesting pod/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 10 18:35:20.081623 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:20.081451 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" podUID="716fb973-aa5c-4a25-a0ff-80c2438b83cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 10 18:35:21.086009 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:21.085977 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:35:21.086494 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:21.086388 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:35:21.087090 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:35:21.087068 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:41:16.422057 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:16.422000 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99"] Jul 10 18:41:16.422577 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:16.422302 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" podUID="0208e802-168d-477a-a28e-71aaa75dfb49" containerName="istio-proxy" containerID="cri-o://6f0720197f52fe1c5da06132b4b35a47b2460517441e0adf93cabdc099d32bcb" gracePeriod=30 Jul 10 18:41:21.680049 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.680021 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:41:21.835952 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.835921 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-credential-socket\") pod \"0208e802-168d-477a-a28e-71aaa75dfb49\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " Jul 10 18:41:21.836143 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.835964 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0208e802-168d-477a-a28e-71aaa75dfb49-istio-podinfo\") pod \"0208e802-168d-477a-a28e-71aaa75dfb49\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " Jul 10 18:41:21.836143 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.835985 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nv6mh\" (UniqueName: \"kubernetes.io/projected/0208e802-168d-477a-a28e-71aaa75dfb49-kube-api-access-nv6mh\") pod \"0208e802-168d-477a-a28e-71aaa75dfb49\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " Jul 10 18:41:21.836143 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.836011 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-workload-certs\") pod \"0208e802-168d-477a-a28e-71aaa75dfb49\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " Jul 10 18:41:21.836143 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.836057 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0208e802-168d-477a-a28e-71aaa75dfb49-istiod-ca-cert\") pod \"0208e802-168d-477a-a28e-71aaa75dfb49\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " Jul 10 18:41:21.836143 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.836097 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0208e802-168d-477a-a28e-71aaa75dfb49-istio-token\") pod \"0208e802-168d-477a-a28e-71aaa75dfb49\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " Jul 10 18:41:21.836429 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.836159 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-istio-data\") pod \"0208e802-168d-477a-a28e-71aaa75dfb49\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " Jul 10 18:41:21.836429 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.836190 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-workload-socket\") pod \"0208e802-168d-477a-a28e-71aaa75dfb49\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " Jul 10 18:41:21.836429 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.836215 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-istio-envoy\") pod \"0208e802-168d-477a-a28e-71aaa75dfb49\" (UID: \"0208e802-168d-477a-a28e-71aaa75dfb49\") " Jul 10 18:41:21.836429 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.836220 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0208e802-168d-477a-a28e-71aaa75dfb49" (UID: "0208e802-168d-477a-a28e-71aaa75dfb49"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:41:21.836631 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.836427 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0208e802-168d-477a-a28e-71aaa75dfb49" (UID: "0208e802-168d-477a-a28e-71aaa75dfb49"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:41:21.836631 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.836604 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0208e802-168d-477a-a28e-71aaa75dfb49-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0208e802-168d-477a-a28e-71aaa75dfb49" (UID: "0208e802-168d-477a-a28e-71aaa75dfb49"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:41:21.836631 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.836609 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0208e802-168d-477a-a28e-71aaa75dfb49" (UID: "0208e802-168d-477a-a28e-71aaa75dfb49"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:41:21.836910 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.836888 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0208e802-168d-477a-a28e-71aaa75dfb49-istiod-ca-cert\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:41:21.837007 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.836914 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-workload-socket\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:41:21.837007 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.836928 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-credential-socket\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:41:21.837007 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.836941 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-workload-certs\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:41:21.837331 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.837216 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-istio-data" (OuterVolumeSpecName: "istio-data") pod "0208e802-168d-477a-a28e-71aaa75dfb49" (UID: "0208e802-168d-477a-a28e-71aaa75dfb49"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:41:21.838500 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.838464 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0208e802-168d-477a-a28e-71aaa75dfb49-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0208e802-168d-477a-a28e-71aaa75dfb49" (UID: "0208e802-168d-477a-a28e-71aaa75dfb49"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 18:41:21.838608 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.838529 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0208e802-168d-477a-a28e-71aaa75dfb49-kube-api-access-nv6mh" (OuterVolumeSpecName: "kube-api-access-nv6mh") pod "0208e802-168d-477a-a28e-71aaa75dfb49" (UID: "0208e802-168d-477a-a28e-71aaa75dfb49"). InnerVolumeSpecName "kube-api-access-nv6mh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:41:21.838659 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.838623 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0208e802-168d-477a-a28e-71aaa75dfb49-istio-token" (OuterVolumeSpecName: "istio-token") pod "0208e802-168d-477a-a28e-71aaa75dfb49" (UID: "0208e802-168d-477a-a28e-71aaa75dfb49"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:41:21.838781 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.838764 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0208e802-168d-477a-a28e-71aaa75dfb49" (UID: "0208e802-168d-477a-a28e-71aaa75dfb49"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:41:21.937833 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.937796 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-istio-data\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:41:21.937833 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.937827 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0208e802-168d-477a-a28e-71aaa75dfb49-istio-envoy\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:41:21.937833 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.937836 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0208e802-168d-477a-a28e-71aaa75dfb49-istio-podinfo\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:41:21.937833 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.937845 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nv6mh\" (UniqueName: \"kubernetes.io/projected/0208e802-168d-477a-a28e-71aaa75dfb49-kube-api-access-nv6mh\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:41:21.938125 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.937880 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0208e802-168d-477a-a28e-71aaa75dfb49-istio-token\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:41:21.983593 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.983559 2579 generic.go:356] "Generic (PLEG): container finished" podID="0208e802-168d-477a-a28e-71aaa75dfb49" containerID="6f0720197f52fe1c5da06132b4b35a47b2460517441e0adf93cabdc099d32bcb" exitCode=0 Jul 10 18:41:21.983772 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.983608 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" Jul 10 18:41:21.983772 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.983620 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" event={"ID":"0208e802-168d-477a-a28e-71aaa75dfb49","Type":"ContainerDied","Data":"6f0720197f52fe1c5da06132b4b35a47b2460517441e0adf93cabdc099d32bcb"} Jul 10 18:41:21.983772 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.983672 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99" event={"ID":"0208e802-168d-477a-a28e-71aaa75dfb49","Type":"ContainerDied","Data":"1df59cd775d2381db3df9eb0404fa3cfdd01ca3e449e80aa204876111de5fca1"} Jul 10 18:41:21.983772 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.983702 2579 scope.go:117] "RemoveContainer" containerID="6f0720197f52fe1c5da06132b4b35a47b2460517441e0adf93cabdc099d32bcb" Jul 10 18:41:21.993722 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:21.993705 2579 scope.go:117] "RemoveContainer" containerID="787ce023d7a0ab814efcb35dd9fa6bc2be465802e9f1963ec5c9fc33e40ccf0c" Jul 10 18:41:22.002127 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:22.002107 2579 scope.go:117] "RemoveContainer" containerID="6f0720197f52fe1c5da06132b4b35a47b2460517441e0adf93cabdc099d32bcb" Jul 10 18:41:22.002385 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:41:22.002367 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f0720197f52fe1c5da06132b4b35a47b2460517441e0adf93cabdc099d32bcb\": container with ID starting with 6f0720197f52fe1c5da06132b4b35a47b2460517441e0adf93cabdc099d32bcb not found: ID does not exist" containerID="6f0720197f52fe1c5da06132b4b35a47b2460517441e0adf93cabdc099d32bcb" Jul 10 18:41:22.002435 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:22.002395 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f0720197f52fe1c5da06132b4b35a47b2460517441e0adf93cabdc099d32bcb"} err="failed to get container status \"6f0720197f52fe1c5da06132b4b35a47b2460517441e0adf93cabdc099d32bcb\": rpc error: code = NotFound desc = could not find container \"6f0720197f52fe1c5da06132b4b35a47b2460517441e0adf93cabdc099d32bcb\": container with ID starting with 6f0720197f52fe1c5da06132b4b35a47b2460517441e0adf93cabdc099d32bcb not found: ID does not exist" Jul 10 18:41:22.002435 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:22.002411 2579 scope.go:117] "RemoveContainer" containerID="787ce023d7a0ab814efcb35dd9fa6bc2be465802e9f1963ec5c9fc33e40ccf0c" Jul 10 18:41:22.002626 ip-10-0-138-201 kubenswrapper[2579]: E0710 18:41:22.002611 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"787ce023d7a0ab814efcb35dd9fa6bc2be465802e9f1963ec5c9fc33e40ccf0c\": container with ID starting with 787ce023d7a0ab814efcb35dd9fa6bc2be465802e9f1963ec5c9fc33e40ccf0c not found: ID does not exist" containerID="787ce023d7a0ab814efcb35dd9fa6bc2be465802e9f1963ec5c9fc33e40ccf0c" Jul 10 18:41:22.002679 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:22.002630 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"787ce023d7a0ab814efcb35dd9fa6bc2be465802e9f1963ec5c9fc33e40ccf0c"} err="failed to get container status \"787ce023d7a0ab814efcb35dd9fa6bc2be465802e9f1963ec5c9fc33e40ccf0c\": rpc error: code = NotFound desc = could not find container \"787ce023d7a0ab814efcb35dd9fa6bc2be465802e9f1963ec5c9fc33e40ccf0c\": container with ID starting with 787ce023d7a0ab814efcb35dd9fa6bc2be465802e9f1963ec5c9fc33e40ccf0c not found: ID does not exist" Jul 10 18:41:22.008482 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:22.008458 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99"] Jul 10 18:41:22.012679 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:22.012650 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-48683a-openshift-default-846c78d675-jvk99"] Jul 10 18:41:22.675231 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:22.675198 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0208e802-168d-477a-a28e-71aaa75dfb49" path="/var/lib/kubelet/pods/0208e802-168d-477a-a28e-71aaa75dfb49/volumes" Jul 10 18:41:23.457020 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:23.456986 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q"] Jul 10 18:41:23.457450 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:23.457221 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" podUID="716fb973-aa5c-4a25-a0ff-80c2438b83cc" containerName="istio-proxy" containerID="cri-o://c54d9b29b826272b5937c4502f1f136fc733d0f97957a43ae79baecd03c045da" gracePeriod=30 Jul 10 18:41:28.709069 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.709043 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:41:28.807561 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.807524 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istiod-ca-cert\") pod \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " Jul 10 18:41:28.807754 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.807582 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-workload-socket\") pod \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " Jul 10 18:41:28.807754 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.807613 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-podinfo\") pod \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " Jul 10 18:41:28.807754 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.807652 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-token\") pod \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " Jul 10 18:41:28.807754 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.807686 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-data\") pod \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " Jul 10 18:41:28.807754 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.807708 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-envoy\") pod \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " Jul 10 18:41:28.807754 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.807727 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-workload-certs\") pod \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " Jul 10 18:41:28.808110 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.807758 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-credential-socket\") pod \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " Jul 10 18:41:28.808110 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.807790 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kp868\" (UniqueName: \"kubernetes.io/projected/716fb973-aa5c-4a25-a0ff-80c2438b83cc-kube-api-access-kp868\") pod \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\" (UID: \"716fb973-aa5c-4a25-a0ff-80c2438b83cc\") " Jul 10 18:41:28.808110 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.807951 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "716fb973-aa5c-4a25-a0ff-80c2438b83cc" (UID: "716fb973-aa5c-4a25-a0ff-80c2438b83cc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:41:28.808110 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.808016 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "716fb973-aa5c-4a25-a0ff-80c2438b83cc" (UID: "716fb973-aa5c-4a25-a0ff-80c2438b83cc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:41:28.808329 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.808222 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "716fb973-aa5c-4a25-a0ff-80c2438b83cc" (UID: "716fb973-aa5c-4a25-a0ff-80c2438b83cc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:41:28.808389 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.808342 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istiod-ca-cert\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:41:28.808444 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.808390 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-workload-socket\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:41:28.808444 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.808405 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-workload-certs\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:41:28.808444 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.808418 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "716fb973-aa5c-4a25-a0ff-80c2438b83cc" (UID: "716fb973-aa5c-4a25-a0ff-80c2438b83cc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:41:28.808626 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.808592 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-data" (OuterVolumeSpecName: "istio-data") pod "716fb973-aa5c-4a25-a0ff-80c2438b83cc" (UID: "716fb973-aa5c-4a25-a0ff-80c2438b83cc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:41:28.809866 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.809829 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "716fb973-aa5c-4a25-a0ff-80c2438b83cc" (UID: "716fb973-aa5c-4a25-a0ff-80c2438b83cc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:41:28.809972 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.809896 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "716fb973-aa5c-4a25-a0ff-80c2438b83cc" (UID: "716fb973-aa5c-4a25-a0ff-80c2438b83cc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 18:41:28.809972 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.809942 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-token" (OuterVolumeSpecName: "istio-token") pod "716fb973-aa5c-4a25-a0ff-80c2438b83cc" (UID: "716fb973-aa5c-4a25-a0ff-80c2438b83cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:41:28.810124 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.810107 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/716fb973-aa5c-4a25-a0ff-80c2438b83cc-kube-api-access-kp868" (OuterVolumeSpecName: "kube-api-access-kp868") pod "716fb973-aa5c-4a25-a0ff-80c2438b83cc" (UID: "716fb973-aa5c-4a25-a0ff-80c2438b83cc"). InnerVolumeSpecName "kube-api-access-kp868". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:41:28.909229 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.909197 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-podinfo\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:41:28.909229 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.909225 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-token\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:41:28.909229 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.909234 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-data\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:41:28.909229 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.909241 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-istio-envoy\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:41:28.909496 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.909251 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/716fb973-aa5c-4a25-a0ff-80c2438b83cc-credential-socket\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:41:28.909496 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.909259 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kp868\" (UniqueName: \"kubernetes.io/projected/716fb973-aa5c-4a25-a0ff-80c2438b83cc-kube-api-access-kp868\") on node \"ip-10-0-138-201.ec2.internal\" DevicePath \"\"" Jul 10 18:41:28.948361 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.948332 2579 scope.go:117] "RemoveContainer" containerID="789b178b40cc3da4fee57384bca6d6ee51f0b514e7731ddbc1ad61dab9cfbcd8" Jul 10 18:41:28.957191 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:28.957174 2579 scope.go:117] "RemoveContainer" containerID="c54d9b29b826272b5937c4502f1f136fc733d0f97957a43ae79baecd03c045da" Jul 10 18:41:29.023633 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:29.023604 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" Jul 10 18:41:29.023802 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:29.023633 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" event={"ID":"716fb973-aa5c-4a25-a0ff-80c2438b83cc","Type":"ContainerDied","Data":"c54d9b29b826272b5937c4502f1f136fc733d0f97957a43ae79baecd03c045da"} Jul 10 18:41:29.023802 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:29.023683 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q" event={"ID":"716fb973-aa5c-4a25-a0ff-80c2438b83cc","Type":"ContainerDied","Data":"4a10efab0244a285dc3b0d57f35020e5774497c2ab629c6796176e8b7de27ead"} Jul 10 18:41:29.055880 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:29.055831 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q"] Jul 10 18:41:29.060026 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:29.059954 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-35792e-openshift-default-59957b6b4c-l467q"] Jul 10 18:41:29.146430 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:29.146402 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-92zwc_e0b12bf0-69de-424d-89bd-a20b52e11fc7/server/0.log" Jul 10 18:41:29.377986 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:29.377910 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb6dcc87f-8sn5x_a7996f9b-d966-491e-821d-5dd96cd11d23/copy-manifests/0.log" Jul 10 18:41:29.396494 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:29.396462 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb6dcc87f-8sn5x_a7996f9b-d966-491e-821d-5dd96cd11d23/manager/0.log" Jul 10 18:41:30.680777 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:30.680744 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="716fb973-aa5c-4a25-a0ff-80c2438b83cc" path="/var/lib/kubelet/pods/716fb973-aa5c-4a25-a0ff-80c2438b83cc/volumes" Jul 10 18:41:30.811380 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:30.811347 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5_90dc343f-73fa-453a-9e58-26a7ce2a031b/util/0.log" Jul 10 18:41:30.817756 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:30.817729 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5_90dc343f-73fa-453a-9e58-26a7ce2a031b/pull/0.log" Jul 10 18:41:30.823680 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:30.823659 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5_90dc343f-73fa-453a-9e58-26a7ce2a031b/extract/0.log" Jul 10 18:41:30.931391 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:30.931310 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm_15e75816-b35f-49e7-8dec-0f2080d3ca32/util/0.log" Jul 10 18:41:30.940462 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:30.940438 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm_15e75816-b35f-49e7-8dec-0f2080d3ca32/pull/0.log" Jul 10 18:41:30.950921 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:30.950901 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm_15e75816-b35f-49e7-8dec-0f2080d3ca32/extract/0.log" Jul 10 18:41:31.058862 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:31.058828 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5_e8116c3d-62d7-4108-9d00-c07c28b8c529/util/0.log" Jul 10 18:41:31.065466 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:31.065439 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5_e8116c3d-62d7-4108-9d00-c07c28b8c529/pull/0.log" Jul 10 18:41:31.072036 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:31.072008 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5_e8116c3d-62d7-4108-9d00-c07c28b8c529/extract/0.log" Jul 10 18:41:31.182915 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:31.182829 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn_86d0f3de-37ea-443c-9922-a33555090907/util/0.log" Jul 10 18:41:31.189226 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:31.189201 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn_86d0f3de-37ea-443c-9922-a33555090907/pull/0.log" Jul 10 18:41:31.194795 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:31.194767 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn_86d0f3de-37ea-443c-9922-a33555090907/extract/0.log" Jul 10 18:41:32.469006 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:32.468976 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678bl6zv_f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea/istio-proxy/0.log" Jul 10 18:41:32.584708 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:32.584666 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s77ln_e7947dff-eec4-43f0-8a0c-582b58078fe1/discovery/0.log" Jul 10 18:41:32.925101 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:32.925067 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ggjch_849be59f-f5c9-4317-9c40-4035f553b744/istio-proxy/1.log" Jul 10 18:41:33.709084 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:33.709051 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-vlph6_28621025-6cad-440f-8665-a2e253511c96/main/0.log" Jul 10 18:41:33.937651 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:33.937614 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbn2htb_7ee3f050-6072-4abb-ae91-dca9edda998f/main/0.log" Jul 10 18:41:41.445901 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:41.445869 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lkzjv_2418c763-f86f-480e-bd1e-1766be24925f/global-pull-secret-syncer/0.log" Jul 10 18:41:41.586609 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:41.586575 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sz5jj_970dcd3c-8d21-40bb-8c9c-852507ae8a1f/konnectivity-agent/0.log" Jul 10 18:41:41.659577 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:41.659545 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-201.ec2.internal_a72846258c46978b3a5ef8b6cbff19db/haproxy/0.log" Jul 10 18:41:46.285826 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:46.285797 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5_90dc343f-73fa-453a-9e58-26a7ce2a031b/extract/0.log" Jul 10 18:41:46.302987 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:46.302962 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5_90dc343f-73fa-453a-9e58-26a7ce2a031b/util/0.log" Jul 10 18:41:46.325014 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:46.324983 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nlwr5_90dc343f-73fa-453a-9e58-26a7ce2a031b/pull/0.log" Jul 10 18:41:46.363906 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:46.363876 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm_15e75816-b35f-49e7-8dec-0f2080d3ca32/extract/0.log" Jul 10 18:41:46.392220 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:46.392190 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm_15e75816-b35f-49e7-8dec-0f2080d3ca32/util/0.log" Jul 10 18:41:46.434909 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:46.434877 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rv2wm_15e75816-b35f-49e7-8dec-0f2080d3ca32/pull/0.log" Jul 10 18:41:46.484049 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:46.484025 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5_e8116c3d-62d7-4108-9d00-c07c28b8c529/extract/0.log" Jul 10 18:41:46.506499 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:46.506477 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5_e8116c3d-62d7-4108-9d00-c07c28b8c529/util/0.log" Jul 10 18:41:46.529169 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:46.529136 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73664v5_e8116c3d-62d7-4108-9d00-c07c28b8c529/pull/0.log" Jul 10 18:41:46.560022 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:46.559993 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn_86d0f3de-37ea-443c-9922-a33555090907/extract/0.log" Jul 10 18:41:46.600830 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:46.600798 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn_86d0f3de-37ea-443c-9922-a33555090907/util/0.log" Jul 10 18:41:46.625293 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:46.625268 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vr4xn_86d0f3de-37ea-443c-9922-a33555090907/pull/0.log" Jul 10 18:41:49.313684 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:49.313650 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_551582f3-62c0-4a18-82a8-349a6ea17251/alertmanager/0.log" Jul 10 18:41:49.343429 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:49.343405 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_551582f3-62c0-4a18-82a8-349a6ea17251/config-reloader/0.log" Jul 10 18:41:49.376408 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:49.376384 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_551582f3-62c0-4a18-82a8-349a6ea17251/kube-rbac-proxy-web/0.log" Jul 10 18:41:49.401401 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:49.401375 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_551582f3-62c0-4a18-82a8-349a6ea17251/kube-rbac-proxy/0.log" Jul 10 18:41:49.429375 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:49.429347 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_551582f3-62c0-4a18-82a8-349a6ea17251/kube-rbac-proxy-metric/0.log" Jul 10 18:41:49.484762 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:49.484733 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_551582f3-62c0-4a18-82a8-349a6ea17251/prom-label-proxy/0.log" Jul 10 18:41:49.509899 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:49.509859 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_551582f3-62c0-4a18-82a8-349a6ea17251/init-config-reloader/0.log" Jul 10 18:41:49.570422 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:49.570355 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lps9f_dfc9ca45-82b1-4478-a216-1adc73054c2e/cluster-monitoring-operator/0.log" Jul 10 18:41:49.731073 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:49.731025 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-jn5cb_b64aa758-5dc1-4dcd-b529-e07c8722cefb/monitoring-plugin/0.log" Jul 10 18:41:49.959486 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:49.959403 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vmv7d_71151d48-fd30-4518-b63e-154be37fcdee/node-exporter/0.log" Jul 10 18:41:49.994396 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:49.994363 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vmv7d_71151d48-fd30-4518-b63e-154be37fcdee/kube-rbac-proxy/0.log" Jul 10 18:41:50.026756 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:50.026729 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vmv7d_71151d48-fd30-4518-b63e-154be37fcdee/init-textfile/0.log" Jul 10 18:41:50.058576 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:50.058541 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-7k4qv_8c03069b-3ec7-4f58-acc1-3320407c6205/kube-rbac-proxy-main/0.log" Jul 10 18:41:50.092862 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:50.092829 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-7k4qv_8c03069b-3ec7-4f58-acc1-3320407c6205/kube-rbac-proxy-self/0.log" Jul 10 18:41:50.123879 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:50.123822 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-7k4qv_8c03069b-3ec7-4f58-acc1-3320407c6205/openshift-state-metrics/0.log" Jul 10 18:41:50.575975 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:50.575942 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c8f689d67-vmlnz_3eaefb5d-f574-419e-9506-2b15f7418322/telemeter-client/0.log" Jul 10 18:41:50.601620 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:50.601598 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c8f689d67-vmlnz_3eaefb5d-f574-419e-9506-2b15f7418322/reload/0.log" Jul 10 18:41:50.625022 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:50.624996 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c8f689d67-vmlnz_3eaefb5d-f574-419e-9506-2b15f7418322/kube-rbac-proxy/0.log" Jul 10 18:41:50.655476 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:50.655449 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-998794db6-9m2vr_27bcd56e-373f-448d-8a3c-9ee5823b9ac4/thanos-query/0.log" Jul 10 18:41:50.684112 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:50.684084 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-998794db6-9m2vr_27bcd56e-373f-448d-8a3c-9ee5823b9ac4/kube-rbac-proxy-web/0.log" Jul 10 18:41:50.709453 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:50.709430 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-998794db6-9m2vr_27bcd56e-373f-448d-8a3c-9ee5823b9ac4/kube-rbac-proxy/0.log" Jul 10 18:41:50.730189 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:50.730165 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-998794db6-9m2vr_27bcd56e-373f-448d-8a3c-9ee5823b9ac4/prom-label-proxy/0.log" Jul 10 18:41:50.752860 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:50.752821 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-998794db6-9m2vr_27bcd56e-373f-448d-8a3c-9ee5823b9ac4/kube-rbac-proxy-rules/0.log" Jul 10 18:41:50.775721 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:50.775692 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-998794db6-9m2vr_27bcd56e-373f-448d-8a3c-9ee5823b9ac4/kube-rbac-proxy-metrics/0.log" Jul 10 18:41:52.044992 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.044952 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-xp7mh_151cc011-39cc-4b5a-8d78-d79e7e53e3ec/networking-console-plugin/0.log" Jul 10 18:41:52.397149 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.397066 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr"] Jul 10 18:41:52.397457 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.397444 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0208e802-168d-477a-a28e-71aaa75dfb49" containerName="istio-proxy" Jul 10 18:41:52.397500 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.397458 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0208e802-168d-477a-a28e-71aaa75dfb49" containerName="istio-proxy" Jul 10 18:41:52.397500 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.397497 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716fb973-aa5c-4a25-a0ff-80c2438b83cc" containerName="istio-proxy" Jul 10 18:41:52.397578 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.397505 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="716fb973-aa5c-4a25-a0ff-80c2438b83cc" containerName="istio-proxy" Jul 10 18:41:52.397578 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.397514 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0208e802-168d-477a-a28e-71aaa75dfb49" containerName="istio-proxy" Jul 10 18:41:52.397578 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.397520 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0208e802-168d-477a-a28e-71aaa75dfb49" containerName="istio-proxy" Jul 10 18:41:52.397737 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.397597 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="716fb973-aa5c-4a25-a0ff-80c2438b83cc" containerName="istio-proxy" Jul 10 18:41:52.397737 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.397605 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0208e802-168d-477a-a28e-71aaa75dfb49" containerName="istio-proxy" Jul 10 18:41:52.397737 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.397611 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0208e802-168d-477a-a28e-71aaa75dfb49" containerName="istio-proxy" Jul 10 18:41:52.400056 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.400036 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr" Jul 10 18:41:52.402623 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.402602 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5tczq\"/\"default-dockercfg-rt4qw\"" Jul 10 18:41:52.402734 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.402616 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5tczq\"/\"openshift-service-ca.crt\"" Jul 10 18:41:52.403820 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.403798 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5tczq\"/\"kube-root-ca.crt\"" Jul 10 18:41:52.409904 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.409880 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr"] Jul 10 18:41:52.525249 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.525211 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a63a0a62-be66-4c0c-b1a3-d14ee438d6a4-proc\") pod \"perf-node-gather-daemonset-zj6lr\" (UID: \"a63a0a62-be66-4c0c-b1a3-d14ee438d6a4\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr" Jul 10 18:41:52.525249 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.525256 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a63a0a62-be66-4c0c-b1a3-d14ee438d6a4-sys\") pod \"perf-node-gather-daemonset-zj6lr\" (UID: \"a63a0a62-be66-4c0c-b1a3-d14ee438d6a4\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr" Jul 10 18:41:52.525491 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.525280 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a63a0a62-be66-4c0c-b1a3-d14ee438d6a4-lib-modules\") pod \"perf-node-gather-daemonset-zj6lr\" (UID: \"a63a0a62-be66-4c0c-b1a3-d14ee438d6a4\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr" Jul 10 18:41:52.525491 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.525353 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6b6h\" (UniqueName: \"kubernetes.io/projected/a63a0a62-be66-4c0c-b1a3-d14ee438d6a4-kube-api-access-j6b6h\") pod \"perf-node-gather-daemonset-zj6lr\" (UID: \"a63a0a62-be66-4c0c-b1a3-d14ee438d6a4\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr" Jul 10 18:41:52.525491 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.525390 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a63a0a62-be66-4c0c-b1a3-d14ee438d6a4-podres\") pod \"perf-node-gather-daemonset-zj6lr\" (UID: \"a63a0a62-be66-4c0c-b1a3-d14ee438d6a4\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr" Jul 10 18:41:52.626489 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.626456 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a63a0a62-be66-4c0c-b1a3-d14ee438d6a4-lib-modules\") pod \"perf-node-gather-daemonset-zj6lr\" (UID: \"a63a0a62-be66-4c0c-b1a3-d14ee438d6a4\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr" Jul 10 18:41:52.626676 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.626506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6b6h\" (UniqueName: \"kubernetes.io/projected/a63a0a62-be66-4c0c-b1a3-d14ee438d6a4-kube-api-access-j6b6h\") pod \"perf-node-gather-daemonset-zj6lr\" (UID: \"a63a0a62-be66-4c0c-b1a3-d14ee438d6a4\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr" Jul 10 18:41:52.626676 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.626546 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a63a0a62-be66-4c0c-b1a3-d14ee438d6a4-podres\") pod \"perf-node-gather-daemonset-zj6lr\" (UID: \"a63a0a62-be66-4c0c-b1a3-d14ee438d6a4\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr" Jul 10 18:41:52.626676 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.626641 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a63a0a62-be66-4c0c-b1a3-d14ee438d6a4-proc\") pod \"perf-node-gather-daemonset-zj6lr\" (UID: \"a63a0a62-be66-4c0c-b1a3-d14ee438d6a4\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr" Jul 10 18:41:52.626676 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.626673 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a63a0a62-be66-4c0c-b1a3-d14ee438d6a4-sys\") pod \"perf-node-gather-daemonset-zj6lr\" (UID: \"a63a0a62-be66-4c0c-b1a3-d14ee438d6a4\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr" Jul 10 18:41:52.626885 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.626674 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a63a0a62-be66-4c0c-b1a3-d14ee438d6a4-proc\") pod \"perf-node-gather-daemonset-zj6lr\" (UID: \"a63a0a62-be66-4c0c-b1a3-d14ee438d6a4\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr" Jul 10 18:41:52.626885 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.626723 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a63a0a62-be66-4c0c-b1a3-d14ee438d6a4-podres\") pod \"perf-node-gather-daemonset-zj6lr\" (UID: \"a63a0a62-be66-4c0c-b1a3-d14ee438d6a4\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr" Jul 10 18:41:52.626885 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.626704 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a63a0a62-be66-4c0c-b1a3-d14ee438d6a4-sys\") pod \"perf-node-gather-daemonset-zj6lr\" (UID: \"a63a0a62-be66-4c0c-b1a3-d14ee438d6a4\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr" Jul 10 18:41:52.626885 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.626643 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a63a0a62-be66-4c0c-b1a3-d14ee438d6a4-lib-modules\") pod \"perf-node-gather-daemonset-zj6lr\" (UID: \"a63a0a62-be66-4c0c-b1a3-d14ee438d6a4\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr" Jul 10 18:41:52.635103 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.635078 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6b6h\" (UniqueName: \"kubernetes.io/projected/a63a0a62-be66-4c0c-b1a3-d14ee438d6a4-kube-api-access-j6b6h\") pod \"perf-node-gather-daemonset-zj6lr\" (UID: \"a63a0a62-be66-4c0c-b1a3-d14ee438d6a4\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr" Jul 10 18:41:52.711523 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.711428 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr" Jul 10 18:41:52.846163 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:52.846136 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr"] Jul 10 18:41:52.848428 ip-10-0-138-201 kubenswrapper[2579]: W0710 18:41:52.848395 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda63a0a62_be66_4c0c_b1a3_d14ee438d6a4.slice/crio-024b07b7c0063b61e978ac2bf23dc18b5ac396e7bb378107ee707f96abe71595 WatchSource:0}: Error finding container 024b07b7c0063b61e978ac2bf23dc18b5ac396e7bb378107ee707f96abe71595: Status 404 returned error can't find the container with id 024b07b7c0063b61e978ac2bf23dc18b5ac396e7bb378107ee707f96abe71595 Jul 10 18:41:53.153025 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:53.152989 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr" event={"ID":"a63a0a62-be66-4c0c-b1a3-d14ee438d6a4","Type":"ContainerStarted","Data":"7fae7b73fb59c0287c0890367a42e924820fcd46b2fe73dc67cddf796db3ae9a"} Jul 10 18:41:53.153419 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:53.153047 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr" Jul 10 18:41:53.153419 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:53.153065 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr" event={"ID":"a63a0a62-be66-4c0c-b1a3-d14ee438d6a4","Type":"ContainerStarted","Data":"024b07b7c0063b61e978ac2bf23dc18b5ac396e7bb378107ee707f96abe71595"} Jul 10 18:41:53.173183 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:53.173136 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr" podStartSLOduration=1.173121695 podStartE2EDuration="1.173121695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:41:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:53.17138466 +0000 UTC m=+2545.012212915" watchObservedRunningTime="2026-07-10 18:41:53.173121695 +0000 UTC m=+2545.013949949" Jul 10 18:41:53.355353 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:53.355322 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55cb8c785f-qqxg7_c86d38f2-7a54-4563-b84c-69e6f033ac6b/console/0.log" Jul 10 18:41:53.391662 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:53.391632 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-hp7w8_674bbc89-fae3-4931-b134-ca7eaeacba24/download-server/0.log" Jul 10 18:41:55.103172 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:55.103133 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r56b5_db3be39f-7610-4b71-9d5b-4087c443e47f/dns/0.log" Jul 10 18:41:55.123421 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:55.123387 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r56b5_db3be39f-7610-4b71-9d5b-4087c443e47f/kube-rbac-proxy/0.log" Jul 10 18:41:55.250823 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:55.250786 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2jckr_f23e6bd7-d9dd-417b-97e3-4463a60f7236/dns-node-resolver/0.log" Jul 10 18:41:55.922869 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:55.922831 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8crj6_e71f5f58-2ce4-4387-b198-55f3ebc9ff22/node-ca/0.log" Jul 10 18:41:56.971346 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:56.971317 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678bl6zv_f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea/istio-proxy/0.log" Jul 10 18:41:57.161624 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:57.161587 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s77ln_e7947dff-eec4-43f0-8a0c-582b58078fe1/discovery/0.log" Jul 10 18:41:57.245232 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:57.245140 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ggjch_849be59f-f5c9-4317-9c40-4035f553b744/istio-proxy/0.log" Jul 10 18:41:57.308599 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:57.308565 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ggjch_849be59f-f5c9-4317-9c40-4035f553b744/istio-proxy/1.log" Jul 10 18:41:58.208226 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:58.208196 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qwjmc_65c5cd7a-6e0d-4b74-bc87-ec84d9362897/serve-healthcheck-canary/0.log" Jul 10 18:41:58.924471 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:58.924445 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nkmh9_e64bd07b-0c58-4b2d-a32d-49493f8a2737/kube-rbac-proxy/0.log" Jul 10 18:41:58.946453 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:58.946426 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nkmh9_e64bd07b-0c58-4b2d-a32d-49493f8a2737/exporter/0.log" Jul 10 18:41:58.967245 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:58.967222 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nkmh9_e64bd07b-0c58-4b2d-a32d-49493f8a2737/extractor/0.log" Jul 10 18:41:59.169006 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:41:59.168982 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-zj6lr" Jul 10 18:42:01.704301 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:42:01.704274 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-92zwc_e0b12bf0-69de-424d-89bd-a20b52e11fc7/server/0.log" Jul 10 18:42:01.896301 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:42:01.896213 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb6dcc87f-8sn5x_a7996f9b-d966-491e-821d-5dd96cd11d23/manager/0.log" Jul 10 18:42:01.913807 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:42:01.913775 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb6dcc87f-8sn5x_a7996f9b-d966-491e-821d-5dd96cd11d23/copy-manifests/0.log" Jul 10 18:42:03.278416 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:42:03.278378 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6d79ff4f99-mcs64_2ce6cbed-6ea6-4c6a-9604-5e279b73140e/manager/0.log" Jul 10 18:42:04.290495 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:42:04.290437 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678bl6zv_f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea/istio-proxy/0.log" Jul 10 18:42:04.481662 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:42:04.481620 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s77ln_e7947dff-eec4-43f0-8a0c-582b58078fe1/discovery/0.log" Jul 10 18:42:04.533669 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:42:04.533639 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ggjch_849be59f-f5c9-4317-9c40-4035f553b744/istio-proxy/0.log" Jul 10 18:42:04.593327 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:42:04.593295 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ggjch_849be59f-f5c9-4317-9c40-4035f553b744/istio-proxy/1.log" Jul 10 18:42:05.974457 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:42:05.974425 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678bl6zv_f0ccfcdf-563e-42be-82ab-d6c7ff1b0dea/istio-proxy/0.log" Jul 10 18:42:06.171568 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:42:06.171523 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s77ln_e7947dff-eec4-43f0-8a0c-582b58078fe1/discovery/0.log" Jul 10 18:42:06.229707 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:42:06.229582 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ggjch_849be59f-f5c9-4317-9c40-4035f553b744/istio-proxy/0.log" Jul 10 18:42:06.292733 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:42:06.292698 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ggjch_849be59f-f5c9-4317-9c40-4035f553b744/istio-proxy/1.log" Jul 10 18:42:08.573683 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:42:08.573650 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-cxs4p_85194ad1-4bfb-4156-85a9-ebfa33430531/migrator/0.log" Jul 10 18:42:08.599295 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:42:08.599264 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-cxs4p_85194ad1-4bfb-4156-85a9-ebfa33430531/graceful-termination/0.log" Jul 10 18:42:09.015601 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:42:09.015518 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-rmd8j_a0beb717-4a66-4c5e-bbd1-34fdc20582ef/kube-storage-version-migrator-operator/1.log" Jul 10 18:42:09.017330 ip-10-0-138-201 kubenswrapper[2579]: I0710 18:42:09.017303 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-rmd8j_a0beb717-4a66-4c5e-bbd1-34fdc20582ef/kube-storage-version-migrator-operator/0.log"